python /home/admin/mtr/script_for_cron.py -j coverage -m 9 -a '' -s coverage -M 0 -S 0 -U 100,100,120 import MySQLdb succeeded root_folder /data_4/data_log/job/2025/December/16122025/coverage/ git_velours : /home/admin/workarea/git/Velours/ out_folder_name htmlcov output_folder /data_4/data_log/job/2025/December/16122025/coverage/htmlcov new path : /data_4/data_log/job/2025/December/16122025/coverage/ command : coverage3 run /home/admin/workarea/git/Velours/python/tests/python_tests.py --short_python3 `cat ~/.fotonower_pass/bdd.py.pass` cat: /home/admin/.fotonower_pass/bdd.py.pass: Aucun fichier ou dossier de ce type import MySQLdb succeeded Import error (python version) python version = 3 warning , we can't find thcl infos in json_data warning , we can't find pdt infos in json_data python version used : 3 #&_# BEGIN OF TEST : tests/mask_test #&_# /home/admin/workarea/git/Velours/python/tests/mask_test.py Test mask-detection python version used : 3 ############################### TEST memory used ################################ free memory at begining : begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 417 run mask_detect Inside batchDatouExec : verbose : False # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : mask_detect list_input_json : [] origin BFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 1 ; length of list_pids : 1 ; length of list_args : 1 time to download the photos : 0.15989041328430176 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : False number of steps : 1 step1:mask_detect Tue Dec 16 05:20:28 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory havn't enough memory gpu , need / 3000 l 3632 free memory gpu now : 417 wait 20 seconds l 3637 free memory gpu now : 417 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 /home/admin/workarea/git/Velours/python/tests/python_tests.py:11: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses import imp 2025-12-16 05:20:51.784487: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-12-16 05:20:51.810419: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493010000 Hz 2025-12-16 05:20:51.812520: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f3ee4000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-12-16 05:20:51.812564: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-12-16 05:20:51.816358: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-12-16 05:20:51.928319: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x18d79ed0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-12-16 05:20:51.928373: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-12-16 05:20:51.929240: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-12-16 05:20:51.929621: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-12-16 05:20:51.932385: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-12-16 05:20:51.934920: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-12-16 05:20:51.935426: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-12-16 05:20:51.938484: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-12-16 05:20:51.940036: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-12-16 05:20:51.944112: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-12-16 05:20:51.944955: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-12-16 05:20:51.945021: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-12-16 05:20:51.945481: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-12-16 05:20:51.945496: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-12-16 05:20:51.945505: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-12-16 05:20:51.946237: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 112 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl454 thcls : [{'id': 454, 'mtr_user_id': 31, 'name': 'mask_coco_origin', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'backgroud,person,bicycle,car,motorcycle,airplane,bus,train,truck,boat,trafficlight,firehydrant,stopsign,parkingmeter,bench,bird,cat,dog,horse,sheep,cow,elephant,bear,zebra,giraffe,backpack,umbrella,handbag,tie,suitcase,frisbee,skis,snowboard,sportsball,kite,baseballbat,baseballglove,skateboard,surfboard,tennisracket,bottle,wineglass,cup,fork,knife,spoon,bowl,banana,apple,sandwich,orange,broccoli,carrot,hotdog,pizza,donut,cake,chair,couch,pottedplant,bed,diningtable,toilet,tv,laptop,mouse,remote,keyboard,cellphone,microwave,oven,toaster,sink,refrigerator,book,clock,vase,scissors,teddybear,hairdrier,toothbrush', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 445, 'photo_desc_type': 3473, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0'}] thcl {'id': 454, 'mtr_user_id': 31, 'name': 'mask_coco_origin', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'backgroud,person,bicycle,car,motorcycle,airplane,bus,train,truck,boat,trafficlight,firehydrant,stopsign,parkingmeter,bench,bird,cat,dog,horse,sheep,cow,elephant,bear,zebra,giraffe,backpack,umbrella,handbag,tie,suitcase,frisbee,skis,snowboard,sportsball,kite,baseballbat,baseballglove,skateboard,surfboard,tennisracket,bottle,wineglass,cup,fork,knife,spoon,bowl,banana,apple,sandwich,orange,broccoli,carrot,hotdog,pizza,donut,cake,chair,couch,pottedplant,bed,diningtable,toilet,tv,laptop,mouse,remote,keyboard,cellphone,microwave,oven,toaster,sink,refrigerator,book,clock,vase,scissors,teddybear,hairdrier,toothbrush', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 445, 'photo_desc_type': 3473, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 3473 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (3473, 'mask_coco_origin', 16384, 25088, 'mask_coco_origin', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2018, 3, 19, 10, 42, 21), datetime.datetime(2018, 3, 19, 10, 42, 21)) {'thcl': {'id': 454, 'mtr_user_id': 31, 'name': 'mask_coco_origin', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'backgroud,person,bicycle,car,motorcycle,airplane,bus,train,truck,boat,trafficlight,firehydrant,stopsign,parkingmeter,bench,bird,cat,dog,horse,sheep,cow,elephant,bear,zebra,giraffe,backpack,umbrella,handbag,tie,suitcase,frisbee,skis,snowboard,sportsball,kite,baseballbat,baseballglove,skateboard,surfboard,tennisracket,bottle,wineglass,cup,fork,knife,spoon,bowl,banana,apple,sandwich,orange,broccoli,carrot,hotdog,pizza,donut,cake,chair,couch,pottedplant,bed,diningtable,toilet,tv,laptop,mouse,remote,keyboard,cellphone,microwave,oven,toaster,sink,refrigerator,book,clock,vase,scissors,teddybear,hairdrier,toothbrush', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 445, 'photo_desc_type': 3473, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['backgroud', 'person', 'bicycle', 'car', 'motorcycle', 'airplane', 'bus', 'train', 'truck', 'boat', 'trafficlight', 'firehydrant', 'stopsign', 'parkingmeter', 'bench', 'bird', 'cat', 'dog', 'horse', 'sheep', 'cow', 'elephant', 'bear', 'zebra', 'giraffe', 'backpack', 'umbrella', 'handbag', 'tie', 'suitcase', 'frisbee', 'skis', 'snowboard', 'sportsball', 'kite', 'baseballbat', 'baseballglove', 'skateboard', 'surfboard', 'tennisracket', 'bottle', 'wineglass', 'cup', 'fork', 'knife', 'spoon', 'bowl', 'banana', 'apple', 'sandwich', 'orange', 'broccoli', 'carrot', 'hotdog', 'pizza', 'donut', 'cake', 'chair', 'couch', 'pottedplant', 'bed', 'diningtable', 'toilet', 'tv', 'laptop', 'mouse', 'remote', 'keyboard', 'cellphone', 'microwave', 'oven', 'toaster', 'sink', 'refrigerator', 'book', 'clock', 'vase', 'scissors', 'teddybear', 'hairdrier', 'toothbrush'], 'list_hashtags_csv': 'backgroud,person,bicycle,car,motorcycle,airplane,bus,train,truck,boat,trafficlight,firehydrant,stopsign,parkingmeter,bench,bird,cat,dog,horse,sheep,cow,elephant,bear,zebra,giraffe,backpack,umbrella,handbag,tie,suitcase,frisbee,skis,snowboard,sportsball,kite,baseballbat,baseballglove,skateboard,surfboard,tennisracket,bottle,wineglass,cup,fork,knife,spoon,bowl,banana,apple,sandwich,orange,broccoli,carrot,hotdog,pizza,donut,cake,chair,couch,pottedplant,bed,diningtable,toilet,tv,laptop,mouse,remote,keyboard,cellphone,microwave,oven,toaster,sink,refrigerator,book,clock,vase,scissors,teddybear,hairdrier,toothbrush', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 445, 'svm_hashtag_type_desc': 3473, 'photo_desc_type': 3473, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['backgroud', 'person', 'bicycle', 'car', 'motorcycle', 'airplane', 'bus', 'train', 'truck', 'boat', 'trafficlight', 'firehydrant', 'stopsign', 'parkingmeter', 'bench', 'bird', 'cat', 'dog', 'horse', 'sheep', 'cow', 'elephant', 'bear', 'zebra', 'giraffe', 'backpack', 'umbrella', 'handbag', 'tie', 'suitcase', 'frisbee', 'skis', 'snowboard', 'sportsball', 'kite', 'baseballbat', 'baseballglove', 'skateboard', 'surfboard', 'tennisracket', 'bottle', 'wineglass', 'cup', 'fork', 'knife', 'spoon', 'bowl', 'banana', 'apple', 'sandwich', 'orange', 'broccoli', 'carrot', 'hotdog', 'pizza', 'donut', 'cake', 'chair', 'couch', 'pottedplant', 'bed', 'diningtable', 'toilet', 'tv', 'laptop', 'mouse', 'remote', 'keyboard', 'cellphone', 'microwave', 'oven', 'toaster', 'sink', 'refrigerator', 'book', 'clock', 'vase', 'scissors', 'teddybear', 'hairdrier', 'toothbrush'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME mask_coco_origin NUM_CLASSES 81 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 2025-12-16 05:20:52.848398: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-12-16 05:20:52.848477: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-12-16 05:20:52.848495: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-12-16 05:20:52.848513: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-12-16 05:20:52.848528: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-12-16 05:20:52.848544: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-12-16 05:20:52.848562: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-12-16 05:20:52.848580: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-12-16 05:20:52.849183: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-12-16 05:20:52.850062: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-12-16 05:20:52.850091: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-12-16 05:20:52.850108: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-12-16 05:20:52.850123: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-12-16 05:20:52.850138: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-12-16 05:20:52.850153: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-12-16 05:20:52.850168: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-12-16 05:20:52.850183: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-12-16 05:20:52.850833: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-12-16 05:20:52.850867: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-12-16 05:20:52.850876: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-12-16 05:20:52.850884: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-12-16 05:20:52.851576: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 112 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) 2025-12-16 05:20:52.854713: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.00M (1048576 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.855540: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 921.8K (943872 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.856273: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 829.8K (849664 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.857036: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 747.0K (764928 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.857829: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 672.5K (688640 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.858646: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 605.2K (619776 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.859450: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 544.8K (557824 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.860190: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 490.5K (502272 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.860915: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 441.5K (452096 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.861641: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 397.5K (407040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.862436: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 357.8K (366336 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.863248: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 322.0K (329728 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.864046: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 290.0K (296960 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.864825: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 261.0K (267264 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.865550: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 235.0K (240640 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.866280: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 211.5K (216576 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.867075: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 190.5K (195072 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.867847: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 171.5K (175616 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.868571: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 154.5K (158208 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.869296: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 139.2K (142592 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.870021: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 125.5K (128512 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.870790: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 113.0K (115712 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.871591: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 101.8K (104192 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.872322: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 91.8K (93952 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.873051: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 82.8K (84736 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.873780: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 74.5K (76288 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.874527: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 67.2K (68864 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.875327: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 60.8K (62208 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.876124: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 54.8K (56064 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.876899: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 49.5K (50688 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.877628: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 44.8K (45824 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.878405: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 40.5K (41472 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.879207: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 36.5K (37376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.879973: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 33.0K (33792 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.880709: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 29.8K (30464 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.881448: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 27.0K (27648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.882245: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 24.5K (25088 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.883025: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 22.2K (22784 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.883758: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 20.2K (20736 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.884488: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 18.2K (18688 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.885217: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 16.5K (16896 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.885946: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 15.0K (15360 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.886681: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 13.5K (13824 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.887412: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 12.2K (12544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.888142: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 11.2K (11520 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.888871: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 10.2K (10496 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.889600: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 9.2K (9472 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.890355: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 8.5K (8704 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.891089: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 7.8K (7936 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.891818: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 7.0K (7168 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.892543: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 6.5K (6656 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.893268: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 6.0K (6144 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.894013: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 5.5K (5632 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.894818: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 5.0K (5120 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.895617: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.5K (4608 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.896345: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.2K (4352 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.897070: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.0K (4096 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.897794: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.8K (3840 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.898541: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.5K (3584 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.899276: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.2K (3328 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.900006: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.0K (3072 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.900735: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.8K (2816 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.901464: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.5K (2560 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.902208: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.902949: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.903676: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.904401: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.905126: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.905850: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.906598: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.907327: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.908052: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.908777: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.909501: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.910226: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.910961: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.911699: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.912496: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.913293: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.914054: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.914794: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.915522: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.916254: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.916979: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.917704: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.918434: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.919161: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.919886: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.920611: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.921335: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.922104: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.922878: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.923677: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.924405: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.925129: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.925856: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.926609: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.927343: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.928072: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.928801: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.929539: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.930342: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.931110: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.931839: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.932568: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.933297: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.934034: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.934771: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.935502: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.936230: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.936959: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.937688: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.938429: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.939162: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.939887: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.940611: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.941336: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.942060: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.942803: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.943530: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.944254: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.944978: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.945703: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.946439: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.947168: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.947922: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.948719: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.949516: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.950264: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.951002: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.951803: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.952615: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.953393: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.954155: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.954886: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.955613: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.956343: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.957071: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.957800: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.958541: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.959275: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.960028: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.960831: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.961628: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.962389: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.963132: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.963916: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.964645: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.965374: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.966103: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.966838: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.967572: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.968369: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.969145: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.969875: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.970632: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.971435: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.972197: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.972926: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.973655: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.974395: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.975195: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.975978: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.976706: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.977432: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.978157: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.978945: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.979745: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.980477: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.981206: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.981935: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.982691: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.983423: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.984206: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.984993: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.985722: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.986457: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.987197: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.987926: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.988655: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.989384: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.990113: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.990874: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.991609: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.992339: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.993068: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.993792: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.994523: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.995250: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.995975: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.996699: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.997423: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.998148: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.998896: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:52.999623: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.000348: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.001076: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.001864: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.002596: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.003324: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.004048: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.004781: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.005511: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.006239: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.006975: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.007706: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.008435: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.009164: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.009895: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.010633: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.011362: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.012087: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.012812: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.013537: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.014261: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.014994: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.015721: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.016446: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.017222: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.017955: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.018733: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.019545: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.020306: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.021035: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.021775: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.022546: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.023279: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.024008: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.024737: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.025466: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.026195: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.027002: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.027803: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.028541: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.029270: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.030056: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.030801: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.031533: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.032262: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.032991: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.033720: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.034456: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.035188: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.035917: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.036645: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.037375: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.038104: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.038847: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.039579: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.040317: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.041047: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.041776: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.042578: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.043341: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.044071: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.044800: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.045527: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.046251: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.046982: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.047708: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.048437: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.049162: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.049886: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.050624: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.051353: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.052119: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.052845: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.053576: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.054311: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.055043: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.055772: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.056501: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.057237: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.057967: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.058710: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.059443: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.060172: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.060901: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.061630: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.062366: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.063099: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.063824: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.064549: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.065274: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.065998: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.066737: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.067464: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.068189: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.068913: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.069638: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.070369: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.071096: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.071821: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.072545: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.073270: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.073994: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.074742: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.075471: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.076196: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.076921: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.077645: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.078375: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.079102: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.079827: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.080551: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.081275: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.082070: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.082874: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.083613: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.084338: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.085063: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.085787: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.086525: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.087254: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.087980: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.088704: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.089428: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.090153: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.090886: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.091634: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.092439: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.093221: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.093945: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.094676: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.095402: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.096127: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.096851: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.097581: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.098323: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.099056: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.099785: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.100514: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.101243: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.101967: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.102699: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.103426: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.104151: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.104876: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.105601: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.106339: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.107069: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.107794: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.108522: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.109278: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.110104: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.110844: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.111581: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.112392: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.113203: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.113952: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.114756: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.115578: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.116381: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.117164: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.117984: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.118810: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.119624: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.120440: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.121262: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.122081: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.122907: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.123724: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.124539: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.125356: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.126176: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.127023: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.127845: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.128669: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.129513: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.130327: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.131135: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.131940: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.132748: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.133527: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.134270: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.135088: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.135901: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.136708: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.137483: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.138235: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.139068: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.139895: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.140668: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.141457: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.142266: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.143099: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.143919: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.144739: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.145528: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.146291: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.147106: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.147934: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.148749: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.149530: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.150351: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.151177: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.151985: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.152806: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.153608: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.154428: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.155259: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.156061: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.156810: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.157561: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.158312: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.159120: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.159927: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.160702: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.161446: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.162248: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.163070: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.163823: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.164565: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.165302: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.166033: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.166825: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.167635: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.168444: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.169253: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.169996: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.170791: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.171602: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.172408: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.173218: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.173962: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.174714: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.175452: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.176195: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.176934: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.177669: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.178417: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.179153: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.179885: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.180622: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.181353: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.182108: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.182929: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.183699: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.184446: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.185228: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.186038: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.186850: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.187656: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.188450: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.189181: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.189913: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.190680: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.191490: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.192737: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.193501: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.194252: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.195074: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.195896: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.196681: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.197433: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.198179: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.198999: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.199836: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.200643: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.201458: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.202283: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.203087: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.203891: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.204673: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.205444: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.206251: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.207081: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.207888: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.208692: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.209487: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.210309: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.211122: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.211940: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.212763: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.213564: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.214329: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.215087: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.215827: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.216574: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.217356: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.218103: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.218910: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.219687: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.220422: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.221164: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.221937: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.222766: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.223573: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.224324: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.225073: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.225821: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.226616: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.227421: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.228172: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.228929: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.229669: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.230433: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.231258: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.232038: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.232846: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.233631: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.234387: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.235138: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.235933: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.236675: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.237412: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.238154: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.238907: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.239640: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.240382: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.241170: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.241995: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.242814: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.243603: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.244337: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.245076: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.245814: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.246570: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.247324: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.248067: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.248810: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.249551: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.250299: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.251043: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.251856: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.252651: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.253430: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.254247: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.255072: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.255844: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.256630: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.257439: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.258180: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.258951: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.259714: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.260531: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.261348: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.262155: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.262969: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.263776: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.264580: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.265327: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.266062: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.266852: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.267642: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.268402: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.269215: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.270027: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.270848: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.271654: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.272462: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.273276: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.274025: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.274775: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.275515: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.276256: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.277012: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.277777: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.278561: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.279312: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.280048: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.280787: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.281523: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.282314: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.283121: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.283919: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.284734: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.285543: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.286353: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.287327: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.288137: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.288937: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.289742: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.290576: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.291391: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.292198: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.292964: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.293711: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.294470: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.295221: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.295966: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.296713: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.297492: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.298315: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.299133: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.299911: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.300659: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.301422: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.302234: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.303069: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.303856: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.304615: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.305365: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.306114: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.306876: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.307632: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.308377: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.309122: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.309856: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.310665: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.311484: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.312290: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.313059: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.313817: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.314602: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.315369: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.316138: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.316897: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.317642: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.318457: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.319269: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.320079: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.320862: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.321619: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.322473: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.323246: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.324008: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.324791: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.325612: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.326373: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.327203: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.327972: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.328705: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.329446: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.330193: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.330963: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.331788: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.332592: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.333394: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.334142: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.334905: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.335791: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.336532: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.337272: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.338012: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.338795: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.339615: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.340360: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.341117: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.341871: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.342695: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.343513: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.344299: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.345120: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.345911: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.346727: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.347560: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.348316: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.349053: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.349791: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.351050: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.351914: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.352717: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.353468: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.354209: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.354993: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.355762: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.356524: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.357356: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.358170: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.358983: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.359788: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.360598: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.361408: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.362217: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.363037: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.363832: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.364619: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.365428: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.366174: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.366973: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.367765: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.368507: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.369313: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.370075: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.370819: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.371581: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.372400: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.373159: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.373899: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.374660: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.375407: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.376146: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.376888: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.377630: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.378369: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.379106: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.379842: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.380577: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.381316: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.382100: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.382925: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.383733: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.384470: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.385207: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.385997: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.386796: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.387560: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.388377: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.389186: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.389991: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.390819: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.391564: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.392348: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.393154: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.393930: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.394733: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.395542: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.396294: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.397035: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.397777: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.398526: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.399266: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.400006: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.400748: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.401532: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.402353: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.403181: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.403965: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.404704: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.405444: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.406185: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.406981: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.407781: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.408519: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.409267: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.410003: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.410798: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.411614: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.412420: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.413179: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.413917: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.414663: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.415413: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.416170: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.416934: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.417731: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.418497: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.419307: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.420081: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.420821: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.421577: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.422407: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.423218: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.424026: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.424828: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.425563: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.426317: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.427128: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.427954: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.428696: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.429439: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.430180: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.430998: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.431809: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.432634: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.433465: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.434243: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.435058: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.435857: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.436602: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.437349: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.438091: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.438850: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.439601: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.440343: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.441091: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.441901: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.442730: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.443472: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.444220: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.444963: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.445712: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.446472: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.447221: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.447965: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.448704: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.449483: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.450301: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.451090: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.451867: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.452691: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.453454: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.454198: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.454966: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.455714: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.456456: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.457198: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.458017: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.458827: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.459634: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.460385: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.461197: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.462014: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.462836: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.463647: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.464463: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.465277: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.466085: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.466907: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.467719: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.468533: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.469351: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.470164: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.471007: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.471832: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.472646: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.473455: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.474267: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.475192: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.476012: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.476825: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.477640: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.478478: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.479313: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.480125: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.480937: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.481746: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.482787: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.483607: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.484428: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.485239: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.486053: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.486890: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.487705: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.488512: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.489319: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.490125: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.490963: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.491776: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.492590: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.493394: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.494200: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.495038: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.495852: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.496661: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.497468: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.498287: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.499104: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.499917: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.500723: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.501531: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.502367: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.503186: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.504020: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.504828: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.505637: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.506464: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.507279: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.508090: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.508900: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.509711: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.510554: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.511370: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.512182: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.512992: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.513802: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.514630: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.515452: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.516266: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.517086: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.517893: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.518738: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.519552: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.520380: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.521187: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.522000: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.522839: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.523673: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.524483: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.525300: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.526113: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.526959: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.527777: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.528587: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.529399: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.530215: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.531051: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.531866: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.532674: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.533484: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.534314: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.535127: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.535935: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.536743: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.537554: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.538369: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.539182: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.539989: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.540793: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.541603: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.542450: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.543268: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.544075: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.544886: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.545693: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.546504: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.547313: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.548126: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.548933: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.549741: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.550561: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.551385: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.552198: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.553012: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.553827: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.554668: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.555491: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.556304: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.557119: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.557958: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.558812: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.559970: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.561063: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.562165: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.563270: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.564447: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.565561: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.566820: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.567987: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.569137: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.570291: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.571110: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.572061: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.572965: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.574045: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.575144: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.576222: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.577292: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.578385: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.579477: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.580563: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.581537: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.582454: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.583319: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.584183: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.585050: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.585915: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.586783: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.587686: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.588555: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.589421: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.590298: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.591162: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.592026: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.592891: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.593752: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.594623: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.595491: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.596365: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.597232: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.598086: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.599425: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.600924: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.602430: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.603906: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.605296: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.606363: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.607423: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.608474: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.609515: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.610576: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.611617: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.612704: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.613782: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.614699: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.615567: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.616426: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.618070: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.618902: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.619735: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.620551: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.621363: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.622179: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.623008: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.623820: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.624637: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.625458: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:20:53.626286: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-16 05:21:05.579937: W tensorflow/core/common_runtime/bfc_allocator.cc:434] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.25MiB (rounded to 2359296) Current allocation summary follows. 2025-12-16 05:21:05.580007: I tensorflow/core/common_runtime/bfc_allocator.cc:934] BFCAllocator dump for GPU_0_bfc 2025-12-16 05:21:05.580054: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (256): Total Chunks: 60, Chunks in use: 60. 15.0KiB allocated for chunks. 15.0KiB in use in bin. 8.8KiB client-requested in use in bin. 2025-12-16 05:21:05.580072: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (512): Total Chunks: 40, Chunks in use: 40. 20.0KiB allocated for chunks. 20.0KiB in use in bin. 20.0KiB client-requested in use in bin. 2025-12-16 05:21:05.580089: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (1024): Total Chunks: 235, Chunks in use: 235. 235.0KiB allocated for chunks. 235.0KiB in use in bin. 235.0KiB client-requested in use in bin. 2025-12-16 05:21:05.580105: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (2048): Total Chunks: 26, Chunks in use: 26. 52.2KiB allocated for chunks. 52.2KiB in use in bin. 51.0KiB client-requested in use in bin. 2025-12-16 05:21:05.580120: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (4096): Total Chunks: 110, Chunks in use: 110. 445.5KiB allocated for chunks. 445.5KiB in use in bin. 440.0KiB client-requested in use in bin. 2025-12-16 05:21:05.580148: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (8192): Total Chunks: 0, Chunks in use: 0. 0B allocated for chunks. 0B in use in bin. 0B client-requested in use in bin. 2025-12-16 05:21:05.580165: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (16384): Total Chunks: 1, Chunks in use: 1. 16.0KiB allocated for chunks. 16.0KiB in use in bin. 16.0KiB client-requested in use in bin. 2025-12-16 05:21:05.580180: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (32768): Total Chunks: 1, Chunks in use: 1. 36.8KiB allocated for chunks. 36.8KiB in use in bin. 36.8KiB client-requested in use in bin. 2025-12-16 05:21:05.580195: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (65536): Total Chunks: 7, Chunks in use: 6. 460.8KiB allocated for chunks. 384.0KiB in use in bin. 384.0KiB client-requested in use in bin. 2025-12-16 05:21:05.580210: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (131072): Total Chunks: 4, Chunks in use: 4. 560.0KiB allocated for chunks. 560.0KiB in use in bin. 560.0KiB client-requested in use in bin. 2025-12-16 05:21:05.580225: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (262144): Total Chunks: 8, Chunks in use: 7. 2.33MiB allocated for chunks. 2.08MiB in use in bin. 1.75MiB client-requested in use in bin. 2025-12-16 05:21:05.580240: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (524288): Total Chunks: 8, Chunks in use: 6. 4.62MiB allocated for chunks. 3.44MiB in use in bin. 3.25MiB client-requested in use in bin. 2025-12-16 05:21:05.580255: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (1048576): Total Chunks: 44, Chunks in use: 42. 49.00MiB allocated for chunks. 46.75MiB in use in bin. 42.00MiB client-requested in use in bin. 2025-12-16 05:21:05.580270: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (2097152): Total Chunks: 23, Chunks in use: 23. 55.12MiB allocated for chunks. 55.12MiB in use in bin. 51.50MiB client-requested in use in bin. 2025-12-16 05:21:05.580284: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (4194304): Total Chunks: 0, Chunks in use: 0. 0B allocated for chunks. 0B in use in bin. 0B client-requested in use in bin. 2025-12-16 05:21:05.580297: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (8388608): Total Chunks: 0, Chunks in use: 0. 0B allocated for chunks. 0B in use in bin. 0B client-requested in use in bin. 2025-12-16 05:21:05.580310: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (16777216): Total Chunks: 0, Chunks in use: 0. 0B allocated for chunks. 0B in use in bin. 0B client-requested in use in bin. 2025-12-16 05:21:05.580323: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (33554432): Total Chunks: 0, Chunks in use: 0. 0B allocated for chunks. 0B in use in bin. 0B client-requested in use in bin. 2025-12-16 05:21:05.580336: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (67108864): Total Chunks: 0, Chunks in use: 0. 0B allocated for chunks. 0B in use in bin. 0B client-requested in use in bin. 2025-12-16 05:21:05.580350: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (134217728): Total Chunks: 0, Chunks in use: 0. 0B allocated for chunks. 0B in use in bin. 0B client-requested in use in bin. 2025-12-16 05:21:05.580363: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (268435456): Total Chunks: 0, Chunks in use: 0. 0B allocated for chunks. 0B in use in bin. 0B client-requested in use in bin. 2025-12-16 05:21:05.580377: I tensorflow/core/common_runtime/bfc_allocator.cc:957] Bin for 2.25MiB was 2.00MiB, Chunk State: 2025-12-16 05:21:05.580388: I tensorflow/core/common_runtime/bfc_allocator.cc:970] Next region of size 53344000 2025-12-16 05:21:05.580406: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d00000000 of size 1048576 next 377 2025-12-16 05:21:05.580426: I tensorflow/core/common_runtime/bfc_allocator.cc:990] Free at 7f3d00100000 of size 1310720 next 371 2025-12-16 05:21:05.580438: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d00240000 of size 2359296 next 369 2025-12-16 05:21:05.580450: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d00480000 of size 1048576 next 395 2025-12-16 05:21:05.580462: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d00580000 of size 1310720 next 389 2025-12-16 05:21:05.580474: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d006c0000 of size 2359296 next 388 2025-12-16 05:21:05.580486: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d00900000 of size 1048576 next 413 2025-12-16 05:21:05.580498: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d00a00000 of size 1310720 next 407 2025-12-16 05:21:05.580510: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d00b40000 of size 2359296 next 406 2025-12-16 05:21:05.580521: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d00d80000 of size 1048576 next 431 2025-12-16 05:21:05.580533: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d00e80000 of size 1310720 next 425 2025-12-16 05:21:05.580544: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d00fc0000 of size 2359296 next 424 2025-12-16 05:21:05.580556: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d01200000 of size 1048576 next 449 2025-12-16 05:21:05.580567: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d01300000 of size 1310720 next 443 2025-12-16 05:21:05.580579: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d01440000 of size 2359296 next 442 2025-12-16 05:21:05.580590: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d01680000 of size 1048576 next 466 2025-12-16 05:21:05.580602: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d01780000 of size 1310720 next 461 2025-12-16 05:21:05.580614: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d018c0000 of size 2359296 next 460 2025-12-16 05:21:05.580625: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d01b00000 of size 1048576 next 484 2025-12-16 05:21:05.580637: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d01c00000 of size 1310720 next 478 2025-12-16 05:21:05.580648: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d01d40000 of size 2359296 next 477 2025-12-16 05:21:05.580660: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d01f80000 of size 1048576 next 502 2025-12-16 05:21:05.580671: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d02080000 of size 1310720 next 496 2025-12-16 05:21:05.580683: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d021c0000 of size 2359296 next 495 2025-12-16 05:21:05.580694: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d02400000 of size 1048576 next 520 2025-12-16 05:21:05.580706: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d02500000 of size 1310720 next 514 2025-12-16 05:21:05.580717: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d02640000 of size 2359296 next 513 2025-12-16 05:21:05.580729: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d02880000 of size 1048576 next 538 2025-12-16 05:21:05.580740: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d02980000 of size 1310720 next 532 2025-12-16 05:21:05.580752: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d02ac0000 of size 2359296 next 531 2025-12-16 05:21:05.580764: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d02d00000 of size 1048576 next 555 2025-12-16 05:21:05.580775: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d02e00000 of size 1310720 next 550 2025-12-16 05:21:05.580787: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d02f40000 of size 3798784 next 18446744073709551615 2025-12-16 05:21:05.580806: I tensorflow/core/common_runtime/bfc_allocator.cc:970] Next region of size 33554432 2025-12-16 05:21:05.580818: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d04000000 of size 1048576 next 253 2025-12-16 05:21:05.580830: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d04100000 of size 1310720 next 247 2025-12-16 05:21:05.580842: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d04240000 of size 2359296 next 245 2025-12-16 05:21:05.580853: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d04480000 of size 1048576 next 271 2025-12-16 05:21:05.580865: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d04580000 of size 1310720 next 265 2025-12-16 05:21:05.580876: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d046c0000 of size 2359296 next 264 2025-12-16 05:21:05.580888: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d04900000 of size 1048576 next 289 2025-12-16 05:21:05.580900: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d04a00000 of size 1310720 next 283 2025-12-16 05:21:05.580911: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d04b40000 of size 2359296 next 282 2025-12-16 05:21:05.580923: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d04d80000 of size 1048576 next 306 2025-12-16 05:21:05.580934: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d04e80000 of size 1310720 next 300 2025-12-16 05:21:05.580946: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d04fc0000 of size 2359296 next 299 2025-12-16 05:21:05.580957: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d05200000 of size 1048576 next 324 2025-12-16 05:21:05.580969: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d05300000 of size 1310720 next 318 2025-12-16 05:21:05.580980: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d05440000 of size 2359296 next 317 2025-12-16 05:21:05.580992: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d05680000 of size 1048576 next 342 2025-12-16 05:21:05.581003: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d05780000 of size 1310720 next 336 2025-12-16 05:21:05.581015: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d058c0000 of size 2359296 next 335 2025-12-16 05:21:05.581027: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d05b00000 of size 1048576 next 359 2025-12-16 05:21:05.581038: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d05c00000 of size 1310720 next 354 2025-12-16 05:21:05.581050: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d05d40000 of size 2883584 next 18446744073709551615 2025-12-16 05:21:05.581061: I tensorflow/core/common_runtime/bfc_allocator.cc:970] Next region of size 16777216 2025-12-16 05:21:05.581073: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d06000000 of size 2359296 next 183 2025-12-16 05:21:05.581085: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d06240000 of size 2097152 next 198 2025-12-16 05:21:05.581096: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d06440000 of size 1048576 next 223 2025-12-16 05:21:05.581108: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d06540000 of size 3670016 next 212 2025-12-16 05:21:05.581119: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d068c0000 of size 2359296 next 211 2025-12-16 05:21:05.581131: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d06b00000 of size 1048576 next 235 2025-12-16 05:21:05.581143: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d06c00000 of size 1310720 next 230 2025-12-16 05:21:05.581154: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d06d40000 of size 2883584 next 18446744073709551615 2025-12-16 05:21:05.581173: I tensorflow/core/common_runtime/bfc_allocator.cc:970] Next region of size 4194304 2025-12-16 05:21:05.581186: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d08800000 of size 1024 next 462 2025-12-16 05:21:05.581197: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d08800400 of size 1024 next 463 2025-12-16 05:21:05.581209: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d08800800 of size 1024 next 464 2025-12-16 05:21:05.581220: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d08800c00 of size 1024 next 465 2025-12-16 05:21:05.581232: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d08801000 of size 4096 next 467 2025-12-16 05:21:05.581244: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d08802000 of size 4096 next 468 2025-12-16 05:21:05.581256: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d08803000 of size 4096 next 469 2025-12-16 05:21:05.581267: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d08804000 of size 4096 next 470 2025-12-16 05:21:05.581278: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d08805000 of size 4096 next 471 2025-12-16 05:21:05.581290: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d08806000 of size 1024 next 472 2025-12-16 05:21:05.581302: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d08806400 of size 1024 next 473 2025-12-16 05:21:05.581313: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d08806800 of size 1024 next 474 2025-12-16 05:21:05.581325: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d08806c00 of size 1024 next 475 2025-12-16 05:21:05.581336: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d08807000 of size 1024 next 476 2025-12-16 05:21:05.581348: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d08807400 of size 1024 next 479 2025-12-16 05:21:05.581359: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d08807800 of size 1024 next 480 2025-12-16 05:21:05.581371: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d08807c00 of size 1024 next 481 2025-12-16 05:21:05.581382: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d08808000 of size 1024 next 482 2025-12-16 05:21:05.581394: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d08808400 of size 1024 next 483 2025-12-16 05:21:05.581405: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d08808800 of size 4096 next 485 2025-12-16 05:21:05.581417: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d08809800 of size 4096 next 486 2025-12-16 05:21:05.581428: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d0880a800 of size 4096 next 487 2025-12-16 05:21:05.581440: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d0880b800 of size 4096 next 488 2025-12-16 05:21:05.581451: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d0880c800 of size 4096 next 489 2025-12-16 05:21:05.581463: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d0880d800 of size 1024 next 490 2025-12-16 05:21:05.581474: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d0880dc00 of size 1024 next 491 2025-12-16 05:21:05.581486: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d0880e000 of size 1024 next 492 2025-12-16 05:21:05.581497: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d0880e400 of size 1024 next 493 2025-12-16 05:21:05.581509: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d0880e800 of size 1024 next 494 2025-12-16 05:21:05.581520: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d0880ec00 of size 1024 next 497 2025-12-16 05:21:05.581532: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d0880f000 of size 1024 next 498 2025-12-16 05:21:05.581543: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d0880f400 of size 1024 next 499 2025-12-16 05:21:05.581563: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d0880f800 of size 1024 next 500 2025-12-16 05:21:05.581575: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d0880fc00 of size 1024 next 501 2025-12-16 05:21:05.581586: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d08810000 of size 4096 next 503 2025-12-16 05:21:05.581598: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d08811000 of size 4096 next 504 2025-12-16 05:21:05.581609: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d08812000 of size 4096 next 505 2025-12-16 05:21:05.581621: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d08813000 of size 4096 next 506 2025-12-16 05:21:05.581633: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d08814000 of size 4096 next 507 2025-12-16 05:21:05.581644: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d08815000 of size 1024 next 508 2025-12-16 05:21:05.581656: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d08815400 of size 1024 next 509 2025-12-16 05:21:05.581667: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d08815800 of size 1024 next 510 2025-12-16 05:21:05.581679: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d08815c00 of size 1024 next 511 2025-12-16 05:21:05.581690: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d08816000 of size 1024 next 512 2025-12-16 05:21:05.581702: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d08816400 of size 1024 next 515 2025-12-16 05:21:05.581714: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d08816800 of size 1024 next 516 2025-12-16 05:21:05.581725: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d08816c00 of size 1024 next 517 2025-12-16 05:21:05.581737: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d08817000 of size 1024 next 518 2025-12-16 05:21:05.581748: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d08817400 of size 1024 next 519 2025-12-16 05:21:05.581760: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d08817800 of size 4096 next 521 2025-12-16 05:21:05.581771: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d08818800 of size 4096 next 522 2025-12-16 05:21:05.581783: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d08819800 of size 4096 next 523 2025-12-16 05:21:05.581795: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d0881a800 of size 4096 next 524 2025-12-16 05:21:05.581806: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d0881b800 of size 4096 next 525 2025-12-16 05:21:05.581818: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d0881c800 of size 1024 next 526 2025-12-16 05:21:05.581829: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d0881cc00 of size 1024 next 527 2025-12-16 05:21:05.581841: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d0881d000 of size 1024 next 528 2025-12-16 05:21:05.581853: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d0881d400 of size 1024 next 529 2025-12-16 05:21:05.581864: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d0881d800 of size 1024 next 530 2025-12-16 05:21:05.581876: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d0881dc00 of size 1024 next 533 2025-12-16 05:21:05.581887: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d0881e000 of size 1024 next 534 2025-12-16 05:21:05.581899: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d0881e400 of size 1024 next 535 2025-12-16 05:21:05.581910: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d0881e800 of size 1024 next 536 2025-12-16 05:21:05.581922: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d0881ec00 of size 1024 next 537 2025-12-16 05:21:05.581941: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d0881f000 of size 4096 next 539 2025-12-16 05:21:05.581953: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d08820000 of size 4096 next 540 2025-12-16 05:21:05.581965: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d08821000 of size 4096 next 541 2025-12-16 05:21:05.581976: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d08822000 of size 4096 next 542 2025-12-16 05:21:05.581988: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d08823000 of size 4096 next 543 2025-12-16 05:21:05.582000: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d08824000 of size 1024 next 544 2025-12-16 05:21:05.582011: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d08824400 of size 1024 next 545 2025-12-16 05:21:05.582023: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d08824800 of size 1024 next 546 2025-12-16 05:21:05.582034: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d08824c00 of size 1024 next 547 2025-12-16 05:21:05.582046: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d08825000 of size 1024 next 548 2025-12-16 05:21:05.582057: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d08825400 of size 1024 next 549 2025-12-16 05:21:05.582069: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d08825800 of size 1024 next 551 2025-12-16 05:21:05.582081: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d08825c00 of size 1024 next 552 2025-12-16 05:21:05.582092: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d08826000 of size 1024 next 553 2025-12-16 05:21:05.582104: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d08826400 of size 1024 next 554 2025-12-16 05:21:05.582115: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d08826800 of size 4096 next 556 2025-12-16 05:21:05.582127: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d08827800 of size 4096 next 557 2025-12-16 05:21:05.582138: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d08828800 of size 4096 next 558 2025-12-16 05:21:05.582150: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d08829800 of size 4096 next 559 2025-12-16 05:21:05.582161: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d0882a800 of size 4096 next 560 2025-12-16 05:21:05.582173: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d0882b800 of size 1024 next 561 2025-12-16 05:21:05.582185: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d0882bc00 of size 1024 next 562 2025-12-16 05:21:05.582196: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d0882c000 of size 1024 next 563 2025-12-16 05:21:05.582208: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d0882c400 of size 1024 next 564 2025-12-16 05:21:05.582219: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d0882c800 of size 1024 next 565 2025-12-16 05:21:05.582231: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d0882cc00 of size 256 next 566 2025-12-16 05:21:05.582243: I tensorflow/core/common_runtime/bfc_allocator.cc:990] Free at 7f3d0882cd00 of size 78592 next 105 2025-12-16 05:21:05.582255: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d08840000 of size 262144 next 104 2025-12-16 05:21:05.582267: I tensorflow/core/common_runtime/bfc_allocator.cc:990] Free at 7f3d08880000 of size 655360 next 98 2025-12-16 05:21:05.582293: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d08920000 of size 589824 next 97 2025-12-16 05:21:05.582305: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d089b0000 of size 262144 next 119 2025-12-16 05:21:05.582317: I tensorflow/core/common_runtime/bfc_allocator.cc:990] Free at 7f3d089f0000 of size 262144 next 114 2025-12-16 05:21:05.582337: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d08a30000 of size 524288 next 113 2025-12-16 05:21:05.582349: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d08ab0000 of size 262144 next 136 2025-12-16 05:21:05.582361: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d08af0000 of size 327680 next 126 2025-12-16 05:21:05.582373: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d08b40000 of size 786432 next 18446744073709551615 2025-12-16 05:21:05.582385: I tensorflow/core/common_runtime/bfc_allocator.cc:970] Next region of size 8388608 2025-12-16 05:21:05.582396: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d08c00000 of size 262144 next 155 2025-12-16 05:21:05.582408: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d08c40000 of size 327680 next 144 2025-12-16 05:21:05.582420: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d08c90000 of size 589824 next 142 2025-12-16 05:21:05.582431: I tensorflow/core/common_runtime/bfc_allocator.cc:990] Free at 7f3d08d20000 of size 589824 next 162 2025-12-16 05:21:05.582443: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d08db0000 of size 589824 next 161 2025-12-16 05:21:05.582455: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d08e40000 of size 524288 next 173 2025-12-16 05:21:05.582466: I tensorflow/core/common_runtime/bfc_allocator.cc:990] Free at 7f3d08ec0000 of size 1048576 next 218 2025-12-16 05:21:05.582478: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d08fc0000 of size 1048576 next 192 2025-12-16 05:21:05.582490: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d090c0000 of size 1048576 next 191 2025-12-16 05:21:05.582501: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d091c0000 of size 1048576 next 205 2025-12-16 05:21:05.582513: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d092c0000 of size 1310720 next 18446744073709551615 2025-12-16 05:21:05.582524: I tensorflow/core/common_runtime/bfc_allocator.cc:970] Next region of size 2304 2025-12-16 05:21:05.582536: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e00000 of size 2304 next 18446744073709551615 2025-12-16 05:21:05.582547: I tensorflow/core/common_runtime/bfc_allocator.cc:970] Next region of size 2097152 2025-12-16 05:21:05.582559: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41000000 of size 256 next 5 2025-12-16 05:21:05.582571: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41000100 of size 256 next 8 2025-12-16 05:21:05.582583: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41000200 of size 256 next 9 2025-12-16 05:21:05.582594: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41000300 of size 256 next 10 2025-12-16 05:21:05.582606: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41000400 of size 256 next 11 2025-12-16 05:21:05.582617: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41000500 of size 256 next 12 2025-12-16 05:21:05.582629: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41000600 of size 256 next 13 2025-12-16 05:21:05.582640: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41000700 of size 256 next 17 2025-12-16 05:21:05.582652: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41000800 of size 256 next 19 2025-12-16 05:21:05.582663: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41000900 of size 256 next 20 2025-12-16 05:21:05.582675: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41000a00 of size 256 next 21 2025-12-16 05:21:05.582686: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41000b00 of size 256 next 22 2025-12-16 05:21:05.582698: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41000c00 of size 256 next 24 2025-12-16 05:21:05.582718: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41000d00 of size 256 next 25 2025-12-16 05:21:05.582730: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41000e00 of size 256 next 23 2025-12-16 05:21:05.582741: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41000f00 of size 256 next 28 2025-12-16 05:21:05.582753: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41001000 of size 256 next 29 2025-12-16 05:21:05.582764: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41001100 of size 256 next 30 2025-12-16 05:21:05.582776: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41001200 of size 256 next 31 2025-12-16 05:21:05.582787: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41001300 of size 256 next 33 2025-12-16 05:21:05.582799: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41001400 of size 256 next 34 2025-12-16 05:21:05.582810: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41001500 of size 1024 next 32 2025-12-16 05:21:05.582822: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41001900 of size 1024 next 37 2025-12-16 05:21:05.582834: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41001d00 of size 1024 next 38 2025-12-16 05:21:05.582845: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41002100 of size 1024 next 39 2025-12-16 05:21:05.582857: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41002500 of size 1024 next 40 2025-12-16 05:21:05.582868: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41002900 of size 1024 next 41 2025-12-16 05:21:05.582880: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41002d00 of size 1024 next 43 2025-12-16 05:21:05.582891: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41003100 of size 1024 next 44 2025-12-16 05:21:05.582903: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41003500 of size 1024 next 45 2025-12-16 05:21:05.582914: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41003900 of size 1024 next 46 2025-12-16 05:21:05.582926: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41003d00 of size 256 next 48 2025-12-16 05:21:05.582937: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41003e00 of size 256 next 49 2025-12-16 05:21:05.582949: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41003f00 of size 256 next 50 2025-12-16 05:21:05.582960: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41004000 of size 256 next 51 2025-12-16 05:21:05.582972: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41004100 of size 256 next 52 2025-12-16 05:21:05.582983: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41004200 of size 256 next 53 2025-12-16 05:21:05.582995: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41004300 of size 256 next 56 2025-12-16 05:21:05.583007: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41004400 of size 256 next 57 2025-12-16 05:21:05.583018: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41004500 of size 256 next 58 2025-12-16 05:21:05.583030: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41004600 of size 256 next 14 2025-12-16 05:21:05.583041: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41004700 of size 256 next 15 2025-12-16 05:21:05.583053: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41004800 of size 256 next 16 2025-12-16 05:21:05.583064: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41004900 of size 1024 next 60 2025-12-16 05:21:05.583076: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41004d00 of size 1024 next 61 2025-12-16 05:21:05.583087: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41005100 of size 1024 next 62 2025-12-16 05:21:05.583106: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41005500 of size 1024 next 63 2025-12-16 05:21:05.583118: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41005900 of size 1024 next 64 2025-12-16 05:21:05.583130: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41005d00 of size 256 next 66 2025-12-16 05:21:05.583141: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41005e00 of size 256 next 67 2025-12-16 05:21:05.583153: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41005f00 of size 256 next 68 2025-12-16 05:21:05.583165: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41006000 of size 256 next 69 2025-12-16 05:21:05.583176: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41006100 of size 256 next 70 2025-12-16 05:21:05.583188: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41006200 of size 256 next 73 2025-12-16 05:21:05.583199: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41006300 of size 256 next 74 2025-12-16 05:21:05.583211: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41006400 of size 256 next 75 2025-12-16 05:21:05.583222: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41006500 of size 256 next 76 2025-12-16 05:21:05.583234: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41006600 of size 256 next 77 2025-12-16 05:21:05.583245: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41006700 of size 1024 next 79 2025-12-16 05:21:05.583257: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41006b00 of size 1024 next 80 2025-12-16 05:21:05.583268: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41006f00 of size 1024 next 81 2025-12-16 05:21:05.583280: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41007300 of size 1024 next 82 2025-12-16 05:21:05.583292: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41007700 of size 1024 next 83 2025-12-16 05:21:05.583303: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41007b00 of size 256 next 84 2025-12-16 05:21:05.583315: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41007c00 of size 256 next 85 2025-12-16 05:21:05.583326: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41007d00 of size 512 next 88 2025-12-16 05:21:05.583338: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41007f00 of size 512 next 89 2025-12-16 05:21:05.583349: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41008100 of size 512 next 90 2025-12-16 05:21:05.583361: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41008300 of size 512 next 91 2025-12-16 05:21:05.583372: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41008500 of size 512 next 92 2025-12-16 05:21:05.583384: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41008700 of size 256 next 95 2025-12-16 05:21:05.583395: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41008800 of size 256 next 96 2025-12-16 05:21:05.583407: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41008900 of size 512 next 94 2025-12-16 05:21:05.583418: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41008b00 of size 512 next 99 2025-12-16 05:21:05.583430: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41008d00 of size 512 next 100 2025-12-16 05:21:05.583441: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41008f00 of size 512 next 101 2025-12-16 05:21:05.583453: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41009100 of size 512 next 2 2025-12-16 05:21:05.583465: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41009300 of size 256 next 3 2025-12-16 05:21:05.583476: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41009400 of size 256 next 4 2025-12-16 05:21:05.583496: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41009500 of size 16384 next 18 2025-12-16 05:21:05.583508: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e4100d500 of size 256 next 102 2025-12-16 05:21:05.583519: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e4100d600 of size 256 next 103 2025-12-16 05:21:05.583531: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e4100d700 of size 2048 next 106 2025-12-16 05:21:05.583543: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e4100df00 of size 2048 next 107 2025-12-16 05:21:05.583554: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e4100e700 of size 2048 next 108 2025-12-16 05:21:05.583566: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e4100ef00 of size 2048 next 109 2025-12-16 05:21:05.583577: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e4100f700 of size 2048 next 110 2025-12-16 05:21:05.583589: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e4100ff00 of size 256 next 111 2025-12-16 05:21:05.583600: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41010000 of size 256 next 112 2025-12-16 05:21:05.583612: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41010100 of size 2048 next 115 2025-12-16 05:21:05.583623: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41010900 of size 2048 next 116 2025-12-16 05:21:05.583635: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41011100 of size 2048 next 117 2025-12-16 05:21:05.583646: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41011900 of size 2048 next 118 2025-12-16 05:21:05.583658: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41012100 of size 2048 next 6 2025-12-16 05:21:05.583670: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41012900 of size 37632 next 7 2025-12-16 05:21:05.583681: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e4101bc00 of size 512 next 120 2025-12-16 05:21:05.583693: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e4101be00 of size 512 next 121 2025-12-16 05:21:05.583705: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e4101c000 of size 512 next 122 2025-12-16 05:21:05.583716: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e4101c200 of size 512 next 123 2025-12-16 05:21:05.583728: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e4101c400 of size 512 next 124 2025-12-16 05:21:05.583739: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e4101c600 of size 512 next 125 2025-12-16 05:21:05.583751: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e4101c800 of size 512 next 127 2025-12-16 05:21:05.583762: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e4101ca00 of size 512 next 128 2025-12-16 05:21:05.583774: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e4101cc00 of size 512 next 129 2025-12-16 05:21:05.583785: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e4101ce00 of size 512 next 130 2025-12-16 05:21:05.583797: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e4101d000 of size 2048 next 131 2025-12-16 05:21:05.583808: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e4101d800 of size 2048 next 132 2025-12-16 05:21:05.583820: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e4101e000 of size 2048 next 133 2025-12-16 05:21:05.583831: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e4101e800 of size 2048 next 134 2025-12-16 05:21:05.583843: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e4101f000 of size 2048 next 135 2025-12-16 05:21:05.583854: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e4101f800 of size 512 next 137 2025-12-16 05:21:05.583874: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e4101fa00 of size 512 next 138 2025-12-16 05:21:05.583886: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e4101fc00 of size 512 next 139 2025-12-16 05:21:05.583897: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e4101fe00 of size 512 next 140 2025-12-16 05:21:05.583909: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41020000 of size 512 next 141 2025-12-16 05:21:05.583920: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41020200 of size 512 next 145 2025-12-16 05:21:05.583932: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41020400 of size 512 next 146 2025-12-16 05:21:05.583943: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41020600 of size 512 next 147 2025-12-16 05:21:05.583955: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41020800 of size 512 next 148 2025-12-16 05:21:05.583967: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41020a00 of size 512 next 149 2025-12-16 05:21:05.583978: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41020c00 of size 2048 next 150 2025-12-16 05:21:05.583990: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41021400 of size 2048 next 151 2025-12-16 05:21:05.584001: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41021c00 of size 2048 next 152 2025-12-16 05:21:05.584013: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41022400 of size 2048 next 153 2025-12-16 05:21:05.584024: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41022c00 of size 2048 next 154 2025-12-16 05:21:05.584036: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41023400 of size 512 next 156 2025-12-16 05:21:05.584047: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41023600 of size 512 next 157 2025-12-16 05:21:05.584059: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41023800 of size 512 next 158 2025-12-16 05:21:05.584071: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41023a00 of size 512 next 159 2025-12-16 05:21:05.584082: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41023c00 of size 512 next 160 2025-12-16 05:21:05.584094: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41023e00 of size 512 next 163 2025-12-16 05:21:05.584105: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41024000 of size 512 next 164 2025-12-16 05:21:05.584117: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41024200 of size 512 next 165 2025-12-16 05:21:05.584128: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41024400 of size 512 next 166 2025-12-16 05:21:05.584140: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41024600 of size 512 next 167 2025-12-16 05:21:05.584151: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41024800 of size 2048 next 168 2025-12-16 05:21:05.584163: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41025000 of size 2048 next 169 2025-12-16 05:21:05.584174: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41025800 of size 2048 next 170 2025-12-16 05:21:05.584186: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41026000 of size 2048 next 171 2025-12-16 05:21:05.584197: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41026800 of size 2048 next 172 2025-12-16 05:21:05.584209: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41027000 of size 1024 next 174 2025-12-16 05:21:05.584221: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41027400 of size 1024 next 175 2025-12-16 05:21:05.584232: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41027800 of size 1024 next 176 2025-12-16 05:21:05.584244: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41027c00 of size 1024 next 177 2025-12-16 05:21:05.584270: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41028000 of size 1024 next 178 2025-12-16 05:21:05.584282: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41028400 of size 256 next 180 2025-12-16 05:21:05.584294: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41028500 of size 256 next 181 2025-12-16 05:21:05.584305: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41028600 of size 1024 next 179 2025-12-16 05:21:05.584317: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41028a00 of size 1024 next 184 2025-12-16 05:21:05.584328: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41028e00 of size 1024 next 185 2025-12-16 05:21:05.584340: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41029200 of size 1024 next 186 2025-12-16 05:21:05.584351: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41029600 of size 1024 next 187 2025-12-16 05:21:05.584363: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41029a00 of size 256 next 189 2025-12-16 05:21:05.584375: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41029b00 of size 256 next 190 2025-12-16 05:21:05.584386: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41029c00 of size 4096 next 188 2025-12-16 05:21:05.584398: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e4102ac00 of size 4096 next 42 2025-12-16 05:21:05.584410: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e4102bc00 of size 65536 next 36 2025-12-16 05:21:05.584421: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e4103bc00 of size 65536 next 35 2025-12-16 05:21:05.584433: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e4104bc00 of size 4096 next 236 2025-12-16 05:21:05.584445: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e4104cc00 of size 4096 next 237 2025-12-16 05:21:05.584456: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e4104dc00 of size 4096 next 238 2025-12-16 05:21:05.584468: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e4104ec00 of size 4096 next 239 2025-12-16 05:21:05.584479: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e4104fc00 of size 1024 next 240 2025-12-16 05:21:05.584491: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41050000 of size 1024 next 241 2025-12-16 05:21:05.584502: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41050400 of size 1024 next 242 2025-12-16 05:21:05.584514: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41050800 of size 1024 next 243 2025-12-16 05:21:05.584525: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41050c00 of size 1024 next 244 2025-12-16 05:21:05.584537: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41051000 of size 1024 next 248 2025-12-16 05:21:05.584549: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41051400 of size 1024 next 249 2025-12-16 05:21:05.584560: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41051800 of size 1024 next 250 2025-12-16 05:21:05.584572: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41051c00 of size 1024 next 251 2025-12-16 05:21:05.584583: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41052000 of size 1024 next 252 2025-12-16 05:21:05.584595: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41052400 of size 4096 next 254 2025-12-16 05:21:05.584606: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41053400 of size 4096 next 255 2025-12-16 05:21:05.584618: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41054400 of size 4096 next 256 2025-12-16 05:21:05.584629: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41055400 of size 4096 next 257 2025-12-16 05:21:05.584649: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41056400 of size 4096 next 258 2025-12-16 05:21:05.584661: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41057400 of size 1024 next 259 2025-12-16 05:21:05.584672: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41057800 of size 1024 next 260 2025-12-16 05:21:05.584684: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41057c00 of size 1024 next 261 2025-12-16 05:21:05.584696: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41058000 of size 1024 next 262 2025-12-16 05:21:05.584707: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41058400 of size 1024 next 263 2025-12-16 05:21:05.584719: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41058800 of size 1024 next 266 2025-12-16 05:21:05.584730: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41058c00 of size 1024 next 267 2025-12-16 05:21:05.584742: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41059000 of size 1024 next 268 2025-12-16 05:21:05.584753: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41059400 of size 1024 next 269 2025-12-16 05:21:05.584765: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41059800 of size 1024 next 270 2025-12-16 05:21:05.584777: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41059c00 of size 4096 next 272 2025-12-16 05:21:05.584788: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e4105ac00 of size 4096 next 273 2025-12-16 05:21:05.584800: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e4105bc00 of size 4096 next 274 2025-12-16 05:21:05.584811: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e4105cc00 of size 4096 next 275 2025-12-16 05:21:05.584823: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e4105dc00 of size 4096 next 276 2025-12-16 05:21:05.584834: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e4105ec00 of size 1024 next 277 2025-12-16 05:21:05.584846: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e4105f000 of size 1024 next 278 2025-12-16 05:21:05.584858: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e4105f400 of size 1024 next 279 2025-12-16 05:21:05.584869: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e4105f800 of size 1024 next 280 2025-12-16 05:21:05.584881: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e4105fc00 of size 1024 next 281 2025-12-16 05:21:05.584892: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41060000 of size 1024 next 284 2025-12-16 05:21:05.584904: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41060400 of size 1024 next 285 2025-12-16 05:21:05.584915: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41060800 of size 1024 next 286 2025-12-16 05:21:05.584927: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41060c00 of size 1024 next 287 2025-12-16 05:21:05.584938: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41061000 of size 1024 next 288 2025-12-16 05:21:05.584950: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41061400 of size 4096 next 290 2025-12-16 05:21:05.584962: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41062400 of size 6144 next 27 2025-12-16 05:21:05.584974: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41063c00 of size 147456 next 26 2025-12-16 05:21:05.584986: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41087c00 of size 65536 next 47 2025-12-16 05:21:05.584997: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41097c00 of size 65536 next 59 2025-12-16 05:21:05.585009: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e410a7c00 of size 65536 next 65 2025-12-16 05:21:05.585029: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e410b7c00 of size 4096 next 363 2025-12-16 05:21:05.585041: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e410b8c00 of size 1024 next 364 2025-12-16 05:21:05.585052: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e410b9000 of size 1024 next 365 2025-12-16 05:21:05.585064: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e410b9400 of size 1024 next 366 2025-12-16 05:21:05.585075: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e410b9800 of size 1024 next 367 2025-12-16 05:21:05.585087: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e410b9c00 of size 1024 next 368 2025-12-16 05:21:05.585099: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e410ba000 of size 1024 next 372 2025-12-16 05:21:05.585110: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e410ba400 of size 1024 next 373 2025-12-16 05:21:05.585122: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e410ba800 of size 1024 next 374 2025-12-16 05:21:05.585133: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e410bac00 of size 1024 next 375 2025-12-16 05:21:05.585145: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e410bb000 of size 1024 next 376 2025-12-16 05:21:05.585157: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e410bb400 of size 4096 next 378 2025-12-16 05:21:05.585168: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e410bc400 of size 4096 next 379 2025-12-16 05:21:05.585180: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e410bd400 of size 4096 next 380 2025-12-16 05:21:05.585191: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e410be400 of size 4096 next 381 2025-12-16 05:21:05.585203: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e410bf400 of size 4096 next 382 2025-12-16 05:21:05.585214: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e410c0400 of size 1024 next 383 2025-12-16 05:21:05.585226: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e410c0800 of size 1024 next 384 2025-12-16 05:21:05.585238: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e410c0c00 of size 1024 next 385 2025-12-16 05:21:05.585249: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e410c1000 of size 1024 next 386 2025-12-16 05:21:05.585261: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e410c1400 of size 1024 next 387 2025-12-16 05:21:05.585272: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e410c1800 of size 1024 next 390 2025-12-16 05:21:05.585284: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e410c1c00 of size 1024 next 391 2025-12-16 05:21:05.585296: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e410c2000 of size 1024 next 392 2025-12-16 05:21:05.585307: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e410c2400 of size 1024 next 393 2025-12-16 05:21:05.585319: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e410c2800 of size 1024 next 394 2025-12-16 05:21:05.585330: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e410c2c00 of size 4096 next 396 2025-12-16 05:21:05.585342: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e410c3c00 of size 4096 next 397 2025-12-16 05:21:05.585353: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e410c4c00 of size 4096 next 398 2025-12-16 05:21:05.585365: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e410c5c00 of size 4096 next 399 2025-12-16 05:21:05.585377: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e410c6c00 of size 4096 next 400 2025-12-16 05:21:05.585388: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e410c7c00 of size 1024 next 401 2025-12-16 05:21:05.585412: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e410c8000 of size 1024 next 402 2025-12-16 05:21:05.585424: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e410c8400 of size 1024 next 403 2025-12-16 05:21:05.585435: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e410c8800 of size 1024 next 404 2025-12-16 05:21:05.585447: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e410c8c00 of size 1024 next 405 2025-12-16 05:21:05.585459: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e410c9000 of size 1024 next 408 2025-12-16 05:21:05.585470: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e410c9400 of size 1024 next 409 2025-12-16 05:21:05.585482: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e410c9800 of size 1024 next 410 2025-12-16 05:21:05.585493: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e410c9c00 of size 1024 next 411 2025-12-16 05:21:05.585505: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e410ca000 of size 1024 next 412 2025-12-16 05:21:05.585517: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e410ca400 of size 4096 next 414 2025-12-16 05:21:05.585528: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e410cb400 of size 4096 next 415 2025-12-16 05:21:05.585540: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e410cc400 of size 4096 next 416 2025-12-16 05:21:05.585551: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e410cd400 of size 4096 next 417 2025-12-16 05:21:05.585563: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e410ce400 of size 4096 next 418 2025-12-16 05:21:05.585575: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e410cf400 of size 1024 next 419 2025-12-16 05:21:05.585586: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e410cf800 of size 1024 next 420 2025-12-16 05:21:05.585598: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e410cfc00 of size 1024 next 421 2025-12-16 05:21:05.585609: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e410d0000 of size 1024 next 422 2025-12-16 05:21:05.585621: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e410d0400 of size 1024 next 423 2025-12-16 05:21:05.585632: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e410d0800 of size 1024 next 426 2025-12-16 05:21:05.585644: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e410d0c00 of size 1024 next 427 2025-12-16 05:21:05.585656: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e410d1000 of size 1024 next 428 2025-12-16 05:21:05.585667: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e410d1400 of size 1024 next 429 2025-12-16 05:21:05.585679: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e410d1800 of size 1024 next 430 2025-12-16 05:21:05.585690: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e410d1c00 of size 4096 next 432 2025-12-16 05:21:05.585702: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e410d2c00 of size 4096 next 433 2025-12-16 05:21:05.585713: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e410d3c00 of size 4096 next 434 2025-12-16 05:21:05.585725: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e410d4c00 of size 4096 next 435 2025-12-16 05:21:05.585737: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e410d5c00 of size 4096 next 436 2025-12-16 05:21:05.585748: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e410d6c00 of size 1024 next 437 2025-12-16 05:21:05.585760: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e410d7000 of size 1024 next 438 2025-12-16 05:21:05.585771: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e410d7400 of size 1024 next 439 2025-12-16 05:21:05.585783: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e410d7800 of size 1024 next 440 2025-12-16 05:21:05.585802: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e410d7c00 of size 1024 next 441 2025-12-16 05:21:05.585814: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e410d8000 of size 1024 next 444 2025-12-16 05:21:05.585830: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e410d8400 of size 1024 next 445 2025-12-16 05:21:05.585842: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e410d8800 of size 1024 next 446 2025-12-16 05:21:05.585854: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e410d8c00 of size 1024 next 447 2025-12-16 05:21:05.585865: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e410d9000 of size 1024 next 448 2025-12-16 05:21:05.585877: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e410d9400 of size 4096 next 450 2025-12-16 05:21:05.585889: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e410da400 of size 4096 next 451 2025-12-16 05:21:05.585900: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e410db400 of size 4096 next 452 2025-12-16 05:21:05.585912: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e410dc400 of size 4096 next 453 2025-12-16 05:21:05.585924: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e410dd400 of size 4096 next 454 2025-12-16 05:21:05.585935: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e410de400 of size 1024 next 455 2025-12-16 05:21:05.585947: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e410de800 of size 1024 next 456 2025-12-16 05:21:05.585958: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e410dec00 of size 1024 next 457 2025-12-16 05:21:05.585970: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e410df000 of size 1024 next 458 2025-12-16 05:21:05.585981: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e410df400 of size 1024 next 459 2025-12-16 05:21:05.585993: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e410df800 of size 1024 next 55 2025-12-16 05:21:05.586005: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e410dfc00 of size 147456 next 54 2025-12-16 05:21:05.586016: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41103c00 of size 65536 next 78 2025-12-16 05:21:05.586028: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41113c00 of size 4096 next 193 2025-12-16 05:21:05.586039: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41114c00 of size 4096 next 194 2025-12-16 05:21:05.586051: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41115c00 of size 4096 next 195 2025-12-16 05:21:05.586063: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41116c00 of size 256 next 196 2025-12-16 05:21:05.586074: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41116d00 of size 256 next 197 2025-12-16 05:21:05.586086: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41116e00 of size 4096 next 199 2025-12-16 05:21:05.586097: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41117e00 of size 4096 next 200 2025-12-16 05:21:05.586109: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41118e00 of size 4096 next 201 2025-12-16 05:21:05.586121: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41119e00 of size 4096 next 202 2025-12-16 05:21:05.586132: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e4111ae00 of size 4096 next 203 2025-12-16 05:21:05.586144: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e4111be00 of size 1024 next 204 2025-12-16 05:21:05.586155: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e4111c200 of size 1024 next 206 2025-12-16 05:21:05.586167: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e4111c600 of size 1024 next 207 2025-12-16 05:21:05.586187: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e4111ca00 of size 1024 next 208 2025-12-16 05:21:05.586199: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e4111ce00 of size 1024 next 209 2025-12-16 05:21:05.586210: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e4111d200 of size 1024 next 210 2025-12-16 05:21:05.586222: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e4111d600 of size 1024 next 213 2025-12-16 05:21:05.586234: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e4111da00 of size 1024 next 214 2025-12-16 05:21:05.586245: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e4111de00 of size 1024 next 215 2025-12-16 05:21:05.586257: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e4111e200 of size 1024 next 216 2025-12-16 05:21:05.586268: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e4111e600 of size 4096 next 217 2025-12-16 05:21:05.586290: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e4111f600 of size 4096 next 219 2025-12-16 05:21:05.586302: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41120600 of size 4096 next 220 2025-12-16 05:21:05.586314: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41121600 of size 4096 next 221 2025-12-16 05:21:05.586326: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41122600 of size 4096 next 222 2025-12-16 05:21:05.586337: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41123600 of size 1024 next 224 2025-12-16 05:21:05.586349: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41123a00 of size 1024 next 225 2025-12-16 05:21:05.586360: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41123e00 of size 1024 next 226 2025-12-16 05:21:05.586372: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41124200 of size 1024 next 227 2025-12-16 05:21:05.586383: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41124600 of size 1024 next 228 2025-12-16 05:21:05.586395: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41124a00 of size 1024 next 229 2025-12-16 05:21:05.586407: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41124e00 of size 1024 next 231 2025-12-16 05:21:05.586418: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41125200 of size 1024 next 232 2025-12-16 05:21:05.586430: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41125600 of size 1024 next 233 2025-12-16 05:21:05.586441: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41125a00 of size 1024 next 234 2025-12-16 05:21:05.586453: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41125e00 of size 7680 next 72 2025-12-16 05:21:05.586465: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41127c00 of size 147456 next 71 2025-12-16 05:21:05.586477: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e4114bc00 of size 4096 next 291 2025-12-16 05:21:05.586488: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e4114cc00 of size 4096 next 292 2025-12-16 05:21:05.586500: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e4114dc00 of size 4096 next 293 2025-12-16 05:21:05.586511: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e4114ec00 of size 1024 next 294 2025-12-16 05:21:05.586523: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e4114f000 of size 1024 next 295 2025-12-16 05:21:05.586534: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e4114f400 of size 1024 next 296 2025-12-16 05:21:05.586546: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e4114f800 of size 1024 next 297 2025-12-16 05:21:05.586558: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e4114fc00 of size 1024 next 298 2025-12-16 05:21:05.586577: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41150000 of size 1024 next 301 2025-12-16 05:21:05.586589: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41150400 of size 1024 next 302 2025-12-16 05:21:05.586601: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41150800 of size 1024 next 303 2025-12-16 05:21:05.586612: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41150c00 of size 1024 next 304 2025-12-16 05:21:05.586624: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41151000 of size 1024 next 305 2025-12-16 05:21:05.586636: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41151400 of size 4096 next 307 2025-12-16 05:21:05.586647: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41152400 of size 4096 next 308 2025-12-16 05:21:05.586659: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41153400 of size 4096 next 309 2025-12-16 05:21:05.586670: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41154400 of size 4096 next 310 2025-12-16 05:21:05.586682: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41155400 of size 4096 next 311 2025-12-16 05:21:05.586694: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41156400 of size 1024 next 312 2025-12-16 05:21:05.586705: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41156800 of size 1024 next 313 2025-12-16 05:21:05.586717: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41156c00 of size 1024 next 314 2025-12-16 05:21:05.586728: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41157000 of size 1024 next 315 2025-12-16 05:21:05.586740: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41157400 of size 1024 next 316 2025-12-16 05:21:05.586751: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41157800 of size 1024 next 319 2025-12-16 05:21:05.586763: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41157c00 of size 1024 next 320 2025-12-16 05:21:05.586775: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41158000 of size 1024 next 321 2025-12-16 05:21:05.586786: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41158400 of size 1024 next 322 2025-12-16 05:21:05.586798: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41158800 of size 1024 next 323 2025-12-16 05:21:05.586809: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41158c00 of size 4096 next 325 2025-12-16 05:21:05.586821: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41159c00 of size 4096 next 326 2025-12-16 05:21:05.586833: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e4115ac00 of size 4096 next 327 2025-12-16 05:21:05.586844: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e4115bc00 of size 4096 next 328 2025-12-16 05:21:05.586856: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e4115cc00 of size 4096 next 329 2025-12-16 05:21:05.586867: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e4115dc00 of size 1024 next 330 2025-12-16 05:21:05.586879: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e4115e000 of size 1024 next 331 2025-12-16 05:21:05.586890: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e4115e400 of size 1024 next 332 2025-12-16 05:21:05.586902: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e4115e800 of size 1024 next 333 2025-12-16 05:21:05.586914: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e4115ec00 of size 1024 next 334 2025-12-16 05:21:05.586925: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e4115f000 of size 1024 next 337 2025-12-16 05:21:05.586937: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e4115f400 of size 1024 next 338 2025-12-16 05:21:05.586959: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e4115f800 of size 1024 next 339 2025-12-16 05:21:05.586971: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e4115fc00 of size 1024 next 340 2025-12-16 05:21:05.586983: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41160000 of size 1024 next 341 2025-12-16 05:21:05.586995: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41160400 of size 4096 next 343 2025-12-16 05:21:05.587006: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41161400 of size 4096 next 344 2025-12-16 05:21:05.587018: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41162400 of size 4096 next 345 2025-12-16 05:21:05.587029: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41163400 of size 4096 next 346 2025-12-16 05:21:05.587041: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41164400 of size 4096 next 347 2025-12-16 05:21:05.587052: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41165400 of size 1024 next 348 2025-12-16 05:21:05.587064: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41165800 of size 1024 next 349 2025-12-16 05:21:05.587076: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41165c00 of size 1024 next 350 2025-12-16 05:21:05.587087: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41166000 of size 1024 next 351 2025-12-16 05:21:05.587099: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41166400 of size 1024 next 352 2025-12-16 05:21:05.587110: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41166800 of size 1024 next 353 2025-12-16 05:21:05.587122: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41166c00 of size 1024 next 355 2025-12-16 05:21:05.587134: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41167000 of size 1024 next 356 2025-12-16 05:21:05.587145: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41167400 of size 1024 next 357 2025-12-16 05:21:05.587157: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41167800 of size 1024 next 358 2025-12-16 05:21:05.587169: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41167c00 of size 4096 next 360 2025-12-16 05:21:05.587180: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41168c00 of size 4096 next 361 2025-12-16 05:21:05.587192: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e41169c00 of size 4096 next 362 2025-12-16 05:21:05.587203: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e4116ac00 of size 4096 next 87 2025-12-16 05:21:05.587215: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e4116bc00 of size 131072 next 86 2025-12-16 05:21:05.587227: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e4118bc00 of size 476160 next 18446744073709551615 2025-12-16 05:21:05.587239: I tensorflow/core/common_runtime/bfc_allocator.cc:995] Summary of in-use Chunks by size: 2025-12-16 05:21:05.587253: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 60 Chunks of size 256 totalling 15.0KiB 2025-12-16 05:21:05.587267: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 40 Chunks of size 512 totalling 20.0KiB 2025-12-16 05:21:05.587281: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 235 Chunks of size 1024 totalling 235.0KiB 2025-12-16 05:21:05.587294: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 25 Chunks of size 2048 totalling 50.0KiB 2025-12-16 05:21:05.587307: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 2304 totalling 2.2KiB 2025-12-16 05:21:05.587320: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 108 Chunks of size 4096 totalling 432.0KiB 2025-12-16 05:21:05.587333: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 6144 totalling 6.0KiB 2025-12-16 05:21:05.587346: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 7680 totalling 7.5KiB 2025-12-16 05:21:05.587368: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 16384 totalling 16.0KiB 2025-12-16 05:21:05.587381: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 37632 totalling 36.8KiB 2025-12-16 05:21:05.587395: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 6 Chunks of size 65536 totalling 384.0KiB 2025-12-16 05:21:05.587408: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 131072 totalling 128.0KiB 2025-12-16 05:21:05.587421: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 3 Chunks of size 147456 totalling 432.0KiB 2025-12-16 05:21:05.587434: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 4 Chunks of size 262144 totalling 1.00MiB 2025-12-16 05:21:05.587447: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 2 Chunks of size 327680 totalling 640.0KiB 2025-12-16 05:21:05.587460: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 476160 totalling 465.0KiB 2025-12-16 05:21:05.587473: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 2 Chunks of size 524288 totalling 1.00MiB 2025-12-16 05:21:05.587486: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 3 Chunks of size 589824 totalling 1.69MiB 2025-12-16 05:21:05.587499: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 786432 totalling 768.0KiB 2025-12-16 05:21:05.587512: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 23 Chunks of size 1048576 totalling 23.00MiB 2025-12-16 05:21:05.587525: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 19 Chunks of size 1310720 totalling 23.75MiB 2025-12-16 05:21:05.587538: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 2097152 totalling 2.00MiB 2025-12-16 05:21:05.587551: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 18 Chunks of size 2359296 totalling 40.50MiB 2025-12-16 05:21:05.587564: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 2 Chunks of size 2883584 totalling 5.50MiB 2025-12-16 05:21:05.587577: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 3670016 totalling 3.50MiB 2025-12-16 05:21:05.587590: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 3798784 totalling 3.62MiB 2025-12-16 05:21:05.587603: I tensorflow/core/common_runtime/bfc_allocator.cc:1002] Sum Total of in-use chunks: 109.11MiB 2025-12-16 05:21:05.587615: I tensorflow/core/common_runtime/bfc_allocator.cc:1004] total_region_allocated_bytes_: 118358016 memory_limit_: 118358016 available bytes: 0 curr_region_allocation_bytes_: 134217728 2025-12-16 05:21:05.587631: I tensorflow/core/common_runtime/bfc_allocator.cc:1010] Stats: Limit: 118358016 InUse: 114412800 MaxInUse: 114412800 NumAllocs: 1896 MaxAllocSize: 3798784 2025-12-16 05:21:05.587657: W tensorflow/core/common_runtime/bfc_allocator.cc:439] ********************************************x******************************************************* 2025-12-16 05:21:05.587698: W tensorflow/core/framework/op_kernel.cc:1753] OP_REQUIRES failed at cwise_ops_common.h:134 : Resource exhausted: OOM when allocating tensor with shape[3,3,256,256] and type float on /job:localhost/replica:0/task:0/device:GPU:0 by allocator GPU_0_bfc RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 Exception in mask_detect : OOM when allocating tensor with shape[3,3,256,256] and type float on /job:localhost/replica:0/task:0/device:GPU:0 by allocator GPU_0_bfc [Op:Mul] we want to redo the detection Using TensorFlow backend. max_time_sub_proc : 3600 erreur pendant la detection Useless call to update_current_state in case -12 caffe_path_current : About to save ! 1 Inside saveOutput : final : True verbose : False eke 12-6-18 : saveMask need to be cleaned for new output ! ERROR : mask output needs to be a dictionnary now ! No output to save, continue without doing anything ! save missing photos in datou_result : After save, about to update current ! datou_cur_ids : [] len(datou.list_steps) : 1 output : -12 free memory after detection : begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 14 ############################### TEST detect object ################################ run mask_detect Inside batchDatouExec : verbose : False Catched exception ! Connect or reconnect ! # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : mask_detect list_input_json : [] origin BFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 1 ; length of list_pids : 1 ; length of list_args : 1 time to download the photos : 0.1894373893737793 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : False number of steps : 1 step1:mask_detect Tue Dec 16 05:21:06 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory havn't enough memory gpu , need / 3000 l 3632 free memory gpu now : 417 wait 20 seconds l 3637 free memory gpu now : 417 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-12-16 05:21:30.313798: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-12-16 05:21:30.342582: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493010000 Hz 2025-12-16 05:21:30.344324: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f3ee4000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-12-16 05:21:30.344381: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-12-16 05:21:30.347118: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-12-16 05:21:30.592878: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x19900670 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-12-16 05:21:30.592939: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-12-16 05:21:30.593673: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-12-16 05:21:30.594155: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-12-16 05:21:30.597554: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-12-16 05:21:30.600723: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-12-16 05:21:30.601261: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-12-16 05:21:30.604523: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-12-16 05:21:30.605571: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-12-16 05:21:30.610100: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-12-16 05:21:30.611006: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-12-16 05:21:30.611096: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-12-16 05:21:30.611573: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-12-16 05:21:30.611589: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-12-16 05:21:30.611599: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-12-16 05:21:30.612299: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 40 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl454 thcls : [{'id': 454, 'mtr_user_id': 31, 'name': 'mask_coco_origin', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'backgroud,person,bicycle,car,motorcycle,airplane,bus,train,truck,boat,trafficlight,firehydrant,stopsign,parkingmeter,bench,bird,cat,dog,horse,sheep,cow,elephant,bear,zebra,giraffe,backpack,umbrella,handbag,tie,suitcase,frisbee,skis,snowboard,sportsball,kite,baseballbat,baseballglove,skateboard,surfboard,tennisracket,bottle,wineglass,cup,fork,knife,spoon,bowl,banana,apple,sandwich,orange,broccoli,carrot,hotdog,pizza,donut,cake,chair,couch,pottedplant,bed,diningtable,toilet,tv,laptop,mouse,remote,keyboard,cellphone,microwave,oven,toaster,sink,refrigerator,book,clock,vase,scissors,teddybear,hairdrier,toothbrush', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 445, 'photo_desc_type': 3473, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0'}] thcl {'id': 454, 'mtr_user_id': 31, 'name': 'mask_coco_origin', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'backgroud,person,bicycle,car,motorcycle,airplane,bus,train,truck,boat,trafficlight,firehydrant,stopsign,parkingmeter,bench,bird,cat,dog,horse,sheep,cow,elephant,bear,zebra,giraffe,backpack,umbrella,handbag,tie,suitcase,frisbee,skis,snowboard,sportsball,kite,baseballbat,baseballglove,skateboard,surfboard,tennisracket,bottle,wineglass,cup,fork,knife,spoon,bowl,banana,apple,sandwich,orange,broccoli,carrot,hotdog,pizza,donut,cake,chair,couch,pottedplant,bed,diningtable,toilet,tv,laptop,mouse,remote,keyboard,cellphone,microwave,oven,toaster,sink,refrigerator,book,clock,vase,scissors,teddybear,hairdrier,toothbrush', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 445, 'photo_desc_type': 3473, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 3473 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (3473, 'mask_coco_origin', 16384, 25088, 'mask_coco_origin', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2018, 3, 19, 10, 42, 21), datetime.datetime(2018, 3, 19, 10, 42, 21)) {'thcl': {'id': 454, 'mtr_user_id': 31, 'name': 'mask_coco_origin', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'backgroud,person,bicycle,car,motorcycle,airplane,bus,train,truck,boat,trafficlight,firehydrant,stopsign,parkingmeter,bench,bird,cat,dog,horse,sheep,cow,elephant,bear,zebra,giraffe,backpack,umbrella,handbag,tie,suitcase,frisbee,skis,snowboard,sportsball,kite,baseballbat,baseballglove,skateboard,surfboard,tennisracket,bottle,wineglass,cup,fork,knife,spoon,bowl,banana,apple,sandwich,orange,broccoli,carrot,hotdog,pizza,donut,cake,chair,couch,pottedplant,bed,diningtable,toilet,tv,laptop,mouse,remote,keyboard,cellphone,microwave,oven,toaster,sink,refrigerator,book,clock,vase,scissors,teddybear,hairdrier,toothbrush', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 445, 'photo_desc_type': 3473, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['backgroud', 'person', 'bicycle', 'car', 'motorcycle', 'airplane', 'bus', 'train', 'truck', 'boat', 'trafficlight', 'firehydrant', 'stopsign', 'parkingmeter', 'bench', 'bird', 'cat', 'dog', 'horse', 'sheep', 'cow', 'elephant', 'bear', 'zebra', 'giraffe', 'backpack', 'umbrella', 'handbag', 'tie', 'suitcase', 'frisbee', 'skis', 'snowboard', 'sportsball', 'kite', 'baseballbat', 'baseballglove', 'skateboard', 'surfboard', 'tennisracket', 'bottle', 'wineglass', 'cup', 'fork', 'knife', 'spoon', 'bowl', 'banana', 'apple', 'sandwich', 'orange', 'broccoli', 'carrot', 'hotdog', 'pizza', 'donut', 'cake', 'chair', 'couch', 'pottedplant', 'bed', 'diningtable', 'toilet', 'tv', 'laptop', 'mouse', 'remote', 'keyboard', 'cellphone', 'microwave', 'oven', 'toaster', 'sink', 'refrigerator', 'book', 'clock', 'vase', 'scissors', 'teddybear', 'hairdrier', 'toothbrush'], 'list_hashtags_csv': 'backgroud,person,bicycle,car,motorcycle,airplane,bus,train,truck,boat,trafficlight,firehydrant,stopsign,parkingmeter,bench,bird,cat,dog,horse,sheep,cow,elephant,bear,zebra,giraffe,backpack,umbrella,handbag,tie,suitcase,frisbee,skis,snowboard,sportsball,kite,baseballbat,baseballglove,skateboard,surfboard,tennisracket,bottle,wineglass,cup,fork,knife,spoon,bowl,banana,apple,sandwich,orange,broccoli,carrot,hotdog,pizza,donut,cake,chair,couch,pottedplant,bed,diningtable,toilet,tv,laptop,mouse,remote,keyboard,cellphone,microwave,oven,toaster,sink,refrigerator,book,clock,vase,scissors,teddybear,hairdrier,toothbrush', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 445, 'svm_hashtag_type_desc': 3473, 'photo_desc_type': 3473, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['backgroud', 'person', 'bicycle', 'car', 'motorcycle', 'airplane', 'bus', 'train', 'truck', 'boat', 'trafficlight', 'firehydrant', 'stopsign', 'parkingmeter', 'bench', 'bird', 'cat', 'dog', 'horse', 'sheep', 'cow', 'elephant', 'bear', 'zebra', 'giraffe', 'backpack', 'umbrella', 'handbag', 'tie', 'suitcase', 'frisbee', 'skis', 'snowboard', 'sportsball', 'kite', 'baseballbat', 'baseballglove', 'skateboard', 'surfboard', 'tennisracket', 'bottle', 'wineglass', 'cup', 'fork', 'knife', 'spoon', 'bowl', 'banana', 'apple', 'sandwich', 'orange', 'broccoli', 'carrot', 'hotdog', 'pizza', 'donut', 'cake', 'chair', 'couch', 'pottedplant', 'bed', 'diningtable', 'toilet', 'tv', 'laptop', 'mouse', 'remote', 'keyboard', 'cellphone', 'microwave', 'oven', 'toaster', 'sink', 'refrigerator', 'book', 'clock', 'vase', 'scissors', 'teddybear', 'hairdrier', 'toothbrush'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME mask_coco_origin NUM_CLASSES 81 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 2025-12-16 05:21:31.340825: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-12-16 05:21:31.340899: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-12-16 05:21:31.340919: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-12-16 05:21:31.340938: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-12-16 05:21:31.340955: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-12-16 05:21:31.340973: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-12-16 05:21:31.340991: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-12-16 05:21:31.341012: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-12-16 05:21:31.341629: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-12-16 05:21:31.342547: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-12-16 05:21:31.342580: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-12-16 05:21:31.342598: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-12-16 05:21:31.342615: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-12-16 05:21:31.342642: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-12-16 05:21:31.342659: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-12-16 05:21:31.342675: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-12-16 05:21:31.342692: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-12-16 05:21:31.343346: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-12-16 05:21:31.343379: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-12-16 05:21:31.343388: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-12-16 05:21:31.343396: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-12-16 05:21:31.344095: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 40 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) 2025-12-16 05:21:42.557374: W tensorflow/core/common_runtime/bfc_allocator.cc:434] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.25MiB (rounded to 2359296) Current allocation summary follows. 2025-12-16 05:21:42.557449: I tensorflow/core/common_runtime/bfc_allocator.cc:934] BFCAllocator dump for GPU_0_bfc 2025-12-16 05:21:42.557472: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (256): Total Chunks: 59, Chunks in use: 59. 14.8KiB allocated for chunks. 14.8KiB in use in bin. 8.8KiB client-requested in use in bin. 2025-12-16 05:21:42.557490: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (512): Total Chunks: 40, Chunks in use: 40. 20.0KiB allocated for chunks. 20.0KiB in use in bin. 20.0KiB client-requested in use in bin. 2025-12-16 05:21:42.557507: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (1024): Total Chunks: 76, Chunks in use: 76. 76.2KiB allocated for chunks. 76.2KiB in use in bin. 76.0KiB client-requested in use in bin. 2025-12-16 05:21:42.557523: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (2048): Total Chunks: 25, Chunks in use: 25. 50.0KiB allocated for chunks. 50.0KiB in use in bin. 50.0KiB client-requested in use in bin. 2025-12-16 05:21:42.557540: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (4096): Total Chunks: 30, Chunks in use: 30. 123.5KiB allocated for chunks. 123.5KiB in use in bin. 120.0KiB client-requested in use in bin. 2025-12-16 05:21:42.557557: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (8192): Total Chunks: 1, Chunks in use: 0. 15.0KiB allocated for chunks. 0B in use in bin. 0B client-requested in use in bin. 2025-12-16 05:21:42.557573: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (16384): Total Chunks: 1, Chunks in use: 1. 16.0KiB allocated for chunks. 16.0KiB in use in bin. 16.0KiB client-requested in use in bin. 2025-12-16 05:21:42.557589: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (32768): Total Chunks: 1, Chunks in use: 1. 36.8KiB allocated for chunks. 36.8KiB in use in bin. 36.8KiB client-requested in use in bin. 2025-12-16 05:21:42.557606: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (65536): Total Chunks: 6, Chunks in use: 6. 384.0KiB allocated for chunks. 384.0KiB in use in bin. 384.0KiB client-requested in use in bin. 2025-12-16 05:21:42.557622: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (131072): Total Chunks: 4, Chunks in use: 4. 560.0KiB allocated for chunks. 560.0KiB in use in bin. 560.0KiB client-requested in use in bin. 2025-12-16 05:21:42.557638: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (262144): Total Chunks: 9, Chunks in use: 7. 2.41MiB allocated for chunks. 1.91MiB in use in bin. 1.75MiB client-requested in use in bin. 2025-12-16 05:21:42.557688: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (524288): Total Chunks: 8, Chunks in use: 6. 4.95MiB allocated for chunks. 3.44MiB in use in bin. 3.25MiB client-requested in use in bin. 2025-12-16 05:21:42.557705: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (1048576): Total Chunks: 12, Chunks in use: 10. 13.12MiB allocated for chunks. 10.88MiB in use in bin. 10.00MiB client-requested in use in bin. 2025-12-16 05:21:42.557722: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (2097152): Total Chunks: 8, Chunks in use: 8. 19.12MiB allocated for chunks. 19.12MiB in use in bin. 17.75MiB client-requested in use in bin. 2025-12-16 05:21:42.557736: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (4194304): Total Chunks: 0, Chunks in use: 0. 0B allocated for chunks. 0B in use in bin. 0B client-requested in use in bin. 2025-12-16 05:21:42.557751: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (8388608): Total Chunks: 0, Chunks in use: 0. 0B allocated for chunks. 0B in use in bin. 0B client-requested in use in bin. 2025-12-16 05:21:42.557765: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (16777216): Total Chunks: 0, Chunks in use: 0. 0B allocated for chunks. 0B in use in bin. 0B client-requested in use in bin. 2025-12-16 05:21:42.557779: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (33554432): Total Chunks: 0, Chunks in use: 0. 0B allocated for chunks. 0B in use in bin. 0B client-requested in use in bin. 2025-12-16 05:21:42.557793: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (67108864): Total Chunks: 0, Chunks in use: 0. 0B allocated for chunks. 0B in use in bin. 0B client-requested in use in bin. 2025-12-16 05:21:42.557807: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (134217728): Total Chunks: 0, Chunks in use: 0. 0B allocated for chunks. 0B in use in bin. 0B client-requested in use in bin. 2025-12-16 05:21:42.557821: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (268435456): Total Chunks: 0, Chunks in use: 0. 0B allocated for chunks. 0B in use in bin. 0B client-requested in use in bin. 2025-12-16 05:21:42.557836: I tensorflow/core/common_runtime/bfc_allocator.cc:957] Bin for 2.25MiB was 2.00MiB, Chunk State: 2025-12-16 05:21:42.557849: I tensorflow/core/common_runtime/bfc_allocator.cc:970] Next region of size 16777216 2025-12-16 05:21:42.557869: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d06000000 of size 2359296 next 181 2025-12-16 05:21:42.557882: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d06240000 of size 2097152 next 196 2025-12-16 05:21:42.557895: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d06440000 of size 1048576 next 216 2025-12-16 05:21:42.557907: I tensorflow/core/common_runtime/bfc_allocator.cc:990] Free at 7f3d06540000 of size 1310720 next 209 2025-12-16 05:21:42.557920: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d06680000 of size 2359296 next 208 2025-12-16 05:21:42.557932: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d068c0000 of size 1048576 next 234 2025-12-16 05:21:42.557945: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d069c0000 of size 1310720 next 228 2025-12-16 05:21:42.557958: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d06b00000 of size 2359296 next 227 2025-12-16 05:21:42.557971: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d06d40000 of size 2883584 next 18446744073709551615 2025-12-16 05:21:42.557983: I tensorflow/core/common_runtime/bfc_allocator.cc:970] Next region of size 10354688 2025-12-16 05:21:42.557995: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d07000000 of size 2359296 next 245 2025-12-16 05:21:42.558008: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d07240000 of size 1048576 next 269 2025-12-16 05:21:42.558030: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d07340000 of size 1310720 next 263 2025-12-16 05:21:42.558043: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d07480000 of size 2359296 next 262 2025-12-16 05:21:42.558055: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d076c0000 of size 3276800 next 18446744073709551615 2025-12-16 05:21:42.558068: I tensorflow/core/common_runtime/bfc_allocator.cc:970] Next region of size 2097152 2025-12-16 05:21:42.558080: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d08600000 of size 147456 next 55 2025-12-16 05:21:42.558093: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d08624000 of size 65536 next 78 2025-12-16 05:21:42.558106: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d08634000 of size 4096 next 191 2025-12-16 05:21:42.558118: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d08635000 of size 4096 next 192 2025-12-16 05:21:42.558131: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d08636000 of size 4096 next 193 2025-12-16 05:21:42.558143: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d08637000 of size 256 next 194 2025-12-16 05:21:42.558156: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d08637100 of size 256 next 195 2025-12-16 05:21:42.558168: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d08637200 of size 4096 next 197 2025-12-16 05:21:42.558180: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d08638200 of size 4096 next 198 2025-12-16 05:21:42.558193: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d08639200 of size 4096 next 199 2025-12-16 05:21:42.558205: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d0863a200 of size 4096 next 200 2025-12-16 05:21:42.558217: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d0863b200 of size 4096 next 201 2025-12-16 05:21:42.558230: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d0863c200 of size 1024 next 202 2025-12-16 05:21:42.558242: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d0863c600 of size 1024 next 204 2025-12-16 05:21:42.558255: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d0863ca00 of size 1024 next 205 2025-12-16 05:21:42.558267: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d0863ce00 of size 1024 next 206 2025-12-16 05:21:42.558297: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d0863d200 of size 1024 next 207 2025-12-16 05:21:42.558310: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d0863d600 of size 1024 next 210 2025-12-16 05:21:42.558323: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d0863da00 of size 1024 next 211 2025-12-16 05:21:42.558335: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d0863de00 of size 1024 next 212 2025-12-16 05:21:42.558347: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d0863e200 of size 1024 next 213 2025-12-16 05:21:42.558360: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d0863e600 of size 1024 next 214 2025-12-16 05:21:42.558375: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d0863ea00 of size 4096 next 215 2025-12-16 05:21:42.558391: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d0863fa00 of size 4096 next 217 2025-12-16 05:21:42.558404: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d08640a00 of size 4096 next 218 2025-12-16 05:21:42.558416: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d08641a00 of size 4096 next 219 2025-12-16 05:21:42.558428: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d08642a00 of size 4096 next 220 2025-12-16 05:21:42.558440: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d08643a00 of size 1024 next 221 2025-12-16 05:21:42.558453: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d08643e00 of size 1024 next 223 2025-12-16 05:21:42.558474: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d08644200 of size 1024 next 224 2025-12-16 05:21:42.558487: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d08644600 of size 1024 next 225 2025-12-16 05:21:42.558499: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d08644a00 of size 1024 next 226 2025-12-16 05:21:42.558511: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d08644e00 of size 1024 next 229 2025-12-16 05:21:42.558523: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d08645200 of size 1024 next 230 2025-12-16 05:21:42.558535: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d08645600 of size 1024 next 231 2025-12-16 05:21:42.558547: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d08645a00 of size 1024 next 232 2025-12-16 05:21:42.558559: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d08645e00 of size 1024 next 233 2025-12-16 05:21:42.558572: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d08646200 of size 7680 next 72 2025-12-16 05:21:42.558584: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d08648000 of size 147456 next 71 2025-12-16 05:21:42.558597: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d0866c000 of size 131072 next 87 2025-12-16 05:21:42.558609: I tensorflow/core/common_runtime/bfc_allocator.cc:990] Free at 7f3d0868c000 of size 262144 next 103 2025-12-16 05:21:42.558621: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d086cc000 of size 262144 next 102 2025-12-16 05:21:42.558633: I tensorflow/core/common_runtime/bfc_allocator.cc:990] Free at 7f3d0870c000 of size 999424 next 18446744073709551615 2025-12-16 05:21:42.558645: I tensorflow/core/common_runtime/bfc_allocator.cc:970] Next region of size 4194304 2025-12-16 05:21:42.558658: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d08800000 of size 589824 next 96 2025-12-16 05:21:42.558670: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d08890000 of size 262144 next 117 2025-12-16 05:21:42.558682: I tensorflow/core/common_runtime/bfc_allocator.cc:990] Free at 7f3d088d0000 of size 262144 next 112 2025-12-16 05:21:42.558695: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d08910000 of size 524288 next 111 2025-12-16 05:21:42.558707: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d08990000 of size 262144 next 135 2025-12-16 05:21:42.558719: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d089d0000 of size 327680 next 124 2025-12-16 05:21:42.558731: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d08a20000 of size 589824 next 123 2025-12-16 05:21:42.558743: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d08ab0000 of size 262144 next 152 2025-12-16 05:21:42.558755: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d08af0000 of size 327680 next 142 2025-12-16 05:21:42.558768: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d08b40000 of size 786432 next 18446744073709551615 2025-12-16 05:21:42.558780: I tensorflow/core/common_runtime/bfc_allocator.cc:970] Next region of size 8388608 2025-12-16 05:21:42.558792: I tensorflow/core/common_runtime/bfc_allocator.cc:990] Free at 7f3d08c00000 of size 589824 next 160 2025-12-16 05:21:42.558804: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d08c90000 of size 589824 next 158 2025-12-16 05:21:42.558816: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d08d20000 of size 524288 next 171 2025-12-16 05:21:42.558828: I tensorflow/core/common_runtime/bfc_allocator.cc:990] Free at 7f3d08da0000 of size 1048576 next 222 2025-12-16 05:21:42.558840: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d08ea0000 of size 1048576 next 190 2025-12-16 05:21:42.558852: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d08fa0000 of size 1048576 next 189 2025-12-16 05:21:42.558873: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d090a0000 of size 1048576 next 203 2025-12-16 05:21:42.558886: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d091a0000 of size 1048576 next 251 2025-12-16 05:21:42.558898: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3d092a0000 of size 1441792 next 18446744073709551615 2025-12-16 05:21:42.558910: I tensorflow/core/common_runtime/bfc_allocator.cc:970] Next region of size 1048576 2025-12-16 05:21:42.558923: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e00000 of size 1280 next 1 2025-12-16 05:21:42.558935: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e00500 of size 256 next 5 2025-12-16 05:21:42.558947: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e00600 of size 256 next 8 2025-12-16 05:21:42.558959: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e00700 of size 256 next 9 2025-12-16 05:21:42.558971: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e00800 of size 256 next 10 2025-12-16 05:21:42.558983: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e00900 of size 256 next 11 2025-12-16 05:21:42.558995: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e00a00 of size 256 next 12 2025-12-16 05:21:42.559008: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e00b00 of size 256 next 13 2025-12-16 05:21:42.559019: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e00c00 of size 256 next 17 2025-12-16 05:21:42.559031: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e00d00 of size 256 next 19 2025-12-16 05:21:42.559044: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e00e00 of size 256 next 20 2025-12-16 05:21:42.559056: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e00f00 of size 256 next 21 2025-12-16 05:21:42.559068: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e01000 of size 256 next 22 2025-12-16 05:21:42.559080: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e01100 of size 256 next 24 2025-12-16 05:21:42.559092: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e01200 of size 256 next 25 2025-12-16 05:21:42.559104: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e01300 of size 256 next 23 2025-12-16 05:21:42.559116: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e01400 of size 256 next 28 2025-12-16 05:21:42.559128: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e01500 of size 256 next 29 2025-12-16 05:21:42.559140: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e01600 of size 256 next 30 2025-12-16 05:21:42.559152: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e01700 of size 256 next 31 2025-12-16 05:21:42.559164: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e01800 of size 256 next 33 2025-12-16 05:21:42.559176: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e01900 of size 256 next 34 2025-12-16 05:21:42.559188: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e01a00 of size 1024 next 32 2025-12-16 05:21:42.559200: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e01e00 of size 1024 next 37 2025-12-16 05:21:42.559212: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e02200 of size 1024 next 38 2025-12-16 05:21:42.559224: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e02600 of size 1024 next 39 2025-12-16 05:21:42.559236: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e02a00 of size 1024 next 40 2025-12-16 05:21:42.559248: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e02e00 of size 1024 next 41 2025-12-16 05:21:42.559268: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e03200 of size 1024 next 43 2025-12-16 05:21:42.559281: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e03600 of size 1024 next 44 2025-12-16 05:21:42.559293: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e03a00 of size 1024 next 45 2025-12-16 05:21:42.559305: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e03e00 of size 1024 next 46 2025-12-16 05:21:42.559317: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e04200 of size 256 next 48 2025-12-16 05:21:42.559329: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e04300 of size 256 next 49 2025-12-16 05:21:42.559341: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e04400 of size 256 next 50 2025-12-16 05:21:42.559353: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e04500 of size 256 next 51 2025-12-16 05:21:42.559365: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e04600 of size 256 next 52 2025-12-16 05:21:42.559378: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e04700 of size 256 next 53 2025-12-16 05:21:42.559390: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e04800 of size 256 next 56 2025-12-16 05:21:42.559402: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e04900 of size 256 next 57 2025-12-16 05:21:42.559414: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e04a00 of size 256 next 58 2025-12-16 05:21:42.559426: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e04b00 of size 256 next 14 2025-12-16 05:21:42.559438: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e04c00 of size 256 next 15 2025-12-16 05:21:42.559450: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e04d00 of size 256 next 16 2025-12-16 05:21:42.559462: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e04e00 of size 1024 next 60 2025-12-16 05:21:42.559474: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e05200 of size 1024 next 61 2025-12-16 05:21:42.559486: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e05600 of size 1024 next 62 2025-12-16 05:21:42.559498: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e05a00 of size 1024 next 63 2025-12-16 05:21:42.559510: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e05e00 of size 1024 next 64 2025-12-16 05:21:42.559522: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e06200 of size 256 next 66 2025-12-16 05:21:42.559534: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e06300 of size 256 next 67 2025-12-16 05:21:42.559546: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e06400 of size 256 next 68 2025-12-16 05:21:42.559559: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e06500 of size 256 next 69 2025-12-16 05:21:42.559573: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e06600 of size 256 next 70 2025-12-16 05:21:42.559587: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e06700 of size 256 next 73 2025-12-16 05:21:42.559601: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e06800 of size 256 next 74 2025-12-16 05:21:42.559615: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e06900 of size 256 next 75 2025-12-16 05:21:42.559628: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e06a00 of size 256 next 76 2025-12-16 05:21:42.559641: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e06b00 of size 256 next 77 2025-12-16 05:21:42.559653: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e06c00 of size 1024 next 79 2025-12-16 05:21:42.559665: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e07000 of size 1024 next 80 2025-12-16 05:21:42.559686: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e07400 of size 1024 next 81 2025-12-16 05:21:42.559699: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e07800 of size 1024 next 82 2025-12-16 05:21:42.559711: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e07c00 of size 1024 next 83 2025-12-16 05:21:42.559724: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e08000 of size 256 next 85 2025-12-16 05:21:42.559736: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e08100 of size 256 next 86 2025-12-16 05:21:42.559749: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e08200 of size 512 next 84 2025-12-16 05:21:42.559761: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e08400 of size 512 next 88 2025-12-16 05:21:42.559773: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e08600 of size 512 next 89 2025-12-16 05:21:42.559786: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e08800 of size 512 next 90 2025-12-16 05:21:42.559798: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e08a00 of size 512 next 91 2025-12-16 05:21:42.559810: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e08c00 of size 256 next 93 2025-12-16 05:21:42.559823: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e08d00 of size 256 next 94 2025-12-16 05:21:42.559835: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e08e00 of size 512 next 92 2025-12-16 05:21:42.559847: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e09000 of size 512 next 97 2025-12-16 05:21:42.559860: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e09200 of size 512 next 98 2025-12-16 05:21:42.559872: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e09400 of size 512 next 99 2025-12-16 05:21:42.559885: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e09600 of size 512 next 2 2025-12-16 05:21:42.559897: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e09800 of size 256 next 3 2025-12-16 05:21:42.559909: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e09900 of size 256 next 4 2025-12-16 05:21:42.559922: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e09a00 of size 16384 next 18 2025-12-16 05:21:42.559934: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e0da00 of size 256 next 100 2025-12-16 05:21:42.559947: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e0db00 of size 256 next 101 2025-12-16 05:21:42.559959: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e0dc00 of size 2048 next 104 2025-12-16 05:21:42.559972: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e0e400 of size 2048 next 105 2025-12-16 05:21:42.559984: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e0ec00 of size 2048 next 106 2025-12-16 05:21:42.559997: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e0f400 of size 2048 next 107 2025-12-16 05:21:42.560009: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e0fc00 of size 2048 next 108 2025-12-16 05:21:42.560021: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e10400 of size 256 next 109 2025-12-16 05:21:42.560034: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e10500 of size 256 next 110 2025-12-16 05:21:42.560046: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e10600 of size 2048 next 113 2025-12-16 05:21:42.560058: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e10e00 of size 2048 next 114 2025-12-16 05:21:42.560071: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e11600 of size 2048 next 115 2025-12-16 05:21:42.560092: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e11e00 of size 2048 next 116 2025-12-16 05:21:42.560104: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e12600 of size 2048 next 6 2025-12-16 05:21:42.560117: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e12e00 of size 37632 next 7 2025-12-16 05:21:42.560130: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e1c100 of size 512 next 118 2025-12-16 05:21:42.560142: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e1c300 of size 512 next 119 2025-12-16 05:21:42.560154: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e1c500 of size 512 next 120 2025-12-16 05:21:42.560167: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e1c700 of size 512 next 121 2025-12-16 05:21:42.560179: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e1c900 of size 512 next 122 2025-12-16 05:21:42.560191: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e1cb00 of size 512 next 125 2025-12-16 05:21:42.560203: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e1cd00 of size 512 next 126 2025-12-16 05:21:42.560216: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e1cf00 of size 512 next 127 2025-12-16 05:21:42.560228: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e1d100 of size 512 next 128 2025-12-16 05:21:42.560240: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e1d300 of size 512 next 129 2025-12-16 05:21:42.560252: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e1d500 of size 2048 next 130 2025-12-16 05:21:42.560265: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e1dd00 of size 2048 next 131 2025-12-16 05:21:42.560277: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e1e500 of size 2048 next 132 2025-12-16 05:21:42.560289: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e1ed00 of size 2048 next 133 2025-12-16 05:21:42.560302: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e1f500 of size 2048 next 134 2025-12-16 05:21:42.560314: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e1fd00 of size 512 next 136 2025-12-16 05:21:42.560326: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e1ff00 of size 512 next 137 2025-12-16 05:21:42.560339: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e20100 of size 512 next 138 2025-12-16 05:21:42.560351: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e20300 of size 512 next 139 2025-12-16 05:21:42.560363: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e20500 of size 512 next 140 2025-12-16 05:21:42.560375: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e20700 of size 512 next 141 2025-12-16 05:21:42.560388: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e20900 of size 512 next 143 2025-12-16 05:21:42.560400: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e20b00 of size 512 next 144 2025-12-16 05:21:42.560412: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e20d00 of size 512 next 145 2025-12-16 05:21:42.560424: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e20f00 of size 512 next 146 2025-12-16 05:21:42.560437: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e21100 of size 2048 next 147 2025-12-16 05:21:42.560449: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e21900 of size 2048 next 148 2025-12-16 05:21:42.560461: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e22100 of size 2048 next 149 2025-12-16 05:21:42.560474: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e22900 of size 2048 next 150 2025-12-16 05:21:42.560486: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e23100 of size 2048 next 151 2025-12-16 05:21:42.560507: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e23900 of size 512 next 153 2025-12-16 05:21:42.560520: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e23b00 of size 512 next 154 2025-12-16 05:21:42.560532: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e23d00 of size 512 next 155 2025-12-16 05:21:42.560545: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e23f00 of size 512 next 156 2025-12-16 05:21:42.560557: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e24100 of size 512 next 157 2025-12-16 05:21:42.560569: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e24300 of size 512 next 161 2025-12-16 05:21:42.560581: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e24500 of size 512 next 162 2025-12-16 05:21:42.560594: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e24700 of size 512 next 163 2025-12-16 05:21:42.560606: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e24900 of size 512 next 164 2025-12-16 05:21:42.560618: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e24b00 of size 512 next 165 2025-12-16 05:21:42.560631: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e24d00 of size 2048 next 166 2025-12-16 05:21:42.560643: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e25500 of size 2048 next 167 2025-12-16 05:21:42.560655: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e25d00 of size 2048 next 168 2025-12-16 05:21:42.560667: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e26500 of size 2048 next 169 2025-12-16 05:21:42.560680: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e26d00 of size 2048 next 170 2025-12-16 05:21:42.560692: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e27500 of size 1024 next 172 2025-12-16 05:21:42.560704: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e27900 of size 1024 next 173 2025-12-16 05:21:42.560717: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e27d00 of size 1024 next 174 2025-12-16 05:21:42.560729: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e28100 of size 1024 next 175 2025-12-16 05:21:42.560741: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e28500 of size 1024 next 176 2025-12-16 05:21:42.560754: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e28900 of size 256 next 178 2025-12-16 05:21:42.560766: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e28a00 of size 256 next 179 2025-12-16 05:21:42.560778: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e28b00 of size 1024 next 177 2025-12-16 05:21:42.560791: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e28f00 of size 1024 next 182 2025-12-16 05:21:42.560803: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e29300 of size 1024 next 183 2025-12-16 05:21:42.560815: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e29700 of size 1024 next 184 2025-12-16 05:21:42.560828: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e29b00 of size 1024 next 185 2025-12-16 05:21:42.560840: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e29f00 of size 256 next 187 2025-12-16 05:21:42.560852: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e2a000 of size 256 next 188 2025-12-16 05:21:42.560864: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e2a100 of size 4096 next 186 2025-12-16 05:21:42.560877: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e2b100 of size 4096 next 42 2025-12-16 05:21:42.560889: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e2c100 of size 65536 next 36 2025-12-16 05:21:42.560910: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e3c100 of size 65536 next 35 2025-12-16 05:21:42.560922: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e4c100 of size 4096 next 235 2025-12-16 05:21:42.560935: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e4d100 of size 4096 next 236 2025-12-16 05:21:42.560947: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e4e100 of size 4096 next 237 2025-12-16 05:21:42.560959: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e4f100 of size 4096 next 238 2025-12-16 05:21:42.560972: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e50100 of size 1024 next 239 2025-12-16 05:21:42.560984: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e50500 of size 1024 next 240 2025-12-16 05:21:42.560996: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e50900 of size 1024 next 241 2025-12-16 05:21:42.561009: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e50d00 of size 1024 next 242 2025-12-16 05:21:42.561021: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e51100 of size 1024 next 243 2025-12-16 05:21:42.561033: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e51500 of size 1024 next 246 2025-12-16 05:21:42.561045: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e51900 of size 1024 next 247 2025-12-16 05:21:42.561058: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e51d00 of size 1024 next 248 2025-12-16 05:21:42.561070: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e52100 of size 1024 next 249 2025-12-16 05:21:42.561082: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e52500 of size 1024 next 250 2025-12-16 05:21:42.561095: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e52900 of size 4096 next 252 2025-12-16 05:21:42.561107: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e53900 of size 4096 next 253 2025-12-16 05:21:42.561119: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e54900 of size 4096 next 254 2025-12-16 05:21:42.561131: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e55900 of size 4096 next 255 2025-12-16 05:21:42.561144: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e56900 of size 4096 next 256 2025-12-16 05:21:42.561156: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e57900 of size 1024 next 257 2025-12-16 05:21:42.561168: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e57d00 of size 1024 next 258 2025-12-16 05:21:42.561181: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e58100 of size 1024 next 259 2025-12-16 05:21:42.561193: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e58500 of size 1024 next 260 2025-12-16 05:21:42.561205: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e58900 of size 1024 next 261 2025-12-16 05:21:42.561217: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e58d00 of size 1024 next 264 2025-12-16 05:21:42.561230: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e59100 of size 1024 next 265 2025-12-16 05:21:42.561242: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e59500 of size 1024 next 266 2025-12-16 05:21:42.561254: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e59900 of size 1024 next 267 2025-12-16 05:21:42.561267: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e59d00 of size 1024 next 268 2025-12-16 05:21:42.561279: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e5a100 of size 4096 next 270 2025-12-16 05:21:42.561291: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e5b100 of size 4096 next 271 2025-12-16 05:21:42.561312: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e5c100 of size 4096 next 272 2025-12-16 05:21:42.561325: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e5d100 of size 4096 next 273 2025-12-16 05:21:42.561337: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e5e100 of size 4096 next 274 2025-12-16 05:21:42.561349: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e5f100 of size 1024 next 275 2025-12-16 05:21:42.561362: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e5f500 of size 1024 next 276 2025-12-16 05:21:42.561374: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e5f900 of size 1024 next 277 2025-12-16 05:21:42.561386: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e5fd00 of size 1024 next 278 2025-12-16 05:21:42.561398: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e60100 of size 1024 next 279 2025-12-16 05:21:42.561411: I tensorflow/core/common_runtime/bfc_allocator.cc:990] Free at 7f3e40e60500 of size 15360 next 27 2025-12-16 05:21:42.561423: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e64100 of size 147456 next 26 2025-12-16 05:21:42.561435: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e88100 of size 65536 next 47 2025-12-16 05:21:42.561448: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40e98100 of size 65536 next 59 2025-12-16 05:21:42.561460: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40ea8100 of size 65536 next 65 2025-12-16 05:21:42.561473: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f3e40eb8100 of size 294656 next 18446744073709551615 2025-12-16 05:21:42.561485: I tensorflow/core/common_runtime/bfc_allocator.cc:995] Summary of in-use Chunks by size: 2025-12-16 05:21:42.561501: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 59 Chunks of size 256 totalling 14.8KiB 2025-12-16 05:21:42.561515: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 40 Chunks of size 512 totalling 20.0KiB 2025-12-16 05:21:42.561529: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 75 Chunks of size 1024 totalling 75.0KiB 2025-12-16 05:21:42.561543: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 1280 totalling 1.2KiB 2025-12-16 05:21:42.561557: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 25 Chunks of size 2048 totalling 50.0KiB 2025-12-16 05:21:42.561571: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 29 Chunks of size 4096 totalling 116.0KiB 2025-12-16 05:21:42.561585: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 7680 totalling 7.5KiB 2025-12-16 05:21:42.561599: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 16384 totalling 16.0KiB 2025-12-16 05:21:42.561613: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 37632 totalling 36.8KiB 2025-12-16 05:21:42.561627: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 6 Chunks of size 65536 totalling 384.0KiB 2025-12-16 05:21:42.561641: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 131072 totalling 128.0KiB 2025-12-16 05:21:42.561655: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 3 Chunks of size 147456 totalling 432.0KiB 2025-12-16 05:21:42.561669: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 4 Chunks of size 262144 totalling 1.00MiB 2025-12-16 05:21:42.561683: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 294656 totalling 287.8KiB 2025-12-16 05:21:42.561697: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 2 Chunks of size 327680 totalling 640.0KiB 2025-12-16 05:21:42.561710: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 2 Chunks of size 524288 totalling 1.00MiB 2025-12-16 05:21:42.561724: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 3 Chunks of size 589824 totalling 1.69MiB 2025-12-16 05:21:42.561738: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 786432 totalling 768.0KiB 2025-12-16 05:21:42.561761: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 7 Chunks of size 1048576 totalling 7.00MiB 2025-12-16 05:21:42.561775: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 2 Chunks of size 1310720 totalling 2.50MiB 2025-12-16 05:21:42.561789: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 1441792 totalling 1.38MiB 2025-12-16 05:21:42.561802: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 2097152 totalling 2.00MiB 2025-12-16 05:21:42.561816: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 5 Chunks of size 2359296 totalling 11.25MiB 2025-12-16 05:21:42.561830: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 2883584 totalling 2.75MiB 2025-12-16 05:21:42.561844: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 3276800 totalling 3.12MiB 2025-12-16 05:21:42.561858: I tensorflow/core/common_runtime/bfc_allocator.cc:1002] Sum Total of in-use chunks: 36.59MiB 2025-12-16 05:21:42.561870: I tensorflow/core/common_runtime/bfc_allocator.cc:1004] total_region_allocated_bytes_: 42860544 memory_limit_: 42860544 available bytes: 0 curr_region_allocation_bytes_: 67108864 2025-12-16 05:21:42.561889: I tensorflow/core/common_runtime/bfc_allocator.cc:1010] Stats: Limit: 42860544 InUse: 38372352 MaxInUse: 38372608 NumAllocs: 889 MaxAllocSize: 4325376 2025-12-16 05:21:42.561911: W tensorflow/core/common_runtime/bfc_allocator.cc:439] *************__***********************x***********************x***__**********_***__**************** 2025-12-16 05:21:42.561967: W tensorflow/core/framework/op_kernel.cc:1753] OP_REQUIRES failed at cwise_ops_common.h:134 : Resource exhausted: OOM when allocating tensor with shape[3,3,256,256] and type float on /job:localhost/replica:0/task:0/device:GPU:0 by allocator GPU_0_bfc RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 Exception in mask_detect : OOM when allocating tensor with shape[3,3,256,256] and type float on /job:localhost/replica:0/task:0/device:GPU:0 by allocator GPU_0_bfc [Op:Add] we want to redo the detection Using TensorFlow backend. max_time_sub_proc : 3600 erreur pendant la detection Useless call to update_current_state in case -12 caffe_path_current : About to save ! 1 Inside saveOutput : final : True verbose : False eke 12-6-18 : saveMask need to be cleaned for new output ! ERROR : mask output needs to be a dictionnary now ! No output to save, continue without doing anything ! save missing photos in datou_result : After save, about to update current ! datou_cur_ids : [] len(datou.list_steps) : 1 output : -12 ERROR : 'int' object is not subscriptable reconnect to base ! warning , we can't find thcl infos in json_data warning , we can't find pdt infos in json_data #&_# TEST FAILED #&_# : tests/mask_test #&_# Error : invalid literal for int() with base 10: "'int' object is not subscriptable" #&_# END OF TEST #&_# : tests/mask_test #&_# #&_# BEGIN OF TEST : tests/datou_test #&_# /home/admin/workarea/git/Velours/python/tests/datou_test.py Datou All Test python version used : 3 ############################### TEST sam ################################ TEST SAM Inside batchDatouExec : verbose : False # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : sam list_input_json : [] origin BFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 1 ; length of list_pids : 1 ; length of list_args : 1 time to download the photos : 0.29572081565856934 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! WARNING : we have an input that is not a photo, we should get rid of it Calling datou_exec Inside datou_exec : verbose : False number of steps : 1 step1:sam Tue Dec 16 05:21:43 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step sam ! Inside sam : nb paths : 1 ERROR in datou_step_exec, will save and exit ! CUDA error: out of memory CUDA kernel errors might be asynchronously reported at some other API call,so the stacktrace below might be incorrect. For debugging consider passing CUDA_LAUNCH_BLOCKING=1. File "/home/admin/workarea/git/Velours/python/mtr/datou/datou_lib.py", line 2339, in datou_exec output = datou_step_exec(sNext, args, cache, context, map_info, verbose, mtr_user_id) File "/home/admin/workarea/git/Velours/python/mtr/datou/datou_lib.py", line 2440, in datou_step_exec return lib_process.datou_step_sam(param, json_param, args, cache, context, map_info, verbose) File "/home/admin/workarea/git/Velours/python/mtr/datou/lib_step_exec/lib_step_process.py", line 367, in datou_step_sam sam.to(device=device) File "/home/admin/.local/lib/python3.8/site-packages/torch/nn/modules/module.py", line 927, in to return self._apply(convert) File "/home/admin/.local/lib/python3.8/site-packages/torch/nn/modules/module.py", line 579, in _apply module._apply(fn) File "/home/admin/.local/lib/python3.8/site-packages/torch/nn/modules/module.py", line 579, in _apply module._apply(fn) File "/home/admin/.local/lib/python3.8/site-packages/torch/nn/modules/module.py", line 579, in _apply module._apply(fn) File "/home/admin/.local/lib/python3.8/site-packages/torch/nn/modules/module.py", line 602, in _apply param_applied = fn(param) File "/home/admin/.local/lib/python3.8/site-packages/torch/nn/modules/module.py", line 925, in convert return t.to(device, dtype if t.is_floating_point() or t.is_complex() else None, non_blocking) [1189321094] begin to insert list_values into mtr_datou_result : length of list_values in save_final : 1 time used for this insertion : 0.02147674560546875 save_final ERROR in last step sam, CUDA error: out of memory CUDA kernel errors might be asynchronously reported at some other API call,so the stacktrace below might be incorrect. For debugging consider passing CUDA_LAUNCH_BLOCKING=1. time spend for datou_step_exec : 6.694661378860474 time spend to save output : 0.022728919982910156 total time spend for step 0 : 6.717390298843384 need to delete datou_research and reload, so keep current state 1 need to delete datou_research and reload, so keep current state 1 caffe_path_current : About to save ! 2 After save, about to update current ! datou_cur_ids : [] len(datou.list_steps) : 1 output : None ERROR nb objects espect : 98 nb_objects detect : 0 ERROR sam FAILED ############################### TEST frcnn ################################ Inside batchDatouExec : verbose : False # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : frcnn list_input_json : [] origin BFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 1 ; length of list_pids : 1 ; length of list_args : 1 time to download the photos : 0.19790983200073242 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : False number of steps : 1 step1:frcnn Tue Dec 16 05:21:50 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step Faster rcnn ! To loadFromThcl() model_param file didn't exist model_name : detection_plaque_valcor_010622 model_type : caffe_faster_rcnn list file need : ['caffemodel', 'test.prototxt'] file exist in s3 : ['caffemodel', 'test.prototxt'] file manque in s3 : [] WARNING: Logging before InitGoogleLogging() is written to STDERR E1216 05:21:51.685674 2913274 common.cpp:114] Cannot create Cublas handle. Cublas won't be available. E1216 05:21:51.712786 2913274 common.cpp:121] Cannot create Curand generator. Curand won't be available. F1216 05:21:51.724490 2913274 syncedmem.hpp:22] Check failed: error == cudaSuccess (2 vs. 0) out of memory *** Check failure stack trace: *** Aborted (core dumped) No data to report. No data to report. ret : 34304 command : coverage3 html -i --omit=/usr/local/lib/python3.8/dist-packages/*,/home/admin/.local/lib/python3.8/site-packages/*,/usr/lib/python3/dist-packages/* -d htmlcov ret : 256 command : coverage3 report -i -m ret : 256 10.17user 7.78system 1:27.67elapsed 20%CPU (0avgtext+0avgdata 1429856maxresident)k 1516584inputs+3896outputs (3876major+641737minor)pagefaults 0swaps