python /home/admin/mtr/script_for_cron.py -j coverage -m 9 -a '' -s coverage -M 0 -S 0 -U 100,100,120 import MySQLdb succeeded root_folder /data_4/data_log/job/2025/December/12122025/coverage/ git_velours : /home/admin/workarea/git/Velours/ out_folder_name htmlcov output_folder /data_4/data_log/job/2025/December/12122025/coverage/htmlcov new path : /data_4/data_log/job/2025/December/12122025/coverage/ command : coverage3 run /home/admin/workarea/git/Velours/python/tests/python_tests.py --short_python3 `cat ~/.fotonower_pass/bdd.py.pass` cat: /home/admin/.fotonower_pass/bdd.py.pass: Aucun fichier ou dossier de ce type import MySQLdb succeeded Import error (python version) python version = 3 warning , we can't find thcl infos in json_data warning , we can't find pdt infos in json_data python version used : 3 #&_# BEGIN OF TEST : tests/mask_test #&_# /home/admin/workarea/git/Velours/python/tests/mask_test.py Test mask-detection python version used : 3 ############################### TEST memory used ################################ free memory at begining : begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 417 run mask_detect Inside batchDatouExec : verbose : False # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : mask_detect list_input_json : [] origin BFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 1 ; length of list_pids : 1 ; length of list_args : 1 time to download the photos : 0.159515380859375 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : False number of steps : 1 step1:mask_detect Fri Dec 12 17:20:29 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory havn't enough memory gpu , need / 3000 l 3632 free memory gpu now : 417 wait 20 seconds l 3637 free memory gpu now : 417 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 /home/admin/workarea/git/Velours/python/tests/python_tests.py:11: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses import imp 2025-12-12 17:20:52.867063: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-12-12 17:20:52.898429: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493010000 Hz 2025-12-12 17:20:52.899869: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f5a90000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-12-12 17:20:52.899920: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-12-12 17:20:52.904616: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-12-12 17:20:53.138489: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x262a1ce0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-12-12 17:20:53.138548: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-12-12 17:20:53.139261: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-12-12 17:20:53.139733: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-12-12 17:20:53.143061: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-12-12 17:20:53.146114: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-12-12 17:20:53.146652: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-12-12 17:20:53.150221: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-12-12 17:20:53.151955: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-12-12 17:20:53.157790: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-12-12 17:20:53.158733: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-12-12 17:20:53.158823: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-12-12 17:20:53.159311: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-12-12 17:20:53.159328: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-12-12 17:20:53.159338: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-12-12 17:20:53.160054: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 40 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl454 thcls : [{'id': 454, 'mtr_user_id': 31, 'name': 'mask_coco_origin', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'backgroud,person,bicycle,car,motorcycle,airplane,bus,train,truck,boat,trafficlight,firehydrant,stopsign,parkingmeter,bench,bird,cat,dog,horse,sheep,cow,elephant,bear,zebra,giraffe,backpack,umbrella,handbag,tie,suitcase,frisbee,skis,snowboard,sportsball,kite,baseballbat,baseballglove,skateboard,surfboard,tennisracket,bottle,wineglass,cup,fork,knife,spoon,bowl,banana,apple,sandwich,orange,broccoli,carrot,hotdog,pizza,donut,cake,chair,couch,pottedplant,bed,diningtable,toilet,tv,laptop,mouse,remote,keyboard,cellphone,microwave,oven,toaster,sink,refrigerator,book,clock,vase,scissors,teddybear,hairdrier,toothbrush', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 445, 'photo_desc_type': 3473, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0'}] thcl {'id': 454, 'mtr_user_id': 31, 'name': 'mask_coco_origin', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'backgroud,person,bicycle,car,motorcycle,airplane,bus,train,truck,boat,trafficlight,firehydrant,stopsign,parkingmeter,bench,bird,cat,dog,horse,sheep,cow,elephant,bear,zebra,giraffe,backpack,umbrella,handbag,tie,suitcase,frisbee,skis,snowboard,sportsball,kite,baseballbat,baseballglove,skateboard,surfboard,tennisracket,bottle,wineglass,cup,fork,knife,spoon,bowl,banana,apple,sandwich,orange,broccoli,carrot,hotdog,pizza,donut,cake,chair,couch,pottedplant,bed,diningtable,toilet,tv,laptop,mouse,remote,keyboard,cellphone,microwave,oven,toaster,sink,refrigerator,book,clock,vase,scissors,teddybear,hairdrier,toothbrush', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 445, 'photo_desc_type': 3473, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 3473 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (3473, 'mask_coco_origin', 16384, 25088, 'mask_coco_origin', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2018, 3, 19, 10, 42, 21), datetime.datetime(2018, 3, 19, 10, 42, 21)) {'thcl': {'id': 454, 'mtr_user_id': 31, 'name': 'mask_coco_origin', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'backgroud,person,bicycle,car,motorcycle,airplane,bus,train,truck,boat,trafficlight,firehydrant,stopsign,parkingmeter,bench,bird,cat,dog,horse,sheep,cow,elephant,bear,zebra,giraffe,backpack,umbrella,handbag,tie,suitcase,frisbee,skis,snowboard,sportsball,kite,baseballbat,baseballglove,skateboard,surfboard,tennisracket,bottle,wineglass,cup,fork,knife,spoon,bowl,banana,apple,sandwich,orange,broccoli,carrot,hotdog,pizza,donut,cake,chair,couch,pottedplant,bed,diningtable,toilet,tv,laptop,mouse,remote,keyboard,cellphone,microwave,oven,toaster,sink,refrigerator,book,clock,vase,scissors,teddybear,hairdrier,toothbrush', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 445, 'photo_desc_type': 3473, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['backgroud', 'person', 'bicycle', 'car', 'motorcycle', 'airplane', 'bus', 'train', 'truck', 'boat', 'trafficlight', 'firehydrant', 'stopsign', 'parkingmeter', 'bench', 'bird', 'cat', 'dog', 'horse', 'sheep', 'cow', 'elephant', 'bear', 'zebra', 'giraffe', 'backpack', 'umbrella', 'handbag', 'tie', 'suitcase', 'frisbee', 'skis', 'snowboard', 'sportsball', 'kite', 'baseballbat', 'baseballglove', 'skateboard', 'surfboard', 'tennisracket', 'bottle', 'wineglass', 'cup', 'fork', 'knife', 'spoon', 'bowl', 'banana', 'apple', 'sandwich', 'orange', 'broccoli', 'carrot', 'hotdog', 'pizza', 'donut', 'cake', 'chair', 'couch', 'pottedplant', 'bed', 'diningtable', 'toilet', 'tv', 'laptop', 'mouse', 'remote', 'keyboard', 'cellphone', 'microwave', 'oven', 'toaster', 'sink', 'refrigerator', 'book', 'clock', 'vase', 'scissors', 'teddybear', 'hairdrier', 'toothbrush'], 'list_hashtags_csv': 'backgroud,person,bicycle,car,motorcycle,airplane,bus,train,truck,boat,trafficlight,firehydrant,stopsign,parkingmeter,bench,bird,cat,dog,horse,sheep,cow,elephant,bear,zebra,giraffe,backpack,umbrella,handbag,tie,suitcase,frisbee,skis,snowboard,sportsball,kite,baseballbat,baseballglove,skateboard,surfboard,tennisracket,bottle,wineglass,cup,fork,knife,spoon,bowl,banana,apple,sandwich,orange,broccoli,carrot,hotdog,pizza,donut,cake,chair,couch,pottedplant,bed,diningtable,toilet,tv,laptop,mouse,remote,keyboard,cellphone,microwave,oven,toaster,sink,refrigerator,book,clock,vase,scissors,teddybear,hairdrier,toothbrush', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 445, 'svm_hashtag_type_desc': 3473, 'photo_desc_type': 3473, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['backgroud', 'person', 'bicycle', 'car', 'motorcycle', 'airplane', 'bus', 'train', 'truck', 'boat', 'trafficlight', 'firehydrant', 'stopsign', 'parkingmeter', 'bench', 'bird', 'cat', 'dog', 'horse', 'sheep', 'cow', 'elephant', 'bear', 'zebra', 'giraffe', 'backpack', 'umbrella', 'handbag', 'tie', 'suitcase', 'frisbee', 'skis', 'snowboard', 'sportsball', 'kite', 'baseballbat', 'baseballglove', 'skateboard', 'surfboard', 'tennisracket', 'bottle', 'wineglass', 'cup', 'fork', 'knife', 'spoon', 'bowl', 'banana', 'apple', 'sandwich', 'orange', 'broccoli', 'carrot', 'hotdog', 'pizza', 'donut', 'cake', 'chair', 'couch', 'pottedplant', 'bed', 'diningtable', 'toilet', 'tv', 'laptop', 'mouse', 'remote', 'keyboard', 'cellphone', 'microwave', 'oven', 'toaster', 'sink', 'refrigerator', 'book', 'clock', 'vase', 'scissors', 'teddybear', 'hairdrier', 'toothbrush'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME mask_coco_origin NUM_CLASSES 81 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 2025-12-12 17:20:53.947532: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-12-12 17:20:53.947634: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-12-12 17:20:53.947665: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-12-12 17:20:53.947696: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-12-12 17:20:53.947721: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-12-12 17:20:53.947746: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-12-12 17:20:53.947770: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-12-12 17:20:53.947795: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-12-12 17:20:53.948694: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-12-12 17:20:53.949729: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-12-12 17:20:53.949784: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-12-12 17:20:53.949811: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-12-12 17:20:53.949837: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-12-12 17:20:53.949861: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-12-12 17:20:53.949888: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-12-12 17:20:53.949913: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-12-12 17:20:53.949937: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-12-12 17:20:53.950816: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-12-12 17:20:53.950854: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-12-12 17:20:53.950867: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-12-12 17:20:53.950878: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-12-12 17:20:53.951829: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 40 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) 2025-12-12 17:20:53.956385: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.00M (1048576 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:53.957700: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 921.8K (943872 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:53.959017: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 829.8K (849664 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:53.960327: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 747.0K (764928 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:53.961594: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 672.5K (688640 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:53.962734: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 605.2K (619776 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:53.963547: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 544.8K (557824 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:53.964323: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 490.5K (502272 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:53.965057: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 441.5K (452096 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:53.965792: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 397.5K (407040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:53.966563: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 357.8K (366336 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:53.967384: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 322.0K (329728 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:53.968179: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 290.0K (296960 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:53.968914: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 261.0K (267264 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:53.969647: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 235.0K (240640 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:53.970401: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 211.5K (216576 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:53.971205: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 190.5K (195072 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:53.972008: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 171.5K (175616 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:53.972808: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 154.5K (158208 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:53.973586: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 139.2K (142592 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:53.974407: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 125.5K (128512 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:53.975210: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 113.0K (115712 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:53.976013: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 101.8K (104192 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:53.976811: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 91.8K (93952 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:53.977565: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 82.8K (84736 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:53.978319: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 74.5K (76288 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:53.979127: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 67.2K (68864 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:53.979926: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 60.8K (62208 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:53.980671: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 54.8K (56064 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:53.981426: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 49.5K (50688 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:53.982220: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 44.8K (45824 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:53.983077: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 40.5K (41472 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:53.983881: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 36.5K (37376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:53.984632: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 33.0K (33792 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:53.985375: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 29.8K (30464 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:53.986105: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 27.0K (27648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:53.986896: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 24.5K (25088 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:53.987712: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 22.2K (22784 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:53.988486: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 20.2K (20736 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:53.989218: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 18.2K (18688 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:53.989986: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 16.5K (16896 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:53.990808: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 15.0K (15360 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:53.991610: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 13.5K (13824 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:53.992408: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 12.2K (12544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:53.993198: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 11.2K (11520 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:53.993928: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 10.2K (10496 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:53.994722: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 9.2K (9472 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:53.995523: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 8.5K (8704 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:53.996321: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 7.8K (7936 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:53.997118: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 7.0K (7168 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:53.997914: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 6.5K (6656 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:53.998743: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 6.0K (6144 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:53.999507: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 5.5K (5632 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.000231: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 5.0K (5120 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.000956: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.5K (4608 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.001703: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.2K (4352 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.002516: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.0K (4096 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.003306: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.8K (3840 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.004041: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.5K (3584 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.004766: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.2K (3328 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.005491: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.0K (3072 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.006218: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.8K (2816 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.007013: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.5K (2560 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.007812: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.008572: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.009352: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.010153: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.010955: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.011757: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.012554: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.013333: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.014061: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.014843: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.015642: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.016414: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.017143: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.017872: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.018642: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.019450: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.020257: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.021060: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.021857: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.024279: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.025026: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.025756: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.026507: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.027307: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.028106: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.028838: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.029563: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.030311: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.031125: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.031936: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.032736: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.033505: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.034229: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.035040: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.035843: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.036598: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.037323: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.038047: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.038833: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.039634: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.040431: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.041226: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.042021: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.042845: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.043654: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.044457: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.045250: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.045975: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.046762: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.047562: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.048345: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.049074: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.049803: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.050566: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.051367: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.052164: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.052970: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.053777: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.054595: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.055411: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.056223: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.057021: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.057769: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.058517: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.059317: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.060113: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.060856: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.061581: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.062320: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.063120: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.063929: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.064731: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.065536: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.066369: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.067190: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.068004: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.068817: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.069616: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.070424: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.071232: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.072030: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.072827: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.073595: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.074328: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.075127: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.075924: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.076722: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.077519: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.078323: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.079124: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.079931: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.080729: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.081527: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.082355: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.083162: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.083961: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.084759: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.085557: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.086360: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.087161: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.087959: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.088757: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.089555: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.090368: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.091171: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.091969: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.092767: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.093565: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.094371: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.095171: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.095975: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.096777: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.097575: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.098407: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.099225: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.100025: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.100822: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.101619: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.102431: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.103234: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.104031: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.104829: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.105627: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.106440: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.107243: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.108040: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.108837: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.109635: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.110440: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.111241: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.112039: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.112836: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.113634: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.114451: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.115254: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.116052: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.116851: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.117648: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.118476: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.119282: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.120081: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.120878: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.121675: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.122482: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.123282: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.124079: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.124877: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.125674: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.126488: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.127290: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.128087: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.128883: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.129681: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.130486: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.131288: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.132086: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.132883: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.133680: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.134518: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.135321: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.136118: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.136915: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.137724: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.138538: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.139340: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.140137: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.140934: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.141731: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.142546: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.143357: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.144156: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.144954: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.145751: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.146557: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.147358: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.148155: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.148961: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.149765: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.150599: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.151402: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.152200: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.152996: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.153793: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.154598: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.155398: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.156195: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.157003: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.157802: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.158647: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.159449: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.160247: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.161045: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.161844: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.162652: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.163453: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.164312: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.165207: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.166011: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.166842: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.167645: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.168446: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.169245: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.170042: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.170848: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.171647: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.172445: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.173242: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.174038: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.174856: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.175677: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.176475: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.177274: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.178071: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.178887: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.179720: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.180522: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.181320: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.182118: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.182923: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.183729: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.184538: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.185337: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.186135: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.186954: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.187755: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.188552: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.189351: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.190149: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.190955: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.191755: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.192554: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.193352: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.194149: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.195007: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.195817: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.196621: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.197420: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.198218: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.199036: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.199843: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.200653: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.201482: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.202312: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.203118: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.203917: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.204714: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.205529: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.206373: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.207201: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.208029: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.208860: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.209665: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.210473: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.211279: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.212100: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.212919: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.213729: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.214562: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.215365: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.216162: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.216980: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.217780: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.218585: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.219388: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.220186: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.220984: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.221794: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.222621: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.223428: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.224231: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.225036: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.225836: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.226644: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.227445: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.228244: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.229041: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.229839: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.230682: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.231487: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.232285: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.233083: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.233894: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.234713: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.235514: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.236311: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.237108: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.237905: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.238709: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.239509: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.240314: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.241113: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.241910: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.242724: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.243525: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.244322: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.245118: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.245915: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.246732: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.247534: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.248331: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.249129: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.249927: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.250745: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.251546: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.252344: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.253150: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.253948: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.254755: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.255554: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.256352: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.257148: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.257944: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.258769: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.259571: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.260368: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.261164: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.261961: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.262767: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.263566: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.264363: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.265169: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.265968: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.266795: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.267600: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.268397: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.269194: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.269991: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.270806: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.271622: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.272420: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.273221: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.274022: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.274836: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.275637: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.276435: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.277232: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.278029: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.278832: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.279631: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.280428: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.281227: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.282024: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.282838: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.283638: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.284435: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.285232: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.286030: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.286856: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.287657: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.288386: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.289138: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.289935: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.290750: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.291550: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.292331: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.293128: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.293925: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.294742: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.295542: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.296287: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.297016: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.297746: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.298484: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.299285: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.300082: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.300878: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.301675: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.302479: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.303278: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.304075: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.304860: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.305584: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.306328: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.307122: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.307904: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.308633: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.309371: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.310114: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.310920: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.311721: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.312525: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.313324: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.314121: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.314935: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.315744: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.316544: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.317341: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.318138: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.318961: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.319762: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.320559: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.321356: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.322159: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.322977: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.323781: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.324578: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.325375: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.326173: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.327001: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.327800: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.328541: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.329271: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.330015: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.330833: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.331634: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.332430: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.333227: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.334024: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.334853: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.335661: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.336412: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.337151: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.337887: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.338638: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.339438: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.340234: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.341031: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.341828: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.342640: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.343441: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.344238: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.345035: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.345832: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.346658: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.347472: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.348239: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.348972: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.349705: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.350493: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.351293: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.352090: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.352881: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.353614: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.354390: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.355192: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.355978: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.356707: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.357441: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.358174: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.358949: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.359749: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.360543: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.361341: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.362138: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.362945: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.363744: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.364487: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.365230: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.365963: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.366743: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.367543: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.368340: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.369112: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.369845: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.370646: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.371586: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.373045: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.374402: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.375743: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.377077: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.378439: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.379779: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.380595: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.381391: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.382188: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.382991: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.383790: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.384571: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.385330: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.386062: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.386852: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.387673: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.388422: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.389153: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.389885: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.390720: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.391523: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.392319: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.393101: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.393833: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.394594: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.395392: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.396165: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.396897: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.397629: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.398379: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.399183: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.399978: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.400710: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.401451: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.402187: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.402980: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.403777: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.404527: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.405265: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.406011: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.406799: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.407599: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.408362: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.409099: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.409835: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.410581: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.411321: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.412059: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.412796: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.413534: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.414278: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.415073: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.415870: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.416615: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.417352: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.418089: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.418845: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.419591: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.420333: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.421075: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.421817: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.422565: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.423310: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.424062: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.424806: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.425547: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.426294: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.427033: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.427771: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.428525: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.429328: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.430114: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.430918: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.431717: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.432473: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.433214: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.433955: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.434733: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.435533: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.436312: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.437058: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.437804: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.438585: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.439387: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.440171: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.440912: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.441653: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.442419: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.443219: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.444014: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.444755: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.445497: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.446238: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.447045: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.447845: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.448600: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.449341: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.450082: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.450869: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.451666: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.452433: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.453174: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.453916: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.454690: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.455490: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.456289: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.457083: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.457824: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.458600: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.459400: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.460187: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.460938: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.461680: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.462430: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.463175: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.463916: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.464657: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.465398: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.466140: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.466889: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.467633: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.468374: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.469116: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.469858: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.470612: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.471354: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.472097: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.472842: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.473584: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.474330: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.475071: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.475809: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.476548: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.477286: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.478033: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.478781: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.479521: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.480258: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.480997: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.481735: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.482490: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.483232: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.483970: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.484707: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.485442: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.486175: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.486915: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.487649: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.488381: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.489113: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.489845: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.490595: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.491335: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.492096: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.492838: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.493576: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.494320: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.495060: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.495806: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.496544: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.497282: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.498019: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.498762: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.499500: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.500233: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.500966: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.501698: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.502446: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.503182: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.503915: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.504647: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.505383: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.506120: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.506864: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.507603: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.508340: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.509076: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.509812: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.510555: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.511294: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.512031: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.512765: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.513506: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.514239: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.514989: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.515725: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.516463: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.517199: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.517936: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.518679: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.519416: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.520152: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.520888: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.521625: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.522369: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.523108: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.523841: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.524572: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.525305: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.526037: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.526829: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.527627: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.528404: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.529140: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.529876: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.530620: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.531388: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.532128: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.532865: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.533601: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.534344: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.535083: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.535819: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.536555: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.537292: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.538028: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.538781: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.539520: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.540258: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.540997: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.541735: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.542485: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.543227: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.543963: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.544700: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.545436: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.546173: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.546918: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.547656: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.548392: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.549132: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.549864: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.550613: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.551352: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.552089: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.552826: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.553562: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.554307: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.555093: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.555842: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.556579: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.557315: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.558051: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.558795: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.559534: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.560270: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.561007: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.561743: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.562494: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.563258: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.564006: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.564743: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.565479: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.566224: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.567024: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.567822: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.568591: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.569327: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.570063: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.570858: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.571633: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.572377: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.573122: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.573868: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.574644: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.575433: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.576179: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.576924: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.577670: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.578429: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.579227: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.579977: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.580722: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.581467: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.582207: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.582965: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.583708: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.584457: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.585198: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.585940: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.586714: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.587499: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.588240: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.588981: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.589722: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.590471: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.591215: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.591956: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.592696: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.593437: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.594177: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.594936: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.595679: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.596415: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.597151: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.597888: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.598632: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.599371: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.600107: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.600843: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.601580: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.602334: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.603073: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.603810: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.604546: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.605278: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.606010: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.606782: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.607518: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.608250: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.608982: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.609714: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.610455: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.611190: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.611922: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.612654: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.613387: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.614124: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.614867: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.615605: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.616341: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.617077: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.617813: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.618563: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.619305: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.620045: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.620778: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.621510: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.622242: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.622981: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.623716: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.624447: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.625179: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.625910: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.626652: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.627392: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.628193: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.628942: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.629698: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.630498: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.631238: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.631974: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.632710: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.633446: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.634183: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.634925: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.635663: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.636400: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.637136: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.637880: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.638624: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.639364: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.640100: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.640836: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.641572: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.642323: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.643064: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.643800: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.644537: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.645272: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.646006: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.646746: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.647480: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.648212: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.648950: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.649687: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.650442: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.651187: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.651925: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.652662: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.653398: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.654135: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.654880: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.655627: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.656364: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.657101: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.657837: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.658580: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.659320: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.660056: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.660792: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.661528: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.662264: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.663019: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.663758: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.664495: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.665231: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.665967: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.666711: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.667449: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.668185: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.668921: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.669658: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.670410: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.671151: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.671888: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.672632: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.673369: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.674105: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.674851: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.675589: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.676326: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.677063: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.677799: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.678542: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.679280: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.680017: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.680753: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.681489: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.682226: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.682977: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.683711: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.684445: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.685182: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.685918: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.686664: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.687403: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.688139: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.688875: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.689611: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.690362: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.691102: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.691838: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.692574: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.693311: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.694047: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.694824: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.695564: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.696300: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.697037: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.697773: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.699033: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.699782: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.700519: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.701255: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.701991: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.702737: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.703476: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.704212: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.704949: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.705685: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.706437: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.707178: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.707914: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.708659: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.709392: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.710124: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.710867: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.711601: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.712333: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.713065: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.713796: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.714538: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.715277: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.716013: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.716749: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.717486: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.718222: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.718973: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.719708: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.720439: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.721172: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.721905: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.722672: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.723470: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.724208: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.724940: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.725676: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.726433: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.727232: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.727993: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.728729: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.729466: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.730202: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.730959: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.731698: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.732435: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.733171: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.733907: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.734654: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.735393: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.736129: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.736866: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.737603: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.738345: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.739084: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.739821: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.740557: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.741293: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.742029: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.742783: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.743522: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.744268: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.745003: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.745735: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.746473: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.747208: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.747939: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.748671: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.749402: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.750136: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.750880: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.751619: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.752355: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.753089: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.753824: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.754575: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.755316: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.756053: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.756789: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.757525: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.758262: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.759006: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.759745: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.760477: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.761225: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.761962: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.762706: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.763445: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.764182: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.764919: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.765655: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.766405: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.767146: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.767883: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.768619: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.769356: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.770092: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.770837: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.771575: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.772311: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.773048: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.773784: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.774528: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.775273: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.776014: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.776754: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.777496: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.778237: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.779002: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.779747: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.780483: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.781220: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.781956: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.782700: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.783439: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.784175: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.784914: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.785657: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.786412: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.787154: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.787892: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.788628: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.789365: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.790102: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.790849: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.791589: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.792326: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.793063: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.793800: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.794543: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.795282: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.796020: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.796765: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.797503: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.798239: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.798993: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.799733: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.800470: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.801206: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.801943: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.802685: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.803419: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.804151: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.804886: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.805622: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.806365: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.807105: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.807840: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.808576: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.809312: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.810049: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.810800: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.811540: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.812277: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.813013: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.813749: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.814500: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.815240: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.815976: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.816712: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.817449: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.818185: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.818928: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.819666: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.820403: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.821138: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.821874: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.822626: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.823367: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.824103: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.824840: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.825576: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.826318: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.827058: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.827794: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.828531: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.829267: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.830003: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.830746: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.831484: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.832228: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.832964: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.833700: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.834450: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.835190: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.835927: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.836664: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.837460: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.838221: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.838966: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.839704: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.840440: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.841176: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.841912: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.842656: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.843395: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.844153: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.844937: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.845668: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.846414: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.847207: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.847984: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.848716: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.849455: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.850187: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.850981: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.851780: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.852512: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.853244: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.854015: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.854828: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.855626: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.856369: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.857096: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.857823: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.858612: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.859410: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.860173: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.860900: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.861627: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.862360: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.863090: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.863817: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.864544: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.865271: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.865998: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.866785: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.867597: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.868348: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.869076: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.869804: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.870558: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.871359: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.872129: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.872864: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.873606: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.874359: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.875125: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.875930: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.876676: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.877410: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.878157: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.878929: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.879686: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.880437: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.881193: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.881950: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.882694: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.883435: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.884178: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.884933: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.885689: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.886458: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.887216: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.887962: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.888701: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.889450: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.890206: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.891030: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.891859: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.892619: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.893381: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.894143: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.894914: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.895680: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.896431: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.897190: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.897942: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.898722: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.899466: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.900217: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.900972: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.901724: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.902483: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.903240: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.904003: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.904751: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.905504: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.906260: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.907019: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.907774: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.908527: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.909274: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.910025: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.910798: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.911549: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.912297: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.913044: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.913794: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.914547: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.915301: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.916044: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.916792: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.917542: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.918300: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.919048: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.919801: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.920558: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.921307: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.922058: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.922842: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.923603: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.924354: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.925101: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.925861: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.926617: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.927377: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.928134: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.928881: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.929623: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.930371: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.931111: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.931856: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.932604: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.933347: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.934099: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.934875: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.935631: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.936380: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.937126: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.937878: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.938628: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.939381: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.940141: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.940883: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.941633: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.942391: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.943126: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.943870: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.944612: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.945346: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.946088: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.946838: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.947586: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.948339: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.949085: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.949840: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.950631: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.951399: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.952155: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.952908: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.953656: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.954415: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.955175: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.955926: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.956675: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.957440: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.958195: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.958953: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.959701: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.960454: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.961202: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.961960: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.962730: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.963491: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.964241: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.964989: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.965740: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.966503: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.967245: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.967992: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.968735: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.969489: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.970235: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.970991: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.971740: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.972485: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.973227: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.973972: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.974729: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.975480: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.976222: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.976967: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.977712: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.978464: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.979211: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.979953: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.980697: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.981436: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.982234: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.983057: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.983801: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.984549: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.985293: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.986043: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.986820: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.987606: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.988364: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.989175: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.989982: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.990790: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.991630: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.992456: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.993239: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.994031: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.994898: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.995705: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.996480: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.997240: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.997995: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.998792: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:54.999612: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.000400: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.001152: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.001897: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.002679: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.003498: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.004322: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.005146: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.005891: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.006684: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.007495: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.008298: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.009053: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.009812: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.010591: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.011401: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.012203: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.012962: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.013736: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.014543: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.015340: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.016446: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.017931: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.019477: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.020970: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.022479: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.023967: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.025454: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.026959: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.028263: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.029070: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.029877: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.030691: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.031505: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.032318: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.033128: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.034026: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.035368: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.036737: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.038065: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.040041: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.041439: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.042715: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.043564: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.044390: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.045206: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.046009: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.046858: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.047669: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.048477: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.049285: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.050091: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.050949: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.051760: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.052572: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.053470: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.054298: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.055128: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.055945: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.056700: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.057440: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.058202: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.059040: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.059860: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.060648: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.061397: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.062160: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.063316: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.064319: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.065136: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.065879: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.066663: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.067472: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.068277: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.069026: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.069769: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.070550: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.071380: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.072204: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.073024: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.073844: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.074701: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.075515: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.076321: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.077171: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.077996: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.078833: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.079607: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.080360: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.081100: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.081901: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.082718: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.083502: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.084239: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.084975: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.085718: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.086473: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.087287: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.088091: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.088848: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.089594: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.090389: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.091204: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.092014: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.092826: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.093600: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.094345: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.095163: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.095970: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.096742: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.097506: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.098324: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.099150: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.099904: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.100648: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.101394: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.102195: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.103038: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.103802: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.104547: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.105310: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.106127: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.106910: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.107761: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.108568: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.109731: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.110803: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.111869: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.112940: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.113967: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.114987: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.116167: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.117385: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.118642: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.119918: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.121253: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.122443: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.123614: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.124823: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.125964: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.127064: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.128148: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.129306: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.130162: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.131075: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.131937: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.132870: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.133769: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.134649: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.135529: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.136402: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.137221: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.138032: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.138906: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.139796: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.140666: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.141568: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.142450: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.143334: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.144212: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.145044: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.145939: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.147039: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.147915: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.148744: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.149565: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.150390: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.151271: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.152152: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.152987: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.153811: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.154630: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.155543: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.156425: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.157322: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.158140: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.158969: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.159786: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.160605: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.161464: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.162353: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.163233: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.164114: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.165395: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.166885: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.169424: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.170369: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.171217: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.172043: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.172882: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.173724: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.174577: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.175426: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.176268: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.177083: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:20:55.177947: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.2K (2304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-12-12 17:21:06.411776: W tensorflow/core/common_runtime/bfc_allocator.cc:434] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.25MiB (rounded to 2359296) Current allocation summary follows. 2025-12-12 17:21:06.411834: I tensorflow/core/common_runtime/bfc_allocator.cc:934] BFCAllocator dump for GPU_0_bfc 2025-12-12 17:21:06.411856: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (256): Total Chunks: 60, Chunks in use: 60. 15.0KiB allocated for chunks. 15.0KiB in use in bin. 8.8KiB client-requested in use in bin. 2025-12-12 17:21:06.411873: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (512): Total Chunks: 40, Chunks in use: 40. 20.0KiB allocated for chunks. 20.0KiB in use in bin. 20.0KiB client-requested in use in bin. 2025-12-12 17:21:06.411890: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (1024): Total Chunks: 75, Chunks in use: 75. 75.0KiB allocated for chunks. 75.0KiB in use in bin. 75.0KiB client-requested in use in bin. 2025-12-12 17:21:06.411907: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (2048): Total Chunks: 26, Chunks in use: 26. 52.2KiB allocated for chunks. 52.2KiB in use in bin. 51.0KiB client-requested in use in bin. 2025-12-12 17:21:06.411924: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (4096): Total Chunks: 30, Chunks in use: 30. 123.5KiB allocated for chunks. 123.5KiB in use in bin. 120.0KiB client-requested in use in bin. 2025-12-12 17:21:06.411940: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (8192): Total Chunks: 1, Chunks in use: 0. 14.8KiB allocated for chunks. 0B in use in bin. 0B client-requested in use in bin. 2025-12-12 17:21:06.411957: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (16384): Total Chunks: 1, Chunks in use: 1. 16.0KiB allocated for chunks. 16.0KiB in use in bin. 16.0KiB client-requested in use in bin. 2025-12-12 17:21:06.411991: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (32768): Total Chunks: 1, Chunks in use: 1. 36.8KiB allocated for chunks. 36.8KiB in use in bin. 36.8KiB client-requested in use in bin. 2025-12-12 17:21:06.412009: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (65536): Total Chunks: 6, Chunks in use: 6. 384.0KiB allocated for chunks. 384.0KiB in use in bin. 384.0KiB client-requested in use in bin. 2025-12-12 17:21:06.412025: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (131072): Total Chunks: 6, Chunks in use: 4. 848.0KiB allocated for chunks. 560.0KiB in use in bin. 560.0KiB client-requested in use in bin. 2025-12-12 17:21:06.412041: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (262144): Total Chunks: 9, Chunks in use: 7. 2.58MiB allocated for chunks. 2.08MiB in use in bin. 1.75MiB client-requested in use in bin. 2025-12-12 17:21:06.412057: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (524288): Total Chunks: 8, Chunks in use: 6. 4.62MiB allocated for chunks. 3.44MiB in use in bin. 3.25MiB client-requested in use in bin. 2025-12-12 17:21:06.412074: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (1048576): Total Chunks: 12, Chunks in use: 10. 13.00MiB allocated for chunks. 10.75MiB in use in bin. 10.00MiB client-requested in use in bin. 2025-12-12 17:21:06.412090: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (2097152): Total Chunks: 6, Chunks in use: 6. 15.00MiB allocated for chunks. 15.00MiB in use in bin. 13.25MiB client-requested in use in bin. 2025-12-12 17:21:06.412106: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (4194304): Total Chunks: 1, Chunks in use: 1. 4.12MiB allocated for chunks. 4.12MiB in use in bin. 2.25MiB client-requested in use in bin. 2025-12-12 17:21:06.412120: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (8388608): Total Chunks: 0, Chunks in use: 0. 0B allocated for chunks. 0B in use in bin. 0B client-requested in use in bin. 2025-12-12 17:21:06.412135: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (16777216): Total Chunks: 0, Chunks in use: 0. 0B allocated for chunks. 0B in use in bin. 0B client-requested in use in bin. 2025-12-12 17:21:06.412149: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (33554432): Total Chunks: 0, Chunks in use: 0. 0B allocated for chunks. 0B in use in bin. 0B client-requested in use in bin. 2025-12-12 17:21:06.412163: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (67108864): Total Chunks: 0, Chunks in use: 0. 0B allocated for chunks. 0B in use in bin. 0B client-requested in use in bin. 2025-12-12 17:21:06.412178: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (134217728): Total Chunks: 0, Chunks in use: 0. 0B allocated for chunks. 0B in use in bin. 0B client-requested in use in bin. 2025-12-12 17:21:06.412192: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (268435456): Total Chunks: 0, Chunks in use: 0. 0B allocated for chunks. 0B in use in bin. 0B client-requested in use in bin. 2025-12-12 17:21:06.412207: I tensorflow/core/common_runtime/bfc_allocator.cc:957] Bin for 2.25MiB was 2.00MiB, Chunk State: 2025-12-12 17:21:06.412220: I tensorflow/core/common_runtime/bfc_allocator.cc:970] Next region of size 16777216 2025-12-12 17:21:06.412237: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f58c6000000 of size 2359296 next 183 2025-12-12 17:21:06.412250: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f58c6240000 of size 2097152 next 198 2025-12-12 17:21:06.412263: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f58c6440000 of size 1048576 next 223 2025-12-12 17:21:06.412276: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f58c6540000 of size 3670016 next 212 2025-12-12 17:21:06.412289: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f58c68c0000 of size 2359296 next 211 2025-12-12 17:21:06.412301: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f58c6b00000 of size 1048576 next 235 2025-12-12 17:21:06.412324: I tensorflow/core/common_runtime/bfc_allocator.cc:990] Free at 7f58c6c00000 of size 1310720 next 230 2025-12-12 17:21:06.412338: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f58c6d40000 of size 2883584 next 18446744073709551615 2025-12-12 17:21:06.412350: I tensorflow/core/common_runtime/bfc_allocator.cc:970] Next region of size 11400960 2025-12-12 17:21:06.412363: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f58c7000000 of size 1048576 next 253 2025-12-12 17:21:06.412376: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f58c7100000 of size 1310720 next 247 2025-12-12 17:21:06.412388: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f58c7240000 of size 2359296 next 245 2025-12-12 17:21:06.412401: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f58c7480000 of size 1048576 next 270 2025-12-12 17:21:06.412413: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f58c7580000 of size 1310720 next 265 2025-12-12 17:21:06.412426: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f58c76c0000 of size 4323072 next 18446744073709551615 2025-12-12 17:21:06.412439: I tensorflow/core/common_runtime/bfc_allocator.cc:970] Next region of size 4194304 2025-12-12 17:21:06.412452: I tensorflow/core/common_runtime/bfc_allocator.cc:990] Free at 7f58c8800000 of size 262144 next 105 2025-12-12 17:21:06.412464: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f58c8840000 of size 262144 next 104 2025-12-12 17:21:06.412477: I tensorflow/core/common_runtime/bfc_allocator.cc:990] Free at 7f58c8880000 of size 655360 next 98 2025-12-12 17:21:06.412490: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f58c8920000 of size 589824 next 97 2025-12-12 17:21:06.412502: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f58c89b0000 of size 262144 next 119 2025-12-12 17:21:06.412515: I tensorflow/core/common_runtime/bfc_allocator.cc:990] Free at 7f58c89f0000 of size 262144 next 114 2025-12-12 17:21:06.412528: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f58c8a30000 of size 524288 next 113 2025-12-12 17:21:06.412540: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f58c8ab0000 of size 262144 next 136 2025-12-12 17:21:06.412553: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f58c8af0000 of size 327680 next 126 2025-12-12 17:21:06.412566: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f58c8b40000 of size 786432 next 18446744073709551615 2025-12-12 17:21:06.412578: I tensorflow/core/common_runtime/bfc_allocator.cc:970] Next region of size 8388608 2025-12-12 17:21:06.412591: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f58c8c00000 of size 262144 next 155 2025-12-12 17:21:06.412604: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f58c8c40000 of size 327680 next 144 2025-12-12 17:21:06.412616: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f58c8c90000 of size 589824 next 142 2025-12-12 17:21:06.412629: I tensorflow/core/common_runtime/bfc_allocator.cc:990] Free at 7f58c8d20000 of size 589824 next 162 2025-12-12 17:21:06.412641: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f58c8db0000 of size 589824 next 161 2025-12-12 17:21:06.412654: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f58c8e40000 of size 524288 next 173 2025-12-12 17:21:06.412666: I tensorflow/core/common_runtime/bfc_allocator.cc:990] Free at 7f58c8ec0000 of size 1048576 next 218 2025-12-12 17:21:06.412679: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f58c8fc0000 of size 1048576 next 192 2025-12-12 17:21:06.412691: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f58c90c0000 of size 1048576 next 191 2025-12-12 17:21:06.412704: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f58c91c0000 of size 1048576 next 205 2025-12-12 17:21:06.412716: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f58c92c0000 of size 1310720 next 18446744073709551615 2025-12-12 17:21:06.412737: I tensorflow/core/common_runtime/bfc_allocator.cc:970] Next region of size 2304 2025-12-12 17:21:06.412751: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a04e00000 of size 2304 next 18446744073709551615 2025-12-12 17:21:06.412763: I tensorflow/core/common_runtime/bfc_allocator.cc:970] Next region of size 2097152 2025-12-12 17:21:06.412789: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05000000 of size 256 next 5 2025-12-12 17:21:06.412802: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05000100 of size 256 next 8 2025-12-12 17:21:06.412815: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05000200 of size 256 next 9 2025-12-12 17:21:06.412828: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05000300 of size 256 next 10 2025-12-12 17:21:06.412840: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05000400 of size 256 next 11 2025-12-12 17:21:06.412853: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05000500 of size 256 next 12 2025-12-12 17:21:06.412865: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05000600 of size 256 next 13 2025-12-12 17:21:06.412877: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05000700 of size 256 next 17 2025-12-12 17:21:06.412890: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05000800 of size 256 next 19 2025-12-12 17:21:06.412902: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05000900 of size 256 next 20 2025-12-12 17:21:06.412915: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05000a00 of size 256 next 21 2025-12-12 17:21:06.412927: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05000b00 of size 256 next 22 2025-12-12 17:21:06.412940: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05000c00 of size 256 next 24 2025-12-12 17:21:06.412952: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05000d00 of size 256 next 25 2025-12-12 17:21:06.412965: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05000e00 of size 256 next 23 2025-12-12 17:21:06.412977: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05000f00 of size 256 next 28 2025-12-12 17:21:06.412989: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05001000 of size 256 next 29 2025-12-12 17:21:06.413002: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05001100 of size 256 next 30 2025-12-12 17:21:06.413014: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05001200 of size 256 next 31 2025-12-12 17:21:06.413027: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05001300 of size 256 next 33 2025-12-12 17:21:06.413039: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05001400 of size 256 next 34 2025-12-12 17:21:06.413052: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05001500 of size 1024 next 32 2025-12-12 17:21:06.413065: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05001900 of size 1024 next 37 2025-12-12 17:21:06.413077: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05001d00 of size 1024 next 38 2025-12-12 17:21:06.413090: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05002100 of size 1024 next 39 2025-12-12 17:21:06.413102: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05002500 of size 1024 next 40 2025-12-12 17:21:06.413115: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05002900 of size 1024 next 41 2025-12-12 17:21:06.413127: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05002d00 of size 1024 next 43 2025-12-12 17:21:06.413140: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05003100 of size 1024 next 44 2025-12-12 17:21:06.413162: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05003500 of size 1024 next 45 2025-12-12 17:21:06.413175: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05003900 of size 1024 next 46 2025-12-12 17:21:06.413187: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05003d00 of size 256 next 48 2025-12-12 17:21:06.413199: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05003e00 of size 256 next 49 2025-12-12 17:21:06.413212: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05003f00 of size 256 next 50 2025-12-12 17:21:06.413224: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05004000 of size 256 next 51 2025-12-12 17:21:06.413237: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05004100 of size 256 next 52 2025-12-12 17:21:06.413249: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05004200 of size 256 next 53 2025-12-12 17:21:06.413262: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05004300 of size 256 next 56 2025-12-12 17:21:06.413274: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05004400 of size 256 next 57 2025-12-12 17:21:06.413287: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05004500 of size 256 next 58 2025-12-12 17:21:06.413299: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05004600 of size 256 next 14 2025-12-12 17:21:06.413312: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05004700 of size 256 next 15 2025-12-12 17:21:06.413324: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05004800 of size 256 next 16 2025-12-12 17:21:06.413336: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05004900 of size 1024 next 60 2025-12-12 17:21:06.413349: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05004d00 of size 1024 next 61 2025-12-12 17:21:06.413362: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05005100 of size 1024 next 62 2025-12-12 17:21:06.413374: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05005500 of size 1024 next 63 2025-12-12 17:21:06.413386: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05005900 of size 1024 next 64 2025-12-12 17:21:06.413399: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05005d00 of size 256 next 66 2025-12-12 17:21:06.413411: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05005e00 of size 256 next 67 2025-12-12 17:21:06.413424: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05005f00 of size 256 next 68 2025-12-12 17:21:06.413436: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05006000 of size 256 next 69 2025-12-12 17:21:06.413449: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05006100 of size 256 next 70 2025-12-12 17:21:06.413461: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05006200 of size 256 next 73 2025-12-12 17:21:06.413474: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05006300 of size 256 next 74 2025-12-12 17:21:06.413486: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05006400 of size 256 next 75 2025-12-12 17:21:06.413499: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05006500 of size 256 next 76 2025-12-12 17:21:06.413511: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05006600 of size 256 next 77 2025-12-12 17:21:06.413524: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05006700 of size 1024 next 79 2025-12-12 17:21:06.413536: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05006b00 of size 1024 next 80 2025-12-12 17:21:06.413548: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05006f00 of size 1024 next 81 2025-12-12 17:21:06.413561: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05007300 of size 1024 next 82 2025-12-12 17:21:06.413582: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05007700 of size 1024 next 83 2025-12-12 17:21:06.413595: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05007b00 of size 256 next 84 2025-12-12 17:21:06.413607: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05007c00 of size 256 next 85 2025-12-12 17:21:06.413620: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05007d00 of size 512 next 88 2025-12-12 17:21:06.413633: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05007f00 of size 512 next 89 2025-12-12 17:21:06.413645: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05008100 of size 512 next 90 2025-12-12 17:21:06.413657: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05008300 of size 512 next 91 2025-12-12 17:21:06.413670: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05008500 of size 512 next 92 2025-12-12 17:21:06.413682: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05008700 of size 256 next 95 2025-12-12 17:21:06.413695: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05008800 of size 256 next 96 2025-12-12 17:21:06.413707: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05008900 of size 512 next 94 2025-12-12 17:21:06.413720: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05008b00 of size 512 next 99 2025-12-12 17:21:06.413732: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05008d00 of size 512 next 100 2025-12-12 17:21:06.413745: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05008f00 of size 512 next 101 2025-12-12 17:21:06.413757: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05009100 of size 512 next 2 2025-12-12 17:21:06.413770: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05009300 of size 256 next 3 2025-12-12 17:21:06.413782: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05009400 of size 256 next 4 2025-12-12 17:21:06.413795: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05009500 of size 16384 next 18 2025-12-12 17:21:06.413807: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a0500d500 of size 256 next 102 2025-12-12 17:21:06.413820: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a0500d600 of size 256 next 103 2025-12-12 17:21:06.413833: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a0500d700 of size 2048 next 106 2025-12-12 17:21:06.413845: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a0500df00 of size 2048 next 107 2025-12-12 17:21:06.413858: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a0500e700 of size 2048 next 108 2025-12-12 17:21:06.413870: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a0500ef00 of size 2048 next 109 2025-12-12 17:21:06.413883: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a0500f700 of size 2048 next 110 2025-12-12 17:21:06.413895: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a0500ff00 of size 256 next 111 2025-12-12 17:21:06.413908: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05010000 of size 256 next 112 2025-12-12 17:21:06.413920: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05010100 of size 2048 next 115 2025-12-12 17:21:06.413933: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05010900 of size 2048 next 116 2025-12-12 17:21:06.413945: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05011100 of size 2048 next 117 2025-12-12 17:21:06.413958: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05011900 of size 2048 next 118 2025-12-12 17:21:06.413970: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05012100 of size 2048 next 6 2025-12-12 17:21:06.413983: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05012900 of size 37632 next 7 2025-12-12 17:21:06.414004: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a0501bc00 of size 512 next 120 2025-12-12 17:21:06.414017: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a0501be00 of size 512 next 121 2025-12-12 17:21:06.414029: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a0501c000 of size 512 next 122 2025-12-12 17:21:06.414042: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a0501c200 of size 512 next 123 2025-12-12 17:21:06.414054: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a0501c400 of size 512 next 124 2025-12-12 17:21:06.414067: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a0501c600 of size 512 next 125 2025-12-12 17:21:06.414079: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a0501c800 of size 512 next 127 2025-12-12 17:21:06.414092: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a0501ca00 of size 512 next 128 2025-12-12 17:21:06.414104: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a0501cc00 of size 512 next 129 2025-12-12 17:21:06.414117: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a0501ce00 of size 512 next 130 2025-12-12 17:21:06.414129: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a0501d000 of size 2048 next 131 2025-12-12 17:21:06.414142: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a0501d800 of size 2048 next 132 2025-12-12 17:21:06.414154: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a0501e000 of size 2048 next 133 2025-12-12 17:21:06.414167: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a0501e800 of size 2048 next 134 2025-12-12 17:21:06.414179: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a0501f000 of size 2048 next 135 2025-12-12 17:21:06.414192: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a0501f800 of size 512 next 137 2025-12-12 17:21:06.414204: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a0501fa00 of size 512 next 138 2025-12-12 17:21:06.414217: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a0501fc00 of size 512 next 139 2025-12-12 17:21:06.414229: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a0501fe00 of size 512 next 140 2025-12-12 17:21:06.414241: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05020000 of size 512 next 141 2025-12-12 17:21:06.414254: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05020200 of size 512 next 145 2025-12-12 17:21:06.414266: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05020400 of size 512 next 146 2025-12-12 17:21:06.414295: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05020600 of size 512 next 147 2025-12-12 17:21:06.414308: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05020800 of size 512 next 148 2025-12-12 17:21:06.414320: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05020a00 of size 512 next 149 2025-12-12 17:21:06.414333: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05020c00 of size 2048 next 150 2025-12-12 17:21:06.414345: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05021400 of size 2048 next 151 2025-12-12 17:21:06.414358: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05021c00 of size 2048 next 152 2025-12-12 17:21:06.414371: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05022400 of size 2048 next 153 2025-12-12 17:21:06.414383: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05022c00 of size 2048 next 154 2025-12-12 17:21:06.414396: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05023400 of size 512 next 156 2025-12-12 17:21:06.414408: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05023600 of size 512 next 157 2025-12-12 17:21:06.414429: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05023800 of size 512 next 158 2025-12-12 17:21:06.414442: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05023a00 of size 512 next 159 2025-12-12 17:21:06.414455: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05023c00 of size 512 next 160 2025-12-12 17:21:06.414467: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05023e00 of size 512 next 163 2025-12-12 17:21:06.414480: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05024000 of size 512 next 164 2025-12-12 17:21:06.414492: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05024200 of size 512 next 165 2025-12-12 17:21:06.414505: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05024400 of size 512 next 166 2025-12-12 17:21:06.414517: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05024600 of size 512 next 167 2025-12-12 17:21:06.414530: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05024800 of size 2048 next 168 2025-12-12 17:21:06.414542: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05025000 of size 2048 next 169 2025-12-12 17:21:06.414555: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05025800 of size 2048 next 170 2025-12-12 17:21:06.414567: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05026000 of size 2048 next 171 2025-12-12 17:21:06.414580: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05026800 of size 2048 next 172 2025-12-12 17:21:06.414592: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05027000 of size 1024 next 174 2025-12-12 17:21:06.414605: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05027400 of size 1024 next 175 2025-12-12 17:21:06.414618: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05027800 of size 1024 next 176 2025-12-12 17:21:06.414630: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05027c00 of size 1024 next 177 2025-12-12 17:21:06.414642: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05028000 of size 1024 next 178 2025-12-12 17:21:06.414655: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05028400 of size 256 next 180 2025-12-12 17:21:06.414667: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05028500 of size 256 next 181 2025-12-12 17:21:06.414680: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05028600 of size 1024 next 179 2025-12-12 17:21:06.414692: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05028a00 of size 1024 next 184 2025-12-12 17:21:06.414705: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05028e00 of size 1024 next 185 2025-12-12 17:21:06.414717: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05029200 of size 1024 next 186 2025-12-12 17:21:06.414730: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05029600 of size 1024 next 187 2025-12-12 17:21:06.414742: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05029a00 of size 256 next 189 2025-12-12 17:21:06.414755: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05029b00 of size 256 next 190 2025-12-12 17:21:06.414768: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05029c00 of size 4096 next 188 2025-12-12 17:21:06.414781: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a0502ac00 of size 4096 next 42 2025-12-12 17:21:06.414794: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a0502bc00 of size 65536 next 36 2025-12-12 17:21:06.414806: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a0503bc00 of size 65536 next 35 2025-12-12 17:21:06.414819: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a0504bc00 of size 4096 next 236 2025-12-12 17:21:06.414840: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a0504cc00 of size 4096 next 237 2025-12-12 17:21:06.414853: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a0504dc00 of size 4096 next 238 2025-12-12 17:21:06.414865: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a0504ec00 of size 4096 next 239 2025-12-12 17:21:06.414878: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a0504fc00 of size 1024 next 240 2025-12-12 17:21:06.414890: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05050000 of size 1024 next 241 2025-12-12 17:21:06.414903: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05050400 of size 1024 next 242 2025-12-12 17:21:06.414915: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05050800 of size 1024 next 243 2025-12-12 17:21:06.414928: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05050c00 of size 1024 next 244 2025-12-12 17:21:06.414940: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05051000 of size 1024 next 248 2025-12-12 17:21:06.414953: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05051400 of size 1024 next 249 2025-12-12 17:21:06.414965: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05051800 of size 1024 next 250 2025-12-12 17:21:06.414978: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05051c00 of size 1024 next 251 2025-12-12 17:21:06.414990: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05052000 of size 1024 next 252 2025-12-12 17:21:06.415003: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05052400 of size 4096 next 254 2025-12-12 17:21:06.415015: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05053400 of size 4096 next 255 2025-12-12 17:21:06.415028: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05054400 of size 4096 next 256 2025-12-12 17:21:06.415040: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05055400 of size 4096 next 257 2025-12-12 17:21:06.415053: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05056400 of size 4096 next 258 2025-12-12 17:21:06.415065: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05057400 of size 1024 next 259 2025-12-12 17:21:06.415078: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05057800 of size 1024 next 260 2025-12-12 17:21:06.415090: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05057c00 of size 1024 next 261 2025-12-12 17:21:06.415103: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05058000 of size 1024 next 262 2025-12-12 17:21:06.415115: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05058400 of size 1024 next 263 2025-12-12 17:21:06.415128: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05058800 of size 1024 next 264 2025-12-12 17:21:06.415140: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05058c00 of size 1024 next 266 2025-12-12 17:21:06.415153: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05059000 of size 1024 next 267 2025-12-12 17:21:06.415165: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05059400 of size 1024 next 268 2025-12-12 17:21:06.415178: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05059800 of size 1024 next 269 2025-12-12 17:21:06.415190: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05059c00 of size 4096 next 271 2025-12-12 17:21:06.415202: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a0505ac00 of size 4096 next 272 2025-12-12 17:21:06.415215: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a0505bc00 of size 4096 next 273 2025-12-12 17:21:06.415227: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a0505cc00 of size 4096 next 274 2025-12-12 17:21:06.415240: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a0505dc00 of size 4096 next 275 2025-12-12 17:21:06.415261: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a0505ec00 of size 1024 next 276 2025-12-12 17:21:06.415273: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a0505f000 of size 1024 next 277 2025-12-12 17:21:06.415286: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a0505f400 of size 1024 next 278 2025-12-12 17:21:06.415298: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a0505f800 of size 1024 next 279 2025-12-12 17:21:06.415311: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a0505fc00 of size 1024 next 280 2025-12-12 17:21:06.415323: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05060000 of size 256 next 281 2025-12-12 17:21:06.415336: I tensorflow/core/common_runtime/bfc_allocator.cc:990] Free at 7f5a05060100 of size 15104 next 27 2025-12-12 17:21:06.415349: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05063c00 of size 147456 next 26 2025-12-12 17:21:06.415361: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05087c00 of size 65536 next 47 2025-12-12 17:21:06.415374: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05097c00 of size 65536 next 59 2025-12-12 17:21:06.415387: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a050a7c00 of size 65536 next 65 2025-12-12 17:21:06.415399: I tensorflow/core/common_runtime/bfc_allocator.cc:990] Free at 7f5a050b7c00 of size 163840 next 55 2025-12-12 17:21:06.415412: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a050dfc00 of size 147456 next 54 2025-12-12 17:21:06.415424: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05103c00 of size 65536 next 78 2025-12-12 17:21:06.415437: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05113c00 of size 4096 next 193 2025-12-12 17:21:06.415449: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05114c00 of size 4096 next 194 2025-12-12 17:21:06.415462: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05115c00 of size 4096 next 195 2025-12-12 17:21:06.415474: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05116c00 of size 256 next 196 2025-12-12 17:21:06.415487: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05116d00 of size 256 next 197 2025-12-12 17:21:06.415499: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05116e00 of size 4096 next 199 2025-12-12 17:21:06.415512: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05117e00 of size 4096 next 200 2025-12-12 17:21:06.415524: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05118e00 of size 4096 next 201 2025-12-12 17:21:06.415537: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05119e00 of size 4096 next 202 2025-12-12 17:21:06.415549: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a0511ae00 of size 4096 next 203 2025-12-12 17:21:06.415562: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a0511be00 of size 1024 next 204 2025-12-12 17:21:06.415574: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a0511c200 of size 1024 next 206 2025-12-12 17:21:06.415587: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a0511c600 of size 1024 next 207 2025-12-12 17:21:06.415599: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a0511ca00 of size 1024 next 208 2025-12-12 17:21:06.415612: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a0511ce00 of size 1024 next 209 2025-12-12 17:21:06.415624: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a0511d200 of size 1024 next 210 2025-12-12 17:21:06.415637: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a0511d600 of size 1024 next 213 2025-12-12 17:21:06.415649: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a0511da00 of size 1024 next 214 2025-12-12 17:21:06.415670: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a0511de00 of size 1024 next 215 2025-12-12 17:21:06.415683: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a0511e200 of size 1024 next 216 2025-12-12 17:21:06.415696: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a0511e600 of size 4096 next 217 2025-12-12 17:21:06.415708: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a0511f600 of size 4096 next 219 2025-12-12 17:21:06.415721: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05120600 of size 4096 next 220 2025-12-12 17:21:06.415733: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05121600 of size 4096 next 221 2025-12-12 17:21:06.415746: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05122600 of size 4096 next 222 2025-12-12 17:21:06.415758: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05123600 of size 1024 next 224 2025-12-12 17:21:06.415771: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05123a00 of size 1024 next 225 2025-12-12 17:21:06.415783: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05123e00 of size 1024 next 226 2025-12-12 17:21:06.415796: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05124200 of size 1024 next 227 2025-12-12 17:21:06.415808: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05124600 of size 1024 next 228 2025-12-12 17:21:06.415821: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05124a00 of size 1024 next 229 2025-12-12 17:21:06.415833: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05124e00 of size 1024 next 231 2025-12-12 17:21:06.415846: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05125200 of size 1024 next 232 2025-12-12 17:21:06.415858: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05125600 of size 1024 next 233 2025-12-12 17:21:06.415871: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05125a00 of size 1024 next 234 2025-12-12 17:21:06.415883: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05125e00 of size 7680 next 72 2025-12-12 17:21:06.415896: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a05127c00 of size 147456 next 71 2025-12-12 17:21:06.415909: I tensorflow/core/common_runtime/bfc_allocator.cc:990] Free at 7f5a0514bc00 of size 131072 next 87 2025-12-12 17:21:06.415922: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a0516bc00 of size 131072 next 86 2025-12-12 17:21:06.415935: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f5a0518bc00 of size 476160 next 18446744073709551615 2025-12-12 17:21:06.415947: I tensorflow/core/common_runtime/bfc_allocator.cc:995] Summary of in-use Chunks by size: 2025-12-12 17:21:06.415968: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 60 Chunks of size 256 totalling 15.0KiB 2025-12-12 17:21:06.415983: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 40 Chunks of size 512 totalling 20.0KiB 2025-12-12 17:21:06.415997: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 75 Chunks of size 1024 totalling 75.0KiB 2025-12-12 17:21:06.416011: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 25 Chunks of size 2048 totalling 50.0KiB 2025-12-12 17:21:06.416025: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 2304 totalling 2.2KiB 2025-12-12 17:21:06.416039: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 29 Chunks of size 4096 totalling 116.0KiB 2025-12-12 17:21:06.416053: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 7680 totalling 7.5KiB 2025-12-12 17:21:06.416067: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 16384 totalling 16.0KiB 2025-12-12 17:21:06.416081: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 37632 totalling 36.8KiB 2025-12-12 17:21:06.416104: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 6 Chunks of size 65536 totalling 384.0KiB 2025-12-12 17:21:06.416118: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 131072 totalling 128.0KiB 2025-12-12 17:21:06.416132: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 3 Chunks of size 147456 totalling 432.0KiB 2025-12-12 17:21:06.416146: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 4 Chunks of size 262144 totalling 1.00MiB 2025-12-12 17:21:06.416160: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 2 Chunks of size 327680 totalling 640.0KiB 2025-12-12 17:21:06.416174: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 476160 totalling 465.0KiB 2025-12-12 17:21:06.416188: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 2 Chunks of size 524288 totalling 1.00MiB 2025-12-12 17:21:06.416202: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 3 Chunks of size 589824 totalling 1.69MiB 2025-12-12 17:21:06.416216: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 786432 totalling 768.0KiB 2025-12-12 17:21:06.416229: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 7 Chunks of size 1048576 totalling 7.00MiB 2025-12-12 17:21:06.416243: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 3 Chunks of size 1310720 totalling 3.75MiB 2025-12-12 17:21:06.416257: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 2097152 totalling 2.00MiB 2025-12-12 17:21:06.416271: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 3 Chunks of size 2359296 totalling 6.75MiB 2025-12-12 17:21:06.416284: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 2883584 totalling 2.75MiB 2025-12-12 17:21:06.416298: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 3670016 totalling 3.50MiB 2025-12-12 17:21:06.416313: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 4323072 totalling 4.12MiB 2025-12-12 17:21:06.416332: I tensorflow/core/common_runtime/bfc_allocator.cc:1002] Sum Total of in-use chunks: 36.64MiB 2025-12-12 17:21:06.416350: I tensorflow/core/common_runtime/bfc_allocator.cc:1004] total_region_allocated_bytes_: 42860544 memory_limit_: 42860544 available bytes: 0 curr_region_allocation_bytes_: 67108864 2025-12-12 17:21:06.416371: I tensorflow/core/common_runtime/bfc_allocator.cc:1010] Stats: Limit: 42860544 InUse: 38421760 MaxInUse: 38421760 NumAllocs: 888 MaxAllocSize: 4323072 2025-12-12 17:21:06.416395: W tensorflow/core/common_runtime/bfc_allocator.cc:439] *******************xx*********__******x***********************xxxx*_***************_**************** 2025-12-12 17:21:06.416438: W tensorflow/core/framework/op_kernel.cc:1753] OP_REQUIRES failed at cwise_ops_common.h:134 : Resource exhausted: OOM when allocating tensor with shape[3,3,256,256] and type float on /job:localhost/replica:0/task:0/device:GPU:0 by allocator GPU_0_bfc RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 Exception in mask_detect : OOM when allocating tensor with shape[3,3,256,256] and type float on /job:localhost/replica:0/task:0/device:GPU:0 by allocator GPU_0_bfc [Op:Mul] we want to redo the detection Using TensorFlow backend. max_time_sub_proc : 3600 erreur pendant la detection Useless call to update_current_state in case -12 caffe_path_current : About to save ! 1 Inside saveOutput : final : True verbose : False eke 12-6-18 : saveMask need to be cleaned for new output ! ERROR : mask output needs to be a dictionnary now ! No output to save, continue without doing anything ! save missing photos in datou_result : After save, about to update current ! datou_cur_ids : [] len(datou.list_steps) : 1 output : -12 free memory after detection : begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 86 ############################### TEST detect object ################################ run mask_detect Inside batchDatouExec : verbose : False Catched exception ! Connect or reconnect ! # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : mask_detect list_input_json : [] origin BFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 1 ; length of list_pids : 1 ; length of list_args : 1 time to download the photos : 0.24758553504943848 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : False number of steps : 1 step1:mask_detect Fri Dec 12 17:21:07 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory havn't enough memory gpu , need / 3000 l 3632 free memory gpu now : 417 wait 20 seconds l 3637 free memory gpu now : 417 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-12-12 17:21:31.067573: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-12-12 17:21:31.094559: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493010000 Hz 2025-12-12 17:21:31.096594: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f5aa4000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-12-12 17:21:31.096639: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-12-12 17:21:31.100217: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-12-12 17:21:31.341009: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x25875ca0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-12-12 17:21:31.341050: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-12-12 17:21:31.341888: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-12-12 17:21:31.342242: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-12-12 17:21:31.345201: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-12-12 17:21:31.347793: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-12-12 17:21:31.348284: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-12-12 17:21:31.351473: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-12-12 17:21:31.352474: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-12-12 17:21:31.356577: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-12-12 17:21:31.357334: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-12-12 17:21:31.357388: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-12-12 17:21:31.357820: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-12-12 17:21:31.357835: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-12-12 17:21:31.357844: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-12-12 17:21:31.358588: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 40 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl454 thcls : [{'id': 454, 'mtr_user_id': 31, 'name': 'mask_coco_origin', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'backgroud,person,bicycle,car,motorcycle,airplane,bus,train,truck,boat,trafficlight,firehydrant,stopsign,parkingmeter,bench,bird,cat,dog,horse,sheep,cow,elephant,bear,zebra,giraffe,backpack,umbrella,handbag,tie,suitcase,frisbee,skis,snowboard,sportsball,kite,baseballbat,baseballglove,skateboard,surfboard,tennisracket,bottle,wineglass,cup,fork,knife,spoon,bowl,banana,apple,sandwich,orange,broccoli,carrot,hotdog,pizza,donut,cake,chair,couch,pottedplant,bed,diningtable,toilet,tv,laptop,mouse,remote,keyboard,cellphone,microwave,oven,toaster,sink,refrigerator,book,clock,vase,scissors,teddybear,hairdrier,toothbrush', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 445, 'photo_desc_type': 3473, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0'}] thcl {'id': 454, 'mtr_user_id': 31, 'name': 'mask_coco_origin', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'backgroud,person,bicycle,car,motorcycle,airplane,bus,train,truck,boat,trafficlight,firehydrant,stopsign,parkingmeter,bench,bird,cat,dog,horse,sheep,cow,elephant,bear,zebra,giraffe,backpack,umbrella,handbag,tie,suitcase,frisbee,skis,snowboard,sportsball,kite,baseballbat,baseballglove,skateboard,surfboard,tennisracket,bottle,wineglass,cup,fork,knife,spoon,bowl,banana,apple,sandwich,orange,broccoli,carrot,hotdog,pizza,donut,cake,chair,couch,pottedplant,bed,diningtable,toilet,tv,laptop,mouse,remote,keyboard,cellphone,microwave,oven,toaster,sink,refrigerator,book,clock,vase,scissors,teddybear,hairdrier,toothbrush', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 445, 'photo_desc_type': 3473, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 3473 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (3473, 'mask_coco_origin', 16384, 25088, 'mask_coco_origin', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2018, 3, 19, 10, 42, 21), datetime.datetime(2018, 3, 19, 10, 42, 21)) {'thcl': {'id': 454, 'mtr_user_id': 31, 'name': 'mask_coco_origin', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'backgroud,person,bicycle,car,motorcycle,airplane,bus,train,truck,boat,trafficlight,firehydrant,stopsign,parkingmeter,bench,bird,cat,dog,horse,sheep,cow,elephant,bear,zebra,giraffe,backpack,umbrella,handbag,tie,suitcase,frisbee,skis,snowboard,sportsball,kite,baseballbat,baseballglove,skateboard,surfboard,tennisracket,bottle,wineglass,cup,fork,knife,spoon,bowl,banana,apple,sandwich,orange,broccoli,carrot,hotdog,pizza,donut,cake,chair,couch,pottedplant,bed,diningtable,toilet,tv,laptop,mouse,remote,keyboard,cellphone,microwave,oven,toaster,sink,refrigerator,book,clock,vase,scissors,teddybear,hairdrier,toothbrush', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 445, 'photo_desc_type': 3473, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['backgroud', 'person', 'bicycle', 'car', 'motorcycle', 'airplane', 'bus', 'train', 'truck', 'boat', 'trafficlight', 'firehydrant', 'stopsign', 'parkingmeter', 'bench', 'bird', 'cat', 'dog', 'horse', 'sheep', 'cow', 'elephant', 'bear', 'zebra', 'giraffe', 'backpack', 'umbrella', 'handbag', 'tie', 'suitcase', 'frisbee', 'skis', 'snowboard', 'sportsball', 'kite', 'baseballbat', 'baseballglove', 'skateboard', 'surfboard', 'tennisracket', 'bottle', 'wineglass', 'cup', 'fork', 'knife', 'spoon', 'bowl', 'banana', 'apple', 'sandwich', 'orange', 'broccoli', 'carrot', 'hotdog', 'pizza', 'donut', 'cake', 'chair', 'couch', 'pottedplant', 'bed', 'diningtable', 'toilet', 'tv', 'laptop', 'mouse', 'remote', 'keyboard', 'cellphone', 'microwave', 'oven', 'toaster', 'sink', 'refrigerator', 'book', 'clock', 'vase', 'scissors', 'teddybear', 'hairdrier', 'toothbrush'], 'list_hashtags_csv': 'backgroud,person,bicycle,car,motorcycle,airplane,bus,train,truck,boat,trafficlight,firehydrant,stopsign,parkingmeter,bench,bird,cat,dog,horse,sheep,cow,elephant,bear,zebra,giraffe,backpack,umbrella,handbag,tie,suitcase,frisbee,skis,snowboard,sportsball,kite,baseballbat,baseballglove,skateboard,surfboard,tennisracket,bottle,wineglass,cup,fork,knife,spoon,bowl,banana,apple,sandwich,orange,broccoli,carrot,hotdog,pizza,donut,cake,chair,couch,pottedplant,bed,diningtable,toilet,tv,laptop,mouse,remote,keyboard,cellphone,microwave,oven,toaster,sink,refrigerator,book,clock,vase,scissors,teddybear,hairdrier,toothbrush', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 445, 'svm_hashtag_type_desc': 3473, 'photo_desc_type': 3473, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['backgroud', 'person', 'bicycle', 'car', 'motorcycle', 'airplane', 'bus', 'train', 'truck', 'boat', 'trafficlight', 'firehydrant', 'stopsign', 'parkingmeter', 'bench', 'bird', 'cat', 'dog', 'horse', 'sheep', 'cow', 'elephant', 'bear', 'zebra', 'giraffe', 'backpack', 'umbrella', 'handbag', 'tie', 'suitcase', 'frisbee', 'skis', 'snowboard', 'sportsball', 'kite', 'baseballbat', 'baseballglove', 'skateboard', 'surfboard', 'tennisracket', 'bottle', 'wineglass', 'cup', 'fork', 'knife', 'spoon', 'bowl', 'banana', 'apple', 'sandwich', 'orange', 'broccoli', 'carrot', 'hotdog', 'pizza', 'donut', 'cake', 'chair', 'couch', 'pottedplant', 'bed', 'diningtable', 'toilet', 'tv', 'laptop', 'mouse', 'remote', 'keyboard', 'cellphone', 'microwave', 'oven', 'toaster', 'sink', 'refrigerator', 'book', 'clock', 'vase', 'scissors', 'teddybear', 'hairdrier', 'toothbrush'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME mask_coco_origin NUM_CLASSES 81 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 2025-12-12 17:21:32.077440: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-12-12 17:21:32.077521: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-12-12 17:21:32.077542: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-12-12 17:21:32.077561: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-12-12 17:21:32.077579: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-12-12 17:21:32.077597: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-12-12 17:21:32.077615: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-12-12 17:21:32.077634: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-12-12 17:21:32.078435: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-12-12 17:21:32.079392: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-12-12 17:21:32.079436: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-12-12 17:21:32.079458: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-12-12 17:21:32.079479: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-12-12 17:21:32.079499: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-12-12 17:21:32.079519: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-12-12 17:21:32.079551: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-12-12 17:21:32.079573: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-12-12 17:21:32.080248: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-12-12 17:21:32.080274: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-12-12 17:21:32.080282: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-12-12 17:21:32.080289: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-12-12 17:21:32.080936: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 40 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) 2025-12-12 17:21:43.325840: W tensorflow/core/common_runtime/bfc_allocator.cc:434] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.25MiB (rounded to 2359296) Current allocation summary follows. 2025-12-12 17:21:43.325913: I tensorflow/core/common_runtime/bfc_allocator.cc:934] BFCAllocator dump for GPU_0_bfc 2025-12-12 17:21:43.325930: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (256): Total Chunks: 59, Chunks in use: 59. 14.8KiB allocated for chunks. 14.8KiB in use in bin. 8.8KiB client-requested in use in bin. 2025-12-12 17:21:43.325943: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (512): Total Chunks: 40, Chunks in use: 40. 20.0KiB allocated for chunks. 20.0KiB in use in bin. 20.0KiB client-requested in use in bin. 2025-12-12 17:21:43.325955: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (1024): Total Chunks: 76, Chunks in use: 76. 76.2KiB allocated for chunks. 76.2KiB in use in bin. 76.0KiB client-requested in use in bin. 2025-12-12 17:21:43.325966: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (2048): Total Chunks: 25, Chunks in use: 25. 50.0KiB allocated for chunks. 50.0KiB in use in bin. 50.0KiB client-requested in use in bin. 2025-12-12 17:21:43.325979: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (4096): Total Chunks: 30, Chunks in use: 30. 123.5KiB allocated for chunks. 123.5KiB in use in bin. 120.0KiB client-requested in use in bin. 2025-12-12 17:21:43.325990: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (8192): Total Chunks: 1, Chunks in use: 0. 15.0KiB allocated for chunks. 0B in use in bin. 0B client-requested in use in bin. 2025-12-12 17:21:43.326002: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (16384): Total Chunks: 1, Chunks in use: 1. 16.0KiB allocated for chunks. 16.0KiB in use in bin. 16.0KiB client-requested in use in bin. 2025-12-12 17:21:43.326013: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (32768): Total Chunks: 1, Chunks in use: 1. 36.8KiB allocated for chunks. 36.8KiB in use in bin. 36.8KiB client-requested in use in bin. 2025-12-12 17:21:43.326025: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (65536): Total Chunks: 6, Chunks in use: 6. 384.0KiB allocated for chunks. 384.0KiB in use in bin. 384.0KiB client-requested in use in bin. 2025-12-12 17:21:43.326036: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (131072): Total Chunks: 4, Chunks in use: 4. 560.0KiB allocated for chunks. 560.0KiB in use in bin. 560.0KiB client-requested in use in bin. 2025-12-12 17:21:43.326047: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (262144): Total Chunks: 9, Chunks in use: 7. 2.41MiB allocated for chunks. 1.91MiB in use in bin. 1.75MiB client-requested in use in bin. 2025-12-12 17:21:43.326058: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (524288): Total Chunks: 8, Chunks in use: 6. 4.95MiB allocated for chunks. 3.44MiB in use in bin. 3.25MiB client-requested in use in bin. 2025-12-12 17:21:43.326096: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (1048576): Total Chunks: 12, Chunks in use: 10. 13.12MiB allocated for chunks. 10.88MiB in use in bin. 10.00MiB client-requested in use in bin. 2025-12-12 17:21:43.326108: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (2097152): Total Chunks: 8, Chunks in use: 8. 19.12MiB allocated for chunks. 19.12MiB in use in bin. 17.75MiB client-requested in use in bin. 2025-12-12 17:21:43.326118: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (4194304): Total Chunks: 0, Chunks in use: 0. 0B allocated for chunks. 0B in use in bin. 0B client-requested in use in bin. 2025-12-12 17:21:43.326128: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (8388608): Total Chunks: 0, Chunks in use: 0. 0B allocated for chunks. 0B in use in bin. 0B client-requested in use in bin. 2025-12-12 17:21:43.326138: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (16777216): Total Chunks: 0, Chunks in use: 0. 0B allocated for chunks. 0B in use in bin. 0B client-requested in use in bin. 2025-12-12 17:21:43.326147: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (33554432): Total Chunks: 0, Chunks in use: 0. 0B allocated for chunks. 0B in use in bin. 0B client-requested in use in bin. 2025-12-12 17:21:43.326157: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (67108864): Total Chunks: 0, Chunks in use: 0. 0B allocated for chunks. 0B in use in bin. 0B client-requested in use in bin. 2025-12-12 17:21:43.326166: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (134217728): Total Chunks: 0, Chunks in use: 0. 0B allocated for chunks. 0B in use in bin. 0B client-requested in use in bin. 2025-12-12 17:21:43.326176: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (268435456): Total Chunks: 0, Chunks in use: 0. 0B allocated for chunks. 0B in use in bin. 0B client-requested in use in bin. 2025-12-12 17:21:43.326186: I tensorflow/core/common_runtime/bfc_allocator.cc:957] Bin for 2.25MiB was 2.00MiB, Chunk State: 2025-12-12 17:21:43.326195: I tensorflow/core/common_runtime/bfc_allocator.cc:970] Next region of size 16777216 2025-12-12 17:21:43.326212: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f58c6000000 of size 2359296 next 181 2025-12-12 17:21:43.326221: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f58c6240000 of size 2097152 next 196 2025-12-12 17:21:43.326230: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f58c6440000 of size 1048576 next 216 2025-12-12 17:21:43.326239: I tensorflow/core/common_runtime/bfc_allocator.cc:990] Free at 7f58c6540000 of size 1310720 next 209 2025-12-12 17:21:43.326247: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f58c6680000 of size 2359296 next 208 2025-12-12 17:21:43.326256: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f58c68c0000 of size 1048576 next 234 2025-12-12 17:21:43.326265: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f58c69c0000 of size 1310720 next 228 2025-12-12 17:21:43.326280: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f58c6b00000 of size 2359296 next 227 2025-12-12 17:21:43.326290: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f58c6d40000 of size 2883584 next 18446744073709551615 2025-12-12 17:21:43.326299: I tensorflow/core/common_runtime/bfc_allocator.cc:970] Next region of size 10354688 2025-12-12 17:21:43.326307: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f58c7000000 of size 2359296 next 245 2025-12-12 17:21:43.326316: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f58c7240000 of size 1048576 next 269 2025-12-12 17:21:43.326324: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f58c7340000 of size 1310720 next 263 2025-12-12 17:21:43.326333: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f58c7480000 of size 2359296 next 262 2025-12-12 17:21:43.326341: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f58c76c0000 of size 3276800 next 18446744073709551615 2025-12-12 17:21:43.326358: I tensorflow/core/common_runtime/bfc_allocator.cc:970] Next region of size 2097152 2025-12-12 17:21:43.326367: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f58c8600000 of size 147456 next 55 2025-12-12 17:21:43.326376: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f58c8624000 of size 65536 next 78 2025-12-12 17:21:43.326385: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f58c8634000 of size 4096 next 191 2025-12-12 17:21:43.326393: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f58c8635000 of size 4096 next 192 2025-12-12 17:21:43.326402: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f58c8636000 of size 4096 next 193 2025-12-12 17:21:43.326411: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f58c8637000 of size 256 next 194 2025-12-12 17:21:43.326419: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f58c8637100 of size 256 next 195 2025-12-12 17:21:43.326427: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f58c8637200 of size 4096 next 197 2025-12-12 17:21:43.326436: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f58c8638200 of size 4096 next 198 2025-12-12 17:21:43.326444: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f58c8639200 of size 4096 next 199 2025-12-12 17:21:43.326453: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f58c863a200 of size 4096 next 200 2025-12-12 17:21:43.326461: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f58c863b200 of size 4096 next 201 2025-12-12 17:21:43.326469: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f58c863c200 of size 1024 next 202 2025-12-12 17:21:43.326478: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f58c863c600 of size 1024 next 204 2025-12-12 17:21:43.326486: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f58c863ca00 of size 1024 next 205 2025-12-12 17:21:43.326495: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f58c863ce00 of size 1024 next 206 2025-12-12 17:21:43.326503: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f58c863d200 of size 1024 next 207 2025-12-12 17:21:43.326511: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f58c863d600 of size 1024 next 210 2025-12-12 17:21:43.326520: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f58c863da00 of size 1024 next 211 2025-12-12 17:21:43.326528: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f58c863de00 of size 1024 next 212 2025-12-12 17:21:43.326536: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f58c863e200 of size 1024 next 213 2025-12-12 17:21:43.326545: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f58c863e600 of size 1024 next 214 2025-12-12 17:21:43.326553: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f58c863ea00 of size 4096 next 215 2025-12-12 17:21:43.326562: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f58c863fa00 of size 4096 next 217 2025-12-12 17:21:43.326570: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f58c8640a00 of size 4096 next 218 2025-12-12 17:21:43.326578: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f58c8641a00 of size 4096 next 219 2025-12-12 17:21:43.326587: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f58c8642a00 of size 4096 next 220 2025-12-12 17:21:43.326595: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f58c8643a00 of size 1024 next 221 2025-12-12 17:21:43.326604: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f58c8643e00 of size 1024 next 223 2025-12-12 17:21:43.326612: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f58c8644200 of size 1024 next 224 2025-12-12 17:21:43.326620: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f58c8644600 of size 1024 next 225 2025-12-12 17:21:43.326635: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f58c8644a00 of size 1024 next 226 2025-12-12 17:21:43.326644: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f58c8644e00 of size 1024 next 229 2025-12-12 17:21:43.326652: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f58c8645200 of size 1024 next 230 2025-12-12 17:21:43.326661: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f58c8645600 of size 1024 next 231 2025-12-12 17:21:43.326669: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f58c8645a00 of size 1024 next 232 2025-12-12 17:21:43.326677: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f58c8645e00 of size 1024 next 233 2025-12-12 17:21:43.326686: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f58c8646200 of size 7680 next 72 2025-12-12 17:21:43.326694: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f58c8648000 of size 147456 next 71 2025-12-12 17:21:43.326703: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f58c866c000 of size 131072 next 87 2025-12-12 17:21:43.326711: I tensorflow/core/common_runtime/bfc_allocator.cc:990] Free at 7f58c868c000 of size 262144 next 103 2025-12-12 17:21:43.326720: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f58c86cc000 of size 262144 next 102 2025-12-12 17:21:43.326729: I tensorflow/core/common_runtime/bfc_allocator.cc:990] Free at 7f58c870c000 of size 999424 next 18446744073709551615 2025-12-12 17:21:43.326737: I tensorflow/core/common_runtime/bfc_allocator.cc:970] Next region of size 4194304 2025-12-12 17:21:43.326746: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f58c8800000 of size 589824 next 96 2025-12-12 17:21:43.326754: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f58c8890000 of size 262144 next 117 2025-12-12 17:21:43.326763: I tensorflow/core/common_runtime/bfc_allocator.cc:990] Free at 7f58c88d0000 of size 262144 next 112 2025-12-12 17:21:43.326771: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f58c8910000 of size 524288 next 111 2025-12-12 17:21:43.326780: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f58c8990000 of size 262144 next 135 2025-12-12 17:21:43.326788: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f58c89d0000 of size 327680 next 124 2025-12-12 17:21:43.326797: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f58c8a20000 of size 589824 next 123 2025-12-12 17:21:43.326805: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f58c8ab0000 of size 262144 next 152 2025-12-12 17:21:43.326814: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f58c8af0000 of size 327680 next 142 2025-12-12 17:21:43.326822: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f58c8b40000 of size 786432 next 18446744073709551615 2025-12-12 17:21:43.326831: I tensorflow/core/common_runtime/bfc_allocator.cc:970] Next region of size 8388608 2025-12-12 17:21:43.326839: I tensorflow/core/common_runtime/bfc_allocator.cc:990] Free at 7f58c8c00000 of size 589824 next 160 2025-12-12 17:21:43.326848: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f58c8c90000 of size 589824 next 158 2025-12-12 17:21:43.326856: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f58c8d20000 of size 524288 next 171 2025-12-12 17:21:43.326865: I tensorflow/core/common_runtime/bfc_allocator.cc:990] Free at 7f58c8da0000 of size 1048576 next 222 2025-12-12 17:21:43.326873: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f58c8ea0000 of size 1048576 next 190 2025-12-12 17:21:43.326882: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f58c8fa0000 of size 1048576 next 189 2025-12-12 17:21:43.326890: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f58c90a0000 of size 1048576 next 203 2025-12-12 17:21:43.326899: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f58c91a0000 of size 1048576 next 251 2025-12-12 17:21:43.326914: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f58c92a0000 of size 1441792 next 18446744073709551615 2025-12-12 17:21:43.326922: I tensorflow/core/common_runtime/bfc_allocator.cc:970] Next region of size 1048576 2025-12-12 17:21:43.326931: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee00000 of size 1280 next 1 2025-12-12 17:21:43.326939: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee00500 of size 256 next 5 2025-12-12 17:21:43.326948: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee00600 of size 256 next 8 2025-12-12 17:21:43.326956: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee00700 of size 256 next 9 2025-12-12 17:21:43.326965: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee00800 of size 256 next 10 2025-12-12 17:21:43.326973: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee00900 of size 256 next 11 2025-12-12 17:21:43.326982: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee00a00 of size 256 next 12 2025-12-12 17:21:43.326990: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee00b00 of size 256 next 13 2025-12-12 17:21:43.326998: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee00c00 of size 256 next 17 2025-12-12 17:21:43.327007: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee00d00 of size 256 next 19 2025-12-12 17:21:43.327015: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee00e00 of size 256 next 20 2025-12-12 17:21:43.327023: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee00f00 of size 256 next 21 2025-12-12 17:21:43.327032: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee01000 of size 256 next 22 2025-12-12 17:21:43.327040: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee01100 of size 256 next 24 2025-12-12 17:21:43.327049: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee01200 of size 256 next 25 2025-12-12 17:21:43.327057: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee01300 of size 256 next 23 2025-12-12 17:21:43.327065: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee01400 of size 256 next 28 2025-12-12 17:21:43.327074: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee01500 of size 256 next 29 2025-12-12 17:21:43.327082: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee01600 of size 256 next 30 2025-12-12 17:21:43.327090: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee01700 of size 256 next 31 2025-12-12 17:21:43.327099: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee01800 of size 256 next 33 2025-12-12 17:21:43.327107: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee01900 of size 256 next 34 2025-12-12 17:21:43.327116: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee01a00 of size 1024 next 32 2025-12-12 17:21:43.327124: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee01e00 of size 1024 next 37 2025-12-12 17:21:43.327132: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee02200 of size 1024 next 38 2025-12-12 17:21:43.327141: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee02600 of size 1024 next 39 2025-12-12 17:21:43.327149: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee02a00 of size 1024 next 40 2025-12-12 17:21:43.327157: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee02e00 of size 1024 next 41 2025-12-12 17:21:43.327166: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee03200 of size 1024 next 43 2025-12-12 17:21:43.327174: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee03600 of size 1024 next 44 2025-12-12 17:21:43.327182: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee03a00 of size 1024 next 45 2025-12-12 17:21:43.327197: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee03e00 of size 1024 next 46 2025-12-12 17:21:43.327206: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee04200 of size 256 next 48 2025-12-12 17:21:43.327214: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee04300 of size 256 next 49 2025-12-12 17:21:43.327223: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee04400 of size 256 next 50 2025-12-12 17:21:43.327231: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee04500 of size 256 next 51 2025-12-12 17:21:43.327239: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee04600 of size 256 next 52 2025-12-12 17:21:43.327248: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee04700 of size 256 next 53 2025-12-12 17:21:43.327256: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee04800 of size 256 next 56 2025-12-12 17:21:43.327265: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee04900 of size 256 next 57 2025-12-12 17:21:43.327273: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee04a00 of size 256 next 58 2025-12-12 17:21:43.327281: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee04b00 of size 256 next 14 2025-12-12 17:21:43.327290: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee04c00 of size 256 next 15 2025-12-12 17:21:43.327298: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee04d00 of size 256 next 16 2025-12-12 17:21:43.327307: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee04e00 of size 1024 next 60 2025-12-12 17:21:43.327315: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee05200 of size 1024 next 61 2025-12-12 17:21:43.327323: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee05600 of size 1024 next 62 2025-12-12 17:21:43.327332: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee05a00 of size 1024 next 63 2025-12-12 17:21:43.327340: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee05e00 of size 1024 next 64 2025-12-12 17:21:43.327348: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee06200 of size 256 next 66 2025-12-12 17:21:43.327357: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee06300 of size 256 next 67 2025-12-12 17:21:43.327365: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee06400 of size 256 next 68 2025-12-12 17:21:43.327373: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee06500 of size 256 next 69 2025-12-12 17:21:43.327382: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee06600 of size 256 next 70 2025-12-12 17:21:43.327390: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee06700 of size 256 next 73 2025-12-12 17:21:43.327398: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee06800 of size 256 next 74 2025-12-12 17:21:43.327407: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee06900 of size 256 next 75 2025-12-12 17:21:43.327415: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee06a00 of size 256 next 76 2025-12-12 17:21:43.327423: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee06b00 of size 256 next 77 2025-12-12 17:21:43.327432: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee06c00 of size 1024 next 79 2025-12-12 17:21:43.327440: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee07000 of size 1024 next 80 2025-12-12 17:21:43.327449: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee07400 of size 1024 next 81 2025-12-12 17:21:43.327457: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee07800 of size 1024 next 82 2025-12-12 17:21:43.327472: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee07c00 of size 1024 next 83 2025-12-12 17:21:43.327480: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee08000 of size 256 next 85 2025-12-12 17:21:43.327489: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee08100 of size 256 next 86 2025-12-12 17:21:43.327497: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee08200 of size 512 next 84 2025-12-12 17:21:43.327506: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee08400 of size 512 next 88 2025-12-12 17:21:43.327514: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee08600 of size 512 next 89 2025-12-12 17:21:43.327523: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee08800 of size 512 next 90 2025-12-12 17:21:43.327531: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee08a00 of size 512 next 91 2025-12-12 17:21:43.327539: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee08c00 of size 256 next 93 2025-12-12 17:21:43.327548: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee08d00 of size 256 next 94 2025-12-12 17:21:43.327556: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee08e00 of size 512 next 92 2025-12-12 17:21:43.327565: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee09000 of size 512 next 97 2025-12-12 17:21:43.327573: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee09200 of size 512 next 98 2025-12-12 17:21:43.327581: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee09400 of size 512 next 99 2025-12-12 17:21:43.327590: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee09600 of size 512 next 2 2025-12-12 17:21:43.327598: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee09800 of size 256 next 3 2025-12-12 17:21:43.327607: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee09900 of size 256 next 4 2025-12-12 17:21:43.327615: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee09a00 of size 16384 next 18 2025-12-12 17:21:43.327624: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee0da00 of size 256 next 100 2025-12-12 17:21:43.327632: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee0db00 of size 256 next 101 2025-12-12 17:21:43.327641: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee0dc00 of size 2048 next 104 2025-12-12 17:21:43.327649: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee0e400 of size 2048 next 105 2025-12-12 17:21:43.327658: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee0ec00 of size 2048 next 106 2025-12-12 17:21:43.327666: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee0f400 of size 2048 next 107 2025-12-12 17:21:43.327675: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee0fc00 of size 2048 next 108 2025-12-12 17:21:43.327683: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee10400 of size 256 next 109 2025-12-12 17:21:43.327692: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee10500 of size 256 next 110 2025-12-12 17:21:43.327700: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee10600 of size 2048 next 113 2025-12-12 17:21:43.327709: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee10e00 of size 2048 next 114 2025-12-12 17:21:43.327717: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee11600 of size 2048 next 115 2025-12-12 17:21:43.327725: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee11e00 of size 2048 next 116 2025-12-12 17:21:43.327734: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee12600 of size 2048 next 6 2025-12-12 17:21:43.327742: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee12e00 of size 37632 next 7 2025-12-12 17:21:43.327757: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee1c100 of size 512 next 118 2025-12-12 17:21:43.327766: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee1c300 of size 512 next 119 2025-12-12 17:21:43.327774: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee1c500 of size 512 next 120 2025-12-12 17:21:43.327783: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee1c700 of size 512 next 121 2025-12-12 17:21:43.327791: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee1c900 of size 512 next 122 2025-12-12 17:21:43.327800: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee1cb00 of size 512 next 125 2025-12-12 17:21:43.327808: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee1cd00 of size 512 next 126 2025-12-12 17:21:43.327816: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee1cf00 of size 512 next 127 2025-12-12 17:21:43.327825: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee1d100 of size 512 next 128 2025-12-12 17:21:43.327833: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee1d300 of size 512 next 129 2025-12-12 17:21:43.327842: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee1d500 of size 2048 next 130 2025-12-12 17:21:43.327850: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee1dd00 of size 2048 next 131 2025-12-12 17:21:43.327859: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee1e500 of size 2048 next 132 2025-12-12 17:21:43.327867: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee1ed00 of size 2048 next 133 2025-12-12 17:21:43.327876: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee1f500 of size 2048 next 134 2025-12-12 17:21:43.327884: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee1fd00 of size 512 next 136 2025-12-12 17:21:43.327892: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee1ff00 of size 512 next 137 2025-12-12 17:21:43.327901: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee20100 of size 512 next 138 2025-12-12 17:21:43.327909: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee20300 of size 512 next 139 2025-12-12 17:21:43.327917: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee20500 of size 512 next 140 2025-12-12 17:21:43.327926: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee20700 of size 512 next 141 2025-12-12 17:21:43.327934: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee20900 of size 512 next 143 2025-12-12 17:21:43.327943: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee20b00 of size 512 next 144 2025-12-12 17:21:43.327951: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee20d00 of size 512 next 145 2025-12-12 17:21:43.327959: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee20f00 of size 512 next 146 2025-12-12 17:21:43.327968: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee21100 of size 2048 next 147 2025-12-12 17:21:43.327976: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee21900 of size 2048 next 148 2025-12-12 17:21:43.327985: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee22100 of size 2048 next 149 2025-12-12 17:21:43.327993: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee22900 of size 2048 next 150 2025-12-12 17:21:43.328002: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee23100 of size 2048 next 151 2025-12-12 17:21:43.328010: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee23900 of size 512 next 153 2025-12-12 17:21:43.328018: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee23b00 of size 512 next 154 2025-12-12 17:21:43.328034: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee23d00 of size 512 next 155 2025-12-12 17:21:43.328042: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee23f00 of size 512 next 156 2025-12-12 17:21:43.328051: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee24100 of size 512 next 157 2025-12-12 17:21:43.328059: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee24300 of size 512 next 161 2025-12-12 17:21:43.328068: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee24500 of size 512 next 162 2025-12-12 17:21:43.328076: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee24700 of size 512 next 163 2025-12-12 17:21:43.328085: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee24900 of size 512 next 164 2025-12-12 17:21:43.328093: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee24b00 of size 512 next 165 2025-12-12 17:21:43.328101: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee24d00 of size 2048 next 166 2025-12-12 17:21:43.328110: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee25500 of size 2048 next 167 2025-12-12 17:21:43.328118: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee25d00 of size 2048 next 168 2025-12-12 17:21:43.328127: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee26500 of size 2048 next 169 2025-12-12 17:21:43.328135: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee26d00 of size 2048 next 170 2025-12-12 17:21:43.328143: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee27500 of size 1024 next 172 2025-12-12 17:21:43.328152: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee27900 of size 1024 next 173 2025-12-12 17:21:43.328160: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee27d00 of size 1024 next 174 2025-12-12 17:21:43.328169: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee28100 of size 1024 next 175 2025-12-12 17:21:43.328177: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee28500 of size 1024 next 176 2025-12-12 17:21:43.328185: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee28900 of size 256 next 178 2025-12-12 17:21:43.328194: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee28a00 of size 256 next 179 2025-12-12 17:21:43.328202: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee28b00 of size 1024 next 177 2025-12-12 17:21:43.328211: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee28f00 of size 1024 next 182 2025-12-12 17:21:43.328219: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee29300 of size 1024 next 183 2025-12-12 17:21:43.328228: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee29700 of size 1024 next 184 2025-12-12 17:21:43.328236: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee29b00 of size 1024 next 185 2025-12-12 17:21:43.328244: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee29f00 of size 256 next 187 2025-12-12 17:21:43.328253: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee2a000 of size 256 next 188 2025-12-12 17:21:43.328261: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee2a100 of size 4096 next 186 2025-12-12 17:21:43.328270: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee2b100 of size 4096 next 42 2025-12-12 17:21:43.328278: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee2c100 of size 65536 next 36 2025-12-12 17:21:43.328287: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee3c100 of size 65536 next 35 2025-12-12 17:21:43.328295: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee4c100 of size 4096 next 235 2025-12-12 17:21:43.328303: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee4d100 of size 4096 next 236 2025-12-12 17:21:43.328318: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee4e100 of size 4096 next 237 2025-12-12 17:21:43.328327: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee4f100 of size 4096 next 238 2025-12-12 17:21:43.328335: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee50100 of size 1024 next 239 2025-12-12 17:21:43.328343: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee50500 of size 1024 next 240 2025-12-12 17:21:43.328352: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee50900 of size 1024 next 241 2025-12-12 17:21:43.328360: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee50d00 of size 1024 next 242 2025-12-12 17:21:43.328368: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee51100 of size 1024 next 243 2025-12-12 17:21:43.328377: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee51500 of size 1024 next 246 2025-12-12 17:21:43.328386: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee51900 of size 1024 next 247 2025-12-12 17:21:43.328394: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee51d00 of size 1024 next 248 2025-12-12 17:21:43.328403: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee52100 of size 1024 next 249 2025-12-12 17:21:43.328411: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee52500 of size 1024 next 250 2025-12-12 17:21:43.328420: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee52900 of size 4096 next 252 2025-12-12 17:21:43.328428: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee53900 of size 4096 next 253 2025-12-12 17:21:43.328437: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee54900 of size 4096 next 254 2025-12-12 17:21:43.328445: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee55900 of size 4096 next 255 2025-12-12 17:21:43.328453: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee56900 of size 4096 next 256 2025-12-12 17:21:43.328462: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee57900 of size 1024 next 257 2025-12-12 17:21:43.328470: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee57d00 of size 1024 next 258 2025-12-12 17:21:43.328479: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee58100 of size 1024 next 259 2025-12-12 17:21:43.328487: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee58500 of size 1024 next 260 2025-12-12 17:21:43.328495: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee58900 of size 1024 next 261 2025-12-12 17:21:43.328504: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee58d00 of size 1024 next 264 2025-12-12 17:21:43.328512: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee59100 of size 1024 next 265 2025-12-12 17:21:43.328521: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee59500 of size 1024 next 266 2025-12-12 17:21:43.328529: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee59900 of size 1024 next 267 2025-12-12 17:21:43.328537: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee59d00 of size 1024 next 268 2025-12-12 17:21:43.328546: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee5a100 of size 4096 next 270 2025-12-12 17:21:43.328554: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee5b100 of size 4096 next 271 2025-12-12 17:21:43.328563: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee5c100 of size 4096 next 272 2025-12-12 17:21:43.328571: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee5d100 of size 4096 next 273 2025-12-12 17:21:43.328579: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee5e100 of size 4096 next 274 2025-12-12 17:21:43.328594: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee5f100 of size 1024 next 275 2025-12-12 17:21:43.328603: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee5f500 of size 1024 next 276 2025-12-12 17:21:43.328611: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee5f900 of size 1024 next 277 2025-12-12 17:21:43.328620: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee5fd00 of size 1024 next 278 2025-12-12 17:21:43.328628: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee60100 of size 1024 next 279 2025-12-12 17:21:43.328636: I tensorflow/core/common_runtime/bfc_allocator.cc:990] Free at 7f59fee60500 of size 15360 next 27 2025-12-12 17:21:43.328645: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee64100 of size 147456 next 26 2025-12-12 17:21:43.328653: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee88100 of size 65536 next 47 2025-12-12 17:21:43.328662: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59fee98100 of size 65536 next 59 2025-12-12 17:21:43.328670: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59feea8100 of size 65536 next 65 2025-12-12 17:21:43.328679: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f59feeb8100 of size 294656 next 18446744073709551615 2025-12-12 17:21:43.328687: I tensorflow/core/common_runtime/bfc_allocator.cc:995] Summary of in-use Chunks by size: 2025-12-12 17:21:43.328699: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 59 Chunks of size 256 totalling 14.8KiB 2025-12-12 17:21:43.328709: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 40 Chunks of size 512 totalling 20.0KiB 2025-12-12 17:21:43.328719: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 75 Chunks of size 1024 totalling 75.0KiB 2025-12-12 17:21:43.328728: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 1280 totalling 1.2KiB 2025-12-12 17:21:43.328737: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 25 Chunks of size 2048 totalling 50.0KiB 2025-12-12 17:21:43.328746: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 29 Chunks of size 4096 totalling 116.0KiB 2025-12-12 17:21:43.328756: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 7680 totalling 7.5KiB 2025-12-12 17:21:43.328765: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 16384 totalling 16.0KiB 2025-12-12 17:21:43.328774: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 37632 totalling 36.8KiB 2025-12-12 17:21:43.328784: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 6 Chunks of size 65536 totalling 384.0KiB 2025-12-12 17:21:43.328793: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 131072 totalling 128.0KiB 2025-12-12 17:21:43.328802: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 3 Chunks of size 147456 totalling 432.0KiB 2025-12-12 17:21:43.328812: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 4 Chunks of size 262144 totalling 1.00MiB 2025-12-12 17:21:43.328821: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 294656 totalling 287.8KiB 2025-12-12 17:21:43.328830: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 2 Chunks of size 327680 totalling 640.0KiB 2025-12-12 17:21:43.328840: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 2 Chunks of size 524288 totalling 1.00MiB 2025-12-12 17:21:43.328849: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 3 Chunks of size 589824 totalling 1.69MiB 2025-12-12 17:21:43.328858: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 786432 totalling 768.0KiB 2025-12-12 17:21:43.328867: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 7 Chunks of size 1048576 totalling 7.00MiB 2025-12-12 17:21:43.328877: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 2 Chunks of size 1310720 totalling 2.50MiB 2025-12-12 17:21:43.328886: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 1441792 totalling 1.38MiB 2025-12-12 17:21:43.328902: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 2097152 totalling 2.00MiB 2025-12-12 17:21:43.328911: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 5 Chunks of size 2359296 totalling 11.25MiB 2025-12-12 17:21:43.328921: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 2883584 totalling 2.75MiB 2025-12-12 17:21:43.328930: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 3276800 totalling 3.12MiB 2025-12-12 17:21:43.328939: I tensorflow/core/common_runtime/bfc_allocator.cc:1002] Sum Total of in-use chunks: 36.59MiB 2025-12-12 17:21:43.328947: I tensorflow/core/common_runtime/bfc_allocator.cc:1004] total_region_allocated_bytes_: 42860544 memory_limit_: 42860544 available bytes: 0 curr_region_allocation_bytes_: 67108864 2025-12-12 17:21:43.328962: I tensorflow/core/common_runtime/bfc_allocator.cc:1010] Stats: Limit: 42860544 InUse: 38372352 MaxInUse: 38372608 NumAllocs: 889 MaxAllocSize: 4325376 2025-12-12 17:21:43.328978: W tensorflow/core/common_runtime/bfc_allocator.cc:439] *************__***********************x***********************x***__**********_***__**************** 2025-12-12 17:21:43.329028: W tensorflow/core/framework/op_kernel.cc:1753] OP_REQUIRES failed at cwise_ops_common.h:134 : Resource exhausted: OOM when allocating tensor with shape[3,3,256,256] and type float on /job:localhost/replica:0/task:0/device:GPU:0 by allocator GPU_0_bfc RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 Exception in mask_detect : OOM when allocating tensor with shape[3,3,256,256] and type float on /job:localhost/replica:0/task:0/device:GPU:0 by allocator GPU_0_bfc [Op:Add] we want to redo the detection Using TensorFlow backend. max_time_sub_proc : 3600 erreur pendant la detection Useless call to update_current_state in case -12 caffe_path_current : About to save ! 1 Inside saveOutput : final : True verbose : False eke 12-6-18 : saveMask need to be cleaned for new output ! ERROR : mask output needs to be a dictionnary now ! No output to save, continue without doing anything ! save missing photos in datou_result : After save, about to update current ! datou_cur_ids : [] len(datou.list_steps) : 1 output : -12 ERROR : 'int' object is not subscriptable reconnect to base ! warning , we can't find thcl infos in json_data warning , we can't find pdt infos in json_data #&_# TEST FAILED #&_# : tests/mask_test #&_# Error : invalid literal for int() with base 10: "'int' object is not subscriptable" #&_# END OF TEST #&_# : tests/mask_test #&_# #&_# BEGIN OF TEST : tests/datou_test #&_# /home/admin/workarea/git/Velours/python/tests/datou_test.py Datou All Test python version used : 3 ############################### TEST sam ################################ TEST SAM Inside batchDatouExec : verbose : False # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : sam list_input_json : [] origin BFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 1 ; length of list_pids : 1 ; length of list_args : 1 time to download the photos : 0.1928706169128418 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! WARNING : we have an input that is not a photo, we should get rid of it Calling datou_exec Inside datou_exec : verbose : False number of steps : 1 step1:sam Fri Dec 12 17:21:43 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step sam ! Inside sam : nb paths : 1 ERROR in datou_step_exec, will save and exit ! CUDA error: out of memory CUDA kernel errors might be asynchronously reported at some other API call,so the stacktrace below might be incorrect. For debugging consider passing CUDA_LAUNCH_BLOCKING=1. File "/home/admin/workarea/git/Velours/python/mtr/datou/datou_lib.py", line 2339, in datou_exec output = datou_step_exec(sNext, args, cache, context, map_info, verbose, mtr_user_id) File "/home/admin/workarea/git/Velours/python/mtr/datou/datou_lib.py", line 2440, in datou_step_exec return lib_process.datou_step_sam(param, json_param, args, cache, context, map_info, verbose) File "/home/admin/workarea/git/Velours/python/mtr/datou/lib_step_exec/lib_step_process.py", line 367, in datou_step_sam sam.to(device=device) File "/home/admin/.local/lib/python3.8/site-packages/torch/nn/modules/module.py", line 927, in to return self._apply(convert) File "/home/admin/.local/lib/python3.8/site-packages/torch/nn/modules/module.py", line 579, in _apply module._apply(fn) File "/home/admin/.local/lib/python3.8/site-packages/torch/nn/modules/module.py", line 579, in _apply module._apply(fn) File "/home/admin/.local/lib/python3.8/site-packages/torch/nn/modules/module.py", line 579, in _apply module._apply(fn) File "/home/admin/.local/lib/python3.8/site-packages/torch/nn/modules/module.py", line 602, in _apply param_applied = fn(param) File "/home/admin/.local/lib/python3.8/site-packages/torch/nn/modules/module.py", line 925, in convert return t.to(device, dtype if t.is_floating_point() or t.is_complex() else None, non_blocking) [1189321094] begin to insert list_values into mtr_datou_result : length of list_values in save_final : 1 time used for this insertion : 0.04448962211608887 save_final ERROR in last step sam, CUDA error: out of memory CUDA kernel errors might be asynchronously reported at some other API call,so the stacktrace below might be incorrect. For debugging consider passing CUDA_LAUNCH_BLOCKING=1. time spend for datou_step_exec : 6.718735933303833 time spend to save output : 0.0457766056060791 total time spend for step 0 : 6.764512538909912 need to delete datou_research and reload, so keep current state 1 need to delete datou_research and reload, so keep current state 1 caffe_path_current : About to save ! 2 After save, about to update current ! datou_cur_ids : [] len(datou.list_steps) : 1 output : None ERROR nb objects espect : 98 nb_objects detect : 0 ERROR sam FAILED ############################### TEST frcnn ################################ Inside batchDatouExec : verbose : False # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : frcnn list_input_json : [] origin BFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 1 ; length of list_pids : 1 ; length of list_args : 1 time to download the photos : 0.16160917282104492 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : False number of steps : 1 step1:frcnn Fri Dec 12 17:21:50 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step Faster rcnn ! To loadFromThcl() model_param file didn't exist model_name : detection_plaque_valcor_010622 model_type : caffe_faster_rcnn list file need : ['caffemodel', 'test.prototxt'] file exist in s3 : ['caffemodel', 'test.prototxt'] file manque in s3 : [] WARNING: Logging before InitGoogleLogging() is written to STDERR E1212 17:21:52.722520 453828 common.cpp:114] Cannot create Cublas handle. Cublas won't be available. E1212 17:21:52.728104 453828 common.cpp:121] Cannot create Curand generator. Curand won't be available. F1212 17:21:52.737538 453828 syncedmem.hpp:22] Check failed: error == cudaSuccess (2 vs. 0) out of memory *** Check failure stack trace: *** Aborted (core dumped) No data to report. No data to report. ret : 34304 command : coverage3 html -i --omit=/usr/local/lib/python3.8/dist-packages/*,/home/admin/.local/lib/python3.8/site-packages/*,/usr/lib/python3/dist-packages/* -d htmlcov ret : 256 command : coverage3 report -i -m ret : 256 9.00user 9.26system 1:27.49elapsed 20%CPU (0avgtext+0avgdata 1477780maxresident)k 1542320inputs+3952outputs (4032major+724379minor)pagefaults 0swaps