python /home/admin/mtr/script_for_cron.py -j python_test3 -m 12 -a ' --short_python3 -v ' -s python_test3 -M 0 -S 0 -U 100,100,120 import MySQLdb succeeded Import error (python version) python version = 3 warning , we can't find thcl infos in json_data warning , we can't find pdt infos in json_data list_job_run_as_list : ['mask_detection', 'datou', 'CacheModelData_queries', 'CachePhotoData_queries', 'test_fork', 'prepare_maskdata', 'portfolio_queries', 'sla_mensuel'] python version used : 3 liste_fichiers : [('tests/mask_test', True, 'Test mask-detection ', 'mask_detection'), ('tests/datou_test', True, 'Datou All Test', 'datou', 'all'), ('mtr/database_queries/CacheModelData_queries', True, 'Test Cache Model Data', 'CacheModelData_queries'), ('tests/cache_photo_data_test', True, 'Test local_cache_photo ', 'CachePhotoData_queries'), ('mtr/mask_rcnn/prepare_maskdata', True, 'test prepare mask data', 'prepare_maskdata', 'all'), ('mtr/database_queries/portfolio_queries', True, 'test portfolio queries', 'portfolio_queries'), ('prod/memo/memo', True, 'SLA Mensuel', 'sla_mensuel', 'all')] #&_# BEGIN OF TEST : tests/mask_test #&_# /home/admin/workarea/git/Velours/python/tests/mask_test.py Test mask-detection python version used : 3 ############################### TEST memory used ################################ free memory at begining : begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 714 run mask_detect Inside batchDatouExec : verbose : False # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : mask_detect list_input_json : [] origin BFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 1 ; length of list_pids : 1 ; length of list_args : 1 time to download the photos : 0.11680078506469727 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : False number of steps : 1 step1:mask_detect Wed May 7 18:35:27 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory havn't enough memory gpu , need / 3000 l 3632 free memory gpu now : 714 wait 20 seconds l 3637 free memory gpu now : 714 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 /home/admin/workarea/git/Velours/python/tests/python_tests.py:11: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses import imp 2025-05-07 18:35:50.885394: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-05-07 18:35:50.893797: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-05-07 18:35:50.895895: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f45b8000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-05-07 18:35:50.895993: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-05-07 18:35:50.900428: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-05-07 18:35:51.139146: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x6d87810 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-05-07 18:35:51.139211: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-05-07 18:35:51.140204: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-07 18:35:51.140674: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-07 18:35:51.143676: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-07 18:35:51.147137: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-07 18:35:51.147631: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-07 18:35:51.150583: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-07 18:35:51.151687: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-07 18:35:51.157037: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-07 18:35:51.157973: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-07 18:35:51.158052: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-07 18:35:51.158514: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-07 18:35:51.158529: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-07 18:35:51.158538: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-07 18:35:51.159304: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 337 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl454 thcls : [{'id': 454, 'mtr_user_id': 31, 'name': 'mask_coco_origin', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'backgroud,person,bicycle,car,motorcycle,airplane,bus,train,truck,boat,trafficlight,firehydrant,stopsign,parkingmeter,bench,bird,cat,dog,horse,sheep,cow,elephant,bear,zebra,giraffe,backpack,umbrella,handbag,tie,suitcase,frisbee,skis,snowboard,sportsball,kite,baseballbat,baseballglove,skateboard,surfboard,tennisracket,bottle,wineglass,cup,fork,knife,spoon,bowl,banana,apple,sandwich,orange,broccoli,carrot,hotdog,pizza,donut,cake,chair,couch,pottedplant,bed,diningtable,toilet,tv,laptop,mouse,remote,keyboard,cellphone,microwave,oven,toaster,sink,refrigerator,book,clock,vase,scissors,teddybear,hairdrier,toothbrush', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 445, 'photo_desc_type': 3473, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0'}] thcl {'id': 454, 'mtr_user_id': 31, 'name': 'mask_coco_origin', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'backgroud,person,bicycle,car,motorcycle,airplane,bus,train,truck,boat,trafficlight,firehydrant,stopsign,parkingmeter,bench,bird,cat,dog,horse,sheep,cow,elephant,bear,zebra,giraffe,backpack,umbrella,handbag,tie,suitcase,frisbee,skis,snowboard,sportsball,kite,baseballbat,baseballglove,skateboard,surfboard,tennisracket,bottle,wineglass,cup,fork,knife,spoon,bowl,banana,apple,sandwich,orange,broccoli,carrot,hotdog,pizza,donut,cake,chair,couch,pottedplant,bed,diningtable,toilet,tv,laptop,mouse,remote,keyboard,cellphone,microwave,oven,toaster,sink,refrigerator,book,clock,vase,scissors,teddybear,hairdrier,toothbrush', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 445, 'photo_desc_type': 3473, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 3473 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (3473, 'mask_coco_origin', 16384, 25088, 'mask_coco_origin', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2018, 3, 19, 10, 42, 21), datetime.datetime(2018, 3, 19, 10, 42, 21)) {'thcl': {'id': 454, 'mtr_user_id': 31, 'name': 'mask_coco_origin', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'backgroud,person,bicycle,car,motorcycle,airplane,bus,train,truck,boat,trafficlight,firehydrant,stopsign,parkingmeter,bench,bird,cat,dog,horse,sheep,cow,elephant,bear,zebra,giraffe,backpack,umbrella,handbag,tie,suitcase,frisbee,skis,snowboard,sportsball,kite,baseballbat,baseballglove,skateboard,surfboard,tennisracket,bottle,wineglass,cup,fork,knife,spoon,bowl,banana,apple,sandwich,orange,broccoli,carrot,hotdog,pizza,donut,cake,chair,couch,pottedplant,bed,diningtable,toilet,tv,laptop,mouse,remote,keyboard,cellphone,microwave,oven,toaster,sink,refrigerator,book,clock,vase,scissors,teddybear,hairdrier,toothbrush', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 445, 'photo_desc_type': 3473, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['backgroud', 'person', 'bicycle', 'car', 'motorcycle', 'airplane', 'bus', 'train', 'truck', 'boat', 'trafficlight', 'firehydrant', 'stopsign', 'parkingmeter', 'bench', 'bird', 'cat', 'dog', 'horse', 'sheep', 'cow', 'elephant', 'bear', 'zebra', 'giraffe', 'backpack', 'umbrella', 'handbag', 'tie', 'suitcase', 'frisbee', 'skis', 'snowboard', 'sportsball', 'kite', 'baseballbat', 'baseballglove', 'skateboard', 'surfboard', 'tennisracket', 'bottle', 'wineglass', 'cup', 'fork', 'knife', 'spoon', 'bowl', 'banana', 'apple', 'sandwich', 'orange', 'broccoli', 'carrot', 'hotdog', 'pizza', 'donut', 'cake', 'chair', 'couch', 'pottedplant', 'bed', 'diningtable', 'toilet', 'tv', 'laptop', 'mouse', 'remote', 'keyboard', 'cellphone', 'microwave', 'oven', 'toaster', 'sink', 'refrigerator', 'book', 'clock', 'vase', 'scissors', 'teddybear', 'hairdrier', 'toothbrush'], 'list_hashtags_csv': 'backgroud,person,bicycle,car,motorcycle,airplane,bus,train,truck,boat,trafficlight,firehydrant,stopsign,parkingmeter,bench,bird,cat,dog,horse,sheep,cow,elephant,bear,zebra,giraffe,backpack,umbrella,handbag,tie,suitcase,frisbee,skis,snowboard,sportsball,kite,baseballbat,baseballglove,skateboard,surfboard,tennisracket,bottle,wineglass,cup,fork,knife,spoon,bowl,banana,apple,sandwich,orange,broccoli,carrot,hotdog,pizza,donut,cake,chair,couch,pottedplant,bed,diningtable,toilet,tv,laptop,mouse,remote,keyboard,cellphone,microwave,oven,toaster,sink,refrigerator,book,clock,vase,scissors,teddybear,hairdrier,toothbrush', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 445, 'svm_hashtag_type_desc': 3473, 'photo_desc_type': 3473, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['backgroud', 'person', 'bicycle', 'car', 'motorcycle', 'airplane', 'bus', 'train', 'truck', 'boat', 'trafficlight', 'firehydrant', 'stopsign', 'parkingmeter', 'bench', 'bird', 'cat', 'dog', 'horse', 'sheep', 'cow', 'elephant', 'bear', 'zebra', 'giraffe', 'backpack', 'umbrella', 'handbag', 'tie', 'suitcase', 'frisbee', 'skis', 'snowboard', 'sportsball', 'kite', 'baseballbat', 'baseballglove', 'skateboard', 'surfboard', 'tennisracket', 'bottle', 'wineglass', 'cup', 'fork', 'knife', 'spoon', 'bowl', 'banana', 'apple', 'sandwich', 'orange', 'broccoli', 'carrot', 'hotdog', 'pizza', 'donut', 'cake', 'chair', 'couch', 'pottedplant', 'bed', 'diningtable', 'toilet', 'tv', 'laptop', 'mouse', 'remote', 'keyboard', 'cellphone', 'microwave', 'oven', 'toaster', 'sink', 'refrigerator', 'book', 'clock', 'vase', 'scissors', 'teddybear', 'hairdrier', 'toothbrush'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME mask_coco_origin NUM_CLASSES 81 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 2025-05-07 18:35:51.833266: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-07 18:35:51.833348: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-07 18:35:51.833370: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-07 18:35:51.833391: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-07 18:35:51.833410: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-07 18:35:51.833429: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-07 18:35:51.833461: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-07 18:35:51.833487: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-07 18:35:51.834320: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-07 18:35:51.835442: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-07 18:35:51.835485: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-07 18:35:51.835511: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-07 18:35:51.835533: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-07 18:35:51.835553: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-07 18:35:51.835570: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-07 18:35:51.835587: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-07 18:35:51.835604: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-07 18:35:51.836419: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-07 18:35:51.836458: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-07 18:35:51.836470: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-07 18:35:51.836479: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-07 18:35:51.837399: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 337 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead 2025-05-07 18:36:03.837816: W tensorflow/core/common_runtime/bfc_allocator.cc:434] Allocator (GPU_0_bfc) ran out of memory trying to allocate 49.00MiB (rounded to 51380224) Current allocation summary follows. 2025-05-07 18:36:03.837940: I tensorflow/core/common_runtime/bfc_allocator.cc:934] BFCAllocator dump for GPU_0_bfc 2025-05-07 18:36:03.837960: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (256): Total Chunks: 78, Chunks in use: 78. 19.5KiB allocated for chunks. 19.5KiB in use in bin. 9.0KiB client-requested in use in bin. 2025-05-07 18:36:03.837976: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (512): Total Chunks: 40, Chunks in use: 40. 20.0KiB allocated for chunks. 20.0KiB in use in bin. 20.0KiB client-requested in use in bin. 2025-05-07 18:36:03.837992: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (1024): Total Chunks: 259, Chunks in use: 259. 259.2KiB allocated for chunks. 259.2KiB in use in bin. 259.0KiB client-requested in use in bin. 2025-05-07 18:36:03.838009: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (2048): Total Chunks: 56, Chunks in use: 56. 112.0KiB allocated for chunks. 112.0KiB in use in bin. 112.0KiB client-requested in use in bin. 2025-05-07 18:36:03.838024: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (4096): Total Chunks: 120, Chunks in use: 120. 487.5KiB allocated for chunks. 487.5KiB in use in bin. 480.0KiB client-requested in use in bin. 2025-05-07 18:36:03.838082: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (8192): Total Chunks: 23, Chunks in use: 21. 194.5KiB allocated for chunks. 172.0KiB in use in bin. 172.0KiB client-requested in use in bin. 2025-05-07 18:36:03.838098: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (16384): Total Chunks: 2, Chunks in use: 2. 40.0KiB allocated for chunks. 40.0KiB in use in bin. 40.0KiB client-requested in use in bin. 2025-05-07 18:36:03.838113: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (32768): Total Chunks: 2, Chunks in use: 1. 84.8KiB allocated for chunks. 36.8KiB in use in bin. 36.8KiB client-requested in use in bin. 2025-05-07 18:36:03.838129: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (65536): Total Chunks: 6, Chunks in use: 6. 384.0KiB allocated for chunks. 384.0KiB in use in bin. 384.0KiB client-requested in use in bin. 2025-05-07 18:36:03.838144: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (131072): Total Chunks: 5, Chunks in use: 4. 783.2KiB allocated for chunks. 560.0KiB in use in bin. 560.0KiB client-requested in use in bin. 2025-05-07 18:36:03.838159: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (262144): Total Chunks: 9, Chunks in use: 8. 2.66MiB allocated for chunks. 2.16MiB in use in bin. 2.00MiB client-requested in use in bin. 2025-05-07 18:36:03.838174: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (524288): Total Chunks: 8, Chunks in use: 7. 4.64MiB allocated for chunks. 3.94MiB in use in bin. 3.75MiB client-requested in use in bin. 2025-05-07 18:36:03.838190: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (1048576): Total Chunks: 47, Chunks in use: 46. 53.12MiB allocated for chunks. 51.88MiB in use in bin. 46.00MiB client-requested in use in bin. 2025-05-07 18:36:03.838205: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (2097152): Total Chunks: 31, Chunks in use: 29. 71.00MiB allocated for chunks. 66.25MiB in use in bin. 64.50MiB client-requested in use in bin. 2025-05-07 18:36:03.838221: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (4194304): Total Chunks: 10, Chunks in use: 7. 46.25MiB allocated for chunks. 30.50MiB in use in bin. 26.75MiB client-requested in use in bin. 2025-05-07 18:36:03.838236: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (8388608): Total Chunks: 4, Chunks in use: 4. 35.00MiB allocated for chunks. 35.00MiB in use in bin. 35.00MiB client-requested in use in bin. 2025-05-07 18:36:03.838250: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (16777216): Total Chunks: 0, Chunks in use: 0. 0B allocated for chunks. 0B in use in bin. 0B client-requested in use in bin. 2025-05-07 18:36:03.838265: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (33554432): Total Chunks: 1, Chunks in use: 0. 40.00MiB allocated for chunks. 0B in use in bin. 0B client-requested in use in bin. 2025-05-07 18:36:03.838280: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (67108864): Total Chunks: 1, Chunks in use: 1. 82.88MiB allocated for chunks. 82.88MiB in use in bin. 49.00MiB client-requested in use in bin. 2025-05-07 18:36:03.838294: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (134217728): Total Chunks: 0, Chunks in use: 0. 0B allocated for chunks. 0B in use in bin. 0B client-requested in use in bin. 2025-05-07 18:36:03.838307: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (268435456): Total Chunks: 0, Chunks in use: 0. 0B allocated for chunks. 0B in use in bin. 0B client-requested in use in bin. 2025-05-07 18:36:03.838322: I tensorflow/core/common_runtime/bfc_allocator.cc:957] Bin for 49.00MiB was 32.00MiB, Chunk State: 2025-05-07 18:36:03.838344: I tensorflow/core/common_runtime/bfc_allocator.cc:963] Size: 40.00MiB | Requested Size: 0B | in_use: 0 | bin_num: 17, prev: Size: 4.50MiB | Requested Size: 4.50MiB | in_use: 1 | bin_num: -1 2025-05-07 18:36:03.838368: I tensorflow/core/common_runtime/bfc_allocator.cc:970] Next region of size 86900736 2025-05-07 18:36:03.838387: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43be000000 of size 86900736 next 18446744073709551615 2025-05-07 18:36:03.838399: I tensorflow/core/common_runtime/bfc_allocator.cc:970] Next region of size 134217728 2025-05-07 18:36:03.838411: I tensorflow/core/common_runtime/bfc_allocator.cc:990] Free at 7f43c4000000 of size 4194304 next 632 2025-05-07 18:36:03.838423: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43c4400000 of size 4194304 next 617 2025-05-07 18:36:03.838435: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43c4800000 of size 4194304 next 616 2025-05-07 18:36:03.838448: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43c4c00000 of size 6291456 next 608 2025-05-07 18:36:03.838460: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43c5200000 of size 9437184 next 607 2025-05-07 18:36:03.838472: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43c5b00000 of size 4194304 next 644 2025-05-07 18:36:03.838484: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43c5f00000 of size 4194304 next 625 2025-05-07 18:36:03.838496: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43c6300000 of size 8388608 next 624 2025-05-07 18:36:03.838508: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43c6b00000 of size 4194304 next 661 2025-05-07 18:36:03.838520: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43c6f00000 of size 2359296 next 676 2025-05-07 18:36:03.838532: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43c7140000 of size 2359296 next 678 2025-05-07 18:36:03.838544: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43c7380000 of size 2359296 next 680 2025-05-07 18:36:03.838556: I tensorflow/core/common_runtime/bfc_allocator.cc:990] Free at 7f43c75c0000 of size 7602176 next 639 2025-05-07 18:36:03.838567: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43c7d00000 of size 9437184 next 638 2025-05-07 18:36:03.838579: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43c8600000 of size 9437184 next 656 2025-05-07 18:36:03.838591: I tensorflow/core/common_runtime/bfc_allocator.cc:990] Free at 7f43c8f00000 of size 4718592 next 685 2025-05-07 18:36:03.838603: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43c9380000 of size 4718592 next 684 2025-05-07 18:36:03.838615: I tensorflow/core/common_runtime/bfc_allocator.cc:990] Free at 7f43c9800000 of size 41943040 next 18446744073709551615 2025-05-07 18:36:03.838626: I tensorflow/core/common_runtime/bfc_allocator.cc:970] Next region of size 67108864 2025-05-07 18:36:03.838639: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43cc000000 of size 2359296 next 370 2025-05-07 18:36:03.838651: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43cc240000 of size 1048576 next 394 2025-05-07 18:36:03.838662: I tensorflow/core/common_runtime/bfc_allocator.cc:990] Free at 7f43cc340000 of size 1310720 next 388 2025-05-07 18:36:03.838674: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43cc480000 of size 2359296 next 387 2025-05-07 18:36:03.838686: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43cc6c0000 of size 1048576 next 412 2025-05-07 18:36:03.838698: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43cc7c0000 of size 1310720 next 406 2025-05-07 18:36:03.838710: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43cc900000 of size 2359296 next 405 2025-05-07 18:36:03.838721: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43ccb40000 of size 1048576 next 430 2025-05-07 18:36:03.838733: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43ccc40000 of size 1310720 next 424 2025-05-07 18:36:03.838745: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43ccd80000 of size 2359296 next 423 2025-05-07 18:36:03.838766: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43ccfc0000 of size 1048576 next 447 2025-05-07 18:36:03.838778: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43cd0c0000 of size 1310720 next 441 2025-05-07 18:36:03.838790: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43cd200000 of size 2359296 next 440 2025-05-07 18:36:03.838802: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43cd440000 of size 1048576 next 465 2025-05-07 18:36:03.838813: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43cd540000 of size 1310720 next 459 2025-05-07 18:36:03.838825: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43cd680000 of size 2359296 next 458 2025-05-07 18:36:03.838837: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43cd8c0000 of size 1048576 next 483 2025-05-07 18:36:03.838849: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43cd9c0000 of size 1310720 next 477 2025-05-07 18:36:03.838861: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43cdb00000 of size 2359296 next 476 2025-05-07 18:36:03.838873: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43cdd40000 of size 1048576 next 501 2025-05-07 18:36:03.838885: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43cde40000 of size 1310720 next 495 2025-05-07 18:36:03.838912: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43cdf80000 of size 2359296 next 494 2025-05-07 18:36:03.838926: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43ce1c0000 of size 1048576 next 519 2025-05-07 18:36:03.838938: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43ce2c0000 of size 1310720 next 513 2025-05-07 18:36:03.838950: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43ce400000 of size 2359296 next 512 2025-05-07 18:36:03.838962: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43ce640000 of size 1048576 next 537 2025-05-07 18:36:03.838974: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43ce740000 of size 1310720 next 531 2025-05-07 18:36:03.838985: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43ce880000 of size 2359296 next 530 2025-05-07 18:36:03.838997: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43ceac0000 of size 1048576 next 555 2025-05-07 18:36:03.839009: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43cebc0000 of size 1310720 next 549 2025-05-07 18:36:03.839020: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43ced00000 of size 2359296 next 548 2025-05-07 18:36:03.839032: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43cef40000 of size 1048576 next 573 2025-05-07 18:36:03.839044: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43cf040000 of size 1310720 next 567 2025-05-07 18:36:03.839056: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43cf180000 of size 2359296 next 566 2025-05-07 18:36:03.839067: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43cf3c0000 of size 1048576 next 591 2025-05-07 18:36:03.839079: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43cf4c0000 of size 1310720 next 585 2025-05-07 18:36:03.839091: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43cf600000 of size 2359296 next 584 2025-05-07 18:36:03.839103: I tensorflow/core/common_runtime/bfc_allocator.cc:990] Free at 7f43cf840000 of size 2097152 next 597 2025-05-07 18:36:03.839115: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43cfa40000 of size 2097152 next 596 2025-05-07 18:36:03.839127: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43cfc40000 of size 3932160 next 18446744073709551615 2025-05-07 18:36:03.839139: I tensorflow/core/common_runtime/bfc_allocator.cc:970] Next region of size 33554432 2025-05-07 18:36:03.839160: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d0000000 of size 2359296 next 245 2025-05-07 18:36:03.839172: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d0240000 of size 1048576 next 269 2025-05-07 18:36:03.839184: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d0340000 of size 1310720 next 263 2025-05-07 18:36:03.839196: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d0480000 of size 2359296 next 262 2025-05-07 18:36:03.839207: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d06c0000 of size 1048576 next 287 2025-05-07 18:36:03.839219: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d07c0000 of size 1310720 next 281 2025-05-07 18:36:03.839231: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d0900000 of size 2359296 next 280 2025-05-07 18:36:03.839243: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d0b40000 of size 1048576 next 304 2025-05-07 18:36:03.839255: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d0c40000 of size 1310720 next 298 2025-05-07 18:36:03.839267: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d0d80000 of size 2359296 next 297 2025-05-07 18:36:03.839278: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d0fc0000 of size 1048576 next 322 2025-05-07 18:36:03.839290: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d10c0000 of size 1310720 next 316 2025-05-07 18:36:03.839302: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d1200000 of size 2359296 next 315 2025-05-07 18:36:03.839314: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d1440000 of size 1048576 next 340 2025-05-07 18:36:03.839325: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d1540000 of size 1310720 next 334 2025-05-07 18:36:03.839337: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d1680000 of size 2359296 next 333 2025-05-07 18:36:03.839349: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d18c0000 of size 1048576 next 358 2025-05-07 18:36:03.839361: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d19c0000 of size 1310720 next 352 2025-05-07 18:36:03.839372: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d1b00000 of size 2359296 next 351 2025-05-07 18:36:03.839384: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d1d40000 of size 1048576 next 376 2025-05-07 18:36:03.839396: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d1e40000 of size 1835008 next 18446744073709551615 2025-05-07 18:36:03.839408: I tensorflow/core/common_runtime/bfc_allocator.cc:970] Next region of size 16777216 2025-05-07 18:36:03.839420: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2000000 of size 2359296 next 181 2025-05-07 18:36:03.839431: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2240000 of size 2097152 next 196 2025-05-07 18:36:03.839443: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2440000 of size 1048576 next 216 2025-05-07 18:36:03.839455: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2540000 of size 1310720 next 209 2025-05-07 18:36:03.839467: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2680000 of size 2359296 next 208 2025-05-07 18:36:03.839478: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d28c0000 of size 1048576 next 234 2025-05-07 18:36:03.839490: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d29c0000 of size 1310720 next 228 2025-05-07 18:36:03.839502: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2b00000 of size 2359296 next 227 2025-05-07 18:36:03.839514: I tensorflow/core/common_runtime/bfc_allocator.cc:990] Free at 7f43d2d40000 of size 2883584 next 18446744073709551615 2025-05-07 18:36:03.839533: I tensorflow/core/common_runtime/bfc_allocator.cc:970] Next region of size 2097152 2025-05-07 18:36:03.839546: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4600000 of size 147456 next 55 2025-05-07 18:36:03.839558: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4624000 of size 65536 next 78 2025-05-07 18:36:03.839570: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4634000 of size 4096 next 191 2025-05-07 18:36:03.839582: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4635000 of size 4096 next 192 2025-05-07 18:36:03.839594: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4636000 of size 4096 next 193 2025-05-07 18:36:03.839606: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4637000 of size 256 next 194 2025-05-07 18:36:03.839618: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4637100 of size 256 next 195 2025-05-07 18:36:03.839629: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4637200 of size 4096 next 197 2025-05-07 18:36:03.839641: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4638200 of size 4096 next 198 2025-05-07 18:36:03.839653: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4639200 of size 4096 next 199 2025-05-07 18:36:03.839665: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d463a200 of size 4096 next 200 2025-05-07 18:36:03.839676: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d463b200 of size 4096 next 201 2025-05-07 18:36:03.839689: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d463c200 of size 1024 next 202 2025-05-07 18:36:03.839700: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d463c600 of size 1024 next 204 2025-05-07 18:36:03.839712: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d463ca00 of size 1024 next 205 2025-05-07 18:36:03.839724: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d463ce00 of size 1024 next 206 2025-05-07 18:36:03.839736: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d463d200 of size 1024 next 207 2025-05-07 18:36:03.839748: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d463d600 of size 1024 next 210 2025-05-07 18:36:03.839760: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d463da00 of size 1024 next 211 2025-05-07 18:36:03.839772: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d463de00 of size 1024 next 212 2025-05-07 18:36:03.839784: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d463e200 of size 1024 next 213 2025-05-07 18:36:03.839796: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d463e600 of size 1024 next 214 2025-05-07 18:36:03.839807: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d463ea00 of size 4096 next 215 2025-05-07 18:36:03.839819: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d463fa00 of size 4096 next 217 2025-05-07 18:36:03.839831: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4640a00 of size 4096 next 218 2025-05-07 18:36:03.839843: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4641a00 of size 4096 next 219 2025-05-07 18:36:03.839855: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4642a00 of size 4096 next 220 2025-05-07 18:36:03.839866: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4643a00 of size 1024 next 221 2025-05-07 18:36:03.839878: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4643e00 of size 1024 next 223 2025-05-07 18:36:03.839890: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4644200 of size 1024 next 224 2025-05-07 18:36:03.839902: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4644600 of size 1024 next 225 2025-05-07 18:36:03.839913: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4644a00 of size 1024 next 226 2025-05-07 18:36:03.839933: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4644e00 of size 1024 next 229 2025-05-07 18:36:03.839945: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4645200 of size 1024 next 230 2025-05-07 18:36:03.839957: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4645600 of size 1024 next 231 2025-05-07 18:36:03.839969: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4645a00 of size 1024 next 232 2025-05-07 18:36:03.839981: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4645e00 of size 1024 next 233 2025-05-07 18:36:03.839993: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4646200 of size 7680 next 72 2025-05-07 18:36:03.840005: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4648000 of size 147456 next 71 2025-05-07 18:36:03.840017: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d466c000 of size 131072 next 87 2025-05-07 18:36:03.840029: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d468c000 of size 4096 next 289 2025-05-07 18:36:03.840040: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d468d000 of size 4096 next 290 2025-05-07 18:36:03.840052: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d468e000 of size 4096 next 291 2025-05-07 18:36:03.840064: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d468f000 of size 1024 next 292 2025-05-07 18:36:03.840076: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d468f400 of size 1024 next 293 2025-05-07 18:36:03.840088: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d468f800 of size 1024 next 294 2025-05-07 18:36:03.840099: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d468fc00 of size 1024 next 295 2025-05-07 18:36:03.840111: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4690000 of size 1024 next 296 2025-05-07 18:36:03.840123: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4690400 of size 1024 next 299 2025-05-07 18:36:03.840138: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4690800 of size 1024 next 300 2025-05-07 18:36:03.840153: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4690c00 of size 1024 next 301 2025-05-07 18:36:03.840169: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4691000 of size 1024 next 302 2025-05-07 18:36:03.840183: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4691400 of size 1024 next 303 2025-05-07 18:36:03.840197: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4691800 of size 4096 next 305 2025-05-07 18:36:03.840211: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4692800 of size 4096 next 306 2025-05-07 18:36:03.840225: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4693800 of size 4096 next 307 2025-05-07 18:36:03.840239: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4694800 of size 4096 next 308 2025-05-07 18:36:03.840254: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4695800 of size 4096 next 309 2025-05-07 18:36:03.840269: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4696800 of size 1024 next 310 2025-05-07 18:36:03.840283: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4696c00 of size 1024 next 311 2025-05-07 18:36:03.840299: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4697000 of size 1024 next 312 2025-05-07 18:36:03.840315: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4697400 of size 1024 next 313 2025-05-07 18:36:03.840330: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4697800 of size 1024 next 314 2025-05-07 18:36:03.840346: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4697c00 of size 1024 next 317 2025-05-07 18:36:03.840373: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4698000 of size 1024 next 318 2025-05-07 18:36:03.840390: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4698400 of size 1024 next 319 2025-05-07 18:36:03.840405: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4698800 of size 1024 next 320 2025-05-07 18:36:03.840420: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4698c00 of size 1024 next 321 2025-05-07 18:36:03.840435: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4699000 of size 4096 next 323 2025-05-07 18:36:03.840452: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d469a000 of size 4096 next 324 2025-05-07 18:36:03.840469: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d469b000 of size 4096 next 325 2025-05-07 18:36:03.840484: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d469c000 of size 4096 next 326 2025-05-07 18:36:03.840499: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d469d000 of size 4096 next 327 2025-05-07 18:36:03.840514: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d469e000 of size 1024 next 328 2025-05-07 18:36:03.840530: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d469e400 of size 1024 next 329 2025-05-07 18:36:03.840544: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d469e800 of size 1024 next 330 2025-05-07 18:36:03.840556: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d469ec00 of size 1024 next 331 2025-05-07 18:36:03.840567: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d469f000 of size 1024 next 332 2025-05-07 18:36:03.840579: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d469f400 of size 1024 next 335 2025-05-07 18:36:03.840591: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d469f800 of size 1024 next 336 2025-05-07 18:36:03.840603: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d469fc00 of size 1024 next 337 2025-05-07 18:36:03.840614: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d46a0000 of size 1024 next 338 2025-05-07 18:36:03.840626: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d46a0400 of size 1024 next 339 2025-05-07 18:36:03.840638: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d46a0800 of size 4096 next 341 2025-05-07 18:36:03.840650: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d46a1800 of size 4096 next 342 2025-05-07 18:36:03.840661: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d46a2800 of size 4096 next 343 2025-05-07 18:36:03.840673: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d46a3800 of size 4096 next 344 2025-05-07 18:36:03.840685: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d46a4800 of size 4096 next 345 2025-05-07 18:36:03.840697: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d46a5800 of size 1024 next 346 2025-05-07 18:36:03.840709: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d46a5c00 of size 1024 next 347 2025-05-07 18:36:03.840720: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d46a6000 of size 1024 next 348 2025-05-07 18:36:03.840732: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d46a6400 of size 1024 next 349 2025-05-07 18:36:03.840744: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d46a6800 of size 1024 next 350 2025-05-07 18:36:03.840755: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d46a6c00 of size 1024 next 353 2025-05-07 18:36:03.840767: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d46a7000 of size 1024 next 354 2025-05-07 18:36:03.840779: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d46a7400 of size 1024 next 355 2025-05-07 18:36:03.840801: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d46a7800 of size 1024 next 356 2025-05-07 18:36:03.840814: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d46a7c00 of size 1024 next 357 2025-05-07 18:36:03.840826: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d46a8000 of size 4096 next 359 2025-05-07 18:36:03.840837: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d46a9000 of size 4096 next 360 2025-05-07 18:36:03.840849: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d46aa000 of size 4096 next 361 2025-05-07 18:36:03.840861: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d46ab000 of size 4096 next 362 2025-05-07 18:36:03.840872: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d46ac000 of size 4096 next 363 2025-05-07 18:36:03.840884: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d46ad000 of size 1024 next 364 2025-05-07 18:36:03.840896: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d46ad400 of size 1024 next 365 2025-05-07 18:36:03.840908: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d46ad800 of size 1024 next 366 2025-05-07 18:36:03.840920: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d46adc00 of size 1024 next 367 2025-05-07 18:36:03.840931: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d46ae000 of size 1024 next 368 2025-05-07 18:36:03.840943: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d46ae400 of size 1024 next 371 2025-05-07 18:36:03.840955: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d46ae800 of size 1024 next 372 2025-05-07 18:36:03.840967: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d46aec00 of size 1024 next 373 2025-05-07 18:36:03.840978: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d46af000 of size 1024 next 374 2025-05-07 18:36:03.840990: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d46af400 of size 1024 next 375 2025-05-07 18:36:03.841002: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d46af800 of size 4096 next 377 2025-05-07 18:36:03.841014: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d46b0800 of size 4096 next 378 2025-05-07 18:36:03.841025: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d46b1800 of size 4096 next 379 2025-05-07 18:36:03.841037: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d46b2800 of size 4096 next 380 2025-05-07 18:36:03.841049: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d46b3800 of size 4096 next 381 2025-05-07 18:36:03.841060: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d46b4800 of size 1024 next 382 2025-05-07 18:36:03.841072: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d46b4c00 of size 1024 next 383 2025-05-07 18:36:03.841084: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d46b5000 of size 1024 next 384 2025-05-07 18:36:03.841096: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d46b5400 of size 1024 next 385 2025-05-07 18:36:03.841107: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d46b5800 of size 1024 next 386 2025-05-07 18:36:03.841119: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d46b5c00 of size 1024 next 389 2025-05-07 18:36:03.841131: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d46b6000 of size 1024 next 390 2025-05-07 18:36:03.841143: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d46b6400 of size 1024 next 391 2025-05-07 18:36:03.841154: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d46b6800 of size 1024 next 392 2025-05-07 18:36:03.841166: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d46b6c00 of size 1024 next 393 2025-05-07 18:36:03.841178: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d46b7000 of size 4096 next 395 2025-05-07 18:36:03.841198: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d46b8000 of size 4096 next 396 2025-05-07 18:36:03.841211: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d46b9000 of size 4096 next 397 2025-05-07 18:36:03.841222: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d46ba000 of size 4096 next 398 2025-05-07 18:36:03.841234: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d46bb000 of size 4096 next 399 2025-05-07 18:36:03.841246: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d46bc000 of size 1024 next 400 2025-05-07 18:36:03.841258: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d46bc400 of size 1024 next 401 2025-05-07 18:36:03.841270: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d46bc800 of size 1024 next 402 2025-05-07 18:36:03.841281: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d46bcc00 of size 1024 next 403 2025-05-07 18:36:03.841293: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d46bd000 of size 1024 next 404 2025-05-07 18:36:03.841305: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d46bd400 of size 1024 next 407 2025-05-07 18:36:03.841316: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d46bd800 of size 1024 next 408 2025-05-07 18:36:03.841328: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d46bdc00 of size 1024 next 409 2025-05-07 18:36:03.841340: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d46be000 of size 1024 next 410 2025-05-07 18:36:03.841351: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d46be400 of size 1024 next 411 2025-05-07 18:36:03.841363: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d46be800 of size 4096 next 413 2025-05-07 18:36:03.841375: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d46bf800 of size 4096 next 414 2025-05-07 18:36:03.841387: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d46c0800 of size 4096 next 415 2025-05-07 18:36:03.841398: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d46c1800 of size 4096 next 416 2025-05-07 18:36:03.841410: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d46c2800 of size 4096 next 417 2025-05-07 18:36:03.841422: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d46c3800 of size 1024 next 418 2025-05-07 18:36:03.841434: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d46c3c00 of size 1024 next 419 2025-05-07 18:36:03.841445: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d46c4000 of size 1024 next 420 2025-05-07 18:36:03.841457: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d46c4400 of size 1024 next 421 2025-05-07 18:36:03.841469: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d46c4800 of size 1024 next 422 2025-05-07 18:36:03.841481: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d46c4c00 of size 1024 next 425 2025-05-07 18:36:03.841492: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d46c5000 of size 1024 next 426 2025-05-07 18:36:03.841504: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d46c5400 of size 1024 next 427 2025-05-07 18:36:03.841516: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d46c5800 of size 1024 next 428 2025-05-07 18:36:03.841528: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d46c5c00 of size 1024 next 429 2025-05-07 18:36:03.841540: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d46c6000 of size 4096 next 431 2025-05-07 18:36:03.841551: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d46c7000 of size 4096 next 432 2025-05-07 18:36:03.841563: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d46c8000 of size 4096 next 433 2025-05-07 18:36:03.841583: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d46c9000 of size 4096 next 434 2025-05-07 18:36:03.841595: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d46ca000 of size 4096 next 435 2025-05-07 18:36:03.841607: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d46cb000 of size 1024 next 436 2025-05-07 18:36:03.841619: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d46cb400 of size 1024 next 437 2025-05-07 18:36:03.841630: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d46cb800 of size 1024 next 438 2025-05-07 18:36:03.841642: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d46cbc00 of size 1024 next 103 2025-05-07 18:36:03.841655: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d46cc000 of size 262144 next 102 2025-05-07 18:36:03.841666: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d470c000 of size 262144 next 674 2025-05-07 18:36:03.841678: I tensorflow/core/common_runtime/bfc_allocator.cc:990] Free at 7f43d474c000 of size 737280 next 18446744073709551615 2025-05-07 18:36:03.841690: I tensorflow/core/common_runtime/bfc_allocator.cc:970] Next region of size 4194304 2025-05-07 18:36:03.841703: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4800000 of size 589824 next 96 2025-05-07 18:36:03.841715: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4890000 of size 262144 next 117 2025-05-07 18:36:03.841726: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d48d0000 of size 1024 next 439 2025-05-07 18:36:03.841738: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d48d0400 of size 1024 next 442 2025-05-07 18:36:03.841750: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d48d0800 of size 1024 next 443 2025-05-07 18:36:03.841762: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d48d0c00 of size 1024 next 444 2025-05-07 18:36:03.841773: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d48d1000 of size 1024 next 445 2025-05-07 18:36:03.841785: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d48d1400 of size 1024 next 446 2025-05-07 18:36:03.841797: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d48d1800 of size 4096 next 448 2025-05-07 18:36:03.841809: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d48d2800 of size 4096 next 449 2025-05-07 18:36:03.841820: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d48d3800 of size 4096 next 450 2025-05-07 18:36:03.841832: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d48d4800 of size 4096 next 451 2025-05-07 18:36:03.841844: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d48d5800 of size 4096 next 452 2025-05-07 18:36:03.841855: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d48d6800 of size 1024 next 453 2025-05-07 18:36:03.841867: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d48d6c00 of size 1024 next 454 2025-05-07 18:36:03.841879: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d48d7000 of size 1024 next 455 2025-05-07 18:36:03.841890: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d48d7400 of size 1024 next 456 2025-05-07 18:36:03.841902: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d48d7800 of size 1024 next 457 2025-05-07 18:36:03.841914: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d48d7c00 of size 1024 next 460 2025-05-07 18:36:03.841926: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d48d8000 of size 1024 next 461 2025-05-07 18:36:03.841937: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d48d8400 of size 1024 next 462 2025-05-07 18:36:03.841949: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d48d8800 of size 1024 next 463 2025-05-07 18:36:03.841969: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d48d8c00 of size 1024 next 464 2025-05-07 18:36:03.841982: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d48d9000 of size 4096 next 466 2025-05-07 18:36:03.841993: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d48da000 of size 4096 next 467 2025-05-07 18:36:03.842005: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d48db000 of size 4096 next 468 2025-05-07 18:36:03.842017: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d48dc000 of size 4096 next 469 2025-05-07 18:36:03.842029: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d48dd000 of size 4096 next 470 2025-05-07 18:36:03.842040: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d48de000 of size 1024 next 471 2025-05-07 18:36:03.842052: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d48de400 of size 1024 next 472 2025-05-07 18:36:03.842064: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d48de800 of size 1024 next 473 2025-05-07 18:36:03.842075: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d48dec00 of size 1024 next 474 2025-05-07 18:36:03.842087: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d48df000 of size 1024 next 475 2025-05-07 18:36:03.842099: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d48df400 of size 1024 next 478 2025-05-07 18:36:03.842110: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d48df800 of size 1024 next 479 2025-05-07 18:36:03.842122: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d48dfc00 of size 1024 next 480 2025-05-07 18:36:03.842134: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d48e0000 of size 1024 next 481 2025-05-07 18:36:03.842146: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d48e0400 of size 1024 next 482 2025-05-07 18:36:03.842157: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d48e0800 of size 4096 next 484 2025-05-07 18:36:03.842169: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d48e1800 of size 4096 next 485 2025-05-07 18:36:03.842181: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d48e2800 of size 4096 next 486 2025-05-07 18:36:03.842193: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d48e3800 of size 4096 next 487 2025-05-07 18:36:03.842204: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d48e4800 of size 4096 next 488 2025-05-07 18:36:03.842216: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d48e5800 of size 1024 next 489 2025-05-07 18:36:03.842228: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d48e5c00 of size 1024 next 490 2025-05-07 18:36:03.842239: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d48e6000 of size 1024 next 491 2025-05-07 18:36:03.842251: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d48e6400 of size 1024 next 492 2025-05-07 18:36:03.842263: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d48e6800 of size 1024 next 493 2025-05-07 18:36:03.842275: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d48e6c00 of size 1024 next 496 2025-05-07 18:36:03.842287: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d48e7000 of size 1024 next 497 2025-05-07 18:36:03.842298: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d48e7400 of size 1024 next 498 2025-05-07 18:36:03.842310: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d48e7800 of size 1024 next 499 2025-05-07 18:36:03.842322: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d48e7c00 of size 1024 next 500 2025-05-07 18:36:03.842333: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d48e8000 of size 4096 next 502 2025-05-07 18:36:03.842353: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d48e9000 of size 4096 next 503 2025-05-07 18:36:03.842365: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d48ea000 of size 4096 next 504 2025-05-07 18:36:03.842377: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d48eb000 of size 4096 next 505 2025-05-07 18:36:03.842389: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d48ec000 of size 4096 next 506 2025-05-07 18:36:03.842401: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d48ed000 of size 1024 next 507 2025-05-07 18:36:03.842412: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d48ed400 of size 1024 next 508 2025-05-07 18:36:03.842424: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d48ed800 of size 1024 next 509 2025-05-07 18:36:03.842436: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d48edc00 of size 1024 next 510 2025-05-07 18:36:03.842447: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d48ee000 of size 1024 next 511 2025-05-07 18:36:03.842459: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d48ee400 of size 1024 next 514 2025-05-07 18:36:03.842471: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d48ee800 of size 1024 next 515 2025-05-07 18:36:03.842482: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d48eec00 of size 1024 next 516 2025-05-07 18:36:03.842494: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d48ef000 of size 1024 next 517 2025-05-07 18:36:03.842506: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d48ef400 of size 1024 next 518 2025-05-07 18:36:03.842517: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d48ef800 of size 4096 next 520 2025-05-07 18:36:03.842529: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d48f0800 of size 4096 next 521 2025-05-07 18:36:03.842541: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d48f1800 of size 4096 next 522 2025-05-07 18:36:03.842553: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d48f2800 of size 4096 next 523 2025-05-07 18:36:03.842565: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d48f3800 of size 4096 next 524 2025-05-07 18:36:03.842576: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d48f4800 of size 1024 next 525 2025-05-07 18:36:03.842588: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d48f4c00 of size 1024 next 526 2025-05-07 18:36:03.842600: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d48f5000 of size 1024 next 527 2025-05-07 18:36:03.842612: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d48f5400 of size 1024 next 528 2025-05-07 18:36:03.842623: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d48f5800 of size 1024 next 529 2025-05-07 18:36:03.842635: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d48f5c00 of size 1024 next 532 2025-05-07 18:36:03.842647: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d48f6000 of size 1024 next 533 2025-05-07 18:36:03.842658: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d48f6400 of size 1024 next 534 2025-05-07 18:36:03.842670: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d48f6800 of size 1024 next 535 2025-05-07 18:36:03.842682: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d48f6c00 of size 1024 next 536 2025-05-07 18:36:03.842693: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d48f7000 of size 4096 next 538 2025-05-07 18:36:03.842705: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d48f8000 of size 4096 next 539 2025-05-07 18:36:03.842717: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d48f9000 of size 4096 next 540 2025-05-07 18:36:03.842729: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d48fa000 of size 4096 next 541 2025-05-07 18:36:03.842745: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d48fb000 of size 4096 next 542 2025-05-07 18:36:03.842758: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d48fc000 of size 1024 next 543 2025-05-07 18:36:03.842769: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d48fc400 of size 1024 next 544 2025-05-07 18:36:03.842781: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d48fc800 of size 1024 next 545 2025-05-07 18:36:03.842793: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d48fcc00 of size 1024 next 546 2025-05-07 18:36:03.842804: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d48fd000 of size 1024 next 547 2025-05-07 18:36:03.842816: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d48fd400 of size 1024 next 550 2025-05-07 18:36:03.842828: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d48fd800 of size 1024 next 551 2025-05-07 18:36:03.842839: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d48fdc00 of size 1024 next 552 2025-05-07 18:36:03.842851: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d48fe000 of size 1024 next 553 2025-05-07 18:36:03.842863: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d48fe400 of size 1024 next 554 2025-05-07 18:36:03.842875: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d48fe800 of size 4096 next 556 2025-05-07 18:36:03.842886: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d48ff800 of size 4096 next 557 2025-05-07 18:36:03.842908: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4900800 of size 4096 next 558 2025-05-07 18:36:03.842922: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4901800 of size 4096 next 559 2025-05-07 18:36:03.842934: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4902800 of size 4096 next 560 2025-05-07 18:36:03.842946: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4903800 of size 1024 next 561 2025-05-07 18:36:03.842957: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4903c00 of size 1024 next 562 2025-05-07 18:36:03.842969: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4904000 of size 1024 next 563 2025-05-07 18:36:03.842981: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4904400 of size 1024 next 564 2025-05-07 18:36:03.842992: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4904800 of size 1024 next 565 2025-05-07 18:36:03.843004: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4904c00 of size 1024 next 568 2025-05-07 18:36:03.843016: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4905000 of size 1024 next 569 2025-05-07 18:36:03.843028: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4905400 of size 1024 next 570 2025-05-07 18:36:03.843039: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4905800 of size 1024 next 571 2025-05-07 18:36:03.843051: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4905c00 of size 1024 next 572 2025-05-07 18:36:03.843063: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4906000 of size 4096 next 574 2025-05-07 18:36:03.843074: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4907000 of size 4096 next 575 2025-05-07 18:36:03.843086: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4908000 of size 4096 next 576 2025-05-07 18:36:03.843098: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4909000 of size 4096 next 577 2025-05-07 18:36:03.843109: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d490a000 of size 4096 next 578 2025-05-07 18:36:03.843121: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d490b000 of size 1024 next 579 2025-05-07 18:36:03.843142: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d490b400 of size 1024 next 580 2025-05-07 18:36:03.843154: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d490b800 of size 1024 next 581 2025-05-07 18:36:03.843166: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d490bc00 of size 1024 next 582 2025-05-07 18:36:03.843177: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d490c000 of size 1024 next 583 2025-05-07 18:36:03.843189: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d490c400 of size 1024 next 586 2025-05-07 18:36:03.843201: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d490c800 of size 1024 next 587 2025-05-07 18:36:03.843213: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d490cc00 of size 1024 next 588 2025-05-07 18:36:03.843224: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d490d000 of size 1024 next 589 2025-05-07 18:36:03.843236: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d490d400 of size 1024 next 590 2025-05-07 18:36:03.843248: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d490d800 of size 4096 next 592 2025-05-07 18:36:03.843260: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d490e800 of size 6144 next 112 2025-05-07 18:36:03.843272: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4910000 of size 524288 next 111 2025-05-07 18:36:03.843284: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4990000 of size 262144 next 135 2025-05-07 18:36:03.843296: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d49d0000 of size 327680 next 124 2025-05-07 18:36:03.843308: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4a20000 of size 589824 next 123 2025-05-07 18:36:03.843320: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4ab0000 of size 262144 next 152 2025-05-07 18:36:03.843331: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4af0000 of size 327680 next 142 2025-05-07 18:36:03.843343: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4b40000 of size 786432 next 18446744073709551615 2025-05-07 18:36:03.843355: I tensorflow/core/common_runtime/bfc_allocator.cc:970] Next region of size 8388608 2025-05-07 18:36:03.843367: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4c00000 of size 4096 next 593 2025-05-07 18:36:03.843379: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4c01000 of size 4096 next 594 2025-05-07 18:36:03.843391: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4c02000 of size 4096 next 595 2025-05-07 18:36:03.843402: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4c03000 of size 2048 next 598 2025-05-07 18:36:03.843414: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4c03800 of size 2048 next 599 2025-05-07 18:36:03.843426: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4c04000 of size 2048 next 600 2025-05-07 18:36:03.843437: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4c04800 of size 2048 next 601 2025-05-07 18:36:03.843449: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4c05000 of size 2048 next 602 2025-05-07 18:36:03.843461: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4c05800 of size 256 next 605 2025-05-07 18:36:03.843473: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4c05900 of size 256 next 606 2025-05-07 18:36:03.843484: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4c05a00 of size 2048 next 604 2025-05-07 18:36:03.843496: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4c06200 of size 2048 next 609 2025-05-07 18:36:03.843508: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4c06a00 of size 2048 next 610 2025-05-07 18:36:03.843533: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4c07200 of size 2048 next 611 2025-05-07 18:36:03.843545: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4c07a00 of size 2048 next 612 2025-05-07 18:36:03.843557: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4c08200 of size 256 next 614 2025-05-07 18:36:03.843569: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4c08300 of size 256 next 615 2025-05-07 18:36:03.843581: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4c08400 of size 8192 next 613 2025-05-07 18:36:03.843592: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4c0a400 of size 8192 next 618 2025-05-07 18:36:03.843604: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4c0c400 of size 8192 next 619 2025-05-07 18:36:03.843616: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4c0e400 of size 8192 next 620 2025-05-07 18:36:03.843627: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4c10400 of size 8192 next 621 2025-05-07 18:36:03.843639: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4c12400 of size 256 next 622 2025-05-07 18:36:03.843651: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4c12500 of size 256 next 623 2025-05-07 18:36:03.843663: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4c12600 of size 8192 next 626 2025-05-07 18:36:03.843674: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4c14600 of size 8192 next 627 2025-05-07 18:36:03.843686: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4c16600 of size 8192 next 628 2025-05-07 18:36:03.843698: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4c18600 of size 8192 next 629 2025-05-07 18:36:03.843710: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4c1a600 of size 8192 next 630 2025-05-07 18:36:03.843722: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4c1c600 of size 2048 next 631 2025-05-07 18:36:03.843733: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4c1ce00 of size 2048 next 633 2025-05-07 18:36:03.843745: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4c1d600 of size 2048 next 634 2025-05-07 18:36:03.843757: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4c1de00 of size 2048 next 635 2025-05-07 18:36:03.843768: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4c1e600 of size 2048 next 636 2025-05-07 18:36:03.843780: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4c1ee00 of size 2048 next 637 2025-05-07 18:36:03.843792: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4c1f600 of size 2048 next 640 2025-05-07 18:36:03.843803: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4c1fe00 of size 2048 next 641 2025-05-07 18:36:03.843815: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4c20600 of size 2048 next 642 2025-05-07 18:36:03.843827: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4c20e00 of size 2048 next 643 2025-05-07 18:36:03.843838: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4c21600 of size 8192 next 645 2025-05-07 18:36:03.843850: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4c23600 of size 8192 next 646 2025-05-07 18:36:03.843862: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4c25600 of size 8192 next 647 2025-05-07 18:36:03.843873: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4c27600 of size 8192 next 648 2025-05-07 18:36:03.843885: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4c29600 of size 8192 next 649 2025-05-07 18:36:03.843897: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4c2b600 of size 2048 next 650 2025-05-07 18:36:03.843917: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4c2be00 of size 2048 next 651 2025-05-07 18:36:03.843929: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4c2c600 of size 2048 next 652 2025-05-07 18:36:03.843941: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4c2ce00 of size 2048 next 653 2025-05-07 18:36:03.843952: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4c2d600 of size 2048 next 654 2025-05-07 18:36:03.843964: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4c2de00 of size 2048 next 655 2025-05-07 18:36:03.843976: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4c2e600 of size 2048 next 657 2025-05-07 18:36:03.843987: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4c2ee00 of size 2048 next 658 2025-05-07 18:36:03.843999: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4c2f600 of size 2048 next 659 2025-05-07 18:36:03.844011: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4c2fe00 of size 2048 next 660 2025-05-07 18:36:03.844022: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4c30600 of size 8192 next 662 2025-05-07 18:36:03.844034: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4c32600 of size 8192 next 663 2025-05-07 18:36:03.844046: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4c34600 of size 8192 next 664 2025-05-07 18:36:03.844058: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4c36600 of size 8192 next 665 2025-05-07 18:36:03.844069: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4c38600 of size 8192 next 666 2025-05-07 18:36:03.844081: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4c3a600 of size 1024 next 667 2025-05-07 18:36:03.844093: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4c3aa00 of size 1024 next 668 2025-05-07 18:36:03.844105: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4c3ae00 of size 1024 next 669 2025-05-07 18:36:03.844116: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4c3b200 of size 1024 next 673 2025-05-07 18:36:03.844128: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4c3b600 of size 1024 next 675 2025-05-07 18:36:03.844140: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4c3ba00 of size 1024 next 677 2025-05-07 18:36:03.844151: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4c3be00 of size 1024 next 679 2025-05-07 18:36:03.844163: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4c3c200 of size 1024 next 681 2025-05-07 18:36:03.844175: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4c3c600 of size 256 next 682 2025-05-07 18:36:03.844186: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4c3c700 of size 256 next 683 2025-05-07 18:36:03.844198: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4c3c800 of size 2048 next 686 2025-05-07 18:36:03.844210: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4c3d000 of size 256 next 690 2025-05-07 18:36:03.844222: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4c3d100 of size 256 next 694 2025-05-07 18:36:03.844233: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4c3d200 of size 256 next 695 2025-05-07 18:36:03.844245: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4c3d300 of size 256 next 693 2025-05-07 18:36:03.844257: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4c3d400 of size 256 next 699 2025-05-07 18:36:03.844268: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4c3d500 of size 256 next 700 2025-05-07 18:36:03.844280: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4c3d600 of size 256 next 701 2025-05-07 18:36:03.844292: I tensorflow/core/common_runtime/bfc_allocator.cc:990] Free at 7f43d4c3d700 of size 10496 next 687 2025-05-07 18:36:03.844311: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4c40000 of size 256 next 688 2025-05-07 18:36:03.844324: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4c40100 of size 256 next 689 2025-05-07 18:36:03.844335: I tensorflow/core/common_runtime/bfc_allocator.cc:990] Free at 7f43d4c40200 of size 12544 next 691 2025-05-07 18:36:03.844347: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4c43300 of size 12288 next 692 2025-05-07 18:36:03.844359: I tensorflow/core/common_runtime/bfc_allocator.cc:990] Free at 7f43d4c46300 of size 49152 next 697 2025-05-07 18:36:03.844371: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4c52300 of size 24576 next 696 2025-05-07 18:36:03.844383: I tensorflow/core/common_runtime/bfc_allocator.cc:990] Free at 7f43d4c58300 of size 228608 next 160 2025-05-07 18:36:03.844395: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4c90000 of size 589824 next 158 2025-05-07 18:36:03.844406: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4d20000 of size 524288 next 171 2025-05-07 18:36:03.844418: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4da0000 of size 256 next 671 2025-05-07 18:36:03.844430: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4da0100 of size 256 next 672 2025-05-07 18:36:03.844441: I tensorflow/core/common_runtime/bfc_allocator.cc:990] Free at 7f43d4da0200 of size 523776 next 670 2025-05-07 18:36:03.844453: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4e20000 of size 524288 next 222 2025-05-07 18:36:03.844465: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4ea0000 of size 1048576 next 190 2025-05-07 18:36:03.844477: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d4fa0000 of size 1048576 next 189 2025-05-07 18:36:03.844488: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d50a0000 of size 1048576 next 203 2025-05-07 18:36:03.844500: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d51a0000 of size 1048576 next 251 2025-05-07 18:36:03.844512: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d52a0000 of size 1441792 next 18446744073709551615 2025-05-07 18:36:03.844524: I tensorflow/core/common_runtime/bfc_allocator.cc:970] Next region of size 1048576 2025-05-07 18:36:03.844536: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e00000 of size 1280 next 1 2025-05-07 18:36:03.844548: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e00500 of size 256 next 5 2025-05-07 18:36:03.844559: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e00600 of size 256 next 8 2025-05-07 18:36:03.844571: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e00700 of size 256 next 9 2025-05-07 18:36:03.844583: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e00800 of size 256 next 10 2025-05-07 18:36:03.844595: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e00900 of size 256 next 11 2025-05-07 18:36:03.844606: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e00a00 of size 256 next 12 2025-05-07 18:36:03.844618: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e00b00 of size 256 next 13 2025-05-07 18:36:03.844630: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e00c00 of size 256 next 17 2025-05-07 18:36:03.844641: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e00d00 of size 256 next 19 2025-05-07 18:36:03.844653: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e00e00 of size 256 next 20 2025-05-07 18:36:03.844665: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e00f00 of size 256 next 21 2025-05-07 18:36:03.844676: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e01000 of size 256 next 22 2025-05-07 18:36:03.844696: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e01100 of size 256 next 24 2025-05-07 18:36:03.844709: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e01200 of size 256 next 25 2025-05-07 18:36:03.844720: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e01300 of size 256 next 23 2025-05-07 18:36:03.844732: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e01400 of size 256 next 28 2025-05-07 18:36:03.844744: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e01500 of size 256 next 29 2025-05-07 18:36:03.844755: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e01600 of size 256 next 30 2025-05-07 18:36:03.844767: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e01700 of size 256 next 31 2025-05-07 18:36:03.844779: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e01800 of size 256 next 33 2025-05-07 18:36:03.844790: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e01900 of size 256 next 34 2025-05-07 18:36:03.844802: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e01a00 of size 1024 next 32 2025-05-07 18:36:03.844814: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e01e00 of size 1024 next 37 2025-05-07 18:36:03.844825: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e02200 of size 1024 next 38 2025-05-07 18:36:03.844837: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e02600 of size 1024 next 39 2025-05-07 18:36:03.844849: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e02a00 of size 1024 next 40 2025-05-07 18:36:03.844860: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e02e00 of size 1024 next 41 2025-05-07 18:36:03.844872: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e03200 of size 1024 next 43 2025-05-07 18:36:03.844884: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e03600 of size 1024 next 44 2025-05-07 18:36:03.844896: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e03a00 of size 1024 next 45 2025-05-07 18:36:03.844907: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e03e00 of size 1024 next 46 2025-05-07 18:36:03.844919: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e04200 of size 256 next 48 2025-05-07 18:36:03.844931: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e04300 of size 256 next 49 2025-05-07 18:36:03.844942: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e04400 of size 256 next 50 2025-05-07 18:36:03.844954: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e04500 of size 256 next 51 2025-05-07 18:36:03.844966: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e04600 of size 256 next 52 2025-05-07 18:36:03.844977: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e04700 of size 256 next 53 2025-05-07 18:36:03.844989: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e04800 of size 256 next 56 2025-05-07 18:36:03.845001: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e04900 of size 256 next 57 2025-05-07 18:36:03.845012: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e04a00 of size 256 next 58 2025-05-07 18:36:03.845024: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e04b00 of size 256 next 14 2025-05-07 18:36:03.845036: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e04c00 of size 256 next 15 2025-05-07 18:36:03.845047: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e04d00 of size 256 next 16 2025-05-07 18:36:03.845059: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e04e00 of size 1024 next 60 2025-05-07 18:36:03.845079: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e05200 of size 1024 next 61 2025-05-07 18:36:03.845091: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e05600 of size 1024 next 62 2025-05-07 18:36:03.845103: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e05a00 of size 1024 next 63 2025-05-07 18:36:03.845115: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e05e00 of size 1024 next 64 2025-05-07 18:36:03.845126: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e06200 of size 256 next 66 2025-05-07 18:36:03.845138: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e06300 of size 256 next 67 2025-05-07 18:36:03.845150: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e06400 of size 256 next 68 2025-05-07 18:36:03.845162: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e06500 of size 256 next 69 2025-05-07 18:36:03.845173: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e06600 of size 256 next 70 2025-05-07 18:36:03.845185: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e06700 of size 256 next 73 2025-05-07 18:36:03.845197: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e06800 of size 256 next 74 2025-05-07 18:36:03.845208: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e06900 of size 256 next 75 2025-05-07 18:36:03.845220: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e06a00 of size 256 next 76 2025-05-07 18:36:03.845232: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e06b00 of size 256 next 77 2025-05-07 18:36:03.845243: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e06c00 of size 1024 next 79 2025-05-07 18:36:03.845255: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e07000 of size 1024 next 80 2025-05-07 18:36:03.845267: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e07400 of size 1024 next 81 2025-05-07 18:36:03.845279: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e07800 of size 1024 next 82 2025-05-07 18:36:03.845290: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e07c00 of size 1024 next 83 2025-05-07 18:36:03.845302: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e08000 of size 256 next 85 2025-05-07 18:36:03.845314: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e08100 of size 256 next 86 2025-05-07 18:36:03.845326: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e08200 of size 512 next 84 2025-05-07 18:36:03.845338: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e08400 of size 512 next 88 2025-05-07 18:36:03.845349: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e08600 of size 512 next 89 2025-05-07 18:36:03.845361: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e08800 of size 512 next 90 2025-05-07 18:36:03.845373: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e08a00 of size 512 next 91 2025-05-07 18:36:03.845385: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e08c00 of size 256 next 93 2025-05-07 18:36:03.845396: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e08d00 of size 256 next 94 2025-05-07 18:36:03.845408: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e08e00 of size 512 next 92 2025-05-07 18:36:03.845420: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e09000 of size 512 next 97 2025-05-07 18:36:03.845431: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e09200 of size 512 next 98 2025-05-07 18:36:03.845443: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e09400 of size 512 next 99 2025-05-07 18:36:03.845455: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e09600 of size 512 next 2 2025-05-07 18:36:03.845475: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e09800 of size 256 next 3 2025-05-07 18:36:03.845487: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e09900 of size 256 next 4 2025-05-07 18:36:03.845499: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e09a00 of size 16384 next 18 2025-05-07 18:36:03.845511: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e0da00 of size 256 next 100 2025-05-07 18:36:03.845522: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e0db00 of size 256 next 101 2025-05-07 18:36:03.845534: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e0dc00 of size 2048 next 104 2025-05-07 18:36:03.845546: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e0e400 of size 2048 next 105 2025-05-07 18:36:03.845558: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e0ec00 of size 2048 next 106 2025-05-07 18:36:03.845569: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e0f400 of size 2048 next 107 2025-05-07 18:36:03.845581: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e0fc00 of size 2048 next 108 2025-05-07 18:36:03.845593: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e10400 of size 256 next 109 2025-05-07 18:36:03.845604: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e10500 of size 256 next 110 2025-05-07 18:36:03.845616: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e10600 of size 2048 next 113 2025-05-07 18:36:03.845628: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e10e00 of size 2048 next 114 2025-05-07 18:36:03.845639: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e11600 of size 2048 next 115 2025-05-07 18:36:03.845651: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e11e00 of size 2048 next 116 2025-05-07 18:36:03.845663: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e12600 of size 2048 next 6 2025-05-07 18:36:03.845675: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e12e00 of size 37632 next 7 2025-05-07 18:36:03.845686: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e1c100 of size 512 next 118 2025-05-07 18:36:03.845698: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e1c300 of size 512 next 119 2025-05-07 18:36:03.845710: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e1c500 of size 512 next 120 2025-05-07 18:36:03.845722: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e1c700 of size 512 next 121 2025-05-07 18:36:03.845733: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e1c900 of size 512 next 122 2025-05-07 18:36:03.845745: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e1cb00 of size 512 next 125 2025-05-07 18:36:03.845757: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e1cd00 of size 512 next 126 2025-05-07 18:36:03.845768: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e1cf00 of size 512 next 127 2025-05-07 18:36:03.845780: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e1d100 of size 512 next 128 2025-05-07 18:36:03.845792: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e1d300 of size 512 next 129 2025-05-07 18:36:03.845803: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e1d500 of size 2048 next 130 2025-05-07 18:36:03.845815: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e1dd00 of size 2048 next 131 2025-05-07 18:36:03.845827: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e1e500 of size 2048 next 132 2025-05-07 18:36:03.845838: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e1ed00 of size 2048 next 133 2025-05-07 18:36:03.845850: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e1f500 of size 2048 next 134 2025-05-07 18:36:03.845870: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e1fd00 of size 512 next 136 2025-05-07 18:36:03.845883: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e1ff00 of size 512 next 137 2025-05-07 18:36:03.845894: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e20100 of size 512 next 138 2025-05-07 18:36:03.845906: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e20300 of size 512 next 139 2025-05-07 18:36:03.845918: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e20500 of size 512 next 140 2025-05-07 18:36:03.845929: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e20700 of size 512 next 141 2025-05-07 18:36:03.845941: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e20900 of size 512 next 143 2025-05-07 18:36:03.845953: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e20b00 of size 512 next 144 2025-05-07 18:36:03.845965: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e20d00 of size 512 next 145 2025-05-07 18:36:03.845976: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e20f00 of size 512 next 146 2025-05-07 18:36:03.845988: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e21100 of size 2048 next 147 2025-05-07 18:36:03.846000: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e21900 of size 2048 next 148 2025-05-07 18:36:03.846011: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e22100 of size 2048 next 149 2025-05-07 18:36:03.846023: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e22900 of size 2048 next 150 2025-05-07 18:36:03.846035: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e23100 of size 2048 next 151 2025-05-07 18:36:03.846046: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e23900 of size 512 next 153 2025-05-07 18:36:03.846058: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e23b00 of size 512 next 154 2025-05-07 18:36:03.846070: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e23d00 of size 512 next 155 2025-05-07 18:36:03.846081: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e23f00 of size 512 next 156 2025-05-07 18:36:03.846093: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e24100 of size 512 next 157 2025-05-07 18:36:03.846105: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e24300 of size 512 next 161 2025-05-07 18:36:03.846116: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e24500 of size 512 next 162 2025-05-07 18:36:03.846128: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e24700 of size 512 next 163 2025-05-07 18:36:03.846140: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e24900 of size 512 next 164 2025-05-07 18:36:03.846151: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e24b00 of size 512 next 165 2025-05-07 18:36:03.846163: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e24d00 of size 2048 next 166 2025-05-07 18:36:03.846175: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e25500 of size 2048 next 167 2025-05-07 18:36:03.846187: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e25d00 of size 2048 next 168 2025-05-07 18:36:03.846198: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e26500 of size 2048 next 169 2025-05-07 18:36:03.846210: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e26d00 of size 2048 next 170 2025-05-07 18:36:03.846222: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e27500 of size 1024 next 172 2025-05-07 18:36:03.846234: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e27900 of size 1024 next 173 2025-05-07 18:36:03.846253: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e27d00 of size 1024 next 174 2025-05-07 18:36:03.846266: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e28100 of size 1024 next 175 2025-05-07 18:36:03.846277: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e28500 of size 1024 next 176 2025-05-07 18:36:03.846289: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e28900 of size 256 next 178 2025-05-07 18:36:03.846301: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e28a00 of size 256 next 179 2025-05-07 18:36:03.846312: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e28b00 of size 1024 next 177 2025-05-07 18:36:03.846324: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e28f00 of size 1024 next 182 2025-05-07 18:36:03.846336: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e29300 of size 1024 next 183 2025-05-07 18:36:03.846347: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e29700 of size 1024 next 184 2025-05-07 18:36:03.846359: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e29b00 of size 1024 next 185 2025-05-07 18:36:03.846371: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e29f00 of size 256 next 187 2025-05-07 18:36:03.846383: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e2a000 of size 256 next 188 2025-05-07 18:36:03.846394: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e2a100 of size 4096 next 186 2025-05-07 18:36:03.846406: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e2b100 of size 4096 next 42 2025-05-07 18:36:03.846418: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e2c100 of size 65536 next 36 2025-05-07 18:36:03.846430: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e3c100 of size 65536 next 35 2025-05-07 18:36:03.846441: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e4c100 of size 4096 next 235 2025-05-07 18:36:03.846453: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e4d100 of size 4096 next 236 2025-05-07 18:36:03.846465: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e4e100 of size 4096 next 237 2025-05-07 18:36:03.846476: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e4f100 of size 4096 next 238 2025-05-07 18:36:03.846488: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e50100 of size 1024 next 239 2025-05-07 18:36:03.846500: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e50500 of size 1024 next 240 2025-05-07 18:36:03.846512: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e50900 of size 1024 next 241 2025-05-07 18:36:03.846523: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e50d00 of size 1024 next 242 2025-05-07 18:36:03.846535: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e51100 of size 1024 next 243 2025-05-07 18:36:03.846547: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e51500 of size 1024 next 246 2025-05-07 18:36:03.846558: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e51900 of size 1024 next 247 2025-05-07 18:36:03.846570: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e51d00 of size 1024 next 248 2025-05-07 18:36:03.846582: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e52100 of size 1024 next 249 2025-05-07 18:36:03.846593: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e52500 of size 1024 next 250 2025-05-07 18:36:03.846605: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e52900 of size 4096 next 252 2025-05-07 18:36:03.846617: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e53900 of size 4096 next 253 2025-05-07 18:36:03.846636: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e54900 of size 4096 next 254 2025-05-07 18:36:03.846649: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e55900 of size 4096 next 255 2025-05-07 18:36:03.846660: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e56900 of size 4096 next 256 2025-05-07 18:36:03.846672: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e57900 of size 1024 next 257 2025-05-07 18:36:03.846684: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e57d00 of size 1024 next 258 2025-05-07 18:36:03.846695: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e58100 of size 1024 next 259 2025-05-07 18:36:03.846707: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e58500 of size 1024 next 260 2025-05-07 18:36:03.846719: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e58900 of size 1024 next 261 2025-05-07 18:36:03.846731: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e58d00 of size 1024 next 264 2025-05-07 18:36:03.846742: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e59100 of size 1024 next 265 2025-05-07 18:36:03.846754: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e59500 of size 1024 next 266 2025-05-07 18:36:03.846766: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e59900 of size 1024 next 267 2025-05-07 18:36:03.846777: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e59d00 of size 1024 next 268 2025-05-07 18:36:03.846789: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e5a100 of size 4096 next 270 2025-05-07 18:36:03.846801: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e5b100 of size 4096 next 271 2025-05-07 18:36:03.846812: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e5c100 of size 4096 next 272 2025-05-07 18:36:03.846824: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e5d100 of size 4096 next 273 2025-05-07 18:36:03.846836: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e5e100 of size 4096 next 274 2025-05-07 18:36:03.846847: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e5f100 of size 1024 next 275 2025-05-07 18:36:03.846859: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e5f500 of size 1024 next 276 2025-05-07 18:36:03.846871: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e5f900 of size 1024 next 277 2025-05-07 18:36:03.846883: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e5fd00 of size 1024 next 278 2025-05-07 18:36:03.846923: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e60100 of size 1024 next 279 2025-05-07 18:36:03.846941: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e60500 of size 1024 next 282 2025-05-07 18:36:03.846953: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e60900 of size 1024 next 283 2025-05-07 18:36:03.846965: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e60d00 of size 1024 next 284 2025-05-07 18:36:03.846976: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e61100 of size 1024 next 285 2025-05-07 18:36:03.846988: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e61500 of size 1024 next 286 2025-05-07 18:36:03.847000: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e61900 of size 4096 next 288 2025-05-07 18:36:03.847011: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e62900 of size 6144 next 27 2025-05-07 18:36:03.847023: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e64100 of size 147456 next 26 2025-05-07 18:36:03.847035: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e88100 of size 65536 next 47 2025-05-07 18:36:03.847047: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e98100 of size 65536 next 59 2025-05-07 18:36:03.847067: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512ea8100 of size 65536 next 65 2025-05-07 18:36:03.847080: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512eb8100 of size 294656 next 18446744073709551615 2025-05-07 18:36:03.847092: I tensorflow/core/common_runtime/bfc_allocator.cc:995] Summary of in-use Chunks by size: 2025-05-07 18:36:03.847111: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 78 Chunks of size 256 totalling 19.5KiB 2025-05-07 18:36:03.847125: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 40 Chunks of size 512 totalling 20.0KiB 2025-05-07 18:36:03.847139: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 258 Chunks of size 1024 totalling 258.0KiB 2025-05-07 18:36:03.847152: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 1280 totalling 1.2KiB 2025-05-07 18:36:03.847165: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 56 Chunks of size 2048 totalling 112.0KiB 2025-05-07 18:36:03.847178: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 117 Chunks of size 4096 totalling 468.0KiB 2025-05-07 18:36:03.847192: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 2 Chunks of size 6144 totalling 12.0KiB 2025-05-07 18:36:03.847205: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 7680 totalling 7.5KiB 2025-05-07 18:36:03.847218: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 20 Chunks of size 8192 totalling 160.0KiB 2025-05-07 18:36:03.847231: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 12288 totalling 12.0KiB 2025-05-07 18:36:03.847244: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 16384 totalling 16.0KiB 2025-05-07 18:36:03.847257: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 24576 totalling 24.0KiB 2025-05-07 18:36:03.847270: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 37632 totalling 36.8KiB 2025-05-07 18:36:03.847284: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 6 Chunks of size 65536 totalling 384.0KiB 2025-05-07 18:36:03.847297: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 131072 totalling 128.0KiB 2025-05-07 18:36:03.847310: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 3 Chunks of size 147456 totalling 432.0KiB 2025-05-07 18:36:03.847323: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 5 Chunks of size 262144 totalling 1.25MiB 2025-05-07 18:36:03.847336: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 294656 totalling 287.8KiB 2025-05-07 18:36:03.847349: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 2 Chunks of size 327680 totalling 640.0KiB 2025-05-07 18:36:03.847362: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 3 Chunks of size 524288 totalling 1.50MiB 2025-05-07 18:36:03.847375: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 3 Chunks of size 589824 totalling 1.69MiB 2025-05-07 18:36:03.847388: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 786432 totalling 768.0KiB 2025-05-07 18:36:03.847401: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 25 Chunks of size 1048576 totalling 25.00MiB 2025-05-07 18:36:03.847414: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 19 Chunks of size 1310720 totalling 23.75MiB 2025-05-07 18:36:03.847427: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 1441792 totalling 1.38MiB 2025-05-07 18:36:03.847440: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 1835008 totalling 1.75MiB 2025-05-07 18:36:03.847453: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 2 Chunks of size 2097152 totalling 4.00MiB 2025-05-07 18:36:03.847466: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 26 Chunks of size 2359296 totalling 58.50MiB 2025-05-07 18:36:03.847478: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 3932160 totalling 3.75MiB 2025-05-07 18:36:03.847494: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 5 Chunks of size 4194304 totalling 20.00MiB 2025-05-07 18:36:03.847502: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 4718592 totalling 4.50MiB 2025-05-07 18:36:03.847509: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 6291456 totalling 6.00MiB 2025-05-07 18:36:03.847517: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 8388608 totalling 8.00MiB 2025-05-07 18:36:03.847524: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 3 Chunks of size 9437184 totalling 27.00MiB 2025-05-07 18:36:03.847532: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 86900736 totalling 82.88MiB 2025-05-07 18:36:03.847540: I tensorflow/core/common_runtime/bfc_allocator.cc:1002] Sum Total of in-use chunks: 274.63MiB 2025-05-07 18:36:03.847547: I tensorflow/core/common_runtime/bfc_allocator.cc:1004] total_region_allocated_bytes_: 354287616 memory_limit_: 354287616 available bytes: 0 curr_region_allocation_bytes_: 536870912 2025-05-07 18:36:03.847559: I tensorflow/core/common_runtime/bfc_allocator.cc:1010] Stats: Limit: 354287616 InUse: 287976192 MaxInUse: 287976192 NumAllocs: 2326 MaxAllocSize: 86900736 2025-05-07 18:36:03.847581: W tensorflow/core/common_runtime/bfc_allocator.cc:439] ***************xxxxxxxxxx****************_******_**___________************************************** 2025-05-07 18:36:03.848025: W tensorflow/core/framework/op_kernel.cc:1753] OP_REQUIRES failed at cwise_ops_common.h:134 : Resource exhausted: OOM when allocating tensor with shape[7,7,256,1024] and type float on /job:localhost/replica:0/task:0/device:GPU:0 by allocator GPU_0_bfc RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 Exception in mask_detect : OOM when allocating tensor with shape[7,7,256,1024] and type float on /job:localhost/replica:0/task:0/device:GPU:0 by allocator GPU_0_bfc [Op:Mul] we want to redo the detection max_time_sub_proc : 3600 erreur pendant la detection Useless call to update_current_state in case -12 caffe_path_current : About to save ! 1 Inside saveOutput : final : True verbose : False eke 12-6-18 : saveMask need to be cleaned for new output ! ERROR : mask output needs to be a dictionnary now ! No output to save, continue without doing anything ! save missing photos in datou_result : After save, about to update current ! datou_cur_ids : [] len(datou.list_steps) : 1 output : -12 free memory after detection : begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 87 ############################### TEST detect object ################################ run mask_detect Inside batchDatouExec : verbose : False Catched exception ! Connect or reconnect ! # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : mask_detect list_input_json : [] origin BFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 1 ; length of list_pids : 1 ; length of list_args : 1 time to download the photos : 0.1621417999267578 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : False number of steps : 1 step1:mask_detect Wed May 7 18:36:05 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory havn't enough memory gpu , need / 3000 l 3632 free memory gpu now : 561 wait 20 seconds l 3637 free memory gpu now : 561 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-05-07 18:36:28.009155: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-05-07 18:36:28.035177: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-05-07 18:36:28.037451: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f45b8000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-05-07 18:36:28.037488: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-05-07 18:36:28.041923: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-05-07 18:36:28.311186: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x6d894d0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-05-07 18:36:28.311250: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-05-07 18:36:28.312042: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-07 18:36:28.312525: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-07 18:36:28.319601: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-07 18:36:28.322666: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-07 18:36:28.323609: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-07 18:36:28.327299: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-07 18:36:28.328736: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-07 18:36:28.334524: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-07 18:36:28.335753: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-07 18:36:28.335860: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-07 18:36:28.336435: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-07 18:36:28.336452: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-07 18:36:28.336461: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-07 18:36:28.337275: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 337 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl454 thcls : [{'id': 454, 'mtr_user_id': 31, 'name': 'mask_coco_origin', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'backgroud,person,bicycle,car,motorcycle,airplane,bus,train,truck,boat,trafficlight,firehydrant,stopsign,parkingmeter,bench,bird,cat,dog,horse,sheep,cow,elephant,bear,zebra,giraffe,backpack,umbrella,handbag,tie,suitcase,frisbee,skis,snowboard,sportsball,kite,baseballbat,baseballglove,skateboard,surfboard,tennisracket,bottle,wineglass,cup,fork,knife,spoon,bowl,banana,apple,sandwich,orange,broccoli,carrot,hotdog,pizza,donut,cake,chair,couch,pottedplant,bed,diningtable,toilet,tv,laptop,mouse,remote,keyboard,cellphone,microwave,oven,toaster,sink,refrigerator,book,clock,vase,scissors,teddybear,hairdrier,toothbrush', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 445, 'photo_desc_type': 3473, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0'}] thcl {'id': 454, 'mtr_user_id': 31, 'name': 'mask_coco_origin', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'backgroud,person,bicycle,car,motorcycle,airplane,bus,train,truck,boat,trafficlight,firehydrant,stopsign,parkingmeter,bench,bird,cat,dog,horse,sheep,cow,elephant,bear,zebra,giraffe,backpack,umbrella,handbag,tie,suitcase,frisbee,skis,snowboard,sportsball,kite,baseballbat,baseballglove,skateboard,surfboard,tennisracket,bottle,wineglass,cup,fork,knife,spoon,bowl,banana,apple,sandwich,orange,broccoli,carrot,hotdog,pizza,donut,cake,chair,couch,pottedplant,bed,diningtable,toilet,tv,laptop,mouse,remote,keyboard,cellphone,microwave,oven,toaster,sink,refrigerator,book,clock,vase,scissors,teddybear,hairdrier,toothbrush', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 445, 'photo_desc_type': 3473, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 3473 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (3473, 'mask_coco_origin', 16384, 25088, 'mask_coco_origin', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2018, 3, 19, 10, 42, 21), datetime.datetime(2018, 3, 19, 10, 42, 21)) {'thcl': {'id': 454, 'mtr_user_id': 31, 'name': 'mask_coco_origin', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'backgroud,person,bicycle,car,motorcycle,airplane,bus,train,truck,boat,trafficlight,firehydrant,stopsign,parkingmeter,bench,bird,cat,dog,horse,sheep,cow,elephant,bear,zebra,giraffe,backpack,umbrella,handbag,tie,suitcase,frisbee,skis,snowboard,sportsball,kite,baseballbat,baseballglove,skateboard,surfboard,tennisracket,bottle,wineglass,cup,fork,knife,spoon,bowl,banana,apple,sandwich,orange,broccoli,carrot,hotdog,pizza,donut,cake,chair,couch,pottedplant,bed,diningtable,toilet,tv,laptop,mouse,remote,keyboard,cellphone,microwave,oven,toaster,sink,refrigerator,book,clock,vase,scissors,teddybear,hairdrier,toothbrush', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 445, 'photo_desc_type': 3473, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['backgroud', 'person', 'bicycle', 'car', 'motorcycle', 'airplane', 'bus', 'train', 'truck', 'boat', 'trafficlight', 'firehydrant', 'stopsign', 'parkingmeter', 'bench', 'bird', 'cat', 'dog', 'horse', 'sheep', 'cow', 'elephant', 'bear', 'zebra', 'giraffe', 'backpack', 'umbrella', 'handbag', 'tie', 'suitcase', 'frisbee', 'skis', 'snowboard', 'sportsball', 'kite', 'baseballbat', 'baseballglove', 'skateboard', 'surfboard', 'tennisracket', 'bottle', 'wineglass', 'cup', 'fork', 'knife', 'spoon', 'bowl', 'banana', 'apple', 'sandwich', 'orange', 'broccoli', 'carrot', 'hotdog', 'pizza', 'donut', 'cake', 'chair', 'couch', 'pottedplant', 'bed', 'diningtable', 'toilet', 'tv', 'laptop', 'mouse', 'remote', 'keyboard', 'cellphone', 'microwave', 'oven', 'toaster', 'sink', 'refrigerator', 'book', 'clock', 'vase', 'scissors', 'teddybear', 'hairdrier', 'toothbrush'], 'list_hashtags_csv': 'backgroud,person,bicycle,car,motorcycle,airplane,bus,train,truck,boat,trafficlight,firehydrant,stopsign,parkingmeter,bench,bird,cat,dog,horse,sheep,cow,elephant,bear,zebra,giraffe,backpack,umbrella,handbag,tie,suitcase,frisbee,skis,snowboard,sportsball,kite,baseballbat,baseballglove,skateboard,surfboard,tennisracket,bottle,wineglass,cup,fork,knife,spoon,bowl,banana,apple,sandwich,orange,broccoli,carrot,hotdog,pizza,donut,cake,chair,couch,pottedplant,bed,diningtable,toilet,tv,laptop,mouse,remote,keyboard,cellphone,microwave,oven,toaster,sink,refrigerator,book,clock,vase,scissors,teddybear,hairdrier,toothbrush', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 445, 'svm_hashtag_type_desc': 3473, 'photo_desc_type': 3473, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['backgroud', 'person', 'bicycle', 'car', 'motorcycle', 'airplane', 'bus', 'train', 'truck', 'boat', 'trafficlight', 'firehydrant', 'stopsign', 'parkingmeter', 'bench', 'bird', 'cat', 'dog', 'horse', 'sheep', 'cow', 'elephant', 'bear', 'zebra', 'giraffe', 'backpack', 'umbrella', 'handbag', 'tie', 'suitcase', 'frisbee', 'skis', 'snowboard', 'sportsball', 'kite', 'baseballbat', 'baseballglove', 'skateboard', 'surfboard', 'tennisracket', 'bottle', 'wineglass', 'cup', 'fork', 'knife', 'spoon', 'bowl', 'banana', 'apple', 'sandwich', 'orange', 'broccoli', 'carrot', 'hotdog', 'pizza', 'donut', 'cake', 'chair', 'couch', 'pottedplant', 'bed', 'diningtable', 'toilet', 'tv', 'laptop', 'mouse', 'remote', 'keyboard', 'cellphone', 'microwave', 'oven', 'toaster', 'sink', 'refrigerator', 'book', 'clock', 'vase', 'scissors', 'teddybear', 'hairdrier', 'toothbrush'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME mask_coco_origin NUM_CLASSES 81 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 2025-05-07 18:36:28.969221: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-07 18:36:28.969336: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-07 18:36:28.969366: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-07 18:36:28.969391: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-07 18:36:28.969415: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-07 18:36:28.969440: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-07 18:36:28.969464: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-07 18:36:28.969493: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-07 18:36:28.970375: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-07 18:36:28.971580: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-07 18:36:28.971635: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-07 18:36:28.971660: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-07 18:36:28.971685: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-07 18:36:28.971710: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-07 18:36:28.971734: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-07 18:36:28.971769: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-07 18:36:28.971793: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-07 18:36:28.972672: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-07 18:36:28.972712: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-07 18:36:28.972724: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-07 18:36:28.972734: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-07 18:36:28.973695: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 337 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead 2025-05-07 18:36:41.355566: W tensorflow/core/common_runtime/bfc_allocator.cc:434] Allocator (GPU_0_bfc) ran out of memory trying to allocate 49.00MiB (rounded to 51380224) Current allocation summary follows. 2025-05-07 18:36:41.355646: I tensorflow/core/common_runtime/bfc_allocator.cc:934] BFCAllocator dump for GPU_0_bfc 2025-05-07 18:36:41.355660: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (256): Total Chunks: 78, Chunks in use: 78. 19.5KiB allocated for chunks. 19.5KiB in use in bin. 9.0KiB client-requested in use in bin. 2025-05-07 18:36:41.355671: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (512): Total Chunks: 40, Chunks in use: 40. 20.0KiB allocated for chunks. 20.0KiB in use in bin. 20.0KiB client-requested in use in bin. 2025-05-07 18:36:41.355683: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (1024): Total Chunks: 259, Chunks in use: 259. 259.2KiB allocated for chunks. 259.2KiB in use in bin. 259.0KiB client-requested in use in bin. 2025-05-07 18:36:41.355694: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (2048): Total Chunks: 56, Chunks in use: 56. 112.0KiB allocated for chunks. 112.0KiB in use in bin. 112.0KiB client-requested in use in bin. 2025-05-07 18:36:41.355705: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (4096): Total Chunks: 120, Chunks in use: 120. 487.5KiB allocated for chunks. 487.5KiB in use in bin. 480.0KiB client-requested in use in bin. 2025-05-07 18:36:41.355716: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (8192): Total Chunks: 23, Chunks in use: 21. 194.5KiB allocated for chunks. 172.0KiB in use in bin. 172.0KiB client-requested in use in bin. 2025-05-07 18:36:41.355726: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (16384): Total Chunks: 2, Chunks in use: 2. 40.0KiB allocated for chunks. 40.0KiB in use in bin. 40.0KiB client-requested in use in bin. 2025-05-07 18:36:41.355737: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (32768): Total Chunks: 2, Chunks in use: 1. 84.8KiB allocated for chunks. 36.8KiB in use in bin. 36.8KiB client-requested in use in bin. 2025-05-07 18:36:41.355747: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (65536): Total Chunks: 6, Chunks in use: 6. 384.0KiB allocated for chunks. 384.0KiB in use in bin. 384.0KiB client-requested in use in bin. 2025-05-07 18:36:41.355758: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (131072): Total Chunks: 5, Chunks in use: 4. 783.2KiB allocated for chunks. 560.0KiB in use in bin. 560.0KiB client-requested in use in bin. 2025-05-07 18:36:41.355768: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (262144): Total Chunks: 9, Chunks in use: 8. 2.66MiB allocated for chunks. 2.16MiB in use in bin. 2.00MiB client-requested in use in bin. 2025-05-07 18:36:41.355778: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (524288): Total Chunks: 8, Chunks in use: 7. 4.64MiB allocated for chunks. 3.94MiB in use in bin. 3.75MiB client-requested in use in bin. 2025-05-07 18:36:41.355789: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (1048576): Total Chunks: 47, Chunks in use: 46. 53.12MiB allocated for chunks. 51.88MiB in use in bin. 46.00MiB client-requested in use in bin. 2025-05-07 18:36:41.355800: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (2097152): Total Chunks: 31, Chunks in use: 29. 71.00MiB allocated for chunks. 66.25MiB in use in bin. 64.50MiB client-requested in use in bin. 2025-05-07 18:36:41.355811: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (4194304): Total Chunks: 10, Chunks in use: 7. 46.25MiB allocated for chunks. 30.50MiB in use in bin. 26.75MiB client-requested in use in bin. 2025-05-07 18:36:41.355821: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (8388608): Total Chunks: 4, Chunks in use: 4. 35.00MiB allocated for chunks. 35.00MiB in use in bin. 35.00MiB client-requested in use in bin. 2025-05-07 18:36:41.355857: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (16777216): Total Chunks: 0, Chunks in use: 0. 0B allocated for chunks. 0B in use in bin. 0B client-requested in use in bin. 2025-05-07 18:36:41.355868: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (33554432): Total Chunks: 1, Chunks in use: 0. 40.00MiB allocated for chunks. 0B in use in bin. 0B client-requested in use in bin. 2025-05-07 18:36:41.355879: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (67108864): Total Chunks: 1, Chunks in use: 1. 82.88MiB allocated for chunks. 82.88MiB in use in bin. 49.00MiB client-requested in use in bin. 2025-05-07 18:36:41.355889: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (134217728): Total Chunks: 0, Chunks in use: 0. 0B allocated for chunks. 0B in use in bin. 0B client-requested in use in bin. 2025-05-07 18:36:41.355898: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (268435456): Total Chunks: 0, Chunks in use: 0. 0B allocated for chunks. 0B in use in bin. 0B client-requested in use in bin. 2025-05-07 18:36:41.355908: I tensorflow/core/common_runtime/bfc_allocator.cc:957] Bin for 49.00MiB was 32.00MiB, Chunk State: 2025-05-07 18:36:41.355922: I tensorflow/core/common_runtime/bfc_allocator.cc:963] Size: 40.00MiB | Requested Size: 0B | in_use: 0 | bin_num: 17, prev: Size: 4.50MiB | Requested Size: 4.50MiB | in_use: 1 | bin_num: -1 2025-05-07 18:36:41.355931: I tensorflow/core/common_runtime/bfc_allocator.cc:970] Next region of size 86900736 2025-05-07 18:36:41.355942: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43bc000000 of size 86900736 next 18446744073709551615 2025-05-07 18:36:41.355950: I tensorflow/core/common_runtime/bfc_allocator.cc:970] Next region of size 134217728 2025-05-07 18:36:41.355958: I tensorflow/core/common_runtime/bfc_allocator.cc:990] Free at 7f43c2000000 of size 4194304 next 632 2025-05-07 18:36:41.355967: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43c2400000 of size 4194304 next 617 2025-05-07 18:36:41.355975: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43c2800000 of size 4194304 next 616 2025-05-07 18:36:41.355984: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43c2c00000 of size 6291456 next 608 2025-05-07 18:36:41.355992: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43c3200000 of size 9437184 next 607 2025-05-07 18:36:41.356000: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43c3b00000 of size 4194304 next 644 2025-05-07 18:36:41.356008: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43c3f00000 of size 4194304 next 625 2025-05-07 18:36:41.356017: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43c4300000 of size 8388608 next 624 2025-05-07 18:36:41.356025: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43c4b00000 of size 4194304 next 661 2025-05-07 18:36:41.356033: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43c4f00000 of size 2359296 next 676 2025-05-07 18:36:41.356040: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43c5140000 of size 2359296 next 678 2025-05-07 18:36:41.356048: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43c5380000 of size 2359296 next 680 2025-05-07 18:36:41.356056: I tensorflow/core/common_runtime/bfc_allocator.cc:990] Free at 7f43c55c0000 of size 7602176 next 639 2025-05-07 18:36:41.356064: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43c5d00000 of size 9437184 next 638 2025-05-07 18:36:41.356072: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43c6600000 of size 9437184 next 656 2025-05-07 18:36:41.356080: I tensorflow/core/common_runtime/bfc_allocator.cc:990] Free at 7f43c6f00000 of size 4718592 next 685 2025-05-07 18:36:41.356088: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43c7380000 of size 4718592 next 684 2025-05-07 18:36:41.356096: I tensorflow/core/common_runtime/bfc_allocator.cc:990] Free at 7f43c7800000 of size 41943040 next 18446744073709551615 2025-05-07 18:36:41.356110: I tensorflow/core/common_runtime/bfc_allocator.cc:970] Next region of size 67108864 2025-05-07 18:36:41.356119: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43ca000000 of size 2359296 next 370 2025-05-07 18:36:41.356127: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43ca240000 of size 1048576 next 394 2025-05-07 18:36:41.356135: I tensorflow/core/common_runtime/bfc_allocator.cc:990] Free at 7f43ca340000 of size 1310720 next 388 2025-05-07 18:36:41.356143: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43ca480000 of size 2359296 next 387 2025-05-07 18:36:41.356150: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43ca6c0000 of size 1048576 next 412 2025-05-07 18:36:41.356159: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43ca7c0000 of size 1310720 next 406 2025-05-07 18:36:41.356167: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43ca900000 of size 2359296 next 405 2025-05-07 18:36:41.356174: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43cab40000 of size 1048576 next 430 2025-05-07 18:36:41.356182: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43cac40000 of size 1310720 next 424 2025-05-07 18:36:41.356190: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43cad80000 of size 2359296 next 423 2025-05-07 18:36:41.356198: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43cafc0000 of size 1048576 next 447 2025-05-07 18:36:41.356206: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43cb0c0000 of size 1310720 next 441 2025-05-07 18:36:41.356214: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43cb200000 of size 2359296 next 440 2025-05-07 18:36:41.356222: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43cb440000 of size 1048576 next 465 2025-05-07 18:36:41.356230: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43cb540000 of size 1310720 next 459 2025-05-07 18:36:41.356238: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43cb680000 of size 2359296 next 458 2025-05-07 18:36:41.356246: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43cb8c0000 of size 1048576 next 483 2025-05-07 18:36:41.356254: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43cb9c0000 of size 1310720 next 477 2025-05-07 18:36:41.356261: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43cbb00000 of size 2359296 next 476 2025-05-07 18:36:41.356269: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43cbd40000 of size 1048576 next 501 2025-05-07 18:36:41.356277: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43cbe40000 of size 1310720 next 495 2025-05-07 18:36:41.356285: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43cbf80000 of size 2359296 next 494 2025-05-07 18:36:41.356293: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43cc1c0000 of size 1048576 next 519 2025-05-07 18:36:41.356301: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43cc2c0000 of size 1310720 next 513 2025-05-07 18:36:41.356309: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43cc400000 of size 2359296 next 512 2025-05-07 18:36:41.356317: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43cc640000 of size 1048576 next 537 2025-05-07 18:36:41.356324: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43cc740000 of size 1310720 next 531 2025-05-07 18:36:41.356332: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43cc880000 of size 2359296 next 530 2025-05-07 18:36:41.356340: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43ccac0000 of size 1048576 next 555 2025-05-07 18:36:41.356348: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43ccbc0000 of size 1310720 next 549 2025-05-07 18:36:41.356362: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43ccd00000 of size 2359296 next 548 2025-05-07 18:36:41.356370: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43ccf40000 of size 1048576 next 573 2025-05-07 18:36:41.356378: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43cd040000 of size 1310720 next 567 2025-05-07 18:36:41.356386: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43cd180000 of size 2359296 next 566 2025-05-07 18:36:41.356394: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43cd3c0000 of size 1048576 next 591 2025-05-07 18:36:41.356402: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43cd4c0000 of size 1310720 next 585 2025-05-07 18:36:41.356410: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43cd600000 of size 2359296 next 584 2025-05-07 18:36:41.356417: I tensorflow/core/common_runtime/bfc_allocator.cc:990] Free at 7f43cd840000 of size 2097152 next 597 2025-05-07 18:36:41.356426: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43cda40000 of size 2097152 next 596 2025-05-07 18:36:41.356434: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43cdc40000 of size 3932160 next 18446744073709551615 2025-05-07 18:36:41.356442: I tensorflow/core/common_runtime/bfc_allocator.cc:970] Next region of size 33554432 2025-05-07 18:36:41.356450: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43ce000000 of size 2359296 next 245 2025-05-07 18:36:41.356457: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43ce240000 of size 1048576 next 269 2025-05-07 18:36:41.356465: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43ce340000 of size 1310720 next 263 2025-05-07 18:36:41.356473: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43ce480000 of size 2359296 next 262 2025-05-07 18:36:41.356481: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43ce6c0000 of size 1048576 next 287 2025-05-07 18:36:41.356489: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43ce7c0000 of size 1310720 next 281 2025-05-07 18:36:41.356497: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43ce900000 of size 2359296 next 280 2025-05-07 18:36:41.356505: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43ceb40000 of size 1048576 next 304 2025-05-07 18:36:41.356513: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43cec40000 of size 1310720 next 298 2025-05-07 18:36:41.356521: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43ced80000 of size 2359296 next 297 2025-05-07 18:36:41.356528: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43cefc0000 of size 1048576 next 322 2025-05-07 18:36:41.356536: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43cf0c0000 of size 1310720 next 316 2025-05-07 18:36:41.356544: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43cf200000 of size 2359296 next 315 2025-05-07 18:36:41.356552: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43cf440000 of size 1048576 next 340 2025-05-07 18:36:41.356560: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43cf540000 of size 1310720 next 334 2025-05-07 18:36:41.356568: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43cf680000 of size 2359296 next 333 2025-05-07 18:36:41.356576: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43cf8c0000 of size 1048576 next 358 2025-05-07 18:36:41.356584: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43cf9c0000 of size 1310720 next 352 2025-05-07 18:36:41.356592: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43cfb00000 of size 2359296 next 351 2025-05-07 18:36:41.356599: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43cfd40000 of size 1048576 next 376 2025-05-07 18:36:41.356608: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43cfe40000 of size 1835008 next 18446744073709551615 2025-05-07 18:36:41.356622: I tensorflow/core/common_runtime/bfc_allocator.cc:970] Next region of size 16777216 2025-05-07 18:36:41.356631: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d0000000 of size 2359296 next 181 2025-05-07 18:36:41.356639: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d0240000 of size 2097152 next 196 2025-05-07 18:36:41.356646: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d0440000 of size 1048576 next 216 2025-05-07 18:36:41.356654: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d0540000 of size 1310720 next 209 2025-05-07 18:36:41.356662: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d0680000 of size 2359296 next 208 2025-05-07 18:36:41.356670: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d08c0000 of size 1048576 next 234 2025-05-07 18:36:41.356678: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d09c0000 of size 1310720 next 228 2025-05-07 18:36:41.356686: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d0b00000 of size 2359296 next 227 2025-05-07 18:36:41.356694: I tensorflow/core/common_runtime/bfc_allocator.cc:990] Free at 7f43d0d40000 of size 2883584 next 18446744073709551615 2025-05-07 18:36:41.356702: I tensorflow/core/common_runtime/bfc_allocator.cc:970] Next region of size 2097152 2025-05-07 18:36:41.356710: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2600000 of size 147456 next 55 2025-05-07 18:36:41.356718: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2624000 of size 65536 next 78 2025-05-07 18:36:41.356726: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2634000 of size 4096 next 191 2025-05-07 18:36:41.356734: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2635000 of size 4096 next 192 2025-05-07 18:36:41.356742: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2636000 of size 4096 next 193 2025-05-07 18:36:41.356750: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2637000 of size 256 next 194 2025-05-07 18:36:41.356758: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2637100 of size 256 next 195 2025-05-07 18:36:41.356767: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2637200 of size 4096 next 197 2025-05-07 18:36:41.356775: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2638200 of size 4096 next 198 2025-05-07 18:36:41.356782: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2639200 of size 4096 next 199 2025-05-07 18:36:41.356790: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d263a200 of size 4096 next 200 2025-05-07 18:36:41.356798: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d263b200 of size 4096 next 201 2025-05-07 18:36:41.356806: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d263c200 of size 1024 next 202 2025-05-07 18:36:41.356814: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d263c600 of size 1024 next 204 2025-05-07 18:36:41.356822: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d263ca00 of size 1024 next 205 2025-05-07 18:36:41.356830: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d263ce00 of size 1024 next 206 2025-05-07 18:36:41.356838: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d263d200 of size 1024 next 207 2025-05-07 18:36:41.356846: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d263d600 of size 1024 next 210 2025-05-07 18:36:41.356854: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d263da00 of size 1024 next 211 2025-05-07 18:36:41.356861: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d263de00 of size 1024 next 212 2025-05-07 18:36:41.356869: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d263e200 of size 1024 next 213 2025-05-07 18:36:41.356883: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d263e600 of size 1024 next 214 2025-05-07 18:36:41.356892: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d263ea00 of size 4096 next 215 2025-05-07 18:36:41.356900: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d263fa00 of size 4096 next 217 2025-05-07 18:36:41.356908: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2640a00 of size 4096 next 218 2025-05-07 18:36:41.356915: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2641a00 of size 4096 next 219 2025-05-07 18:36:41.356923: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2642a00 of size 4096 next 220 2025-05-07 18:36:41.356931: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2643a00 of size 1024 next 221 2025-05-07 18:36:41.356939: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2643e00 of size 1024 next 223 2025-05-07 18:36:41.356947: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2644200 of size 1024 next 224 2025-05-07 18:36:41.356955: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2644600 of size 1024 next 225 2025-05-07 18:36:41.356963: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2644a00 of size 1024 next 226 2025-05-07 18:36:41.356970: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2644e00 of size 1024 next 229 2025-05-07 18:36:41.356978: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2645200 of size 1024 next 230 2025-05-07 18:36:41.356986: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2645600 of size 1024 next 231 2025-05-07 18:36:41.356994: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2645a00 of size 1024 next 232 2025-05-07 18:36:41.357002: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2645e00 of size 1024 next 233 2025-05-07 18:36:41.357011: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2646200 of size 7680 next 72 2025-05-07 18:36:41.357019: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2648000 of size 147456 next 71 2025-05-07 18:36:41.357027: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d266c000 of size 131072 next 87 2025-05-07 18:36:41.357035: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d268c000 of size 4096 next 289 2025-05-07 18:36:41.357042: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d268d000 of size 4096 next 290 2025-05-07 18:36:41.357050: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d268e000 of size 4096 next 291 2025-05-07 18:36:41.357058: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d268f000 of size 1024 next 292 2025-05-07 18:36:41.357066: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d268f400 of size 1024 next 293 2025-05-07 18:36:41.357074: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d268f800 of size 1024 next 294 2025-05-07 18:36:41.357082: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d268fc00 of size 1024 next 295 2025-05-07 18:36:41.357090: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2690000 of size 1024 next 296 2025-05-07 18:36:41.357098: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2690400 of size 1024 next 299 2025-05-07 18:36:41.357106: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2690800 of size 1024 next 300 2025-05-07 18:36:41.357113: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2690c00 of size 1024 next 301 2025-05-07 18:36:41.357121: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2691000 of size 1024 next 302 2025-05-07 18:36:41.357129: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2691400 of size 1024 next 303 2025-05-07 18:36:41.357143: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2691800 of size 4096 next 305 2025-05-07 18:36:41.357151: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2692800 of size 4096 next 306 2025-05-07 18:36:41.357159: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2693800 of size 4096 next 307 2025-05-07 18:36:41.357167: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2694800 of size 4096 next 308 2025-05-07 18:36:41.357177: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2695800 of size 4096 next 309 2025-05-07 18:36:41.357186: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2696800 of size 1024 next 310 2025-05-07 18:36:41.357194: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2696c00 of size 1024 next 311 2025-05-07 18:36:41.357203: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2697000 of size 1024 next 312 2025-05-07 18:36:41.357212: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2697400 of size 1024 next 313 2025-05-07 18:36:41.357220: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2697800 of size 1024 next 314 2025-05-07 18:36:41.357229: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2697c00 of size 1024 next 317 2025-05-07 18:36:41.357238: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2698000 of size 1024 next 318 2025-05-07 18:36:41.357246: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2698400 of size 1024 next 319 2025-05-07 18:36:41.357255: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2698800 of size 1024 next 320 2025-05-07 18:36:41.357263: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2698c00 of size 1024 next 321 2025-05-07 18:36:41.357272: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2699000 of size 4096 next 323 2025-05-07 18:36:41.357281: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d269a000 of size 4096 next 324 2025-05-07 18:36:41.357289: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d269b000 of size 4096 next 325 2025-05-07 18:36:41.357298: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d269c000 of size 4096 next 326 2025-05-07 18:36:41.357306: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d269d000 of size 4096 next 327 2025-05-07 18:36:41.357315: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d269e000 of size 1024 next 328 2025-05-07 18:36:41.357324: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d269e400 of size 1024 next 329 2025-05-07 18:36:41.357332: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d269e800 of size 1024 next 330 2025-05-07 18:36:41.357341: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d269ec00 of size 1024 next 331 2025-05-07 18:36:41.357349: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d269f000 of size 1024 next 332 2025-05-07 18:36:41.357358: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d269f400 of size 1024 next 335 2025-05-07 18:36:41.357366: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d269f800 of size 1024 next 336 2025-05-07 18:36:41.357375: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d269fc00 of size 1024 next 337 2025-05-07 18:36:41.357383: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d26a0000 of size 1024 next 338 2025-05-07 18:36:41.357392: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d26a0400 of size 1024 next 339 2025-05-07 18:36:41.357401: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d26a0800 of size 4096 next 341 2025-05-07 18:36:41.357409: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d26a1800 of size 4096 next 342 2025-05-07 18:36:41.357424: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d26a2800 of size 4096 next 343 2025-05-07 18:36:41.357433: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d26a3800 of size 4096 next 344 2025-05-07 18:36:41.357442: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d26a4800 of size 4096 next 345 2025-05-07 18:36:41.357450: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d26a5800 of size 1024 next 346 2025-05-07 18:36:41.357459: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d26a5c00 of size 1024 next 347 2025-05-07 18:36:41.357467: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d26a6000 of size 1024 next 348 2025-05-07 18:36:41.357476: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d26a6400 of size 1024 next 349 2025-05-07 18:36:41.357484: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d26a6800 of size 1024 next 350 2025-05-07 18:36:41.357493: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d26a6c00 of size 1024 next 353 2025-05-07 18:36:41.357502: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d26a7000 of size 1024 next 354 2025-05-07 18:36:41.357510: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d26a7400 of size 1024 next 355 2025-05-07 18:36:41.357519: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d26a7800 of size 1024 next 356 2025-05-07 18:36:41.357527: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d26a7c00 of size 1024 next 357 2025-05-07 18:36:41.357536: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d26a8000 of size 4096 next 359 2025-05-07 18:36:41.357544: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d26a9000 of size 4096 next 360 2025-05-07 18:36:41.357553: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d26aa000 of size 4096 next 361 2025-05-07 18:36:41.357561: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d26ab000 of size 4096 next 362 2025-05-07 18:36:41.357570: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d26ac000 of size 4096 next 363 2025-05-07 18:36:41.357578: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d26ad000 of size 1024 next 364 2025-05-07 18:36:41.357587: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d26ad400 of size 1024 next 365 2025-05-07 18:36:41.357595: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d26ad800 of size 1024 next 366 2025-05-07 18:36:41.357604: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d26adc00 of size 1024 next 367 2025-05-07 18:36:41.357612: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d26ae000 of size 1024 next 368 2025-05-07 18:36:41.357621: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d26ae400 of size 1024 next 371 2025-05-07 18:36:41.357629: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d26ae800 of size 1024 next 372 2025-05-07 18:36:41.357638: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d26aec00 of size 1024 next 373 2025-05-07 18:36:41.357646: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d26af000 of size 1024 next 374 2025-05-07 18:36:41.357655: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d26af400 of size 1024 next 375 2025-05-07 18:36:41.357664: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d26af800 of size 4096 next 377 2025-05-07 18:36:41.357672: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d26b0800 of size 4096 next 378 2025-05-07 18:36:41.357681: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d26b1800 of size 4096 next 379 2025-05-07 18:36:41.357689: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d26b2800 of size 4096 next 380 2025-05-07 18:36:41.357698: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d26b3800 of size 4096 next 381 2025-05-07 18:36:41.357711: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d26b4800 of size 1024 next 382 2025-05-07 18:36:41.357720: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d26b4c00 of size 1024 next 383 2025-05-07 18:36:41.357728: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d26b5000 of size 1024 next 384 2025-05-07 18:36:41.357737: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d26b5400 of size 1024 next 385 2025-05-07 18:36:41.357746: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d26b5800 of size 1024 next 386 2025-05-07 18:36:41.357754: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d26b5c00 of size 1024 next 389 2025-05-07 18:36:41.357763: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d26b6000 of size 1024 next 390 2025-05-07 18:36:41.357772: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d26b6400 of size 1024 next 391 2025-05-07 18:36:41.357780: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d26b6800 of size 1024 next 392 2025-05-07 18:36:41.357789: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d26b6c00 of size 1024 next 393 2025-05-07 18:36:41.357797: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d26b7000 of size 4096 next 395 2025-05-07 18:36:41.357806: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d26b8000 of size 4096 next 396 2025-05-07 18:36:41.357814: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d26b9000 of size 4096 next 397 2025-05-07 18:36:41.357823: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d26ba000 of size 4096 next 398 2025-05-07 18:36:41.357831: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d26bb000 of size 4096 next 399 2025-05-07 18:36:41.357840: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d26bc000 of size 1024 next 400 2025-05-07 18:36:41.357848: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d26bc400 of size 1024 next 401 2025-05-07 18:36:41.357857: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d26bc800 of size 1024 next 402 2025-05-07 18:36:41.357865: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d26bcc00 of size 1024 next 403 2025-05-07 18:36:41.357874: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d26bd000 of size 1024 next 404 2025-05-07 18:36:41.357882: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d26bd400 of size 1024 next 407 2025-05-07 18:36:41.357891: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d26bd800 of size 1024 next 408 2025-05-07 18:36:41.357899: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d26bdc00 of size 1024 next 409 2025-05-07 18:36:41.357908: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d26be000 of size 1024 next 410 2025-05-07 18:36:41.357916: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d26be400 of size 1024 next 411 2025-05-07 18:36:41.357925: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d26be800 of size 4096 next 413 2025-05-07 18:36:41.357934: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d26bf800 of size 4096 next 414 2025-05-07 18:36:41.357942: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d26c0800 of size 4096 next 415 2025-05-07 18:36:41.357951: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d26c1800 of size 4096 next 416 2025-05-07 18:36:41.357959: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d26c2800 of size 4096 next 417 2025-05-07 18:36:41.357968: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d26c3800 of size 1024 next 418 2025-05-07 18:36:41.357976: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d26c3c00 of size 1024 next 419 2025-05-07 18:36:41.357992: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d26c4000 of size 1024 next 420 2025-05-07 18:36:41.358001: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d26c4400 of size 1024 next 421 2025-05-07 18:36:41.358009: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d26c4800 of size 1024 next 422 2025-05-07 18:36:41.358018: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d26c4c00 of size 1024 next 425 2025-05-07 18:36:41.358026: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d26c5000 of size 1024 next 426 2025-05-07 18:36:41.358035: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d26c5400 of size 1024 next 427 2025-05-07 18:36:41.358043: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d26c5800 of size 1024 next 428 2025-05-07 18:36:41.358052: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d26c5c00 of size 1024 next 429 2025-05-07 18:36:41.358060: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d26c6000 of size 4096 next 431 2025-05-07 18:36:41.358069: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d26c7000 of size 4096 next 432 2025-05-07 18:36:41.358077: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d26c8000 of size 4096 next 433 2025-05-07 18:36:41.358086: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d26c9000 of size 4096 next 434 2025-05-07 18:36:41.358095: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d26ca000 of size 4096 next 435 2025-05-07 18:36:41.358103: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d26cb000 of size 1024 next 436 2025-05-07 18:36:41.358112: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d26cb400 of size 1024 next 437 2025-05-07 18:36:41.358120: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d26cb800 of size 1024 next 438 2025-05-07 18:36:41.358129: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d26cbc00 of size 1024 next 103 2025-05-07 18:36:41.358140: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d26cc000 of size 262144 next 102 2025-05-07 18:36:41.358149: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d270c000 of size 262144 next 674 2025-05-07 18:36:41.358157: I tensorflow/core/common_runtime/bfc_allocator.cc:990] Free at 7f43d274c000 of size 737280 next 18446744073709551615 2025-05-07 18:36:41.358165: I tensorflow/core/common_runtime/bfc_allocator.cc:970] Next region of size 4194304 2025-05-07 18:36:41.358173: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2800000 of size 589824 next 96 2025-05-07 18:36:41.358181: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2890000 of size 262144 next 117 2025-05-07 18:36:41.358188: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d28d0000 of size 1024 next 439 2025-05-07 18:36:41.358196: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d28d0400 of size 1024 next 442 2025-05-07 18:36:41.358204: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d28d0800 of size 1024 next 443 2025-05-07 18:36:41.358212: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d28d0c00 of size 1024 next 444 2025-05-07 18:36:41.358220: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d28d1000 of size 1024 next 445 2025-05-07 18:36:41.358228: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d28d1400 of size 1024 next 446 2025-05-07 18:36:41.358236: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d28d1800 of size 4096 next 448 2025-05-07 18:36:41.358243: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d28d2800 of size 4096 next 449 2025-05-07 18:36:41.358251: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d28d3800 of size 4096 next 450 2025-05-07 18:36:41.358265: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d28d4800 of size 4096 next 451 2025-05-07 18:36:41.358273: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d28d5800 of size 4096 next 452 2025-05-07 18:36:41.358282: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d28d6800 of size 1024 next 453 2025-05-07 18:36:41.358290: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d28d6c00 of size 1024 next 454 2025-05-07 18:36:41.358298: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d28d7000 of size 1024 next 455 2025-05-07 18:36:41.358305: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d28d7400 of size 1024 next 456 2025-05-07 18:36:41.358313: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d28d7800 of size 1024 next 457 2025-05-07 18:36:41.358321: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d28d7c00 of size 1024 next 460 2025-05-07 18:36:41.358329: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d28d8000 of size 1024 next 461 2025-05-07 18:36:41.358337: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d28d8400 of size 1024 next 462 2025-05-07 18:36:41.358345: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d28d8800 of size 1024 next 463 2025-05-07 18:36:41.358353: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d28d8c00 of size 1024 next 464 2025-05-07 18:36:41.358360: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d28d9000 of size 4096 next 466 2025-05-07 18:36:41.358368: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d28da000 of size 4096 next 467 2025-05-07 18:36:41.358376: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d28db000 of size 4096 next 468 2025-05-07 18:36:41.358384: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d28dc000 of size 4096 next 469 2025-05-07 18:36:41.358392: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d28dd000 of size 4096 next 470 2025-05-07 18:36:41.358400: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d28de000 of size 1024 next 471 2025-05-07 18:36:41.358408: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d28de400 of size 1024 next 472 2025-05-07 18:36:41.358416: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d28de800 of size 1024 next 473 2025-05-07 18:36:41.358423: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d28dec00 of size 1024 next 474 2025-05-07 18:36:41.358431: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d28df000 of size 1024 next 475 2025-05-07 18:36:41.358439: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d28df400 of size 1024 next 478 2025-05-07 18:36:41.358447: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d28df800 of size 1024 next 479 2025-05-07 18:36:41.358455: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d28dfc00 of size 1024 next 480 2025-05-07 18:36:41.358462: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d28e0000 of size 1024 next 481 2025-05-07 18:36:41.358470: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d28e0400 of size 1024 next 482 2025-05-07 18:36:41.358478: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d28e0800 of size 4096 next 484 2025-05-07 18:36:41.358486: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d28e1800 of size 4096 next 485 2025-05-07 18:36:41.358494: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d28e2800 of size 4096 next 486 2025-05-07 18:36:41.358502: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d28e3800 of size 4096 next 487 2025-05-07 18:36:41.358510: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d28e4800 of size 4096 next 488 2025-05-07 18:36:41.358524: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d28e5800 of size 1024 next 489 2025-05-07 18:36:41.358532: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d28e5c00 of size 1024 next 490 2025-05-07 18:36:41.358540: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d28e6000 of size 1024 next 491 2025-05-07 18:36:41.358548: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d28e6400 of size 1024 next 492 2025-05-07 18:36:41.358556: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d28e6800 of size 1024 next 493 2025-05-07 18:36:41.358564: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d28e6c00 of size 1024 next 496 2025-05-07 18:36:41.358572: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d28e7000 of size 1024 next 497 2025-05-07 18:36:41.358580: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d28e7400 of size 1024 next 498 2025-05-07 18:36:41.358587: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d28e7800 of size 1024 next 499 2025-05-07 18:36:41.358595: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d28e7c00 of size 1024 next 500 2025-05-07 18:36:41.358603: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d28e8000 of size 4096 next 502 2025-05-07 18:36:41.358611: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d28e9000 of size 4096 next 503 2025-05-07 18:36:41.358619: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d28ea000 of size 4096 next 504 2025-05-07 18:36:41.358627: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d28eb000 of size 4096 next 505 2025-05-07 18:36:41.358635: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d28ec000 of size 4096 next 506 2025-05-07 18:36:41.358643: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d28ed000 of size 1024 next 507 2025-05-07 18:36:41.358650: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d28ed400 of size 1024 next 508 2025-05-07 18:36:41.358658: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d28ed800 of size 1024 next 509 2025-05-07 18:36:41.358666: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d28edc00 of size 1024 next 510 2025-05-07 18:36:41.358674: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d28ee000 of size 1024 next 511 2025-05-07 18:36:41.358682: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d28ee400 of size 1024 next 514 2025-05-07 18:36:41.358690: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d28ee800 of size 1024 next 515 2025-05-07 18:36:41.358698: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d28eec00 of size 1024 next 516 2025-05-07 18:36:41.358706: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d28ef000 of size 1024 next 517 2025-05-07 18:36:41.358713: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d28ef400 of size 1024 next 518 2025-05-07 18:36:41.358721: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d28ef800 of size 4096 next 520 2025-05-07 18:36:41.358729: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d28f0800 of size 4096 next 521 2025-05-07 18:36:41.358737: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d28f1800 of size 4096 next 522 2025-05-07 18:36:41.358745: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d28f2800 of size 4096 next 523 2025-05-07 18:36:41.358753: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d28f3800 of size 4096 next 524 2025-05-07 18:36:41.358761: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d28f4800 of size 1024 next 525 2025-05-07 18:36:41.358769: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d28f4c00 of size 1024 next 526 2025-05-07 18:36:41.358783: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d28f5000 of size 1024 next 527 2025-05-07 18:36:41.358791: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d28f5400 of size 1024 next 528 2025-05-07 18:36:41.358799: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d28f5800 of size 1024 next 529 2025-05-07 18:36:41.358807: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d28f5c00 of size 1024 next 532 2025-05-07 18:36:41.358814: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d28f6000 of size 1024 next 533 2025-05-07 18:36:41.358822: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d28f6400 of size 1024 next 534 2025-05-07 18:36:41.358830: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d28f6800 of size 1024 next 535 2025-05-07 18:36:41.358838: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d28f6c00 of size 1024 next 536 2025-05-07 18:36:41.358846: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d28f7000 of size 4096 next 538 2025-05-07 18:36:41.358854: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d28f8000 of size 4096 next 539 2025-05-07 18:36:41.358862: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d28f9000 of size 4096 next 540 2025-05-07 18:36:41.358870: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d28fa000 of size 4096 next 541 2025-05-07 18:36:41.358877: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d28fb000 of size 4096 next 542 2025-05-07 18:36:41.358885: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d28fc000 of size 1024 next 543 2025-05-07 18:36:41.358893: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d28fc400 of size 1024 next 544 2025-05-07 18:36:41.358923: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d28fc800 of size 1024 next 545 2025-05-07 18:36:41.358931: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d28fcc00 of size 1024 next 546 2025-05-07 18:36:41.358939: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d28fd000 of size 1024 next 547 2025-05-07 18:36:41.358947: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d28fd400 of size 1024 next 550 2025-05-07 18:36:41.358955: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d28fd800 of size 1024 next 551 2025-05-07 18:36:41.358963: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d28fdc00 of size 1024 next 552 2025-05-07 18:36:41.358971: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d28fe000 of size 1024 next 553 2025-05-07 18:36:41.358979: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d28fe400 of size 1024 next 554 2025-05-07 18:36:41.358986: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d28fe800 of size 4096 next 556 2025-05-07 18:36:41.358994: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d28ff800 of size 4096 next 557 2025-05-07 18:36:41.359002: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2900800 of size 4096 next 558 2025-05-07 18:36:41.359010: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2901800 of size 4096 next 559 2025-05-07 18:36:41.359018: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2902800 of size 4096 next 560 2025-05-07 18:36:41.359026: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2903800 of size 1024 next 561 2025-05-07 18:36:41.359034: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2903c00 of size 1024 next 562 2025-05-07 18:36:41.359042: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2904000 of size 1024 next 563 2025-05-07 18:36:41.359049: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2904400 of size 1024 next 564 2025-05-07 18:36:41.359057: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2904800 of size 1024 next 565 2025-05-07 18:36:41.359071: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2904c00 of size 1024 next 568 2025-05-07 18:36:41.359079: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2905000 of size 1024 next 569 2025-05-07 18:36:41.359088: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2905400 of size 1024 next 570 2025-05-07 18:36:41.359095: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2905800 of size 1024 next 571 2025-05-07 18:36:41.359103: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2905c00 of size 1024 next 572 2025-05-07 18:36:41.359111: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2906000 of size 4096 next 574 2025-05-07 18:36:41.359119: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2907000 of size 4096 next 575 2025-05-07 18:36:41.359127: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2908000 of size 4096 next 576 2025-05-07 18:36:41.359135: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2909000 of size 4096 next 577 2025-05-07 18:36:41.359143: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d290a000 of size 4096 next 578 2025-05-07 18:36:41.359151: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d290b000 of size 1024 next 579 2025-05-07 18:36:41.359159: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d290b400 of size 1024 next 580 2025-05-07 18:36:41.359167: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d290b800 of size 1024 next 581 2025-05-07 18:36:41.359175: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d290bc00 of size 1024 next 582 2025-05-07 18:36:41.359182: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d290c000 of size 1024 next 583 2025-05-07 18:36:41.359190: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d290c400 of size 1024 next 586 2025-05-07 18:36:41.359198: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d290c800 of size 1024 next 587 2025-05-07 18:36:41.359206: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d290cc00 of size 1024 next 588 2025-05-07 18:36:41.359214: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d290d000 of size 1024 next 589 2025-05-07 18:36:41.359222: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d290d400 of size 1024 next 590 2025-05-07 18:36:41.359230: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d290d800 of size 4096 next 592 2025-05-07 18:36:41.359238: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d290e800 of size 6144 next 112 2025-05-07 18:36:41.359246: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2910000 of size 524288 next 111 2025-05-07 18:36:41.359254: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2990000 of size 262144 next 135 2025-05-07 18:36:41.359262: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d29d0000 of size 327680 next 124 2025-05-07 18:36:41.359270: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2a20000 of size 589824 next 123 2025-05-07 18:36:41.359278: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2ab0000 of size 262144 next 152 2025-05-07 18:36:41.359286: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2af0000 of size 327680 next 142 2025-05-07 18:36:41.359294: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2b40000 of size 786432 next 18446744073709551615 2025-05-07 18:36:41.359302: I tensorflow/core/common_runtime/bfc_allocator.cc:970] Next region of size 8388608 2025-05-07 18:36:41.359310: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2c00000 of size 4096 next 593 2025-05-07 18:36:41.359317: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2c01000 of size 4096 next 594 2025-05-07 18:36:41.359330: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2c02000 of size 4096 next 595 2025-05-07 18:36:41.359338: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2c03000 of size 2048 next 598 2025-05-07 18:36:41.359346: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2c03800 of size 2048 next 599 2025-05-07 18:36:41.359354: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2c04000 of size 2048 next 600 2025-05-07 18:36:41.359362: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2c04800 of size 2048 next 601 2025-05-07 18:36:41.359370: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2c05000 of size 2048 next 602 2025-05-07 18:36:41.359377: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2c05800 of size 256 next 605 2025-05-07 18:36:41.359385: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2c05900 of size 256 next 606 2025-05-07 18:36:41.359393: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2c05a00 of size 2048 next 604 2025-05-07 18:36:41.359401: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2c06200 of size 2048 next 609 2025-05-07 18:36:41.359409: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2c06a00 of size 2048 next 610 2025-05-07 18:36:41.359417: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2c07200 of size 2048 next 611 2025-05-07 18:36:41.359425: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2c07a00 of size 2048 next 612 2025-05-07 18:36:41.359432: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2c08200 of size 256 next 614 2025-05-07 18:36:41.359440: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2c08300 of size 256 next 615 2025-05-07 18:36:41.359449: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2c08400 of size 8192 next 613 2025-05-07 18:36:41.359456: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2c0a400 of size 8192 next 618 2025-05-07 18:36:41.359464: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2c0c400 of size 8192 next 619 2025-05-07 18:36:41.359472: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2c0e400 of size 8192 next 620 2025-05-07 18:36:41.359480: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2c10400 of size 8192 next 621 2025-05-07 18:36:41.359488: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2c12400 of size 256 next 622 2025-05-07 18:36:41.359496: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2c12500 of size 256 next 623 2025-05-07 18:36:41.359504: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2c12600 of size 8192 next 626 2025-05-07 18:36:41.359511: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2c14600 of size 8192 next 627 2025-05-07 18:36:41.359519: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2c16600 of size 8192 next 628 2025-05-07 18:36:41.359527: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2c18600 of size 8192 next 629 2025-05-07 18:36:41.359535: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2c1a600 of size 8192 next 630 2025-05-07 18:36:41.359543: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2c1c600 of size 2048 next 631 2025-05-07 18:36:41.359551: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2c1ce00 of size 2048 next 633 2025-05-07 18:36:41.359559: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2c1d600 of size 2048 next 634 2025-05-07 18:36:41.359567: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2c1de00 of size 2048 next 635 2025-05-07 18:36:41.359575: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2c1e600 of size 2048 next 636 2025-05-07 18:36:41.359593: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2c1ee00 of size 2048 next 637 2025-05-07 18:36:41.359601: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2c1f600 of size 2048 next 640 2025-05-07 18:36:41.359609: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2c1fe00 of size 2048 next 641 2025-05-07 18:36:41.359617: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2c20600 of size 2048 next 642 2025-05-07 18:36:41.359625: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2c20e00 of size 2048 next 643 2025-05-07 18:36:41.359633: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2c21600 of size 8192 next 645 2025-05-07 18:36:41.359641: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2c23600 of size 8192 next 646 2025-05-07 18:36:41.359649: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2c25600 of size 8192 next 647 2025-05-07 18:36:41.359657: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2c27600 of size 8192 next 648 2025-05-07 18:36:41.359665: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2c29600 of size 8192 next 649 2025-05-07 18:36:41.359672: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2c2b600 of size 2048 next 650 2025-05-07 18:36:41.359680: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2c2be00 of size 2048 next 651 2025-05-07 18:36:41.359688: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2c2c600 of size 2048 next 652 2025-05-07 18:36:41.359696: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2c2ce00 of size 2048 next 653 2025-05-07 18:36:41.359704: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2c2d600 of size 2048 next 654 2025-05-07 18:36:41.359712: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2c2de00 of size 2048 next 655 2025-05-07 18:36:41.359720: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2c2e600 of size 2048 next 657 2025-05-07 18:36:41.359728: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2c2ee00 of size 2048 next 658 2025-05-07 18:36:41.359736: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2c2f600 of size 2048 next 659 2025-05-07 18:36:41.359743: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2c2fe00 of size 2048 next 660 2025-05-07 18:36:41.359751: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2c30600 of size 8192 next 662 2025-05-07 18:36:41.359759: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2c32600 of size 8192 next 663 2025-05-07 18:36:41.359767: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2c34600 of size 8192 next 664 2025-05-07 18:36:41.359775: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2c36600 of size 8192 next 665 2025-05-07 18:36:41.359783: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2c38600 of size 8192 next 666 2025-05-07 18:36:41.359791: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2c3a600 of size 1024 next 667 2025-05-07 18:36:41.359799: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2c3aa00 of size 1024 next 668 2025-05-07 18:36:41.359806: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2c3ae00 of size 1024 next 669 2025-05-07 18:36:41.359814: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2c3b200 of size 1024 next 673 2025-05-07 18:36:41.359822: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2c3b600 of size 1024 next 675 2025-05-07 18:36:41.359830: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2c3ba00 of size 1024 next 677 2025-05-07 18:36:41.359838: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2c3be00 of size 1024 next 679 2025-05-07 18:36:41.359852: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2c3c200 of size 1024 next 681 2025-05-07 18:36:41.359860: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2c3c600 of size 256 next 682 2025-05-07 18:36:41.359868: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2c3c700 of size 256 next 683 2025-05-07 18:36:41.359876: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2c3c800 of size 2048 next 686 2025-05-07 18:36:41.359884: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2c3d000 of size 256 next 690 2025-05-07 18:36:41.359891: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2c3d100 of size 256 next 694 2025-05-07 18:36:41.359899: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2c3d200 of size 256 next 695 2025-05-07 18:36:41.359907: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2c3d300 of size 256 next 693 2025-05-07 18:36:41.359915: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2c3d400 of size 256 next 699 2025-05-07 18:36:41.359923: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2c3d500 of size 256 next 700 2025-05-07 18:36:41.359931: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2c3d600 of size 256 next 701 2025-05-07 18:36:41.359939: I tensorflow/core/common_runtime/bfc_allocator.cc:990] Free at 7f43d2c3d700 of size 10496 next 687 2025-05-07 18:36:41.359946: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2c40000 of size 256 next 688 2025-05-07 18:36:41.359954: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2c40100 of size 256 next 689 2025-05-07 18:36:41.359962: I tensorflow/core/common_runtime/bfc_allocator.cc:990] Free at 7f43d2c40200 of size 12544 next 691 2025-05-07 18:36:41.359970: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2c43300 of size 12288 next 692 2025-05-07 18:36:41.359978: I tensorflow/core/common_runtime/bfc_allocator.cc:990] Free at 7f43d2c46300 of size 49152 next 697 2025-05-07 18:36:41.359986: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2c52300 of size 24576 next 696 2025-05-07 18:36:41.359994: I tensorflow/core/common_runtime/bfc_allocator.cc:990] Free at 7f43d2c58300 of size 228608 next 160 2025-05-07 18:36:41.360002: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2c90000 of size 589824 next 158 2025-05-07 18:36:41.360010: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2d20000 of size 524288 next 171 2025-05-07 18:36:41.360018: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2da0000 of size 256 next 671 2025-05-07 18:36:41.360026: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2da0100 of size 256 next 672 2025-05-07 18:36:41.360034: I tensorflow/core/common_runtime/bfc_allocator.cc:990] Free at 7f43d2da0200 of size 523776 next 670 2025-05-07 18:36:41.360041: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2e20000 of size 524288 next 222 2025-05-07 18:36:41.360049: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2ea0000 of size 1048576 next 190 2025-05-07 18:36:41.360057: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d2fa0000 of size 1048576 next 189 2025-05-07 18:36:41.360065: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d30a0000 of size 1048576 next 203 2025-05-07 18:36:41.360073: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d31a0000 of size 1048576 next 251 2025-05-07 18:36:41.360081: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f43d32a0000 of size 1441792 next 18446744073709551615 2025-05-07 18:36:41.360089: I tensorflow/core/common_runtime/bfc_allocator.cc:970] Next region of size 1048576 2025-05-07 18:36:41.360098: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e00000 of size 1280 next 1 2025-05-07 18:36:41.360111: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e00500 of size 256 next 5 2025-05-07 18:36:41.360120: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e00600 of size 256 next 8 2025-05-07 18:36:41.360128: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e00700 of size 256 next 9 2025-05-07 18:36:41.360136: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e00800 of size 256 next 10 2025-05-07 18:36:41.360143: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e00900 of size 256 next 11 2025-05-07 18:36:41.360151: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e00a00 of size 256 next 12 2025-05-07 18:36:41.360159: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e00b00 of size 256 next 13 2025-05-07 18:36:41.360167: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e00c00 of size 256 next 17 2025-05-07 18:36:41.360175: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e00d00 of size 256 next 19 2025-05-07 18:36:41.360183: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e00e00 of size 256 next 20 2025-05-07 18:36:41.360191: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e00f00 of size 256 next 21 2025-05-07 18:36:41.360198: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e01000 of size 256 next 22 2025-05-07 18:36:41.360206: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e01100 of size 256 next 24 2025-05-07 18:36:41.360214: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e01200 of size 256 next 25 2025-05-07 18:36:41.360222: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e01300 of size 256 next 23 2025-05-07 18:36:41.360230: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e01400 of size 256 next 28 2025-05-07 18:36:41.360238: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e01500 of size 256 next 29 2025-05-07 18:36:41.360246: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e01600 of size 256 next 30 2025-05-07 18:36:41.360253: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e01700 of size 256 next 31 2025-05-07 18:36:41.360261: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e01800 of size 256 next 33 2025-05-07 18:36:41.360269: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e01900 of size 256 next 34 2025-05-07 18:36:41.360277: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e01a00 of size 1024 next 32 2025-05-07 18:36:41.360285: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e01e00 of size 1024 next 37 2025-05-07 18:36:41.360293: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e02200 of size 1024 next 38 2025-05-07 18:36:41.360301: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e02600 of size 1024 next 39 2025-05-07 18:36:41.360309: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e02a00 of size 1024 next 40 2025-05-07 18:36:41.360317: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e02e00 of size 1024 next 41 2025-05-07 18:36:41.360325: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e03200 of size 1024 next 43 2025-05-07 18:36:41.360332: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e03600 of size 1024 next 44 2025-05-07 18:36:41.360340: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e03a00 of size 1024 next 45 2025-05-07 18:36:41.360348: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e03e00 of size 1024 next 46 2025-05-07 18:36:41.360356: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e04200 of size 256 next 48 2025-05-07 18:36:41.360364: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e04300 of size 256 next 49 2025-05-07 18:36:41.360378: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e04400 of size 256 next 50 2025-05-07 18:36:41.360386: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e04500 of size 256 next 51 2025-05-07 18:36:41.360394: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e04600 of size 256 next 52 2025-05-07 18:36:41.360402: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e04700 of size 256 next 53 2025-05-07 18:36:41.360410: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e04800 of size 256 next 56 2025-05-07 18:36:41.360417: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e04900 of size 256 next 57 2025-05-07 18:36:41.360425: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e04a00 of size 256 next 58 2025-05-07 18:36:41.360433: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e04b00 of size 256 next 14 2025-05-07 18:36:41.360441: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e04c00 of size 256 next 15 2025-05-07 18:36:41.360449: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e04d00 of size 256 next 16 2025-05-07 18:36:41.360457: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e04e00 of size 1024 next 60 2025-05-07 18:36:41.360465: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e05200 of size 1024 next 61 2025-05-07 18:36:41.360473: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e05600 of size 1024 next 62 2025-05-07 18:36:41.360480: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e05a00 of size 1024 next 63 2025-05-07 18:36:41.360488: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e05e00 of size 1024 next 64 2025-05-07 18:36:41.360496: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e06200 of size 256 next 66 2025-05-07 18:36:41.360504: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e06300 of size 256 next 67 2025-05-07 18:36:41.360512: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e06400 of size 256 next 68 2025-05-07 18:36:41.360520: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e06500 of size 256 next 69 2025-05-07 18:36:41.360528: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e06600 of size 256 next 70 2025-05-07 18:36:41.360536: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e06700 of size 256 next 73 2025-05-07 18:36:41.360544: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e06800 of size 256 next 74 2025-05-07 18:36:41.360551: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e06900 of size 256 next 75 2025-05-07 18:36:41.360559: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e06a00 of size 256 next 76 2025-05-07 18:36:41.360567: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e06b00 of size 256 next 77 2025-05-07 18:36:41.360575: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e06c00 of size 1024 next 79 2025-05-07 18:36:41.360583: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e07000 of size 1024 next 80 2025-05-07 18:36:41.360591: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e07400 of size 1024 next 81 2025-05-07 18:36:41.360599: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e07800 of size 1024 next 82 2025-05-07 18:36:41.360606: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e07c00 of size 1024 next 83 2025-05-07 18:36:41.360614: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e08000 of size 256 next 85 2025-05-07 18:36:41.360622: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e08100 of size 256 next 86 2025-05-07 18:36:41.360630: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e08200 of size 512 next 84 2025-05-07 18:36:41.360644: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e08400 of size 512 next 88 2025-05-07 18:36:41.360653: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e08600 of size 512 next 89 2025-05-07 18:36:41.360660: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e08800 of size 512 next 90 2025-05-07 18:36:41.360668: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e08a00 of size 512 next 91 2025-05-07 18:36:41.360676: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e08c00 of size 256 next 93 2025-05-07 18:36:41.360684: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e08d00 of size 256 next 94 2025-05-07 18:36:41.360692: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e08e00 of size 512 next 92 2025-05-07 18:36:41.360700: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e09000 of size 512 next 97 2025-05-07 18:36:41.360708: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e09200 of size 512 next 98 2025-05-07 18:36:41.360715: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e09400 of size 512 next 99 2025-05-07 18:36:41.360723: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e09600 of size 512 next 2 2025-05-07 18:36:41.360731: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e09800 of size 256 next 3 2025-05-07 18:36:41.360739: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e09900 of size 256 next 4 2025-05-07 18:36:41.360747: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e09a00 of size 16384 next 18 2025-05-07 18:36:41.360755: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e0da00 of size 256 next 100 2025-05-07 18:36:41.360763: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e0db00 of size 256 next 101 2025-05-07 18:36:41.360771: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e0dc00 of size 2048 next 104 2025-05-07 18:36:41.360779: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e0e400 of size 2048 next 105 2025-05-07 18:36:41.360787: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e0ec00 of size 2048 next 106 2025-05-07 18:36:41.360795: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e0f400 of size 2048 next 107 2025-05-07 18:36:41.360802: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e0fc00 of size 2048 next 108 2025-05-07 18:36:41.360810: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e10400 of size 256 next 109 2025-05-07 18:36:41.360818: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e10500 of size 256 next 110 2025-05-07 18:36:41.360826: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e10600 of size 2048 next 113 2025-05-07 18:36:41.360834: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e10e00 of size 2048 next 114 2025-05-07 18:36:41.360842: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e11600 of size 2048 next 115 2025-05-07 18:36:41.360850: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e11e00 of size 2048 next 116 2025-05-07 18:36:41.360858: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e12600 of size 2048 next 6 2025-05-07 18:36:41.360866: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e12e00 of size 37632 next 7 2025-05-07 18:36:41.360874: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e1c100 of size 512 next 118 2025-05-07 18:36:41.360882: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e1c300 of size 512 next 119 2025-05-07 18:36:41.360890: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e1c500 of size 512 next 120 2025-05-07 18:36:41.360904: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e1c700 of size 512 next 121 2025-05-07 18:36:41.360912: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e1c900 of size 512 next 122 2025-05-07 18:36:41.360920: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e1cb00 of size 512 next 125 2025-05-07 18:36:41.360928: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e1cd00 of size 512 next 126 2025-05-07 18:36:41.360935: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e1cf00 of size 512 next 127 2025-05-07 18:36:41.360943: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e1d100 of size 512 next 128 2025-05-07 18:36:41.360951: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e1d300 of size 512 next 129 2025-05-07 18:36:41.360959: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e1d500 of size 2048 next 130 2025-05-07 18:36:41.360967: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e1dd00 of size 2048 next 131 2025-05-07 18:36:41.360975: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e1e500 of size 2048 next 132 2025-05-07 18:36:41.360983: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e1ed00 of size 2048 next 133 2025-05-07 18:36:41.360991: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e1f500 of size 2048 next 134 2025-05-07 18:36:41.360999: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e1fd00 of size 512 next 136 2025-05-07 18:36:41.361007: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e1ff00 of size 512 next 137 2025-05-07 18:36:41.361015: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e20100 of size 512 next 138 2025-05-07 18:36:41.361023: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e20300 of size 512 next 139 2025-05-07 18:36:41.361030: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e20500 of size 512 next 140 2025-05-07 18:36:41.361038: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e20700 of size 512 next 141 2025-05-07 18:36:41.361046: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e20900 of size 512 next 143 2025-05-07 18:36:41.361054: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e20b00 of size 512 next 144 2025-05-07 18:36:41.361062: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e20d00 of size 512 next 145 2025-05-07 18:36:41.361070: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e20f00 of size 512 next 146 2025-05-07 18:36:41.361078: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e21100 of size 2048 next 147 2025-05-07 18:36:41.361085: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e21900 of size 2048 next 148 2025-05-07 18:36:41.361093: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e22100 of size 2048 next 149 2025-05-07 18:36:41.361101: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e22900 of size 2048 next 150 2025-05-07 18:36:41.361109: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e23100 of size 2048 next 151 2025-05-07 18:36:41.361117: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e23900 of size 512 next 153 2025-05-07 18:36:41.361125: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e23b00 of size 512 next 154 2025-05-07 18:36:41.361133: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e23d00 of size 512 next 155 2025-05-07 18:36:41.361140: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e23f00 of size 512 next 156 2025-05-07 18:36:41.361148: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e24100 of size 512 next 157 2025-05-07 18:36:41.361156: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e24300 of size 512 next 161 2025-05-07 18:36:41.361170: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e24500 of size 512 next 162 2025-05-07 18:36:41.361178: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e24700 of size 512 next 163 2025-05-07 18:36:41.361186: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e24900 of size 512 next 164 2025-05-07 18:36:41.361194: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e24b00 of size 512 next 165 2025-05-07 18:36:41.361202: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e24d00 of size 2048 next 166 2025-05-07 18:36:41.361210: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e25500 of size 2048 next 167 2025-05-07 18:36:41.361218: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e25d00 of size 2048 next 168 2025-05-07 18:36:41.361226: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e26500 of size 2048 next 169 2025-05-07 18:36:41.361233: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e26d00 of size 2048 next 170 2025-05-07 18:36:41.361241: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e27500 of size 1024 next 172 2025-05-07 18:36:41.361249: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e27900 of size 1024 next 173 2025-05-07 18:36:41.361257: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e27d00 of size 1024 next 174 2025-05-07 18:36:41.361265: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e28100 of size 1024 next 175 2025-05-07 18:36:41.361273: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e28500 of size 1024 next 176 2025-05-07 18:36:41.361281: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e28900 of size 256 next 178 2025-05-07 18:36:41.361289: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e28a00 of size 256 next 179 2025-05-07 18:36:41.361296: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e28b00 of size 1024 next 177 2025-05-07 18:36:41.361304: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e28f00 of size 1024 next 182 2025-05-07 18:36:41.361312: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e29300 of size 1024 next 183 2025-05-07 18:36:41.361320: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e29700 of size 1024 next 184 2025-05-07 18:36:41.361328: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e29b00 of size 1024 next 185 2025-05-07 18:36:41.361336: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e29f00 of size 256 next 187 2025-05-07 18:36:41.361343: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e2a000 of size 256 next 188 2025-05-07 18:36:41.361351: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e2a100 of size 4096 next 186 2025-05-07 18:36:41.361359: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e2b100 of size 4096 next 42 2025-05-07 18:36:41.361367: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e2c100 of size 65536 next 36 2025-05-07 18:36:41.361375: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e3c100 of size 65536 next 35 2025-05-07 18:36:41.361383: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e4c100 of size 4096 next 235 2025-05-07 18:36:41.361391: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e4d100 of size 4096 next 236 2025-05-07 18:36:41.361399: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e4e100 of size 4096 next 237 2025-05-07 18:36:41.361406: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e4f100 of size 4096 next 238 2025-05-07 18:36:41.361414: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e50100 of size 1024 next 239 2025-05-07 18:36:41.361428: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e50500 of size 1024 next 240 2025-05-07 18:36:41.361436: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e50900 of size 1024 next 241 2025-05-07 18:36:41.361444: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e50d00 of size 1024 next 242 2025-05-07 18:36:41.361452: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e51100 of size 1024 next 243 2025-05-07 18:36:41.361460: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e51500 of size 1024 next 246 2025-05-07 18:36:41.361468: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e51900 of size 1024 next 247 2025-05-07 18:36:41.361476: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e51d00 of size 1024 next 248 2025-05-07 18:36:41.361484: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e52100 of size 1024 next 249 2025-05-07 18:36:41.361492: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e52500 of size 1024 next 250 2025-05-07 18:36:41.361499: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e52900 of size 4096 next 252 2025-05-07 18:36:41.361507: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e53900 of size 4096 next 253 2025-05-07 18:36:41.361515: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e54900 of size 4096 next 254 2025-05-07 18:36:41.361523: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e55900 of size 4096 next 255 2025-05-07 18:36:41.361531: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e56900 of size 4096 next 256 2025-05-07 18:36:41.361539: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e57900 of size 1024 next 257 2025-05-07 18:36:41.361547: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e57d00 of size 1024 next 258 2025-05-07 18:36:41.361555: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e58100 of size 1024 next 259 2025-05-07 18:36:41.361562: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e58500 of size 1024 next 260 2025-05-07 18:36:41.361570: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e58900 of size 1024 next 261 2025-05-07 18:36:41.361578: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e58d00 of size 1024 next 264 2025-05-07 18:36:41.361586: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e59100 of size 1024 next 265 2025-05-07 18:36:41.361594: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e59500 of size 1024 next 266 2025-05-07 18:36:41.361602: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e59900 of size 1024 next 267 2025-05-07 18:36:41.361609: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e59d00 of size 1024 next 268 2025-05-07 18:36:41.361617: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e5a100 of size 4096 next 270 2025-05-07 18:36:41.361625: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e5b100 of size 4096 next 271 2025-05-07 18:36:41.361633: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e5c100 of size 4096 next 272 2025-05-07 18:36:41.361641: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e5d100 of size 4096 next 273 2025-05-07 18:36:41.361649: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e5e100 of size 4096 next 274 2025-05-07 18:36:41.361657: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e5f100 of size 1024 next 275 2025-05-07 18:36:41.361665: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e5f500 of size 1024 next 276 2025-05-07 18:36:41.361672: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e5f900 of size 1024 next 277 2025-05-07 18:36:41.361687: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e5fd00 of size 1024 next 278 2025-05-07 18:36:41.361695: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e60100 of size 1024 next 279 2025-05-07 18:36:41.361703: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e60500 of size 1024 next 282 2025-05-07 18:36:41.361711: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e60900 of size 1024 next 283 2025-05-07 18:36:41.361719: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e60d00 of size 1024 next 284 2025-05-07 18:36:41.361727: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e61100 of size 1024 next 285 2025-05-07 18:36:41.361734: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e61500 of size 1024 next 286 2025-05-07 18:36:41.361742: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e61900 of size 4096 next 288 2025-05-07 18:36:41.361750: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e62900 of size 6144 next 27 2025-05-07 18:36:41.361758: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e64100 of size 147456 next 26 2025-05-07 18:36:41.361766: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e88100 of size 65536 next 47 2025-05-07 18:36:41.361774: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512e98100 of size 65536 next 59 2025-05-07 18:36:41.361782: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512ea8100 of size 65536 next 65 2025-05-07 18:36:41.361790: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4512eb8100 of size 294656 next 18446744073709551615 2025-05-07 18:36:41.361798: I tensorflow/core/common_runtime/bfc_allocator.cc:995] Summary of in-use Chunks by size: 2025-05-07 18:36:41.361812: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 78 Chunks of size 256 totalling 19.5KiB 2025-05-07 18:36:41.361822: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 40 Chunks of size 512 totalling 20.0KiB 2025-05-07 18:36:41.361831: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 258 Chunks of size 1024 totalling 258.0KiB 2025-05-07 18:36:41.361839: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 1280 totalling 1.2KiB 2025-05-07 18:36:41.361848: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 56 Chunks of size 2048 totalling 112.0KiB 2025-05-07 18:36:41.361857: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 117 Chunks of size 4096 totalling 468.0KiB 2025-05-07 18:36:41.361866: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 2 Chunks of size 6144 totalling 12.0KiB 2025-05-07 18:36:41.361874: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 7680 totalling 7.5KiB 2025-05-07 18:36:41.361883: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 20 Chunks of size 8192 totalling 160.0KiB 2025-05-07 18:36:41.361892: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 12288 totalling 12.0KiB 2025-05-07 18:36:41.361901: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 16384 totalling 16.0KiB 2025-05-07 18:36:41.361909: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 24576 totalling 24.0KiB 2025-05-07 18:36:41.361918: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 37632 totalling 36.8KiB 2025-05-07 18:36:41.361927: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 6 Chunks of size 65536 totalling 384.0KiB 2025-05-07 18:36:41.361935: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 131072 totalling 128.0KiB 2025-05-07 18:36:41.361944: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 3 Chunks of size 147456 totalling 432.0KiB 2025-05-07 18:36:41.361952: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 5 Chunks of size 262144 totalling 1.25MiB 2025-05-07 18:36:41.361961: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 294656 totalling 287.8KiB 2025-05-07 18:36:41.361977: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 2 Chunks of size 327680 totalling 640.0KiB 2025-05-07 18:36:41.361986: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 3 Chunks of size 524288 totalling 1.50MiB 2025-05-07 18:36:41.361995: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 3 Chunks of size 589824 totalling 1.69MiB 2025-05-07 18:36:41.362003: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 786432 totalling 768.0KiB 2025-05-07 18:36:41.362012: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 25 Chunks of size 1048576 totalling 25.00MiB 2025-05-07 18:36:41.362021: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 19 Chunks of size 1310720 totalling 23.75MiB 2025-05-07 18:36:41.362029: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 1441792 totalling 1.38MiB 2025-05-07 18:36:41.362038: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 1835008 totalling 1.75MiB 2025-05-07 18:36:41.362046: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 2 Chunks of size 2097152 totalling 4.00MiB 2025-05-07 18:36:41.362055: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 26 Chunks of size 2359296 totalling 58.50MiB 2025-05-07 18:36:41.362064: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 3932160 totalling 3.75MiB 2025-05-07 18:36:41.362072: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 5 Chunks of size 4194304 totalling 20.00MiB 2025-05-07 18:36:41.362081: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 4718592 totalling 4.50MiB 2025-05-07 18:36:41.362089: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 6291456 totalling 6.00MiB 2025-05-07 18:36:41.362098: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 8388608 totalling 8.00MiB 2025-05-07 18:36:41.362106: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 3 Chunks of size 9437184 totalling 27.00MiB 2025-05-07 18:36:41.362115: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 86900736 totalling 82.88MiB 2025-05-07 18:36:41.362124: I tensorflow/core/common_runtime/bfc_allocator.cc:1002] Sum Total of in-use chunks: 274.63MiB 2025-05-07 18:36:41.362132: I tensorflow/core/common_runtime/bfc_allocator.cc:1004] total_region_allocated_bytes_: 354287616 memory_limit_: 354287616 available bytes: 0 curr_region_allocation_bytes_: 536870912 2025-05-07 18:36:41.362144: I tensorflow/core/common_runtime/bfc_allocator.cc:1010] Stats: Limit: 354287616 InUse: 287976192 MaxInUse: 287976192 NumAllocs: 2326 MaxAllocSize: 86900736 2025-05-07 18:36:41.362169: W tensorflow/core/common_runtime/bfc_allocator.cc:439] ***************xxxxxxxxxx****************_******_**___________************************************** 2025-05-07 18:36:41.362211: W tensorflow/core/framework/op_kernel.cc:1753] OP_REQUIRES failed at cwise_ops_common.h:134 : Resource exhausted: OOM when allocating tensor with shape[7,7,256,1024] and type float on /job:localhost/replica:0/task:0/device:GPU:0 by allocator GPU_0_bfc RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 Exception in mask_detect : OOM when allocating tensor with shape[7,7,256,1024] and type float on /job:localhost/replica:0/task:0/device:GPU:0 by allocator GPU_0_bfc [Op:Mul] we want to redo the detection max_time_sub_proc : 3600 erreur pendant la detection Useless call to update_current_state in case -12 caffe_path_current : About to save ! 1 Inside saveOutput : final : True verbose : False eke 12-6-18 : saveMask need to be cleaned for new output ! ERROR : mask output needs to be a dictionnary now ! No output to save, continue without doing anything ! save missing photos in datou_result : After save, about to update current ! datou_cur_ids : [] len(datou.list_steps) : 1 output : -12 ERROR : 'int' object is not subscriptable reconnect to base ! warning , we can't find thcl infos in json_data warning , we can't find pdt infos in json_data #&_# TEST FAILED #&_# : tests/mask_test #&_# Error : invalid literal for int() with base 10: "'int' object is not subscriptable" /home/admin/workarea/git/Velours/python/tests/python_tests.py refs/heads/master_6b796098f0a7c88b7d6a90fb4c0df56eec821fbf SQL :INSERT INTO MTRAdmin.monitor_sys (name, type, server, version_code, result_str, result_bool, lien , test_group ,test_name) VALUES ('python_test3','1','marlene','refs/heads/master_6b796098f0a7c88b7d6a90fb4c0df56eec821fbf','{"mask_detection": "fail"}','0','http://marlene.fotonower-preprod.com/job/2025/May/07052025/python_test3//data_2/data_log/job/2025/May/07052025/python_test3/log-python3----short_python3--v--marlene-18:35:01.txt','mask_detection','unknown'); #&_# END OF TEST #&_# : tests/mask_test #&_# #&_# BEGIN OF TEST : tests/datou_test #&_# /home/admin/workarea/git/Velours/python/tests/datou_test.py Datou All Test python version used : 3 ############################### TEST sam ################################ TEST SAM Inside batchDatouExec : verbose : True ##### chargement datou SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4573 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4573 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4573 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4573 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! no param json to modify List Step Type Loaded in datou : sam list_input_json : [] ##### fin chargement datou ##### chargement data ##### Call load_data_input : nb_thread : 5 origin SELECT photo_id, url FROM MTRBack.photos ph WHERE photo_id IN (1189321094) Found this number of photos: 1 ##### Call download_photos : nb_thread : 5 begin to download photo : 1189321094 download finish for photo 1189321094 we have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB ##### After download_photos length of list_filenames : 1 ; length of list_pids : 1 ; length of list_args : 1 ##### After load_data_input time to download the photos : 0.1345360279083252 #### fin chargement data Blocking on flush ? No conitnuing About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! WARNING : we have an input that is not a photo, we should get rid of it Calling datou_exec Inside datou_exec : verbose : True number of steps : 1 step1:sam Wed May 7 18:36:41 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec After prepare type args : Here we display some param of map_info ! map_filenames : {'temp/1746635801_1916220_1189321094_9626af7f95d010f2a4fd524688d4ea22_76896585.png': 1189321094} map_photo_id_path_extension : {1189321094: {'path': 'temp/1746635801_1916220_1189321094_9626af7f95d010f2a4fd524688d4ea22_76896585.png', 'extension': 'png'}} map_subphoto_mainphoto : {} Beginning of datou step sam ! pht : 4677 Inside sam : nb paths : 1 ERROR in datou_step_exec, will save and exit ! CUDA error: out of memory CUDA kernel errors might be asynchronously reported at some other API call,so the stacktrace below might be incorrect. For debugging consider passing CUDA_LAUNCH_BLOCKING=1. File "/home/admin/workarea/git/Velours/python/mtr/datou/datou_lib.py", line 2329, in datou_exec output = datou_step_exec(sNext, args, cache, context, map_info, verbose, mtr_user_id) File "/home/admin/workarea/git/Velours/python/mtr/datou/datou_lib.py", line 2430, in datou_step_exec return lib_process.datou_step_sam(param, json_param, args, cache, context, map_info, verbose) File "/home/admin/workarea/git/Velours/python/mtr/datou/lib_step_exec/lib_step_process.py", line 367, in datou_step_sam sam.to(device=device) File "/home/admin/.local/lib/python3.8/site-packages/torch/nn/modules/module.py", line 927, in to return self._apply(convert) File "/home/admin/.local/lib/python3.8/site-packages/torch/nn/modules/module.py", line 579, in _apply module._apply(fn) File "/home/admin/.local/lib/python3.8/site-packages/torch/nn/modules/module.py", line 579, in _apply module._apply(fn) File "/home/admin/.local/lib/python3.8/site-packages/torch/nn/modules/module.py", line 579, in _apply module._apply(fn) File "/home/admin/.local/lib/python3.8/site-packages/torch/nn/modules/module.py", line 602, in _apply param_applied = fn(param) File "/home/admin/.local/lib/python3.8/site-packages/torch/nn/modules/module.py", line 925, in convert return t.to(device, dtype if t.is_floating_point() or t.is_complex() else None, non_blocking) [1189321094] map_info['map_portfolio_photo'] : {} final : True mtd_id 4573 list_pids : [1189321094] begin to insert list_values into mtr_datou_result : length of list_values in save_final : 1 insert ignore into MTRPhoto.mtr_datou_result (mtd_id, mtr_portfolio_id,mtr_photo_id,result,result_long,result_double,hashtag_id,proba, mtr_current_id) values (%s,%s,%s,%s,%s,%s,%s,%s,%s) on duplicate key update mtr_portfolio_id = mtr_portfolio_id list_values : [('4573', None, '1189321094', "[>, , , , , 'CUDA error: out of memory\\nCUDA kernel errors might be asynchronously reported at some other API call,so the stacktrace below might be incorrect.\\nFor debugging consider passing CUDA_LAUNCH_BLOCKING=1.']", '-1', '-1.0', '501120777', '1.0', None)] time used for this insertion : 0.01732039451599121 save_final ERROR in last step sam, CUDA error: out of memory CUDA kernel errors might be asynchronously reported at some other API call,so the stacktrace below might be incorrect. For debugging consider passing CUDA_LAUNCH_BLOCKING=1. time spend for datou_step_exec : 5.33948278427124 time spend to save output : 0.018599271774291992 total time spend for step 0 : 5.358082056045532 need to delete datou_research and reload, so keep current state 1 need to delete datou_research and reload, so keep current state 1 caffe_path_current : About to save ! 2 After save, about to update current ! datou_cur_ids : [] len(datou.list_steps) : 1 output : None ERROR nb objects espect : 98 nb_objects detect : 0 ERROR sam FAILED ############################### TEST frcnn ################################ test frcnn Inside batchDatouExec : verbose : True ##### chargement datou SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4184 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4184 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4184 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4184 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! no param json to modify List Step Type Loaded in datou : frcnn list_input_json : [] ##### fin chargement datou ##### chargement data ##### Call load_data_input : nb_thread : 5 origin SELECT photo_id, url FROM MTRBack.photos ph WHERE photo_id IN (917754606) Found this number of photos: 1 ##### Call download_photos : nb_thread : 5 begin to download photo : 917754606 download finish for photo 917754606 we have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB ##### After download_photos length of list_filenames : 1 ; length of list_pids : 1 ; length of list_args : 1 ##### After load_data_input time to download the photos : 0.22530698776245117 #### fin chargement data Blocking on flush ? No conitnuing About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : True number of steps : 1 step1:frcnn Wed May 7 18:36:47 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec After prepare type args : Here we display some param of map_info ! map_filenames : {'temp/1746635807_1916220_917754606_35f3c9ae49686a6be16030c6ec25c9ee.jpg': 917754606} map_photo_id_path_extension : {917754606: {'path': 'temp/1746635807_1916220_917754606_35f3c9ae49686a6be16030c6ec25c9ee.jpg', 'extension': 'jpg'}} map_subphoto_mainphoto : {} Beginning of datou step Faster rcnn ! classes : ['background', 'plaque'] pht : 4370 caffemodel_name (should be vgg16_immat_307 but not used because net loaded outside in the fonction) : {'id': 3375, 'mtr_user_id': 31, 'name': 'detection_plaque_valcor_010622', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,plaque', 'svm_portfolios_learning': '0,0', 'photo_hashtag_type': 4370, 'photo_desc_type': 5676, 'type_classification': 'caffe_faster_rcnn', 'hashtag_id_list': '0,0'} To loadFromThcl() model_param file didn't exist model_name : detection_plaque_valcor_010622 model_type : caffe_faster_rcnn list file need : ['caffemodel', 'test.prototxt'] file exist in s3 : ['caffemodel', 'test.prototxt'] file manque in s3 : [] WARNING: Logging before InitGoogleLogging() is written to STDERR E0507 18:36:48.879215 1916220 common.cpp:114] Cannot create Cublas handle. Cublas won't be available. E0507 18:36:48.883409 1916220 common.cpp:121] Cannot create Curand generator. Curand won't be available. F0507 18:36:48.891954 1916220 syncedmem.hpp:22] Check failed: error == cudaSuccess (2 vs. 0) out of memory *** Check failure stack trace: *** Command terminated by signal 6 8.89user 7.78system 1:24.10elapsed 19%CPU (0avgtext+0avgdata 2173172maxresident)k 1718856inputs+3536outputs (4909major+795439minor)pagefaults 0swaps