python /home/admin/mtr/script_for_cron.py -j python_test3 -m 12 -a ' --short_python3 -v ' -s python_test3 -M 0 -S 0 -U 100,100,120 import MySQLdb succeeded Import error (python version) python version = 3 warning , we can't find thcl infos in json_data warning , we can't find pdt infos in json_data list_job_run_as_list : ['mask_detection', 'datou', 'CacheModelData_queries', 'CachePhotoData_queries', 'test_fork', 'prepare_maskdata', 'portfolio_queries', 'sla_mensuel'] python version used : 3 liste_fichiers : [('tests/mask_test', True, 'Test mask-detection ', 'mask_detection'), ('tests/datou_test', True, 'Datou All Test', 'datou', 'all'), ('mtr/database_queries/CacheModelData_queries', True, 'Test Cache Model Data', 'CacheModelData_queries'), ('tests/cache_photo_data_test', True, 'Test local_cache_photo ', 'CachePhotoData_queries'), ('mtr/mask_rcnn/prepare_maskdata', True, 'test prepare mask data', 'prepare_maskdata', 'all'), ('mtr/database_queries/portfolio_queries', True, 'test portfolio queries', 'portfolio_queries'), ('prod/memo/memo', True, 'SLA Mensuel', 'sla_mensuel', 'all')] #&_# BEGIN OF TEST : tests/mask_test #&_# /home/admin/workarea/git/Velours/python/tests/mask_test.py Test mask-detection python version used : 3 ############################### TEST memory used ################################ free memory at begining : begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 544 run mask_detect Inside batchDatouExec : verbose : False # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : mask_detect list_input_json : [] origin BFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 1 ; length of list_pids : 1 ; length of list_args : 1 time to download the photos : 0.6811919212341309 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : False number of steps : 1 step1:mask_detect Sat Mar 1 00:35:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory havn't enough memory gpu , need / 3000 l 3632 free memory gpu now : 544 wait 20 seconds l 3637 free memory gpu now : 544 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 /home/admin/workarea/git/Velours/python/tests/python_tests.py:11: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses import imp 2025-03-01 00:35:53.778520: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-03-01 00:35:53.803052: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-03-01 00:35:53.805086: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f0f10000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-03-01 00:35:53.805150: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-03-01 00:35:53.808902: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-03-01 00:35:54.066952: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x44e32b0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-03-01 00:35:54.067005: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-03-01 00:35:54.067907: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-03-01 00:35:54.068325: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-01 00:35:54.071326: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-01 00:35:54.073951: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-03-01 00:35:54.074439: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-03-01 00:35:54.077147: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-03-01 00:35:54.078204: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-03-01 00:35:54.082189: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-03-01 00:35:54.082990: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-03-01 00:35:54.083050: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-01 00:35:54.083522: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-03-01 00:35:54.083537: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-03-01 00:35:54.083545: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-03-01 00:35:54.084311: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 167 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl454 thcls : [{'id': 454, 'mtr_user_id': 31, 'name': 'mask_coco_origin', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'backgroud,person,bicycle,car,motorcycle,airplane,bus,train,truck,boat,trafficlight,firehydrant,stopsign,parkingmeter,bench,bird,cat,dog,horse,sheep,cow,elephant,bear,zebra,giraffe,backpack,umbrella,handbag,tie,suitcase,frisbee,skis,snowboard,sportsball,kite,baseballbat,baseballglove,skateboard,surfboard,tennisracket,bottle,wineglass,cup,fork,knife,spoon,bowl,banana,apple,sandwich,orange,broccoli,carrot,hotdog,pizza,donut,cake,chair,couch,pottedplant,bed,diningtable,toilet,tv,laptop,mouse,remote,keyboard,cellphone,microwave,oven,toaster,sink,refrigerator,book,clock,vase,scissors,teddybear,hairdrier,toothbrush', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 445, 'photo_desc_type': 3473, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0'}] thcl {'id': 454, 'mtr_user_id': 31, 'name': 'mask_coco_origin', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'backgroud,person,bicycle,car,motorcycle,airplane,bus,train,truck,boat,trafficlight,firehydrant,stopsign,parkingmeter,bench,bird,cat,dog,horse,sheep,cow,elephant,bear,zebra,giraffe,backpack,umbrella,handbag,tie,suitcase,frisbee,skis,snowboard,sportsball,kite,baseballbat,baseballglove,skateboard,surfboard,tennisracket,bottle,wineglass,cup,fork,knife,spoon,bowl,banana,apple,sandwich,orange,broccoli,carrot,hotdog,pizza,donut,cake,chair,couch,pottedplant,bed,diningtable,toilet,tv,laptop,mouse,remote,keyboard,cellphone,microwave,oven,toaster,sink,refrigerator,book,clock,vase,scissors,teddybear,hairdrier,toothbrush', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 445, 'photo_desc_type': 3473, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 3473 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (3473, 'mask_coco_origin', 16384, 25088, 'mask_coco_origin', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2018, 3, 19, 10, 42, 21), datetime.datetime(2018, 3, 19, 10, 42, 21)) {'thcl': {'id': 454, 'mtr_user_id': 31, 'name': 'mask_coco_origin', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'backgroud,person,bicycle,car,motorcycle,airplane,bus,train,truck,boat,trafficlight,firehydrant,stopsign,parkingmeter,bench,bird,cat,dog,horse,sheep,cow,elephant,bear,zebra,giraffe,backpack,umbrella,handbag,tie,suitcase,frisbee,skis,snowboard,sportsball,kite,baseballbat,baseballglove,skateboard,surfboard,tennisracket,bottle,wineglass,cup,fork,knife,spoon,bowl,banana,apple,sandwich,orange,broccoli,carrot,hotdog,pizza,donut,cake,chair,couch,pottedplant,bed,diningtable,toilet,tv,laptop,mouse,remote,keyboard,cellphone,microwave,oven,toaster,sink,refrigerator,book,clock,vase,scissors,teddybear,hairdrier,toothbrush', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 445, 'photo_desc_type': 3473, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['backgroud', 'person', 'bicycle', 'car', 'motorcycle', 'airplane', 'bus', 'train', 'truck', 'boat', 'trafficlight', 'firehydrant', 'stopsign', 'parkingmeter', 'bench', 'bird', 'cat', 'dog', 'horse', 'sheep', 'cow', 'elephant', 'bear', 'zebra', 'giraffe', 'backpack', 'umbrella', 'handbag', 'tie', 'suitcase', 'frisbee', 'skis', 'snowboard', 'sportsball', 'kite', 'baseballbat', 'baseballglove', 'skateboard', 'surfboard', 'tennisracket', 'bottle', 'wineglass', 'cup', 'fork', 'knife', 'spoon', 'bowl', 'banana', 'apple', 'sandwich', 'orange', 'broccoli', 'carrot', 'hotdog', 'pizza', 'donut', 'cake', 'chair', 'couch', 'pottedplant', 'bed', 'diningtable', 'toilet', 'tv', 'laptop', 'mouse', 'remote', 'keyboard', 'cellphone', 'microwave', 'oven', 'toaster', 'sink', 'refrigerator', 'book', 'clock', 'vase', 'scissors', 'teddybear', 'hairdrier', 'toothbrush'], 'list_hashtags_csv': 'backgroud,person,bicycle,car,motorcycle,airplane,bus,train,truck,boat,trafficlight,firehydrant,stopsign,parkingmeter,bench,bird,cat,dog,horse,sheep,cow,elephant,bear,zebra,giraffe,backpack,umbrella,handbag,tie,suitcase,frisbee,skis,snowboard,sportsball,kite,baseballbat,baseballglove,skateboard,surfboard,tennisracket,bottle,wineglass,cup,fork,knife,spoon,bowl,banana,apple,sandwich,orange,broccoli,carrot,hotdog,pizza,donut,cake,chair,couch,pottedplant,bed,diningtable,toilet,tv,laptop,mouse,remote,keyboard,cellphone,microwave,oven,toaster,sink,refrigerator,book,clock,vase,scissors,teddybear,hairdrier,toothbrush', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 445, 'svm_hashtag_type_desc': 3473, 'photo_desc_type': 3473, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['backgroud', 'person', 'bicycle', 'car', 'motorcycle', 'airplane', 'bus', 'train', 'truck', 'boat', 'trafficlight', 'firehydrant', 'stopsign', 'parkingmeter', 'bench', 'bird', 'cat', 'dog', 'horse', 'sheep', 'cow', 'elephant', 'bear', 'zebra', 'giraffe', 'backpack', 'umbrella', 'handbag', 'tie', 'suitcase', 'frisbee', 'skis', 'snowboard', 'sportsball', 'kite', 'baseballbat', 'baseballglove', 'skateboard', 'surfboard', 'tennisracket', 'bottle', 'wineglass', 'cup', 'fork', 'knife', 'spoon', 'bowl', 'banana', 'apple', 'sandwich', 'orange', 'broccoli', 'carrot', 'hotdog', 'pizza', 'donut', 'cake', 'chair', 'couch', 'pottedplant', 'bed', 'diningtable', 'toilet', 'tv', 'laptop', 'mouse', 'remote', 'keyboard', 'cellphone', 'microwave', 'oven', 'toaster', 'sink', 'refrigerator', 'book', 'clock', 'vase', 'scissors', 'teddybear', 'hairdrier', 'toothbrush'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME mask_coco_origin NUM_CLASSES 81 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 2025-03-01 00:35:54.897902: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-03-01 00:35:54.897996: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-01 00:35:54.898024: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-01 00:35:54.898049: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-03-01 00:35:54.898073: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-03-01 00:35:54.898097: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-03-01 00:35:54.898137: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-03-01 00:35:54.898162: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-03-01 00:35:54.899272: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-03-01 00:35:54.900202: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-03-01 00:35:54.900235: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-01 00:35:54.900250: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-01 00:35:54.900264: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-03-01 00:35:54.900278: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-03-01 00:35:54.900292: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-03-01 00:35:54.900307: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-03-01 00:35:54.900320: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-03-01 00:35:54.900981: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-03-01 00:35:54.901007: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-03-01 00:35:54.901014: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-03-01 00:35:54.901022: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-03-01 00:35:54.901698: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 167 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) 2025-03-01 00:36:06.512657: W tensorflow/core/common_runtime/bfc_allocator.cc:434] Allocator (GPU_0_bfc) ran out of memory trying to allocate 9.00MiB (rounded to 9437184) Current allocation summary follows. 2025-03-01 00:36:06.512731: I tensorflow/core/common_runtime/bfc_allocator.cc:934] BFCAllocator dump for GPU_0_bfc 2025-03-01 00:36:06.512750: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (256): Total Chunks: 65, Chunks in use: 65. 16.2KiB allocated for chunks. 16.2KiB in use in bin. 8.9KiB client-requested in use in bin. 2025-03-01 00:36:06.512766: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (512): Total Chunks: 40, Chunks in use: 40. 20.0KiB allocated for chunks. 20.0KiB in use in bin. 20.0KiB client-requested in use in bin. 2025-03-01 00:36:06.512782: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (1024): Total Chunks: 251, Chunks in use: 251. 251.2KiB allocated for chunks. 251.2KiB in use in bin. 251.0KiB client-requested in use in bin. 2025-03-01 00:36:06.512800: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (2048): Total Chunks: 40, Chunks in use: 40. 80.0KiB allocated for chunks. 80.0KiB in use in bin. 80.0KiB client-requested in use in bin. 2025-03-01 00:36:06.512815: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (4096): Total Chunks: 120, Chunks in use: 120. 487.5KiB allocated for chunks. 487.5KiB in use in bin. 480.0KiB client-requested in use in bin. 2025-03-01 00:36:06.512830: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (8192): Total Chunks: 10, Chunks in use: 10. 80.0KiB allocated for chunks. 80.0KiB in use in bin. 80.0KiB client-requested in use in bin. 2025-03-01 00:36:06.512861: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (16384): Total Chunks: 1, Chunks in use: 1. 16.0KiB allocated for chunks. 16.0KiB in use in bin. 16.0KiB client-requested in use in bin. 2025-03-01 00:36:06.512876: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (32768): Total Chunks: 1, Chunks in use: 1. 36.8KiB allocated for chunks. 36.8KiB in use in bin. 36.8KiB client-requested in use in bin. 2025-03-01 00:36:06.512891: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (65536): Total Chunks: 6, Chunks in use: 6. 384.0KiB allocated for chunks. 384.0KiB in use in bin. 384.0KiB client-requested in use in bin. 2025-03-01 00:36:06.512911: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (131072): Total Chunks: 4, Chunks in use: 4. 560.0KiB allocated for chunks. 560.0KiB in use in bin. 560.0KiB client-requested in use in bin. 2025-03-01 00:36:06.512932: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (262144): Total Chunks: 8, Chunks in use: 7. 2.35MiB allocated for chunks. 1.91MiB in use in bin. 1.75MiB client-requested in use in bin. 2025-03-01 00:36:06.512947: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (524288): Total Chunks: 7, Chunks in use: 6. 4.39MiB allocated for chunks. 3.44MiB in use in bin. 3.25MiB client-requested in use in bin. 2025-03-01 00:36:06.512962: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (1048576): Total Chunks: 48, Chunks in use: 45. 54.12MiB allocated for chunks. 50.62MiB in use in bin. 45.00MiB client-requested in use in bin. 2025-03-01 00:36:06.512977: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (2097152): Total Chunks: 28, Chunks in use: 25. 64.25MiB allocated for chunks. 55.75MiB in use in bin. 55.75MiB client-requested in use in bin. 2025-03-01 00:36:06.512992: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (4194304): Total Chunks: 3, Chunks in use: 2. 13.88MiB allocated for chunks. 9.88MiB in use in bin. 8.00MiB client-requested in use in bin. 2025-03-01 00:36:06.513007: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (8388608): Total Chunks: 3, Chunks in use: 2. 27.00MiB allocated for chunks. 19.00MiB in use in bin. 17.00MiB client-requested in use in bin. 2025-03-01 00:36:06.513020: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (16777216): Total Chunks: 0, Chunks in use: 0. 0B allocated for chunks. 0B in use in bin. 0B client-requested in use in bin. 2025-03-01 00:36:06.513033: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (33554432): Total Chunks: 0, Chunks in use: 0. 0B allocated for chunks. 0B in use in bin. 0B client-requested in use in bin. 2025-03-01 00:36:06.513047: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (67108864): Total Chunks: 0, Chunks in use: 0. 0B allocated for chunks. 0B in use in bin. 0B client-requested in use in bin. 2025-03-01 00:36:06.513059: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (134217728): Total Chunks: 0, Chunks in use: 0. 0B allocated for chunks. 0B in use in bin. 0B client-requested in use in bin. 2025-03-01 00:36:06.513072: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (268435456): Total Chunks: 0, Chunks in use: 0. 0B allocated for chunks. 0B in use in bin. 0B client-requested in use in bin. 2025-03-01 00:36:06.513087: I tensorflow/core/common_runtime/bfc_allocator.cc:957] Bin for 9.00MiB was 8.00MiB, Chunk State: 2025-03-01 00:36:06.513113: I tensorflow/core/common_runtime/bfc_allocator.cc:963] Size: 8.00MiB | Requested Size: 4.00MiB | in_use: 0 | bin_num: 15, next: Size: 10.00MiB | Requested Size: 8.00MiB | in_use: 1 | bin_num: -1 2025-03-01 00:36:06.513127: I tensorflow/core/common_runtime/bfc_allocator.cc:970] Next region of size 42860544 2025-03-01 00:36:06.513141: I tensorflow/core/common_runtime/bfc_allocator.cc:990] Free at 7f0d28000000 of size 8388608 next 624 2025-03-01 00:36:06.513154: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d28800000 of size 10485760 next 608 2025-03-01 00:36:06.513176: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d29200000 of size 9437184 next 607 2025-03-01 00:36:06.513189: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d29b00000 of size 4194304 next 630 2025-03-01 00:36:06.513200: I tensorflow/core/common_runtime/bfc_allocator.cc:990] Free at 7f0d29f00000 of size 4194304 next 617 2025-03-01 00:36:06.513212: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d2a300000 of size 6160384 next 18446744073709551615 2025-03-01 00:36:06.513223: I tensorflow/core/common_runtime/bfc_allocator.cc:970] Next region of size 67108864 2025-03-01 00:36:06.513235: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d2c000000 of size 2359296 next 370 2025-03-01 00:36:06.513247: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d2c240000 of size 1048576 next 394 2025-03-01 00:36:06.513259: I tensorflow/core/common_runtime/bfc_allocator.cc:990] Free at 7f0d2c340000 of size 1310720 next 388 2025-03-01 00:36:06.513270: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d2c480000 of size 2359296 next 387 2025-03-01 00:36:06.513284: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d2c6c0000 of size 1048576 next 412 2025-03-01 00:36:06.513296: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d2c7c0000 of size 1310720 next 406 2025-03-01 00:36:06.513308: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d2c900000 of size 2359296 next 405 2025-03-01 00:36:06.513319: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d2cb40000 of size 1048576 next 430 2025-03-01 00:36:06.513331: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d2cc40000 of size 1310720 next 424 2025-03-01 00:36:06.513342: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d2cd80000 of size 2359296 next 423 2025-03-01 00:36:06.513354: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d2cfc0000 of size 1048576 next 447 2025-03-01 00:36:06.513365: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d2d0c0000 of size 1310720 next 441 2025-03-01 00:36:06.513377: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d2d200000 of size 2359296 next 440 2025-03-01 00:36:06.513388: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d2d440000 of size 1048576 next 465 2025-03-01 00:36:06.513400: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d2d540000 of size 1310720 next 459 2025-03-01 00:36:06.513411: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d2d680000 of size 2359296 next 458 2025-03-01 00:36:06.513422: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d2d8c0000 of size 1048576 next 483 2025-03-01 00:36:06.513434: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d2d9c0000 of size 1310720 next 477 2025-03-01 00:36:06.513445: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d2db00000 of size 2359296 next 476 2025-03-01 00:36:06.513457: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d2dd40000 of size 1048576 next 501 2025-03-01 00:36:06.513468: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d2de40000 of size 1310720 next 495 2025-03-01 00:36:06.513480: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d2df80000 of size 2359296 next 494 2025-03-01 00:36:06.513491: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d2e1c0000 of size 1048576 next 519 2025-03-01 00:36:06.513503: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d2e2c0000 of size 1310720 next 513 2025-03-01 00:36:06.513514: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d2e400000 of size 2359296 next 512 2025-03-01 00:36:06.513526: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d2e640000 of size 1048576 next 537 2025-03-01 00:36:06.513546: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d2e740000 of size 1310720 next 531 2025-03-01 00:36:06.513557: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d2e880000 of size 2359296 next 530 2025-03-01 00:36:06.513569: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d2eac0000 of size 1048576 next 555 2025-03-01 00:36:06.513580: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d2ebc0000 of size 1310720 next 549 2025-03-01 00:36:06.513592: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d2ed00000 of size 2359296 next 548 2025-03-01 00:36:06.513603: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d2ef40000 of size 1048576 next 573 2025-03-01 00:36:06.513615: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d2f040000 of size 1310720 next 567 2025-03-01 00:36:06.513626: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d2f180000 of size 2359296 next 566 2025-03-01 00:36:06.513638: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d2f3c0000 of size 1048576 next 591 2025-03-01 00:36:06.513649: I tensorflow/core/common_runtime/bfc_allocator.cc:990] Free at 7f0d2f4c0000 of size 1310720 next 585 2025-03-01 00:36:06.513661: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d2f600000 of size 2359296 next 584 2025-03-01 00:36:06.513672: I tensorflow/core/common_runtime/bfc_allocator.cc:990] Free at 7f0d2f840000 of size 2097152 next 597 2025-03-01 00:36:06.513684: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d2fa40000 of size 2097152 next 596 2025-03-01 00:36:06.513696: I tensorflow/core/common_runtime/bfc_allocator.cc:990] Free at 7f0d2fc40000 of size 3932160 next 18446744073709551615 2025-03-01 00:36:06.513708: I tensorflow/core/common_runtime/bfc_allocator.cc:970] Next region of size 33554432 2025-03-01 00:36:06.513719: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d30000000 of size 2359296 next 245 2025-03-01 00:36:06.513731: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d30240000 of size 1048576 next 269 2025-03-01 00:36:06.513742: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d30340000 of size 1310720 next 263 2025-03-01 00:36:06.513754: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d30480000 of size 2359296 next 262 2025-03-01 00:36:06.513765: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d306c0000 of size 1048576 next 287 2025-03-01 00:36:06.513777: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d307c0000 of size 1310720 next 281 2025-03-01 00:36:06.513788: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d30900000 of size 2359296 next 280 2025-03-01 00:36:06.513800: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d30b40000 of size 1048576 next 304 2025-03-01 00:36:06.513811: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d30c40000 of size 1310720 next 298 2025-03-01 00:36:06.513823: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d30d80000 of size 2359296 next 297 2025-03-01 00:36:06.513834: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d30fc0000 of size 1048576 next 322 2025-03-01 00:36:06.513846: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d310c0000 of size 1310720 next 316 2025-03-01 00:36:06.513857: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d31200000 of size 2359296 next 315 2025-03-01 00:36:06.513868: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d31440000 of size 1048576 next 340 2025-03-01 00:36:06.513880: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d31540000 of size 1310720 next 334 2025-03-01 00:36:06.513894: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d31680000 of size 2359296 next 333 2025-03-01 00:36:06.513908: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d318c0000 of size 1048576 next 358 2025-03-01 00:36:06.513929: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d319c0000 of size 1310720 next 352 2025-03-01 00:36:06.513944: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d31b00000 of size 2359296 next 351 2025-03-01 00:36:06.513959: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d31d40000 of size 1048576 next 376 2025-03-01 00:36:06.513971: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d31e40000 of size 1835008 next 18446744073709551615 2025-03-01 00:36:06.513984: I tensorflow/core/common_runtime/bfc_allocator.cc:970] Next region of size 16777216 2025-03-01 00:36:06.513997: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d32000000 of size 2359296 next 181 2025-03-01 00:36:06.514008: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d32240000 of size 2097152 next 196 2025-03-01 00:36:06.514020: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d32440000 of size 1048576 next 216 2025-03-01 00:36:06.514031: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d32540000 of size 1310720 next 209 2025-03-01 00:36:06.514042: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d32680000 of size 2359296 next 208 2025-03-01 00:36:06.514054: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d328c0000 of size 1048576 next 234 2025-03-01 00:36:06.514065: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d329c0000 of size 1310720 next 228 2025-03-01 00:36:06.514077: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d32b00000 of size 2359296 next 227 2025-03-01 00:36:06.514088: I tensorflow/core/common_runtime/bfc_allocator.cc:990] Free at 7f0d32d40000 of size 2883584 next 18446744073709551615 2025-03-01 00:36:06.514099: I tensorflow/core/common_runtime/bfc_allocator.cc:970] Next region of size 2097152 2025-03-01 00:36:06.514111: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34600000 of size 147456 next 55 2025-03-01 00:36:06.514123: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34624000 of size 65536 next 78 2025-03-01 00:36:06.514134: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34634000 of size 4096 next 191 2025-03-01 00:36:06.514146: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34635000 of size 4096 next 192 2025-03-01 00:36:06.514158: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34636000 of size 4096 next 193 2025-03-01 00:36:06.514169: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34637000 of size 256 next 194 2025-03-01 00:36:06.514181: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34637100 of size 256 next 195 2025-03-01 00:36:06.514192: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34637200 of size 4096 next 197 2025-03-01 00:36:06.514204: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34638200 of size 4096 next 198 2025-03-01 00:36:06.514215: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34639200 of size 4096 next 199 2025-03-01 00:36:06.514226: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d3463a200 of size 4096 next 200 2025-03-01 00:36:06.514238: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d3463b200 of size 4096 next 201 2025-03-01 00:36:06.514250: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d3463c200 of size 1024 next 202 2025-03-01 00:36:06.514261: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d3463c600 of size 1024 next 204 2025-03-01 00:36:06.514273: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d3463ca00 of size 1024 next 205 2025-03-01 00:36:06.514284: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d3463ce00 of size 1024 next 206 2025-03-01 00:36:06.514295: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d3463d200 of size 1024 next 207 2025-03-01 00:36:06.514316: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d3463d600 of size 1024 next 210 2025-03-01 00:36:06.514328: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d3463da00 of size 1024 next 211 2025-03-01 00:36:06.514339: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d3463de00 of size 1024 next 212 2025-03-01 00:36:06.514350: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d3463e200 of size 1024 next 213 2025-03-01 00:36:06.514362: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d3463e600 of size 1024 next 214 2025-03-01 00:36:06.514373: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d3463ea00 of size 4096 next 215 2025-03-01 00:36:06.514385: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d3463fa00 of size 4096 next 217 2025-03-01 00:36:06.514396: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34640a00 of size 4096 next 218 2025-03-01 00:36:06.514407: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34641a00 of size 4096 next 219 2025-03-01 00:36:06.514419: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34642a00 of size 4096 next 220 2025-03-01 00:36:06.514430: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34643a00 of size 1024 next 221 2025-03-01 00:36:06.514441: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34643e00 of size 1024 next 223 2025-03-01 00:36:06.514453: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34644200 of size 1024 next 224 2025-03-01 00:36:06.514464: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34644600 of size 1024 next 225 2025-03-01 00:36:06.514476: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34644a00 of size 1024 next 226 2025-03-01 00:36:06.514487: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34644e00 of size 1024 next 229 2025-03-01 00:36:06.514498: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34645200 of size 1024 next 230 2025-03-01 00:36:06.514509: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34645600 of size 1024 next 231 2025-03-01 00:36:06.514521: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34645a00 of size 1024 next 232 2025-03-01 00:36:06.514532: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34645e00 of size 1024 next 233 2025-03-01 00:36:06.514544: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34646200 of size 7680 next 72 2025-03-01 00:36:06.514555: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34648000 of size 147456 next 71 2025-03-01 00:36:06.514567: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d3466c000 of size 131072 next 87 2025-03-01 00:36:06.514579: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d3468c000 of size 4096 next 289 2025-03-01 00:36:06.514590: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d3468d000 of size 4096 next 290 2025-03-01 00:36:06.514601: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d3468e000 of size 4096 next 291 2025-03-01 00:36:06.514613: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d3468f000 of size 1024 next 292 2025-03-01 00:36:06.514624: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d3468f400 of size 1024 next 293 2025-03-01 00:36:06.514635: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d3468f800 of size 1024 next 294 2025-03-01 00:36:06.514647: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d3468fc00 of size 1024 next 295 2025-03-01 00:36:06.514658: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34690000 of size 1024 next 296 2025-03-01 00:36:06.514670: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34690400 of size 1024 next 299 2025-03-01 00:36:06.514690: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34690800 of size 1024 next 300 2025-03-01 00:36:06.514702: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34690c00 of size 1024 next 301 2025-03-01 00:36:06.514713: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34691000 of size 1024 next 302 2025-03-01 00:36:06.514725: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34691400 of size 1024 next 303 2025-03-01 00:36:06.514736: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34691800 of size 4096 next 305 2025-03-01 00:36:06.514747: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34692800 of size 4096 next 306 2025-03-01 00:36:06.514759: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34693800 of size 4096 next 307 2025-03-01 00:36:06.514770: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34694800 of size 4096 next 308 2025-03-01 00:36:06.514781: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34695800 of size 4096 next 309 2025-03-01 00:36:06.514793: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34696800 of size 1024 next 310 2025-03-01 00:36:06.514804: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34696c00 of size 1024 next 311 2025-03-01 00:36:06.514815: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34697000 of size 1024 next 312 2025-03-01 00:36:06.514827: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34697400 of size 1024 next 313 2025-03-01 00:36:06.514838: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34697800 of size 1024 next 314 2025-03-01 00:36:06.514849: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34697c00 of size 1024 next 317 2025-03-01 00:36:06.514863: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34698000 of size 1024 next 318 2025-03-01 00:36:06.514877: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34698400 of size 1024 next 319 2025-03-01 00:36:06.514889: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34698800 of size 1024 next 320 2025-03-01 00:36:06.514921: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34698c00 of size 1024 next 321 2025-03-01 00:36:06.514935: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34699000 of size 4096 next 323 2025-03-01 00:36:06.514947: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d3469a000 of size 4096 next 324 2025-03-01 00:36:06.514961: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d3469b000 of size 4096 next 325 2025-03-01 00:36:06.514975: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d3469c000 of size 4096 next 326 2025-03-01 00:36:06.514986: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d3469d000 of size 4096 next 327 2025-03-01 00:36:06.514998: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d3469e000 of size 1024 next 328 2025-03-01 00:36:06.515011: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d3469e400 of size 1024 next 329 2025-03-01 00:36:06.515023: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d3469e800 of size 1024 next 330 2025-03-01 00:36:06.515034: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d3469ec00 of size 1024 next 331 2025-03-01 00:36:06.515045: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d3469f000 of size 1024 next 332 2025-03-01 00:36:06.515057: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d3469f400 of size 1024 next 335 2025-03-01 00:36:06.515068: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d3469f800 of size 1024 next 336 2025-03-01 00:36:06.515079: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d3469fc00 of size 1024 next 337 2025-03-01 00:36:06.515111: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346a0000 of size 1024 next 338 2025-03-01 00:36:06.515123: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346a0400 of size 1024 next 339 2025-03-01 00:36:06.515135: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346a0800 of size 4096 next 341 2025-03-01 00:36:06.515146: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346a1800 of size 4096 next 342 2025-03-01 00:36:06.515157: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346a2800 of size 4096 next 343 2025-03-01 00:36:06.515169: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346a3800 of size 4096 next 344 2025-03-01 00:36:06.515180: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346a4800 of size 4096 next 345 2025-03-01 00:36:06.515191: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346a5800 of size 1024 next 346 2025-03-01 00:36:06.515203: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346a5c00 of size 1024 next 347 2025-03-01 00:36:06.515214: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346a6000 of size 1024 next 348 2025-03-01 00:36:06.515226: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346a6400 of size 1024 next 349 2025-03-01 00:36:06.515237: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346a6800 of size 1024 next 350 2025-03-01 00:36:06.515248: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346a6c00 of size 1024 next 353 2025-03-01 00:36:06.515260: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346a7000 of size 1024 next 354 2025-03-01 00:36:06.515271: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346a7400 of size 1024 next 355 2025-03-01 00:36:06.515283: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346a7800 of size 1024 next 356 2025-03-01 00:36:06.515294: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346a7c00 of size 1024 next 357 2025-03-01 00:36:06.515305: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346a8000 of size 4096 next 359 2025-03-01 00:36:06.515317: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346a9000 of size 4096 next 360 2025-03-01 00:36:06.515328: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346aa000 of size 4096 next 361 2025-03-01 00:36:06.515339: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346ab000 of size 4096 next 362 2025-03-01 00:36:06.515351: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346ac000 of size 4096 next 363 2025-03-01 00:36:06.515362: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346ad000 of size 1024 next 364 2025-03-01 00:36:06.515374: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346ad400 of size 1024 next 365 2025-03-01 00:36:06.515385: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346ad800 of size 1024 next 366 2025-03-01 00:36:06.515396: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346adc00 of size 1024 next 367 2025-03-01 00:36:06.515408: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346ae000 of size 1024 next 368 2025-03-01 00:36:06.515419: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346ae400 of size 1024 next 371 2025-03-01 00:36:06.515430: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346ae800 of size 1024 next 372 2025-03-01 00:36:06.515442: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346aec00 of size 1024 next 373 2025-03-01 00:36:06.515453: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346af000 of size 1024 next 374 2025-03-01 00:36:06.515464: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346af400 of size 1024 next 375 2025-03-01 00:36:06.515484: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346af800 of size 4096 next 377 2025-03-01 00:36:06.515496: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346b0800 of size 4096 next 378 2025-03-01 00:36:06.515508: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346b1800 of size 4096 next 379 2025-03-01 00:36:06.515519: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346b2800 of size 4096 next 380 2025-03-01 00:36:06.515530: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346b3800 of size 4096 next 381 2025-03-01 00:36:06.515542: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346b4800 of size 1024 next 382 2025-03-01 00:36:06.515553: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346b4c00 of size 1024 next 383 2025-03-01 00:36:06.515565: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346b5000 of size 1024 next 384 2025-03-01 00:36:06.515576: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346b5400 of size 1024 next 385 2025-03-01 00:36:06.515587: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346b5800 of size 1024 next 386 2025-03-01 00:36:06.515599: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346b5c00 of size 1024 next 389 2025-03-01 00:36:06.515610: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346b6000 of size 1024 next 390 2025-03-01 00:36:06.515622: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346b6400 of size 1024 next 391 2025-03-01 00:36:06.515633: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346b6800 of size 1024 next 392 2025-03-01 00:36:06.515644: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346b6c00 of size 1024 next 393 2025-03-01 00:36:06.515656: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346b7000 of size 4096 next 395 2025-03-01 00:36:06.515667: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346b8000 of size 4096 next 396 2025-03-01 00:36:06.515678: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346b9000 of size 4096 next 397 2025-03-01 00:36:06.515690: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346ba000 of size 4096 next 398 2025-03-01 00:36:06.515701: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346bb000 of size 4096 next 399 2025-03-01 00:36:06.515713: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346bc000 of size 1024 next 400 2025-03-01 00:36:06.515724: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346bc400 of size 1024 next 401 2025-03-01 00:36:06.515735: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346bc800 of size 1024 next 402 2025-03-01 00:36:06.515747: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346bcc00 of size 1024 next 403 2025-03-01 00:36:06.515758: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346bd000 of size 1024 next 404 2025-03-01 00:36:06.515769: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346bd400 of size 1024 next 407 2025-03-01 00:36:06.515781: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346bd800 of size 1024 next 408 2025-03-01 00:36:06.515792: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346bdc00 of size 1024 next 409 2025-03-01 00:36:06.515803: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346be000 of size 1024 next 410 2025-03-01 00:36:06.515815: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346be400 of size 1024 next 411 2025-03-01 00:36:06.515826: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346be800 of size 4096 next 413 2025-03-01 00:36:06.515837: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346bf800 of size 4096 next 414 2025-03-01 00:36:06.515849: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346c0800 of size 4096 next 415 2025-03-01 00:36:06.515867: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346c1800 of size 4096 next 416 2025-03-01 00:36:06.515879: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346c2800 of size 4096 next 417 2025-03-01 00:36:06.515893: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346c3800 of size 1024 next 418 2025-03-01 00:36:06.515909: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346c3c00 of size 1024 next 419 2025-03-01 00:36:06.515921: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346c4000 of size 1024 next 420 2025-03-01 00:36:06.515934: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346c4400 of size 1024 next 421 2025-03-01 00:36:06.515949: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346c4800 of size 1024 next 422 2025-03-01 00:36:06.515962: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346c4c00 of size 1024 next 425 2025-03-01 00:36:06.515973: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346c5000 of size 1024 next 426 2025-03-01 00:36:06.515986: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346c5400 of size 1024 next 427 2025-03-01 00:36:06.515998: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346c5800 of size 1024 next 428 2025-03-01 00:36:06.516010: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346c5c00 of size 1024 next 429 2025-03-01 00:36:06.516021: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346c6000 of size 4096 next 431 2025-03-01 00:36:06.516033: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346c7000 of size 4096 next 432 2025-03-01 00:36:06.516044: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346c8000 of size 4096 next 433 2025-03-01 00:36:06.516055: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346c9000 of size 4096 next 434 2025-03-01 00:36:06.516067: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346ca000 of size 4096 next 435 2025-03-01 00:36:06.516078: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346cb000 of size 1024 next 436 2025-03-01 00:36:06.516090: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346cb400 of size 1024 next 437 2025-03-01 00:36:06.516101: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346cb800 of size 1024 next 438 2025-03-01 00:36:06.516112: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346cbc00 of size 1024 next 103 2025-03-01 00:36:06.516124: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346cc000 of size 262144 next 102 2025-03-01 00:36:06.516136: I tensorflow/core/common_runtime/bfc_allocator.cc:990] Free at 7f0d3470c000 of size 999424 next 18446744073709551615 2025-03-01 00:36:06.516148: I tensorflow/core/common_runtime/bfc_allocator.cc:970] Next region of size 4194304 2025-03-01 00:36:06.516159: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34800000 of size 589824 next 96 2025-03-01 00:36:06.516171: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34890000 of size 262144 next 117 2025-03-01 00:36:06.516183: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348d0000 of size 1024 next 439 2025-03-01 00:36:06.516194: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348d0400 of size 1024 next 442 2025-03-01 00:36:06.516206: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348d0800 of size 1024 next 443 2025-03-01 00:36:06.516217: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348d0c00 of size 1024 next 444 2025-03-01 00:36:06.516228: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348d1000 of size 1024 next 445 2025-03-01 00:36:06.516240: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348d1400 of size 1024 next 446 2025-03-01 00:36:06.516260: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348d1800 of size 4096 next 448 2025-03-01 00:36:06.516272: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348d2800 of size 4096 next 449 2025-03-01 00:36:06.516283: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348d3800 of size 4096 next 450 2025-03-01 00:36:06.516295: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348d4800 of size 4096 next 451 2025-03-01 00:36:06.516306: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348d5800 of size 4096 next 452 2025-03-01 00:36:06.516318: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348d6800 of size 1024 next 453 2025-03-01 00:36:06.516329: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348d6c00 of size 1024 next 454 2025-03-01 00:36:06.516341: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348d7000 of size 1024 next 455 2025-03-01 00:36:06.516352: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348d7400 of size 1024 next 456 2025-03-01 00:36:06.516363: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348d7800 of size 1024 next 457 2025-03-01 00:36:06.516375: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348d7c00 of size 1024 next 460 2025-03-01 00:36:06.516386: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348d8000 of size 1024 next 461 2025-03-01 00:36:06.516398: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348d8400 of size 1024 next 462 2025-03-01 00:36:06.516409: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348d8800 of size 1024 next 463 2025-03-01 00:36:06.516420: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348d8c00 of size 1024 next 464 2025-03-01 00:36:06.516432: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348d9000 of size 4096 next 466 2025-03-01 00:36:06.516443: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348da000 of size 4096 next 467 2025-03-01 00:36:06.516455: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348db000 of size 4096 next 468 2025-03-01 00:36:06.516466: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348dc000 of size 4096 next 469 2025-03-01 00:36:06.516477: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348dd000 of size 4096 next 470 2025-03-01 00:36:06.516489: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348de000 of size 1024 next 471 2025-03-01 00:36:06.516500: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348de400 of size 1024 next 472 2025-03-01 00:36:06.516512: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348de800 of size 1024 next 473 2025-03-01 00:36:06.516523: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348dec00 of size 1024 next 474 2025-03-01 00:36:06.516535: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348df000 of size 1024 next 475 2025-03-01 00:36:06.516546: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348df400 of size 1024 next 478 2025-03-01 00:36:06.516558: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348df800 of size 1024 next 479 2025-03-01 00:36:06.516569: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348dfc00 of size 1024 next 480 2025-03-01 00:36:06.516580: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348e0000 of size 1024 next 481 2025-03-01 00:36:06.516592: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348e0400 of size 1024 next 482 2025-03-01 00:36:06.516603: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348e0800 of size 4096 next 484 2025-03-01 00:36:06.516615: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348e1800 of size 4096 next 485 2025-03-01 00:36:06.516634: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348e2800 of size 4096 next 486 2025-03-01 00:36:06.516645: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348e3800 of size 4096 next 487 2025-03-01 00:36:06.516657: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348e4800 of size 4096 next 488 2025-03-01 00:36:06.516668: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348e5800 of size 1024 next 489 2025-03-01 00:36:06.516680: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348e5c00 of size 1024 next 490 2025-03-01 00:36:06.516691: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348e6000 of size 1024 next 491 2025-03-01 00:36:06.516703: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348e6400 of size 1024 next 492 2025-03-01 00:36:06.516714: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348e6800 of size 1024 next 493 2025-03-01 00:36:06.516726: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348e6c00 of size 1024 next 496 2025-03-01 00:36:06.516737: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348e7000 of size 1024 next 497 2025-03-01 00:36:06.516748: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348e7400 of size 1024 next 498 2025-03-01 00:36:06.516760: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348e7800 of size 1024 next 499 2025-03-01 00:36:06.516771: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348e7c00 of size 1024 next 500 2025-03-01 00:36:06.516783: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348e8000 of size 4096 next 502 2025-03-01 00:36:06.516794: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348e9000 of size 4096 next 503 2025-03-01 00:36:06.516805: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348ea000 of size 4096 next 504 2025-03-01 00:36:06.516817: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348eb000 of size 4096 next 505 2025-03-01 00:36:06.516828: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348ec000 of size 4096 next 506 2025-03-01 00:36:06.516840: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348ed000 of size 1024 next 507 2025-03-01 00:36:06.516851: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348ed400 of size 1024 next 508 2025-03-01 00:36:06.516863: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348ed800 of size 1024 next 509 2025-03-01 00:36:06.516878: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348edc00 of size 1024 next 510 2025-03-01 00:36:06.516890: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348ee000 of size 1024 next 511 2025-03-01 00:36:06.516902: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348ee400 of size 1024 next 514 2025-03-01 00:36:06.516915: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348ee800 of size 1024 next 515 2025-03-01 00:36:06.516930: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348eec00 of size 1024 next 516 2025-03-01 00:36:06.516941: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348ef000 of size 1024 next 517 2025-03-01 00:36:06.516952: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348ef400 of size 1024 next 518 2025-03-01 00:36:06.516964: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348ef800 of size 4096 next 520 2025-03-01 00:36:06.516975: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348f0800 of size 4096 next 521 2025-03-01 00:36:06.516987: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348f1800 of size 4096 next 522 2025-03-01 00:36:06.516998: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348f2800 of size 4096 next 523 2025-03-01 00:36:06.517019: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348f3800 of size 4096 next 524 2025-03-01 00:36:06.517030: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348f4800 of size 1024 next 525 2025-03-01 00:36:06.517042: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348f4c00 of size 1024 next 526 2025-03-01 00:36:06.517053: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348f5000 of size 1024 next 527 2025-03-01 00:36:06.517065: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348f5400 of size 1024 next 528 2025-03-01 00:36:06.517076: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348f5800 of size 1024 next 529 2025-03-01 00:36:06.517088: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348f5c00 of size 1024 next 532 2025-03-01 00:36:06.517099: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348f6000 of size 1024 next 533 2025-03-01 00:36:06.517110: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348f6400 of size 1024 next 534 2025-03-01 00:36:06.517122: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348f6800 of size 1024 next 535 2025-03-01 00:36:06.517133: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348f6c00 of size 1024 next 536 2025-03-01 00:36:06.517144: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348f7000 of size 4096 next 538 2025-03-01 00:36:06.517156: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348f8000 of size 4096 next 539 2025-03-01 00:36:06.517167: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348f9000 of size 4096 next 540 2025-03-01 00:36:06.517179: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348fa000 of size 4096 next 541 2025-03-01 00:36:06.517190: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348fb000 of size 4096 next 542 2025-03-01 00:36:06.517201: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348fc000 of size 1024 next 543 2025-03-01 00:36:06.517213: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348fc400 of size 1024 next 544 2025-03-01 00:36:06.517224: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348fc800 of size 1024 next 545 2025-03-01 00:36:06.517235: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348fcc00 of size 1024 next 546 2025-03-01 00:36:06.517247: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348fd000 of size 1024 next 547 2025-03-01 00:36:06.517258: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348fd400 of size 1024 next 550 2025-03-01 00:36:06.517270: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348fd800 of size 1024 next 551 2025-03-01 00:36:06.517281: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348fdc00 of size 1024 next 552 2025-03-01 00:36:06.517292: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348fe000 of size 1024 next 553 2025-03-01 00:36:06.517304: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348fe400 of size 1024 next 554 2025-03-01 00:36:06.517315: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348fe800 of size 4096 next 556 2025-03-01 00:36:06.517326: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348ff800 of size 4096 next 557 2025-03-01 00:36:06.517338: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34900800 of size 4096 next 558 2025-03-01 00:36:06.517349: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34901800 of size 4096 next 559 2025-03-01 00:36:06.517361: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34902800 of size 4096 next 560 2025-03-01 00:36:06.517372: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34903800 of size 1024 next 561 2025-03-01 00:36:06.517383: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34903c00 of size 1024 next 562 2025-03-01 00:36:06.517403: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34904000 of size 1024 next 563 2025-03-01 00:36:06.517414: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34904400 of size 1024 next 564 2025-03-01 00:36:06.517426: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34904800 of size 1024 next 565 2025-03-01 00:36:06.517437: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34904c00 of size 1024 next 568 2025-03-01 00:36:06.517448: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34905000 of size 1024 next 569 2025-03-01 00:36:06.517460: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34905400 of size 1024 next 570 2025-03-01 00:36:06.517471: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34905800 of size 1024 next 571 2025-03-01 00:36:06.517482: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34905c00 of size 1024 next 572 2025-03-01 00:36:06.517494: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34906000 of size 4096 next 574 2025-03-01 00:36:06.517505: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34907000 of size 4096 next 575 2025-03-01 00:36:06.517517: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34908000 of size 4096 next 576 2025-03-01 00:36:06.517528: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34909000 of size 4096 next 577 2025-03-01 00:36:06.517539: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d3490a000 of size 4096 next 578 2025-03-01 00:36:06.517551: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d3490b000 of size 1024 next 579 2025-03-01 00:36:06.517562: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d3490b400 of size 1024 next 580 2025-03-01 00:36:06.517574: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d3490b800 of size 1024 next 581 2025-03-01 00:36:06.517585: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d3490bc00 of size 1024 next 582 2025-03-01 00:36:06.517597: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d3490c000 of size 1024 next 583 2025-03-01 00:36:06.517608: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d3490c400 of size 1024 next 586 2025-03-01 00:36:06.517619: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d3490c800 of size 1024 next 587 2025-03-01 00:36:06.517631: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d3490cc00 of size 1024 next 588 2025-03-01 00:36:06.517642: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d3490d000 of size 1024 next 589 2025-03-01 00:36:06.517653: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d3490d400 of size 1024 next 590 2025-03-01 00:36:06.517665: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d3490d800 of size 4096 next 592 2025-03-01 00:36:06.517676: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d3490e800 of size 6144 next 112 2025-03-01 00:36:06.517688: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34910000 of size 524288 next 111 2025-03-01 00:36:06.517700: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34990000 of size 262144 next 135 2025-03-01 00:36:06.517712: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d349d0000 of size 327680 next 124 2025-03-01 00:36:06.517723: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34a20000 of size 589824 next 123 2025-03-01 00:36:06.517735: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34ab0000 of size 262144 next 152 2025-03-01 00:36:06.517746: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34af0000 of size 327680 next 142 2025-03-01 00:36:06.517758: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34b40000 of size 786432 next 18446744073709551615 2025-03-01 00:36:06.517789: I tensorflow/core/common_runtime/bfc_allocator.cc:970] Next region of size 8388608 2025-03-01 00:36:06.517802: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34c00000 of size 4096 next 593 2025-03-01 00:36:06.517814: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34c01000 of size 4096 next 594 2025-03-01 00:36:06.517825: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34c02000 of size 4096 next 595 2025-03-01 00:36:06.517837: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34c03000 of size 2048 next 598 2025-03-01 00:36:06.517848: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34c03800 of size 2048 next 599 2025-03-01 00:36:06.517860: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34c04000 of size 2048 next 600 2025-03-01 00:36:06.517871: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34c04800 of size 2048 next 601 2025-03-01 00:36:06.517883: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34c05000 of size 2048 next 602 2025-03-01 00:36:06.517894: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34c05800 of size 256 next 605 2025-03-01 00:36:06.517905: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34c05900 of size 256 next 606 2025-03-01 00:36:06.517917: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34c05a00 of size 2048 next 604 2025-03-01 00:36:06.517928: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34c06200 of size 2048 next 609 2025-03-01 00:36:06.517940: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34c06a00 of size 2048 next 610 2025-03-01 00:36:06.517951: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34c07200 of size 2048 next 611 2025-03-01 00:36:06.517962: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34c07a00 of size 2048 next 612 2025-03-01 00:36:06.517974: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34c08200 of size 256 next 614 2025-03-01 00:36:06.517985: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34c08300 of size 256 next 615 2025-03-01 00:36:06.517997: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34c08400 of size 8192 next 613 2025-03-01 00:36:06.518008: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34c0a400 of size 8192 next 616 2025-03-01 00:36:06.518020: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34c0c400 of size 8192 next 618 2025-03-01 00:36:06.518031: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34c0e400 of size 8192 next 619 2025-03-01 00:36:06.518042: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34c10400 of size 8192 next 620 2025-03-01 00:36:06.518054: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34c12400 of size 256 next 621 2025-03-01 00:36:06.518066: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34c12500 of size 256 next 622 2025-03-01 00:36:06.518077: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34c12600 of size 8192 next 623 2025-03-01 00:36:06.518088: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34c14600 of size 8192 next 625 2025-03-01 00:36:06.518100: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34c16600 of size 8192 next 626 2025-03-01 00:36:06.518111: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34c18600 of size 8192 next 627 2025-03-01 00:36:06.518123: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34c1a600 of size 8192 next 628 2025-03-01 00:36:06.518134: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34c1c600 of size 2048 next 629 2025-03-01 00:36:06.518145: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34c1ce00 of size 2048 next 631 2025-03-01 00:36:06.518169: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34c1d600 of size 2048 next 632 2025-03-01 00:36:06.518181: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34c1de00 of size 2048 next 633 2025-03-01 00:36:06.518192: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34c1e600 of size 2048 next 634 2025-03-01 00:36:06.518204: I tensorflow/core/common_runtime/bfc_allocator.cc:990] Free at 7f0d34c1ee00 of size 463360 next 160 2025-03-01 00:36:06.518215: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34c90000 of size 589824 next 158 2025-03-01 00:36:06.518227: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34d20000 of size 524288 next 171 2025-03-01 00:36:06.518238: I tensorflow/core/common_runtime/bfc_allocator.cc:990] Free at 7f0d34da0000 of size 1048576 next 222 2025-03-01 00:36:06.518250: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34ea0000 of size 1048576 next 190 2025-03-01 00:36:06.518261: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34fa0000 of size 1048576 next 189 2025-03-01 00:36:06.518272: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d350a0000 of size 1048576 next 203 2025-03-01 00:36:06.518284: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d351a0000 of size 1048576 next 251 2025-03-01 00:36:06.518296: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d352a0000 of size 1441792 next 18446744073709551615 2025-03-01 00:36:06.518307: I tensorflow/core/common_runtime/bfc_allocator.cc:970] Next region of size 1048576 2025-03-01 00:36:06.518319: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee00000 of size 1280 next 1 2025-03-01 00:36:06.518330: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee00500 of size 256 next 5 2025-03-01 00:36:06.518342: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee00600 of size 256 next 8 2025-03-01 00:36:06.518353: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee00700 of size 256 next 9 2025-03-01 00:36:06.518365: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee00800 of size 256 next 10 2025-03-01 00:36:06.518376: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee00900 of size 256 next 11 2025-03-01 00:36:06.518388: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee00a00 of size 256 next 12 2025-03-01 00:36:06.518399: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee00b00 of size 256 next 13 2025-03-01 00:36:06.518411: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee00c00 of size 256 next 17 2025-03-01 00:36:06.518422: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee00d00 of size 256 next 19 2025-03-01 00:36:06.518433: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee00e00 of size 256 next 20 2025-03-01 00:36:06.518445: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee00f00 of size 256 next 21 2025-03-01 00:36:06.518456: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee01000 of size 256 next 22 2025-03-01 00:36:06.518467: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee01100 of size 256 next 24 2025-03-01 00:36:06.518479: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee01200 of size 256 next 25 2025-03-01 00:36:06.518490: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee01300 of size 256 next 23 2025-03-01 00:36:06.518502: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee01400 of size 256 next 28 2025-03-01 00:36:06.518513: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee01500 of size 256 next 29 2025-03-01 00:36:06.518524: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee01600 of size 256 next 30 2025-03-01 00:36:06.518543: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee01700 of size 256 next 31 2025-03-01 00:36:06.518555: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee01800 of size 256 next 33 2025-03-01 00:36:06.518567: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee01900 of size 256 next 34 2025-03-01 00:36:06.518578: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee01a00 of size 1024 next 32 2025-03-01 00:36:06.518589: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee01e00 of size 1024 next 37 2025-03-01 00:36:06.518601: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee02200 of size 1024 next 38 2025-03-01 00:36:06.518612: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee02600 of size 1024 next 39 2025-03-01 00:36:06.518624: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee02a00 of size 1024 next 40 2025-03-01 00:36:06.518635: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee02e00 of size 1024 next 41 2025-03-01 00:36:06.518646: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee03200 of size 1024 next 43 2025-03-01 00:36:06.518658: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee03600 of size 1024 next 44 2025-03-01 00:36:06.518669: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee03a00 of size 1024 next 45 2025-03-01 00:36:06.518680: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee03e00 of size 1024 next 46 2025-03-01 00:36:06.518692: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee04200 of size 256 next 48 2025-03-01 00:36:06.518703: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee04300 of size 256 next 49 2025-03-01 00:36:06.518715: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee04400 of size 256 next 50 2025-03-01 00:36:06.518726: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee04500 of size 256 next 51 2025-03-01 00:36:06.518737: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee04600 of size 256 next 52 2025-03-01 00:36:06.518749: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee04700 of size 256 next 53 2025-03-01 00:36:06.518760: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee04800 of size 256 next 56 2025-03-01 00:36:06.518772: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee04900 of size 256 next 57 2025-03-01 00:36:06.518783: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee04a00 of size 256 next 58 2025-03-01 00:36:06.518794: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee04b00 of size 256 next 14 2025-03-01 00:36:06.518806: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee04c00 of size 256 next 15 2025-03-01 00:36:06.518817: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee04d00 of size 256 next 16 2025-03-01 00:36:06.518828: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee04e00 of size 1024 next 60 2025-03-01 00:36:06.518840: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee05200 of size 1024 next 61 2025-03-01 00:36:06.518851: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee05600 of size 1024 next 62 2025-03-01 00:36:06.518863: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee05a00 of size 1024 next 63 2025-03-01 00:36:06.518874: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee05e00 of size 1024 next 64 2025-03-01 00:36:06.518885: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee06200 of size 256 next 66 2025-03-01 00:36:06.518905: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee06300 of size 256 next 67 2025-03-01 00:36:06.518919: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee06400 of size 256 next 68 2025-03-01 00:36:06.518938: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee06500 of size 256 next 69 2025-03-01 00:36:06.518950: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee06600 of size 256 next 70 2025-03-01 00:36:06.518962: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee06700 of size 256 next 73 2025-03-01 00:36:06.518973: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee06800 of size 256 next 74 2025-03-01 00:36:06.518984: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee06900 of size 256 next 75 2025-03-01 00:36:06.518996: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee06a00 of size 256 next 76 2025-03-01 00:36:06.519007: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee06b00 of size 256 next 77 2025-03-01 00:36:06.519018: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee06c00 of size 1024 next 79 2025-03-01 00:36:06.519030: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee07000 of size 1024 next 80 2025-03-01 00:36:06.519041: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee07400 of size 1024 next 81 2025-03-01 00:36:06.519053: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee07800 of size 1024 next 82 2025-03-01 00:36:06.519064: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee07c00 of size 1024 next 83 2025-03-01 00:36:06.519075: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee08000 of size 256 next 85 2025-03-01 00:36:06.519087: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee08100 of size 256 next 86 2025-03-01 00:36:06.519099: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee08200 of size 512 next 84 2025-03-01 00:36:06.519110: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee08400 of size 512 next 88 2025-03-01 00:36:06.519121: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee08600 of size 512 next 89 2025-03-01 00:36:06.519133: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee08800 of size 512 next 90 2025-03-01 00:36:06.519144: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee08a00 of size 512 next 91 2025-03-01 00:36:06.519156: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee08c00 of size 256 next 93 2025-03-01 00:36:06.519167: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee08d00 of size 256 next 94 2025-03-01 00:36:06.519179: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee08e00 of size 512 next 92 2025-03-01 00:36:06.519190: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee09000 of size 512 next 97 2025-03-01 00:36:06.519201: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee09200 of size 512 next 98 2025-03-01 00:36:06.519213: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee09400 of size 512 next 99 2025-03-01 00:36:06.519224: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee09600 of size 512 next 2 2025-03-01 00:36:06.519235: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee09800 of size 256 next 3 2025-03-01 00:36:06.519247: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee09900 of size 256 next 4 2025-03-01 00:36:06.519259: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee09a00 of size 16384 next 18 2025-03-01 00:36:06.519270: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee0da00 of size 256 next 100 2025-03-01 00:36:06.519282: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee0db00 of size 256 next 101 2025-03-01 00:36:06.519293: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee0dc00 of size 2048 next 104 2025-03-01 00:36:06.519304: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee0e400 of size 2048 next 105 2025-03-01 00:36:06.519323: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee0ec00 of size 2048 next 106 2025-03-01 00:36:06.519335: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee0f400 of size 2048 next 107 2025-03-01 00:36:06.519349: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee0fc00 of size 2048 next 108 2025-03-01 00:36:06.519365: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee10400 of size 256 next 109 2025-03-01 00:36:06.519381: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee10500 of size 256 next 110 2025-03-01 00:36:06.519396: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee10600 of size 2048 next 113 2025-03-01 00:36:06.519408: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee10e00 of size 2048 next 114 2025-03-01 00:36:06.519419: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee11600 of size 2048 next 115 2025-03-01 00:36:06.519431: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee11e00 of size 2048 next 116 2025-03-01 00:36:06.519442: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee12600 of size 2048 next 6 2025-03-01 00:36:06.519454: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee12e00 of size 37632 next 7 2025-03-01 00:36:06.519466: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee1c100 of size 512 next 118 2025-03-01 00:36:06.519477: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee1c300 of size 512 next 119 2025-03-01 00:36:06.519488: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee1c500 of size 512 next 120 2025-03-01 00:36:06.519500: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee1c700 of size 512 next 121 2025-03-01 00:36:06.519511: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee1c900 of size 512 next 122 2025-03-01 00:36:06.519522: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee1cb00 of size 512 next 125 2025-03-01 00:36:06.519534: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee1cd00 of size 512 next 126 2025-03-01 00:36:06.519545: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee1cf00 of size 512 next 127 2025-03-01 00:36:06.519557: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee1d100 of size 512 next 128 2025-03-01 00:36:06.519568: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee1d300 of size 512 next 129 2025-03-01 00:36:06.519579: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee1d500 of size 2048 next 130 2025-03-01 00:36:06.519591: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee1dd00 of size 2048 next 131 2025-03-01 00:36:06.519602: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee1e500 of size 2048 next 132 2025-03-01 00:36:06.519614: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee1ed00 of size 2048 next 133 2025-03-01 00:36:06.519625: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee1f500 of size 2048 next 134 2025-03-01 00:36:06.519637: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee1fd00 of size 512 next 136 2025-03-01 00:36:06.519648: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee1ff00 of size 512 next 137 2025-03-01 00:36:06.519659: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee20100 of size 512 next 138 2025-03-01 00:36:06.519671: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee20300 of size 512 next 139 2025-03-01 00:36:06.519682: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee20500 of size 512 next 140 2025-03-01 00:36:06.519694: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee20700 of size 512 next 141 2025-03-01 00:36:06.519714: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee20900 of size 512 next 143 2025-03-01 00:36:06.519726: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee20b00 of size 512 next 144 2025-03-01 00:36:06.519737: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee20d00 of size 512 next 145 2025-03-01 00:36:06.519751: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee20f00 of size 512 next 146 2025-03-01 00:36:06.519766: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee21100 of size 2048 next 147 2025-03-01 00:36:06.519778: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee21900 of size 2048 next 148 2025-03-01 00:36:06.519812: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee22100 of size 2048 next 149 2025-03-01 00:36:06.519827: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee22900 of size 2048 next 150 2025-03-01 00:36:06.519839: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee23100 of size 2048 next 151 2025-03-01 00:36:06.519852: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee23900 of size 512 next 153 2025-03-01 00:36:06.519864: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee23b00 of size 512 next 154 2025-03-01 00:36:06.519875: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee23d00 of size 512 next 155 2025-03-01 00:36:06.519887: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee23f00 of size 512 next 156 2025-03-01 00:36:06.519898: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee24100 of size 512 next 157 2025-03-01 00:36:06.519910: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee24300 of size 512 next 161 2025-03-01 00:36:06.519921: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee24500 of size 512 next 162 2025-03-01 00:36:06.519932: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee24700 of size 512 next 163 2025-03-01 00:36:06.519944: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee24900 of size 512 next 164 2025-03-01 00:36:06.519955: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee24b00 of size 512 next 165 2025-03-01 00:36:06.519967: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee24d00 of size 2048 next 166 2025-03-01 00:36:06.519989: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee25500 of size 2048 next 167 2025-03-01 00:36:06.520001: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee25d00 of size 2048 next 168 2025-03-01 00:36:06.520012: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee26500 of size 2048 next 169 2025-03-01 00:36:06.520024: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee26d00 of size 2048 next 170 2025-03-01 00:36:06.520035: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee27500 of size 1024 next 172 2025-03-01 00:36:06.520046: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee27900 of size 1024 next 173 2025-03-01 00:36:06.520058: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee27d00 of size 1024 next 174 2025-03-01 00:36:06.520069: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee28100 of size 1024 next 175 2025-03-01 00:36:06.520081: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee28500 of size 1024 next 176 2025-03-01 00:36:06.520092: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee28900 of size 256 next 178 2025-03-01 00:36:06.520104: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee28a00 of size 256 next 179 2025-03-01 00:36:06.520115: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee28b00 of size 1024 next 177 2025-03-01 00:36:06.520127: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee28f00 of size 1024 next 182 2025-03-01 00:36:06.520148: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee29300 of size 1024 next 183 2025-03-01 00:36:06.520159: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee29700 of size 1024 next 184 2025-03-01 00:36:06.520171: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee29b00 of size 1024 next 185 2025-03-01 00:36:06.520182: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee29f00 of size 256 next 187 2025-03-01 00:36:06.520194: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee2a000 of size 256 next 188 2025-03-01 00:36:06.520205: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee2a100 of size 4096 next 186 2025-03-01 00:36:06.520217: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee2b100 of size 4096 next 42 2025-03-01 00:36:06.520228: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee2c100 of size 65536 next 36 2025-03-01 00:36:06.520240: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee3c100 of size 65536 next 35 2025-03-01 00:36:06.520251: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee4c100 of size 4096 next 235 2025-03-01 00:36:06.520263: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee4d100 of size 4096 next 236 2025-03-01 00:36:06.520274: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee4e100 of size 4096 next 237 2025-03-01 00:36:06.520286: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee4f100 of size 4096 next 238 2025-03-01 00:36:06.520297: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee50100 of size 1024 next 239 2025-03-01 00:36:06.520308: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee50500 of size 1024 next 240 2025-03-01 00:36:06.520320: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee50900 of size 1024 next 241 2025-03-01 00:36:06.520331: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee50d00 of size 1024 next 242 2025-03-01 00:36:06.520343: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee51100 of size 1024 next 243 2025-03-01 00:36:06.520354: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee51500 of size 1024 next 246 2025-03-01 00:36:06.520366: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee51900 of size 1024 next 247 2025-03-01 00:36:06.520377: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee51d00 of size 1024 next 248 2025-03-01 00:36:06.520388: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee52100 of size 1024 next 249 2025-03-01 00:36:06.520400: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee52500 of size 1024 next 250 2025-03-01 00:36:06.520411: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee52900 of size 4096 next 252 2025-03-01 00:36:06.520423: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee53900 of size 4096 next 253 2025-03-01 00:36:06.520434: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee54900 of size 4096 next 254 2025-03-01 00:36:06.520445: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee55900 of size 4096 next 255 2025-03-01 00:36:06.520457: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee56900 of size 4096 next 256 2025-03-01 00:36:06.520468: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee57900 of size 1024 next 257 2025-03-01 00:36:06.520480: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee57d00 of size 1024 next 258 2025-03-01 00:36:06.520491: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee58100 of size 1024 next 259 2025-03-01 00:36:06.520502: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee58500 of size 1024 next 260 2025-03-01 00:36:06.520522: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee58900 of size 1024 next 261 2025-03-01 00:36:06.520534: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee58d00 of size 1024 next 264 2025-03-01 00:36:06.520545: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee59100 of size 1024 next 265 2025-03-01 00:36:06.520557: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee59500 of size 1024 next 266 2025-03-01 00:36:06.520568: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee59900 of size 1024 next 267 2025-03-01 00:36:06.520580: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee59d00 of size 1024 next 268 2025-03-01 00:36:06.520591: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee5a100 of size 4096 next 270 2025-03-01 00:36:06.520602: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee5b100 of size 4096 next 271 2025-03-01 00:36:06.520614: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee5c100 of size 4096 next 272 2025-03-01 00:36:06.520625: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee5d100 of size 4096 next 273 2025-03-01 00:36:06.520637: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee5e100 of size 4096 next 274 2025-03-01 00:36:06.520648: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee5f100 of size 1024 next 275 2025-03-01 00:36:06.520660: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee5f500 of size 1024 next 276 2025-03-01 00:36:06.520671: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee5f900 of size 1024 next 277 2025-03-01 00:36:06.520683: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee5fd00 of size 1024 next 278 2025-03-01 00:36:06.520694: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee60100 of size 1024 next 279 2025-03-01 00:36:06.520706: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee60500 of size 1024 next 282 2025-03-01 00:36:06.520717: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee60900 of size 1024 next 283 2025-03-01 00:36:06.520728: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee60d00 of size 1024 next 284 2025-03-01 00:36:06.520740: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee61100 of size 1024 next 285 2025-03-01 00:36:06.520751: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee61500 of size 1024 next 286 2025-03-01 00:36:06.520763: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee61900 of size 4096 next 288 2025-03-01 00:36:06.520774: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee62900 of size 6144 next 27 2025-03-01 00:36:06.520786: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee64100 of size 147456 next 26 2025-03-01 00:36:06.520797: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee88100 of size 65536 next 47 2025-03-01 00:36:06.520809: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee98100 of size 65536 next 59 2025-03-01 00:36:06.520820: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6eea8100 of size 65536 next 65 2025-03-01 00:36:06.520832: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6eeb8100 of size 294656 next 18446744073709551615 2025-03-01 00:36:06.520847: I tensorflow/core/common_runtime/bfc_allocator.cc:995] Summary of in-use Chunks by size: 2025-03-01 00:36:06.520865: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 65 Chunks of size 256 totalling 16.2KiB 2025-03-01 00:36:06.520878: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 40 Chunks of size 512 totalling 20.0KiB 2025-03-01 00:36:06.520891: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 250 Chunks of size 1024 totalling 250.0KiB 2025-03-01 00:36:06.520913: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 1280 totalling 1.2KiB 2025-03-01 00:36:06.520926: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 40 Chunks of size 2048 totalling 80.0KiB 2025-03-01 00:36:06.520938: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 117 Chunks of size 4096 totalling 468.0KiB 2025-03-01 00:36:06.520951: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 2 Chunks of size 6144 totalling 12.0KiB 2025-03-01 00:36:06.520963: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 7680 totalling 7.5KiB 2025-03-01 00:36:06.520976: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 10 Chunks of size 8192 totalling 80.0KiB 2025-03-01 00:36:06.520989: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 16384 totalling 16.0KiB 2025-03-01 00:36:06.521001: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 37632 totalling 36.8KiB 2025-03-01 00:36:06.521014: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 6 Chunks of size 65536 totalling 384.0KiB 2025-03-01 00:36:06.521027: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 131072 totalling 128.0KiB 2025-03-01 00:36:06.521039: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 3 Chunks of size 147456 totalling 432.0KiB 2025-03-01 00:36:06.521052: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 4 Chunks of size 262144 totalling 1.00MiB 2025-03-01 00:36:06.521064: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 294656 totalling 287.8KiB 2025-03-01 00:36:06.521077: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 2 Chunks of size 327680 totalling 640.0KiB 2025-03-01 00:36:06.521089: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 2 Chunks of size 524288 totalling 1.00MiB 2025-03-01 00:36:06.521102: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 3 Chunks of size 589824 totalling 1.69MiB 2025-03-01 00:36:06.521114: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 786432 totalling 768.0KiB 2025-03-01 00:36:06.521127: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 25 Chunks of size 1048576 totalling 25.00MiB 2025-03-01 00:36:06.521139: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 18 Chunks of size 1310720 totalling 22.50MiB 2025-03-01 00:36:06.521152: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 1441792 totalling 1.38MiB 2025-03-01 00:36:06.521164: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 1835008 totalling 1.75MiB 2025-03-01 00:36:06.521176: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 2 Chunks of size 2097152 totalling 4.00MiB 2025-03-01 00:36:06.521189: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 23 Chunks of size 2359296 totalling 51.75MiB 2025-03-01 00:36:06.521201: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 4194304 totalling 4.00MiB 2025-03-01 00:36:06.521214: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 6160384 totalling 5.88MiB 2025-03-01 00:36:06.521226: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 9437184 totalling 9.00MiB 2025-03-01 00:36:06.521239: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 10485760 totalling 10.00MiB 2025-03-01 00:36:06.521252: I tensorflow/core/common_runtime/bfc_allocator.cc:1002] Sum Total of in-use chunks: 142.48MiB 2025-03-01 00:36:06.521263: I tensorflow/core/common_runtime/bfc_allocator.cc:1004] total_region_allocated_bytes_: 176029696 memory_limit_: 176029696 available bytes: 0 curr_region_allocation_bytes_: 268435456 2025-03-01 00:36:06.521279: I tensorflow/core/common_runtime/bfc_allocator.cc:1010] Stats: Limit: 176029696 InUse: 149401088 MaxInUse: 161932800 NumAllocs: 2110 MaxAllocSize: 10485760 2025-03-01 00:36:06.521307: W tensorflow/core/common_runtime/bfc_allocator.cc:439] ____***************_**************************************_**_****************************_********* 2025-03-01 00:36:06.521358: W tensorflow/core/framework/op_kernel.cc:1753] OP_REQUIRES failed at random_op.cc:77 : Resource exhausted: OOM when allocating tensor with shape[3,3,512,512] and type float on /job:localhost/replica:0/task:0/device:GPU:0 by allocator GPU_0_bfc RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 Exception in mask_detect : OOM when allocating tensor with shape[3,3,512,512] and type float on /job:localhost/replica:0/task:0/device:GPU:0 by allocator GPU_0_bfc [Op:RandomUniform] we want to redo the detection Using TensorFlow backend. max_time_sub_proc : 3600 erreur pendant la detection Useless call to update_current_state in case -12 caffe_path_current : About to save ! 1 Inside saveOutput : final : True verbose : False eke 12-6-18 : saveMask need to be cleaned for new output ! ERROR : mask output needs to be a dictionnary now ! No output to save, continue without doing anything ! save missing photos in datou_result : After save, about to update current ! datou_cur_ids : [] len(datou.list_steps) : 1 output : -12 free memory after detection : begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 87 ############################### TEST detect object ################################ run mask_detect Inside batchDatouExec : verbose : False Catched exception ! Connect or reconnect ! # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : mask_detect list_input_json : [] origin BFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 1 ; length of list_pids : 1 ; length of list_args : 1 time to download the photos : 0.1293790340423584 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : False number of steps : 1 step1:mask_detect Sat Mar 1 00:36:07 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory havn't enough memory gpu , need / 3000 l 3632 free memory gpu now : 544 wait 20 seconds l 3637 free memory gpu now : 544 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-03-01 00:36:30.515677: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-03-01 00:36:30.547236: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-03-01 00:36:30.549277: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f0f10000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-03-01 00:36:30.549355: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-03-01 00:36:30.553401: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-03-01 00:36:30.816002: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x44e69c0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-03-01 00:36:30.816050: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-03-01 00:36:30.816530: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-03-01 00:36:30.816869: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-01 00:36:30.818984: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-01 00:36:30.821079: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-03-01 00:36:30.821407: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-03-01 00:36:30.823820: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-03-01 00:36:30.824907: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-03-01 00:36:30.829799: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-03-01 00:36:30.830950: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-03-01 00:36:30.831040: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-01 00:36:30.831623: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-03-01 00:36:30.831642: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-03-01 00:36:30.831654: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-03-01 00:36:30.832593: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 167 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl454 thcls : [{'id': 454, 'mtr_user_id': 31, 'name': 'mask_coco_origin', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'backgroud,person,bicycle,car,motorcycle,airplane,bus,train,truck,boat,trafficlight,firehydrant,stopsign,parkingmeter,bench,bird,cat,dog,horse,sheep,cow,elephant,bear,zebra,giraffe,backpack,umbrella,handbag,tie,suitcase,frisbee,skis,snowboard,sportsball,kite,baseballbat,baseballglove,skateboard,surfboard,tennisracket,bottle,wineglass,cup,fork,knife,spoon,bowl,banana,apple,sandwich,orange,broccoli,carrot,hotdog,pizza,donut,cake,chair,couch,pottedplant,bed,diningtable,toilet,tv,laptop,mouse,remote,keyboard,cellphone,microwave,oven,toaster,sink,refrigerator,book,clock,vase,scissors,teddybear,hairdrier,toothbrush', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 445, 'photo_desc_type': 3473, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0'}] thcl {'id': 454, 'mtr_user_id': 31, 'name': 'mask_coco_origin', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'backgroud,person,bicycle,car,motorcycle,airplane,bus,train,truck,boat,trafficlight,firehydrant,stopsign,parkingmeter,bench,bird,cat,dog,horse,sheep,cow,elephant,bear,zebra,giraffe,backpack,umbrella,handbag,tie,suitcase,frisbee,skis,snowboard,sportsball,kite,baseballbat,baseballglove,skateboard,surfboard,tennisracket,bottle,wineglass,cup,fork,knife,spoon,bowl,banana,apple,sandwich,orange,broccoli,carrot,hotdog,pizza,donut,cake,chair,couch,pottedplant,bed,diningtable,toilet,tv,laptop,mouse,remote,keyboard,cellphone,microwave,oven,toaster,sink,refrigerator,book,clock,vase,scissors,teddybear,hairdrier,toothbrush', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 445, 'photo_desc_type': 3473, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 3473 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (3473, 'mask_coco_origin', 16384, 25088, 'mask_coco_origin', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2018, 3, 19, 10, 42, 21), datetime.datetime(2018, 3, 19, 10, 42, 21)) {'thcl': {'id': 454, 'mtr_user_id': 31, 'name': 'mask_coco_origin', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'backgroud,person,bicycle,car,motorcycle,airplane,bus,train,truck,boat,trafficlight,firehydrant,stopsign,parkingmeter,bench,bird,cat,dog,horse,sheep,cow,elephant,bear,zebra,giraffe,backpack,umbrella,handbag,tie,suitcase,frisbee,skis,snowboard,sportsball,kite,baseballbat,baseballglove,skateboard,surfboard,tennisracket,bottle,wineglass,cup,fork,knife,spoon,bowl,banana,apple,sandwich,orange,broccoli,carrot,hotdog,pizza,donut,cake,chair,couch,pottedplant,bed,diningtable,toilet,tv,laptop,mouse,remote,keyboard,cellphone,microwave,oven,toaster,sink,refrigerator,book,clock,vase,scissors,teddybear,hairdrier,toothbrush', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 445, 'photo_desc_type': 3473, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['backgroud', 'person', 'bicycle', 'car', 'motorcycle', 'airplane', 'bus', 'train', 'truck', 'boat', 'trafficlight', 'firehydrant', 'stopsign', 'parkingmeter', 'bench', 'bird', 'cat', 'dog', 'horse', 'sheep', 'cow', 'elephant', 'bear', 'zebra', 'giraffe', 'backpack', 'umbrella', 'handbag', 'tie', 'suitcase', 'frisbee', 'skis', 'snowboard', 'sportsball', 'kite', 'baseballbat', 'baseballglove', 'skateboard', 'surfboard', 'tennisracket', 'bottle', 'wineglass', 'cup', 'fork', 'knife', 'spoon', 'bowl', 'banana', 'apple', 'sandwich', 'orange', 'broccoli', 'carrot', 'hotdog', 'pizza', 'donut', 'cake', 'chair', 'couch', 'pottedplant', 'bed', 'diningtable', 'toilet', 'tv', 'laptop', 'mouse', 'remote', 'keyboard', 'cellphone', 'microwave', 'oven', 'toaster', 'sink', 'refrigerator', 'book', 'clock', 'vase', 'scissors', 'teddybear', 'hairdrier', 'toothbrush'], 'list_hashtags_csv': 'backgroud,person,bicycle,car,motorcycle,airplane,bus,train,truck,boat,trafficlight,firehydrant,stopsign,parkingmeter,bench,bird,cat,dog,horse,sheep,cow,elephant,bear,zebra,giraffe,backpack,umbrella,handbag,tie,suitcase,frisbee,skis,snowboard,sportsball,kite,baseballbat,baseballglove,skateboard,surfboard,tennisracket,bottle,wineglass,cup,fork,knife,spoon,bowl,banana,apple,sandwich,orange,broccoli,carrot,hotdog,pizza,donut,cake,chair,couch,pottedplant,bed,diningtable,toilet,tv,laptop,mouse,remote,keyboard,cellphone,microwave,oven,toaster,sink,refrigerator,book,clock,vase,scissors,teddybear,hairdrier,toothbrush', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 445, 'svm_hashtag_type_desc': 3473, 'photo_desc_type': 3473, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['backgroud', 'person', 'bicycle', 'car', 'motorcycle', 'airplane', 'bus', 'train', 'truck', 'boat', 'trafficlight', 'firehydrant', 'stopsign', 'parkingmeter', 'bench', 'bird', 'cat', 'dog', 'horse', 'sheep', 'cow', 'elephant', 'bear', 'zebra', 'giraffe', 'backpack', 'umbrella', 'handbag', 'tie', 'suitcase', 'frisbee', 'skis', 'snowboard', 'sportsball', 'kite', 'baseballbat', 'baseballglove', 'skateboard', 'surfboard', 'tennisracket', 'bottle', 'wineglass', 'cup', 'fork', 'knife', 'spoon', 'bowl', 'banana', 'apple', 'sandwich', 'orange', 'broccoli', 'carrot', 'hotdog', 'pizza', 'donut', 'cake', 'chair', 'couch', 'pottedplant', 'bed', 'diningtable', 'toilet', 'tv', 'laptop', 'mouse', 'remote', 'keyboard', 'cellphone', 'microwave', 'oven', 'toaster', 'sink', 'refrigerator', 'book', 'clock', 'vase', 'scissors', 'teddybear', 'hairdrier', 'toothbrush'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME mask_coco_origin NUM_CLASSES 81 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 2025-03-01 00:36:31.375561: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-03-01 00:36:31.375665: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-01 00:36:31.375693: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-01 00:36:31.375718: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-03-01 00:36:31.375743: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-03-01 00:36:31.375766: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-03-01 00:36:31.375807: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-03-01 00:36:31.375833: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-03-01 00:36:31.376723: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-03-01 00:36:31.377504: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-03-01 00:36:31.377537: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-01 00:36:31.377553: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-01 00:36:31.377567: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-03-01 00:36:31.377581: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-03-01 00:36:31.377596: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-03-01 00:36:31.377610: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-03-01 00:36:31.377624: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-03-01 00:36:31.378311: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-03-01 00:36:31.378339: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-03-01 00:36:31.378348: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-03-01 00:36:31.378355: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-03-01 00:36:31.379052: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 167 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) 2025-03-01 00:36:43.086190: W tensorflow/core/common_runtime/bfc_allocator.cc:434] Allocator (GPU_0_bfc) ran out of memory trying to allocate 9.00MiB (rounded to 9437184) Current allocation summary follows. 2025-03-01 00:36:43.086296: I tensorflow/core/common_runtime/bfc_allocator.cc:934] BFCAllocator dump for GPU_0_bfc 2025-03-01 00:36:43.086314: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (256): Total Chunks: 65, Chunks in use: 65. 16.2KiB allocated for chunks. 16.2KiB in use in bin. 8.9KiB client-requested in use in bin. 2025-03-01 00:36:43.086327: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (512): Total Chunks: 40, Chunks in use: 40. 20.0KiB allocated for chunks. 20.0KiB in use in bin. 20.0KiB client-requested in use in bin. 2025-03-01 00:36:43.086339: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (1024): Total Chunks: 251, Chunks in use: 251. 251.2KiB allocated for chunks. 251.2KiB in use in bin. 251.0KiB client-requested in use in bin. 2025-03-01 00:36:43.086352: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (2048): Total Chunks: 40, Chunks in use: 40. 80.0KiB allocated for chunks. 80.0KiB in use in bin. 80.0KiB client-requested in use in bin. 2025-03-01 00:36:43.086363: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (4096): Total Chunks: 120, Chunks in use: 120. 487.5KiB allocated for chunks. 487.5KiB in use in bin. 480.0KiB client-requested in use in bin. 2025-03-01 00:36:43.086375: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (8192): Total Chunks: 10, Chunks in use: 10. 80.0KiB allocated for chunks. 80.0KiB in use in bin. 80.0KiB client-requested in use in bin. 2025-03-01 00:36:43.086411: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (16384): Total Chunks: 1, Chunks in use: 1. 16.0KiB allocated for chunks. 16.0KiB in use in bin. 16.0KiB client-requested in use in bin. 2025-03-01 00:36:43.086423: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (32768): Total Chunks: 1, Chunks in use: 1. 36.8KiB allocated for chunks. 36.8KiB in use in bin. 36.8KiB client-requested in use in bin. 2025-03-01 00:36:43.086434: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (65536): Total Chunks: 6, Chunks in use: 6. 384.0KiB allocated for chunks. 384.0KiB in use in bin. 384.0KiB client-requested in use in bin. 2025-03-01 00:36:43.086445: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (131072): Total Chunks: 4, Chunks in use: 4. 560.0KiB allocated for chunks. 560.0KiB in use in bin. 560.0KiB client-requested in use in bin. 2025-03-01 00:36:43.086456: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (262144): Total Chunks: 8, Chunks in use: 7. 2.35MiB allocated for chunks. 1.91MiB in use in bin. 1.75MiB client-requested in use in bin. 2025-03-01 00:36:43.086467: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (524288): Total Chunks: 7, Chunks in use: 6. 4.39MiB allocated for chunks. 3.44MiB in use in bin. 3.25MiB client-requested in use in bin. 2025-03-01 00:36:43.086479: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (1048576): Total Chunks: 48, Chunks in use: 45. 54.12MiB allocated for chunks. 50.62MiB in use in bin. 45.00MiB client-requested in use in bin. 2025-03-01 00:36:43.086490: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (2097152): Total Chunks: 28, Chunks in use: 25. 64.25MiB allocated for chunks. 55.75MiB in use in bin. 55.75MiB client-requested in use in bin. 2025-03-01 00:36:43.086501: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (4194304): Total Chunks: 3, Chunks in use: 2. 13.88MiB allocated for chunks. 9.88MiB in use in bin. 8.00MiB client-requested in use in bin. 2025-03-01 00:36:43.086513: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (8388608): Total Chunks: 3, Chunks in use: 2. 27.00MiB allocated for chunks. 19.00MiB in use in bin. 17.00MiB client-requested in use in bin. 2025-03-01 00:36:43.086523: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (16777216): Total Chunks: 0, Chunks in use: 0. 0B allocated for chunks. 0B in use in bin. 0B client-requested in use in bin. 2025-03-01 00:36:43.086533: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (33554432): Total Chunks: 0, Chunks in use: 0. 0B allocated for chunks. 0B in use in bin. 0B client-requested in use in bin. 2025-03-01 00:36:43.086543: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (67108864): Total Chunks: 0, Chunks in use: 0. 0B allocated for chunks. 0B in use in bin. 0B client-requested in use in bin. 2025-03-01 00:36:43.086553: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (134217728): Total Chunks: 0, Chunks in use: 0. 0B allocated for chunks. 0B in use in bin. 0B client-requested in use in bin. 2025-03-01 00:36:43.086562: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (268435456): Total Chunks: 0, Chunks in use: 0. 0B allocated for chunks. 0B in use in bin. 0B client-requested in use in bin. 2025-03-01 00:36:43.086573: I tensorflow/core/common_runtime/bfc_allocator.cc:957] Bin for 9.00MiB was 8.00MiB, Chunk State: 2025-03-01 00:36:43.086591: I tensorflow/core/common_runtime/bfc_allocator.cc:963] Size: 8.00MiB | Requested Size: 4.00MiB | in_use: 0 | bin_num: 15, next: Size: 10.00MiB | Requested Size: 8.00MiB | in_use: 1 | bin_num: -1 2025-03-01 00:36:43.086600: I tensorflow/core/common_runtime/bfc_allocator.cc:970] Next region of size 42860544 2025-03-01 00:36:43.086613: I tensorflow/core/common_runtime/bfc_allocator.cc:990] Free at 7f0d28000000 of size 8388608 next 624 2025-03-01 00:36:43.086624: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d28800000 of size 10485760 next 608 2025-03-01 00:36:43.086639: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d29200000 of size 9437184 next 607 2025-03-01 00:36:43.086648: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d29b00000 of size 4194304 next 630 2025-03-01 00:36:43.086727: I tensorflow/core/common_runtime/bfc_allocator.cc:990] Free at 7f0d29f00000 of size 4194304 next 617 2025-03-01 00:36:43.086739: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d2a300000 of size 6160384 next 18446744073709551615 2025-03-01 00:36:43.086748: I tensorflow/core/common_runtime/bfc_allocator.cc:970] Next region of size 67108864 2025-03-01 00:36:43.086757: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d2c000000 of size 2359296 next 370 2025-03-01 00:36:43.086766: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d2c240000 of size 1048576 next 394 2025-03-01 00:36:43.086775: I tensorflow/core/common_runtime/bfc_allocator.cc:990] Free at 7f0d2c340000 of size 1310720 next 388 2025-03-01 00:36:43.086783: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d2c480000 of size 2359296 next 387 2025-03-01 00:36:43.086792: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d2c6c0000 of size 1048576 next 412 2025-03-01 00:36:43.086801: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d2c7c0000 of size 1310720 next 406 2025-03-01 00:36:43.086810: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d2c900000 of size 2359296 next 405 2025-03-01 00:36:43.086818: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d2cb40000 of size 1048576 next 430 2025-03-01 00:36:43.086827: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d2cc40000 of size 1310720 next 424 2025-03-01 00:36:43.086835: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d2cd80000 of size 2359296 next 423 2025-03-01 00:36:43.086844: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d2cfc0000 of size 1048576 next 447 2025-03-01 00:36:43.086852: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d2d0c0000 of size 1310720 next 441 2025-03-01 00:36:43.086861: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d2d200000 of size 2359296 next 440 2025-03-01 00:36:43.086869: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d2d440000 of size 1048576 next 465 2025-03-01 00:36:43.086878: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d2d540000 of size 1310720 next 459 2025-03-01 00:36:43.086886: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d2d680000 of size 2359296 next 458 2025-03-01 00:36:43.086900: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d2d8c0000 of size 1048576 next 483 2025-03-01 00:36:43.086911: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d2d9c0000 of size 1310720 next 477 2025-03-01 00:36:43.086920: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d2db00000 of size 2359296 next 476 2025-03-01 00:36:43.086929: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d2dd40000 of size 1048576 next 501 2025-03-01 00:36:43.086937: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d2de40000 of size 1310720 next 495 2025-03-01 00:36:43.086946: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d2df80000 of size 2359296 next 494 2025-03-01 00:36:43.086954: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d2e1c0000 of size 1048576 next 519 2025-03-01 00:36:43.086962: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d2e2c0000 of size 1310720 next 513 2025-03-01 00:36:43.086971: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d2e400000 of size 2359296 next 512 2025-03-01 00:36:43.086979: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d2e640000 of size 1048576 next 537 2025-03-01 00:36:43.086995: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d2e740000 of size 1310720 next 531 2025-03-01 00:36:43.087004: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d2e880000 of size 2359296 next 530 2025-03-01 00:36:43.087012: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d2eac0000 of size 1048576 next 555 2025-03-01 00:36:43.087021: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d2ebc0000 of size 1310720 next 549 2025-03-01 00:36:43.087029: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d2ed00000 of size 2359296 next 548 2025-03-01 00:36:43.087038: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d2ef40000 of size 1048576 next 573 2025-03-01 00:36:43.087046: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d2f040000 of size 1310720 next 567 2025-03-01 00:36:43.087055: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d2f180000 of size 2359296 next 566 2025-03-01 00:36:43.087063: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d2f3c0000 of size 1048576 next 591 2025-03-01 00:36:43.087072: I tensorflow/core/common_runtime/bfc_allocator.cc:990] Free at 7f0d2f4c0000 of size 1310720 next 585 2025-03-01 00:36:43.087080: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d2f600000 of size 2359296 next 584 2025-03-01 00:36:43.087089: I tensorflow/core/common_runtime/bfc_allocator.cc:990] Free at 7f0d2f840000 of size 2097152 next 597 2025-03-01 00:36:43.087098: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d2fa40000 of size 2097152 next 596 2025-03-01 00:36:43.087107: I tensorflow/core/common_runtime/bfc_allocator.cc:990] Free at 7f0d2fc40000 of size 3932160 next 18446744073709551615 2025-03-01 00:36:43.087115: I tensorflow/core/common_runtime/bfc_allocator.cc:970] Next region of size 33554432 2025-03-01 00:36:43.087124: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d30000000 of size 2359296 next 245 2025-03-01 00:36:43.087132: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d30240000 of size 1048576 next 269 2025-03-01 00:36:43.087141: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d30340000 of size 1310720 next 263 2025-03-01 00:36:43.087149: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d30480000 of size 2359296 next 262 2025-03-01 00:36:43.087158: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d306c0000 of size 1048576 next 287 2025-03-01 00:36:43.087166: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d307c0000 of size 1310720 next 281 2025-03-01 00:36:43.087175: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d30900000 of size 2359296 next 280 2025-03-01 00:36:43.087183: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d30b40000 of size 1048576 next 304 2025-03-01 00:36:43.087192: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d30c40000 of size 1310720 next 298 2025-03-01 00:36:43.087200: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d30d80000 of size 2359296 next 297 2025-03-01 00:36:43.087209: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d30fc0000 of size 1048576 next 322 2025-03-01 00:36:43.087217: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d310c0000 of size 1310720 next 316 2025-03-01 00:36:43.087226: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d31200000 of size 2359296 next 315 2025-03-01 00:36:43.087234: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d31440000 of size 1048576 next 340 2025-03-01 00:36:43.087243: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d31540000 of size 1310720 next 334 2025-03-01 00:36:43.087251: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d31680000 of size 2359296 next 333 2025-03-01 00:36:43.087260: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d318c0000 of size 1048576 next 358 2025-03-01 00:36:43.087275: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d319c0000 of size 1310720 next 352 2025-03-01 00:36:43.087284: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d31b00000 of size 2359296 next 351 2025-03-01 00:36:43.087292: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d31d40000 of size 1048576 next 376 2025-03-01 00:36:43.087301: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d31e40000 of size 1835008 next 18446744073709551615 2025-03-01 00:36:43.087309: I tensorflow/core/common_runtime/bfc_allocator.cc:970] Next region of size 16777216 2025-03-01 00:36:43.087318: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d32000000 of size 2359296 next 181 2025-03-01 00:36:43.087326: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d32240000 of size 2097152 next 196 2025-03-01 00:36:43.087335: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d32440000 of size 1048576 next 216 2025-03-01 00:36:43.087344: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d32540000 of size 1310720 next 209 2025-03-01 00:36:43.087352: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d32680000 of size 2359296 next 208 2025-03-01 00:36:43.087361: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d328c0000 of size 1048576 next 234 2025-03-01 00:36:43.087369: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d329c0000 of size 1310720 next 228 2025-03-01 00:36:43.087378: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d32b00000 of size 2359296 next 227 2025-03-01 00:36:43.087386: I tensorflow/core/common_runtime/bfc_allocator.cc:990] Free at 7f0d32d40000 of size 2883584 next 18446744073709551615 2025-03-01 00:36:43.087394: I tensorflow/core/common_runtime/bfc_allocator.cc:970] Next region of size 2097152 2025-03-01 00:36:43.087403: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34600000 of size 147456 next 55 2025-03-01 00:36:43.087412: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34624000 of size 65536 next 78 2025-03-01 00:36:43.087421: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34634000 of size 4096 next 191 2025-03-01 00:36:43.087429: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34635000 of size 4096 next 192 2025-03-01 00:36:43.087438: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34636000 of size 4096 next 193 2025-03-01 00:36:43.087447: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34637000 of size 256 next 194 2025-03-01 00:36:43.087455: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34637100 of size 256 next 195 2025-03-01 00:36:43.087464: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34637200 of size 4096 next 197 2025-03-01 00:36:43.087472: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34638200 of size 4096 next 198 2025-03-01 00:36:43.087481: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34639200 of size 4096 next 199 2025-03-01 00:36:43.087489: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d3463a200 of size 4096 next 200 2025-03-01 00:36:43.087498: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d3463b200 of size 4096 next 201 2025-03-01 00:36:43.087507: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d3463c200 of size 1024 next 202 2025-03-01 00:36:43.087515: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d3463c600 of size 1024 next 204 2025-03-01 00:36:43.087524: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d3463ca00 of size 1024 next 205 2025-03-01 00:36:43.087533: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d3463ce00 of size 1024 next 206 2025-03-01 00:36:43.087541: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d3463d200 of size 1024 next 207 2025-03-01 00:36:43.087556: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d3463d600 of size 1024 next 210 2025-03-01 00:36:43.087565: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d3463da00 of size 1024 next 211 2025-03-01 00:36:43.087573: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d3463de00 of size 1024 next 212 2025-03-01 00:36:43.087582: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d3463e200 of size 1024 next 213 2025-03-01 00:36:43.087590: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d3463e600 of size 1024 next 214 2025-03-01 00:36:43.087599: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d3463ea00 of size 4096 next 215 2025-03-01 00:36:43.087607: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d3463fa00 of size 4096 next 217 2025-03-01 00:36:43.087616: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34640a00 of size 4096 next 218 2025-03-01 00:36:43.087624: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34641a00 of size 4096 next 219 2025-03-01 00:36:43.087633: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34642a00 of size 4096 next 220 2025-03-01 00:36:43.087641: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34643a00 of size 1024 next 221 2025-03-01 00:36:43.087650: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34643e00 of size 1024 next 223 2025-03-01 00:36:43.087658: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34644200 of size 1024 next 224 2025-03-01 00:36:43.087667: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34644600 of size 1024 next 225 2025-03-01 00:36:43.087675: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34644a00 of size 1024 next 226 2025-03-01 00:36:43.087684: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34644e00 of size 1024 next 229 2025-03-01 00:36:43.087692: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34645200 of size 1024 next 230 2025-03-01 00:36:43.087701: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34645600 of size 1024 next 231 2025-03-01 00:36:43.087709: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34645a00 of size 1024 next 232 2025-03-01 00:36:43.087718: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34645e00 of size 1024 next 233 2025-03-01 00:36:43.087727: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34646200 of size 7680 next 72 2025-03-01 00:36:43.087735: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34648000 of size 147456 next 71 2025-03-01 00:36:43.087744: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d3466c000 of size 131072 next 87 2025-03-01 00:36:43.087752: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d3468c000 of size 4096 next 289 2025-03-01 00:36:43.087761: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d3468d000 of size 4096 next 290 2025-03-01 00:36:43.087769: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d3468e000 of size 4096 next 291 2025-03-01 00:36:43.087778: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d3468f000 of size 1024 next 292 2025-03-01 00:36:43.087786: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d3468f400 of size 1024 next 293 2025-03-01 00:36:43.087795: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d3468f800 of size 1024 next 294 2025-03-01 00:36:43.087803: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d3468fc00 of size 1024 next 295 2025-03-01 00:36:43.087812: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34690000 of size 1024 next 296 2025-03-01 00:36:43.087820: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34690400 of size 1024 next 299 2025-03-01 00:36:43.087835: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34690800 of size 1024 next 300 2025-03-01 00:36:43.087844: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34690c00 of size 1024 next 301 2025-03-01 00:36:43.087852: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34691000 of size 1024 next 302 2025-03-01 00:36:43.087861: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34691400 of size 1024 next 303 2025-03-01 00:36:43.087869: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34691800 of size 4096 next 305 2025-03-01 00:36:43.087878: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34692800 of size 4096 next 306 2025-03-01 00:36:43.087887: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34693800 of size 4096 next 307 2025-03-01 00:36:43.087895: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34694800 of size 4096 next 308 2025-03-01 00:36:43.087904: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34695800 of size 4096 next 309 2025-03-01 00:36:43.087912: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34696800 of size 1024 next 310 2025-03-01 00:36:43.087921: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34696c00 of size 1024 next 311 2025-03-01 00:36:43.087929: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34697000 of size 1024 next 312 2025-03-01 00:36:43.087938: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34697400 of size 1024 next 313 2025-03-01 00:36:43.087946: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34697800 of size 1024 next 314 2025-03-01 00:36:43.087955: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34697c00 of size 1024 next 317 2025-03-01 00:36:43.087963: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34698000 of size 1024 next 318 2025-03-01 00:36:43.087972: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34698400 of size 1024 next 319 2025-03-01 00:36:43.087981: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34698800 of size 1024 next 320 2025-03-01 00:36:43.087989: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34698c00 of size 1024 next 321 2025-03-01 00:36:43.087998: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34699000 of size 4096 next 323 2025-03-01 00:36:43.088006: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d3469a000 of size 4096 next 324 2025-03-01 00:36:43.088015: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d3469b000 of size 4096 next 325 2025-03-01 00:36:43.088023: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d3469c000 of size 4096 next 326 2025-03-01 00:36:43.088032: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d3469d000 of size 4096 next 327 2025-03-01 00:36:43.088041: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d3469e000 of size 1024 next 328 2025-03-01 00:36:43.088049: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d3469e400 of size 1024 next 329 2025-03-01 00:36:43.088058: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d3469e800 of size 1024 next 330 2025-03-01 00:36:43.088066: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d3469ec00 of size 1024 next 331 2025-03-01 00:36:43.088074: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d3469f000 of size 1024 next 332 2025-03-01 00:36:43.088083: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d3469f400 of size 1024 next 335 2025-03-01 00:36:43.088092: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d3469f800 of size 1024 next 336 2025-03-01 00:36:43.088100: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d3469fc00 of size 1024 next 337 2025-03-01 00:36:43.088116: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346a0000 of size 1024 next 338 2025-03-01 00:36:43.088124: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346a0400 of size 1024 next 339 2025-03-01 00:36:43.088133: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346a0800 of size 4096 next 341 2025-03-01 00:36:43.088141: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346a1800 of size 4096 next 342 2025-03-01 00:36:43.088150: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346a2800 of size 4096 next 343 2025-03-01 00:36:43.088158: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346a3800 of size 4096 next 344 2025-03-01 00:36:43.088167: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346a4800 of size 4096 next 345 2025-03-01 00:36:43.088175: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346a5800 of size 1024 next 346 2025-03-01 00:36:43.088184: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346a5c00 of size 1024 next 347 2025-03-01 00:36:43.088192: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346a6000 of size 1024 next 348 2025-03-01 00:36:43.088201: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346a6400 of size 1024 next 349 2025-03-01 00:36:43.088209: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346a6800 of size 1024 next 350 2025-03-01 00:36:43.088218: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346a6c00 of size 1024 next 353 2025-03-01 00:36:43.088226: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346a7000 of size 1024 next 354 2025-03-01 00:36:43.088235: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346a7400 of size 1024 next 355 2025-03-01 00:36:43.088243: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346a7800 of size 1024 next 356 2025-03-01 00:36:43.088252: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346a7c00 of size 1024 next 357 2025-03-01 00:36:43.088260: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346a8000 of size 4096 next 359 2025-03-01 00:36:43.088269: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346a9000 of size 4096 next 360 2025-03-01 00:36:43.088277: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346aa000 of size 4096 next 361 2025-03-01 00:36:43.088285: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346ab000 of size 4096 next 362 2025-03-01 00:36:43.088294: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346ac000 of size 4096 next 363 2025-03-01 00:36:43.088303: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346ad000 of size 1024 next 364 2025-03-01 00:36:43.088311: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346ad400 of size 1024 next 365 2025-03-01 00:36:43.088320: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346ad800 of size 1024 next 366 2025-03-01 00:36:43.088328: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346adc00 of size 1024 next 367 2025-03-01 00:36:43.088337: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346ae000 of size 1024 next 368 2025-03-01 00:36:43.088345: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346ae400 of size 1024 next 371 2025-03-01 00:36:43.088354: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346ae800 of size 1024 next 372 2025-03-01 00:36:43.088362: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346aec00 of size 1024 next 373 2025-03-01 00:36:43.088371: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346af000 of size 1024 next 374 2025-03-01 00:36:43.088380: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346af400 of size 1024 next 375 2025-03-01 00:36:43.088388: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346af800 of size 4096 next 377 2025-03-01 00:36:43.088403: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346b0800 of size 4096 next 378 2025-03-01 00:36:43.088412: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346b1800 of size 4096 next 379 2025-03-01 00:36:43.088421: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346b2800 of size 4096 next 380 2025-03-01 00:36:43.088429: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346b3800 of size 4096 next 381 2025-03-01 00:36:43.088438: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346b4800 of size 1024 next 382 2025-03-01 00:36:43.088447: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346b4c00 of size 1024 next 383 2025-03-01 00:36:43.088455: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346b5000 of size 1024 next 384 2025-03-01 00:36:43.088464: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346b5400 of size 1024 next 385 2025-03-01 00:36:43.088472: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346b5800 of size 1024 next 386 2025-03-01 00:36:43.088481: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346b5c00 of size 1024 next 389 2025-03-01 00:36:43.088490: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346b6000 of size 1024 next 390 2025-03-01 00:36:43.088498: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346b6400 of size 1024 next 391 2025-03-01 00:36:43.088507: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346b6800 of size 1024 next 392 2025-03-01 00:36:43.088516: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346b6c00 of size 1024 next 393 2025-03-01 00:36:43.088524: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346b7000 of size 4096 next 395 2025-03-01 00:36:43.088533: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346b8000 of size 4096 next 396 2025-03-01 00:36:43.088541: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346b9000 of size 4096 next 397 2025-03-01 00:36:43.088549: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346ba000 of size 4096 next 398 2025-03-01 00:36:43.088558: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346bb000 of size 4096 next 399 2025-03-01 00:36:43.088565: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346bc000 of size 1024 next 400 2025-03-01 00:36:43.088572: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346bc400 of size 1024 next 401 2025-03-01 00:36:43.088579: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346bc800 of size 1024 next 402 2025-03-01 00:36:43.088586: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346bcc00 of size 1024 next 403 2025-03-01 00:36:43.088593: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346bd000 of size 1024 next 404 2025-03-01 00:36:43.088599: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346bd400 of size 1024 next 407 2025-03-01 00:36:43.088606: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346bd800 of size 1024 next 408 2025-03-01 00:36:43.088613: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346bdc00 of size 1024 next 409 2025-03-01 00:36:43.088620: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346be000 of size 1024 next 410 2025-03-01 00:36:43.088626: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346be400 of size 1024 next 411 2025-03-01 00:36:43.088633: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346be800 of size 4096 next 413 2025-03-01 00:36:43.088640: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346bf800 of size 4096 next 414 2025-03-01 00:36:43.088647: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346c0800 of size 4096 next 415 2025-03-01 00:36:43.088660: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346c1800 of size 4096 next 416 2025-03-01 00:36:43.088667: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346c2800 of size 4096 next 417 2025-03-01 00:36:43.088674: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346c3800 of size 1024 next 418 2025-03-01 00:36:43.088680: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346c3c00 of size 1024 next 419 2025-03-01 00:36:43.088687: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346c4000 of size 1024 next 420 2025-03-01 00:36:43.088694: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346c4400 of size 1024 next 421 2025-03-01 00:36:43.088701: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346c4800 of size 1024 next 422 2025-03-01 00:36:43.088707: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346c4c00 of size 1024 next 425 2025-03-01 00:36:43.088714: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346c5000 of size 1024 next 426 2025-03-01 00:36:43.088721: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346c5400 of size 1024 next 427 2025-03-01 00:36:43.088727: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346c5800 of size 1024 next 428 2025-03-01 00:36:43.088734: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346c5c00 of size 1024 next 429 2025-03-01 00:36:43.088741: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346c6000 of size 4096 next 431 2025-03-01 00:36:43.088748: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346c7000 of size 4096 next 432 2025-03-01 00:36:43.088754: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346c8000 of size 4096 next 433 2025-03-01 00:36:43.088761: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346c9000 of size 4096 next 434 2025-03-01 00:36:43.088768: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346ca000 of size 4096 next 435 2025-03-01 00:36:43.088774: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346cb000 of size 1024 next 436 2025-03-01 00:36:43.088781: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346cb400 of size 1024 next 437 2025-03-01 00:36:43.088788: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346cb800 of size 1024 next 438 2025-03-01 00:36:43.088795: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346cbc00 of size 1024 next 103 2025-03-01 00:36:43.088802: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d346cc000 of size 262144 next 102 2025-03-01 00:36:43.088809: I tensorflow/core/common_runtime/bfc_allocator.cc:990] Free at 7f0d3470c000 of size 999424 next 18446744073709551615 2025-03-01 00:36:43.088816: I tensorflow/core/common_runtime/bfc_allocator.cc:970] Next region of size 4194304 2025-03-01 00:36:43.088823: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34800000 of size 589824 next 96 2025-03-01 00:36:43.088829: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34890000 of size 262144 next 117 2025-03-01 00:36:43.088836: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348d0000 of size 1024 next 439 2025-03-01 00:36:43.088843: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348d0400 of size 1024 next 442 2025-03-01 00:36:43.088850: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348d0800 of size 1024 next 443 2025-03-01 00:36:43.088856: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348d0c00 of size 1024 next 444 2025-03-01 00:36:43.088863: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348d1000 of size 1024 next 445 2025-03-01 00:36:43.088870: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348d1400 of size 1024 next 446 2025-03-01 00:36:43.088882: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348d1800 of size 4096 next 448 2025-03-01 00:36:43.088889: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348d2800 of size 4096 next 449 2025-03-01 00:36:43.088896: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348d3800 of size 4096 next 450 2025-03-01 00:36:43.088902: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348d4800 of size 4096 next 451 2025-03-01 00:36:43.088909: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348d5800 of size 4096 next 452 2025-03-01 00:36:43.088916: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348d6800 of size 1024 next 453 2025-03-01 00:36:43.088923: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348d6c00 of size 1024 next 454 2025-03-01 00:36:43.088929: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348d7000 of size 1024 next 455 2025-03-01 00:36:43.088936: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348d7400 of size 1024 next 456 2025-03-01 00:36:43.088943: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348d7800 of size 1024 next 457 2025-03-01 00:36:43.088949: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348d7c00 of size 1024 next 460 2025-03-01 00:36:43.088956: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348d8000 of size 1024 next 461 2025-03-01 00:36:43.088963: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348d8400 of size 1024 next 462 2025-03-01 00:36:43.088970: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348d8800 of size 1024 next 463 2025-03-01 00:36:43.088976: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348d8c00 of size 1024 next 464 2025-03-01 00:36:43.088983: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348d9000 of size 4096 next 466 2025-03-01 00:36:43.088990: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348da000 of size 4096 next 467 2025-03-01 00:36:43.088997: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348db000 of size 4096 next 468 2025-03-01 00:36:43.089003: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348dc000 of size 4096 next 469 2025-03-01 00:36:43.089010: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348dd000 of size 4096 next 470 2025-03-01 00:36:43.089017: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348de000 of size 1024 next 471 2025-03-01 00:36:43.089024: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348de400 of size 1024 next 472 2025-03-01 00:36:43.089030: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348de800 of size 1024 next 473 2025-03-01 00:36:43.089037: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348dec00 of size 1024 next 474 2025-03-01 00:36:43.089044: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348df000 of size 1024 next 475 2025-03-01 00:36:43.089050: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348df400 of size 1024 next 478 2025-03-01 00:36:43.089057: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348df800 of size 1024 next 479 2025-03-01 00:36:43.089064: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348dfc00 of size 1024 next 480 2025-03-01 00:36:43.089071: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348e0000 of size 1024 next 481 2025-03-01 00:36:43.089077: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348e0400 of size 1024 next 482 2025-03-01 00:36:43.089084: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348e0800 of size 4096 next 484 2025-03-01 00:36:43.089091: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348e1800 of size 4096 next 485 2025-03-01 00:36:43.089102: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348e2800 of size 4096 next 486 2025-03-01 00:36:43.089110: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348e3800 of size 4096 next 487 2025-03-01 00:36:43.089116: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348e4800 of size 4096 next 488 2025-03-01 00:36:43.089123: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348e5800 of size 1024 next 489 2025-03-01 00:36:43.089130: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348e5c00 of size 1024 next 490 2025-03-01 00:36:43.089136: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348e6000 of size 1024 next 491 2025-03-01 00:36:43.089143: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348e6400 of size 1024 next 492 2025-03-01 00:36:43.089150: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348e6800 of size 1024 next 493 2025-03-01 00:36:43.089157: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348e6c00 of size 1024 next 496 2025-03-01 00:36:43.089163: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348e7000 of size 1024 next 497 2025-03-01 00:36:43.089170: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348e7400 of size 1024 next 498 2025-03-01 00:36:43.089177: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348e7800 of size 1024 next 499 2025-03-01 00:36:43.089183: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348e7c00 of size 1024 next 500 2025-03-01 00:36:43.089190: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348e8000 of size 4096 next 502 2025-03-01 00:36:43.089197: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348e9000 of size 4096 next 503 2025-03-01 00:36:43.089204: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348ea000 of size 4096 next 504 2025-03-01 00:36:43.089210: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348eb000 of size 4096 next 505 2025-03-01 00:36:43.089217: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348ec000 of size 4096 next 506 2025-03-01 00:36:43.089224: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348ed000 of size 1024 next 507 2025-03-01 00:36:43.089231: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348ed400 of size 1024 next 508 2025-03-01 00:36:43.089237: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348ed800 of size 1024 next 509 2025-03-01 00:36:43.089244: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348edc00 of size 1024 next 510 2025-03-01 00:36:43.089251: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348ee000 of size 1024 next 511 2025-03-01 00:36:43.089257: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348ee400 of size 1024 next 514 2025-03-01 00:36:43.089264: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348ee800 of size 1024 next 515 2025-03-01 00:36:43.089271: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348eec00 of size 1024 next 516 2025-03-01 00:36:43.089278: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348ef000 of size 1024 next 517 2025-03-01 00:36:43.089285: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348ef400 of size 1024 next 518 2025-03-01 00:36:43.089291: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348ef800 of size 4096 next 520 2025-03-01 00:36:43.089298: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348f0800 of size 4096 next 521 2025-03-01 00:36:43.089305: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348f1800 of size 4096 next 522 2025-03-01 00:36:43.089311: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348f2800 of size 4096 next 523 2025-03-01 00:36:43.089318: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348f3800 of size 4096 next 524 2025-03-01 00:36:43.089330: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348f4800 of size 1024 next 525 2025-03-01 00:36:43.089336: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348f4c00 of size 1024 next 526 2025-03-01 00:36:43.089343: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348f5000 of size 1024 next 527 2025-03-01 00:36:43.089350: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348f5400 of size 1024 next 528 2025-03-01 00:36:43.089357: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348f5800 of size 1024 next 529 2025-03-01 00:36:43.089363: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348f5c00 of size 1024 next 532 2025-03-01 00:36:43.089370: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348f6000 of size 1024 next 533 2025-03-01 00:36:43.089377: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348f6400 of size 1024 next 534 2025-03-01 00:36:43.089384: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348f6800 of size 1024 next 535 2025-03-01 00:36:43.089390: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348f6c00 of size 1024 next 536 2025-03-01 00:36:43.089397: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348f7000 of size 4096 next 538 2025-03-01 00:36:43.089404: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348f8000 of size 4096 next 539 2025-03-01 00:36:43.089410: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348f9000 of size 4096 next 540 2025-03-01 00:36:43.089417: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348fa000 of size 4096 next 541 2025-03-01 00:36:43.089424: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348fb000 of size 4096 next 542 2025-03-01 00:36:43.089430: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348fc000 of size 1024 next 543 2025-03-01 00:36:43.089437: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348fc400 of size 1024 next 544 2025-03-01 00:36:43.089444: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348fc800 of size 1024 next 545 2025-03-01 00:36:43.089451: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348fcc00 of size 1024 next 546 2025-03-01 00:36:43.089457: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348fd000 of size 1024 next 547 2025-03-01 00:36:43.089464: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348fd400 of size 1024 next 550 2025-03-01 00:36:43.089471: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348fd800 of size 1024 next 551 2025-03-01 00:36:43.089478: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348fdc00 of size 1024 next 552 2025-03-01 00:36:43.089484: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348fe000 of size 1024 next 553 2025-03-01 00:36:43.089491: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348fe400 of size 1024 next 554 2025-03-01 00:36:43.089498: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348fe800 of size 4096 next 556 2025-03-01 00:36:43.089504: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d348ff800 of size 4096 next 557 2025-03-01 00:36:43.089511: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34900800 of size 4096 next 558 2025-03-01 00:36:43.089518: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34901800 of size 4096 next 559 2025-03-01 00:36:43.089525: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34902800 of size 4096 next 560 2025-03-01 00:36:43.089531: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34903800 of size 1024 next 561 2025-03-01 00:36:43.089538: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34903c00 of size 1024 next 562 2025-03-01 00:36:43.089552: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34904000 of size 1024 next 563 2025-03-01 00:36:43.089562: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34904400 of size 1024 next 564 2025-03-01 00:36:43.089571: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34904800 of size 1024 next 565 2025-03-01 00:36:43.089579: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34904c00 of size 1024 next 568 2025-03-01 00:36:43.089587: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34905000 of size 1024 next 569 2025-03-01 00:36:43.089595: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34905400 of size 1024 next 570 2025-03-01 00:36:43.089604: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34905800 of size 1024 next 571 2025-03-01 00:36:43.089613: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34905c00 of size 1024 next 572 2025-03-01 00:36:43.089622: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34906000 of size 4096 next 574 2025-03-01 00:36:43.089632: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34907000 of size 4096 next 575 2025-03-01 00:36:43.089641: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34908000 of size 4096 next 576 2025-03-01 00:36:43.089650: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34909000 of size 4096 next 577 2025-03-01 00:36:43.089660: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d3490a000 of size 4096 next 578 2025-03-01 00:36:43.089669: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d3490b000 of size 1024 next 579 2025-03-01 00:36:43.089678: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d3490b400 of size 1024 next 580 2025-03-01 00:36:43.089687: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d3490b800 of size 1024 next 581 2025-03-01 00:36:43.089696: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d3490bc00 of size 1024 next 582 2025-03-01 00:36:43.089705: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d3490c000 of size 1024 next 583 2025-03-01 00:36:43.089716: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d3490c400 of size 1024 next 586 2025-03-01 00:36:43.089725: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d3490c800 of size 1024 next 587 2025-03-01 00:36:43.089733: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d3490cc00 of size 1024 next 588 2025-03-01 00:36:43.089742: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d3490d000 of size 1024 next 589 2025-03-01 00:36:43.089751: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d3490d400 of size 1024 next 590 2025-03-01 00:36:43.089760: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d3490d800 of size 4096 next 592 2025-03-01 00:36:43.089769: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d3490e800 of size 6144 next 112 2025-03-01 00:36:43.089779: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34910000 of size 524288 next 111 2025-03-01 00:36:43.089788: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34990000 of size 262144 next 135 2025-03-01 00:36:43.089798: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d349d0000 of size 327680 next 124 2025-03-01 00:36:43.089807: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34a20000 of size 589824 next 123 2025-03-01 00:36:43.089817: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34ab0000 of size 262144 next 152 2025-03-01 00:36:43.089828: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34af0000 of size 327680 next 142 2025-03-01 00:36:43.089837: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34b40000 of size 786432 next 18446744073709551615 2025-03-01 00:36:43.089854: I tensorflow/core/common_runtime/bfc_allocator.cc:970] Next region of size 8388608 2025-03-01 00:36:43.089863: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34c00000 of size 4096 next 593 2025-03-01 00:36:43.089872: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34c01000 of size 4096 next 594 2025-03-01 00:36:43.089881: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34c02000 of size 4096 next 595 2025-03-01 00:36:43.089890: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34c03000 of size 2048 next 598 2025-03-01 00:36:43.089899: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34c03800 of size 2048 next 599 2025-03-01 00:36:43.089908: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34c04000 of size 2048 next 600 2025-03-01 00:36:43.089918: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34c04800 of size 2048 next 601 2025-03-01 00:36:43.089928: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34c05000 of size 2048 next 602 2025-03-01 00:36:43.089939: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34c05800 of size 256 next 605 2025-03-01 00:36:43.089947: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34c05900 of size 256 next 606 2025-03-01 00:36:43.089955: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34c05a00 of size 2048 next 604 2025-03-01 00:36:43.089964: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34c06200 of size 2048 next 609 2025-03-01 00:36:43.089972: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34c06a00 of size 2048 next 610 2025-03-01 00:36:43.089980: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34c07200 of size 2048 next 611 2025-03-01 00:36:43.089989: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34c07a00 of size 2048 next 612 2025-03-01 00:36:43.089998: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34c08200 of size 256 next 614 2025-03-01 00:36:43.090006: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34c08300 of size 256 next 615 2025-03-01 00:36:43.090014: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34c08400 of size 8192 next 613 2025-03-01 00:36:43.090023: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34c0a400 of size 8192 next 616 2025-03-01 00:36:43.090032: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34c0c400 of size 8192 next 618 2025-03-01 00:36:43.090040: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34c0e400 of size 8192 next 619 2025-03-01 00:36:43.090048: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34c10400 of size 8192 next 620 2025-03-01 00:36:43.090057: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34c12400 of size 256 next 621 2025-03-01 00:36:43.090066: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34c12500 of size 256 next 622 2025-03-01 00:36:43.090074: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34c12600 of size 8192 next 623 2025-03-01 00:36:43.090083: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34c14600 of size 8192 next 625 2025-03-01 00:36:43.090092: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34c16600 of size 8192 next 626 2025-03-01 00:36:43.090103: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34c18600 of size 8192 next 627 2025-03-01 00:36:43.090112: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34c1a600 of size 8192 next 628 2025-03-01 00:36:43.090121: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34c1c600 of size 2048 next 629 2025-03-01 00:36:43.090128: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34c1ce00 of size 2048 next 631 2025-03-01 00:36:43.090148: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34c1d600 of size 2048 next 632 2025-03-01 00:36:43.090157: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34c1de00 of size 2048 next 633 2025-03-01 00:36:43.090166: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34c1e600 of size 2048 next 634 2025-03-01 00:36:43.090175: I tensorflow/core/common_runtime/bfc_allocator.cc:990] Free at 7f0d34c1ee00 of size 463360 next 160 2025-03-01 00:36:43.090185: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34c90000 of size 589824 next 158 2025-03-01 00:36:43.090194: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34d20000 of size 524288 next 171 2025-03-01 00:36:43.090202: I tensorflow/core/common_runtime/bfc_allocator.cc:990] Free at 7f0d34da0000 of size 1048576 next 222 2025-03-01 00:36:43.090210: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34ea0000 of size 1048576 next 190 2025-03-01 00:36:43.090218: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d34fa0000 of size 1048576 next 189 2025-03-01 00:36:43.090227: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d350a0000 of size 1048576 next 203 2025-03-01 00:36:43.090236: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d351a0000 of size 1048576 next 251 2025-03-01 00:36:43.090245: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0d352a0000 of size 1441792 next 18446744073709551615 2025-03-01 00:36:43.090253: I tensorflow/core/common_runtime/bfc_allocator.cc:970] Next region of size 1048576 2025-03-01 00:36:43.090261: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee00000 of size 1280 next 1 2025-03-01 00:36:43.090270: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee00500 of size 256 next 5 2025-03-01 00:36:43.090279: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee00600 of size 256 next 8 2025-03-01 00:36:43.090287: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee00700 of size 256 next 9 2025-03-01 00:36:43.090296: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee00800 of size 256 next 10 2025-03-01 00:36:43.090305: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee00900 of size 256 next 11 2025-03-01 00:36:43.090314: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee00a00 of size 256 next 12 2025-03-01 00:36:43.090322: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee00b00 of size 256 next 13 2025-03-01 00:36:43.090331: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee00c00 of size 256 next 17 2025-03-01 00:36:43.090340: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee00d00 of size 256 next 19 2025-03-01 00:36:43.090348: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee00e00 of size 256 next 20 2025-03-01 00:36:43.090356: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee00f00 of size 256 next 21 2025-03-01 00:36:43.090365: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee01000 of size 256 next 22 2025-03-01 00:36:43.090375: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee01100 of size 256 next 24 2025-03-01 00:36:43.090384: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee01200 of size 256 next 25 2025-03-01 00:36:43.090393: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee01300 of size 256 next 23 2025-03-01 00:36:43.090402: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee01400 of size 256 next 28 2025-03-01 00:36:43.090410: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee01500 of size 256 next 29 2025-03-01 00:36:43.090421: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee01600 of size 256 next 30 2025-03-01 00:36:43.090430: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee01700 of size 256 next 31 2025-03-01 00:36:43.090446: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee01800 of size 256 next 33 2025-03-01 00:36:43.090455: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee01900 of size 256 next 34 2025-03-01 00:36:43.090463: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee01a00 of size 1024 next 32 2025-03-01 00:36:43.090473: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee01e00 of size 1024 next 37 2025-03-01 00:36:43.090482: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee02200 of size 1024 next 38 2025-03-01 00:36:43.090491: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee02600 of size 1024 next 39 2025-03-01 00:36:43.090500: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee02a00 of size 1024 next 40 2025-03-01 00:36:43.090508: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee02e00 of size 1024 next 41 2025-03-01 00:36:43.090517: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee03200 of size 1024 next 43 2025-03-01 00:36:43.090526: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee03600 of size 1024 next 44 2025-03-01 00:36:43.090535: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee03a00 of size 1024 next 45 2025-03-01 00:36:43.090543: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee03e00 of size 1024 next 46 2025-03-01 00:36:43.090552: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee04200 of size 256 next 48 2025-03-01 00:36:43.090560: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee04300 of size 256 next 49 2025-03-01 00:36:43.090570: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee04400 of size 256 next 50 2025-03-01 00:36:43.090578: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee04500 of size 256 next 51 2025-03-01 00:36:43.090587: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee04600 of size 256 next 52 2025-03-01 00:36:43.090596: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee04700 of size 256 next 53 2025-03-01 00:36:43.090605: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee04800 of size 256 next 56 2025-03-01 00:36:43.090615: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee04900 of size 256 next 57 2025-03-01 00:36:43.090623: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee04a00 of size 256 next 58 2025-03-01 00:36:43.090631: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee04b00 of size 256 next 14 2025-03-01 00:36:43.090641: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee04c00 of size 256 next 15 2025-03-01 00:36:43.090650: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee04d00 of size 256 next 16 2025-03-01 00:36:43.090658: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee04e00 of size 1024 next 60 2025-03-01 00:36:43.090666: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee05200 of size 1024 next 61 2025-03-01 00:36:43.090673: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee05600 of size 1024 next 62 2025-03-01 00:36:43.090682: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee05a00 of size 1024 next 63 2025-03-01 00:36:43.090692: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee05e00 of size 1024 next 64 2025-03-01 00:36:43.090702: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee06200 of size 256 next 66 2025-03-01 00:36:43.090712: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee06300 of size 256 next 67 2025-03-01 00:36:43.090720: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee06400 of size 256 next 68 2025-03-01 00:36:43.090736: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee06500 of size 256 next 69 2025-03-01 00:36:43.090746: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee06600 of size 256 next 70 2025-03-01 00:36:43.090755: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee06700 of size 256 next 73 2025-03-01 00:36:43.090764: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee06800 of size 256 next 74 2025-03-01 00:36:43.090772: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee06900 of size 256 next 75 2025-03-01 00:36:43.090780: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee06a00 of size 256 next 76 2025-03-01 00:36:43.090788: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee06b00 of size 256 next 77 2025-03-01 00:36:43.090797: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee06c00 of size 1024 next 79 2025-03-01 00:36:43.090805: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee07000 of size 1024 next 80 2025-03-01 00:36:43.090814: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee07400 of size 1024 next 81 2025-03-01 00:36:43.090821: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee07800 of size 1024 next 82 2025-03-01 00:36:43.090830: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee07c00 of size 1024 next 83 2025-03-01 00:36:43.090839: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee08000 of size 256 next 85 2025-03-01 00:36:43.090848: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee08100 of size 256 next 86 2025-03-01 00:36:43.090857: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee08200 of size 512 next 84 2025-03-01 00:36:43.090866: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee08400 of size 512 next 88 2025-03-01 00:36:43.090875: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee08600 of size 512 next 89 2025-03-01 00:36:43.090885: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee08800 of size 512 next 90 2025-03-01 00:36:43.090894: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee08a00 of size 512 next 91 2025-03-01 00:36:43.090944: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee08c00 of size 256 next 93 2025-03-01 00:36:43.090955: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee08d00 of size 256 next 94 2025-03-01 00:36:43.090964: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee08e00 of size 512 next 92 2025-03-01 00:36:43.090975: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee09000 of size 512 next 97 2025-03-01 00:36:43.090985: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee09200 of size 512 next 98 2025-03-01 00:36:43.090993: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee09400 of size 512 next 99 2025-03-01 00:36:43.091002: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee09600 of size 512 next 2 2025-03-01 00:36:43.091013: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee09800 of size 256 next 3 2025-03-01 00:36:43.091024: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee09900 of size 256 next 4 2025-03-01 00:36:43.091034: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee09a00 of size 16384 next 18 2025-03-01 00:36:43.091045: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee0da00 of size 256 next 100 2025-03-01 00:36:43.091055: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee0db00 of size 256 next 101 2025-03-01 00:36:43.091065: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee0dc00 of size 2048 next 104 2025-03-01 00:36:43.091075: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee0e400 of size 2048 next 105 2025-03-01 00:36:43.091095: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee0ec00 of size 2048 next 106 2025-03-01 00:36:43.091106: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee0f400 of size 2048 next 107 2025-03-01 00:36:43.091117: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee0fc00 of size 2048 next 108 2025-03-01 00:36:43.091127: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee10400 of size 256 next 109 2025-03-01 00:36:43.091138: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee10500 of size 256 next 110 2025-03-01 00:36:43.091148: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee10600 of size 2048 next 113 2025-03-01 00:36:43.091158: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee10e00 of size 2048 next 114 2025-03-01 00:36:43.091168: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee11600 of size 2048 next 115 2025-03-01 00:36:43.091177: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee11e00 of size 2048 next 116 2025-03-01 00:36:43.091187: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee12600 of size 2048 next 6 2025-03-01 00:36:43.091198: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee12e00 of size 37632 next 7 2025-03-01 00:36:43.091208: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee1c100 of size 512 next 118 2025-03-01 00:36:43.091218: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee1c300 of size 512 next 119 2025-03-01 00:36:43.091228: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee1c500 of size 512 next 120 2025-03-01 00:36:43.091238: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee1c700 of size 512 next 121 2025-03-01 00:36:43.091249: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee1c900 of size 512 next 122 2025-03-01 00:36:43.091259: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee1cb00 of size 512 next 125 2025-03-01 00:36:43.091269: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee1cd00 of size 512 next 126 2025-03-01 00:36:43.091279: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee1cf00 of size 512 next 127 2025-03-01 00:36:43.091289: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee1d100 of size 512 next 128 2025-03-01 00:36:43.091299: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee1d300 of size 512 next 129 2025-03-01 00:36:43.091309: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee1d500 of size 2048 next 130 2025-03-01 00:36:43.091318: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee1dd00 of size 2048 next 131 2025-03-01 00:36:43.091328: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee1e500 of size 2048 next 132 2025-03-01 00:36:43.091338: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee1ed00 of size 2048 next 133 2025-03-01 00:36:43.091348: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee1f500 of size 2048 next 134 2025-03-01 00:36:43.091359: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee1fd00 of size 512 next 136 2025-03-01 00:36:43.091368: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee1ff00 of size 512 next 137 2025-03-01 00:36:43.091378: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee20100 of size 512 next 138 2025-03-01 00:36:43.091388: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee20300 of size 512 next 139 2025-03-01 00:36:43.091398: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee20500 of size 512 next 140 2025-03-01 00:36:43.091408: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee20700 of size 512 next 141 2025-03-01 00:36:43.091426: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee20900 of size 512 next 143 2025-03-01 00:36:43.091436: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee20b00 of size 512 next 144 2025-03-01 00:36:43.091446: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee20d00 of size 512 next 145 2025-03-01 00:36:43.091456: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee20f00 of size 512 next 146 2025-03-01 00:36:43.091467: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee21100 of size 2048 next 147 2025-03-01 00:36:43.091476: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee21900 of size 2048 next 148 2025-03-01 00:36:43.091486: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee22100 of size 2048 next 149 2025-03-01 00:36:43.091496: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee22900 of size 2048 next 150 2025-03-01 00:36:43.091506: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee23100 of size 2048 next 151 2025-03-01 00:36:43.091516: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee23900 of size 512 next 153 2025-03-01 00:36:43.091526: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee23b00 of size 512 next 154 2025-03-01 00:36:43.091536: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee23d00 of size 512 next 155 2025-03-01 00:36:43.091546: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee23f00 of size 512 next 156 2025-03-01 00:36:43.091556: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee24100 of size 512 next 157 2025-03-01 00:36:43.091565: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee24300 of size 512 next 161 2025-03-01 00:36:43.091574: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee24500 of size 512 next 162 2025-03-01 00:36:43.091584: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee24700 of size 512 next 163 2025-03-01 00:36:43.091594: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee24900 of size 512 next 164 2025-03-01 00:36:43.091603: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee24b00 of size 512 next 165 2025-03-01 00:36:43.091612: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee24d00 of size 2048 next 166 2025-03-01 00:36:43.091622: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee25500 of size 2048 next 167 2025-03-01 00:36:43.091632: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee25d00 of size 2048 next 168 2025-03-01 00:36:43.091641: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee26500 of size 2048 next 169 2025-03-01 00:36:43.091650: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee26d00 of size 2048 next 170 2025-03-01 00:36:43.091658: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee27500 of size 1024 next 172 2025-03-01 00:36:43.091667: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee27900 of size 1024 next 173 2025-03-01 00:36:43.091675: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee27d00 of size 1024 next 174 2025-03-01 00:36:43.091682: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee28100 of size 1024 next 175 2025-03-01 00:36:43.091689: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee28500 of size 1024 next 176 2025-03-01 00:36:43.091696: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee28900 of size 256 next 178 2025-03-01 00:36:43.091703: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee28a00 of size 256 next 179 2025-03-01 00:36:43.091710: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee28b00 of size 1024 next 177 2025-03-01 00:36:43.091717: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee28f00 of size 1024 next 182 2025-03-01 00:36:43.091730: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee29300 of size 1024 next 183 2025-03-01 00:36:43.091737: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee29700 of size 1024 next 184 2025-03-01 00:36:43.091744: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee29b00 of size 1024 next 185 2025-03-01 00:36:43.091751: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee29f00 of size 256 next 187 2025-03-01 00:36:43.091758: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee2a000 of size 256 next 188 2025-03-01 00:36:43.091765: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee2a100 of size 4096 next 186 2025-03-01 00:36:43.091772: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee2b100 of size 4096 next 42 2025-03-01 00:36:43.091778: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee2c100 of size 65536 next 36 2025-03-01 00:36:43.091785: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee3c100 of size 65536 next 35 2025-03-01 00:36:43.091792: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee4c100 of size 4096 next 235 2025-03-01 00:36:43.091799: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee4d100 of size 4096 next 236 2025-03-01 00:36:43.091805: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee4e100 of size 4096 next 237 2025-03-01 00:36:43.091812: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee4f100 of size 4096 next 238 2025-03-01 00:36:43.091819: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee50100 of size 1024 next 239 2025-03-01 00:36:43.091826: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee50500 of size 1024 next 240 2025-03-01 00:36:43.091832: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee50900 of size 1024 next 241 2025-03-01 00:36:43.091839: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee50d00 of size 1024 next 242 2025-03-01 00:36:43.091846: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee51100 of size 1024 next 243 2025-03-01 00:36:43.091853: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee51500 of size 1024 next 246 2025-03-01 00:36:43.091859: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee51900 of size 1024 next 247 2025-03-01 00:36:43.091866: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee51d00 of size 1024 next 248 2025-03-01 00:36:43.091873: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee52100 of size 1024 next 249 2025-03-01 00:36:43.091879: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee52500 of size 1024 next 250 2025-03-01 00:36:43.091886: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee52900 of size 4096 next 252 2025-03-01 00:36:43.091893: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee53900 of size 4096 next 253 2025-03-01 00:36:43.091900: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee54900 of size 4096 next 254 2025-03-01 00:36:43.091906: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee55900 of size 4096 next 255 2025-03-01 00:36:43.091913: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee56900 of size 4096 next 256 2025-03-01 00:36:43.091920: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee57900 of size 1024 next 257 2025-03-01 00:36:43.091927: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee57d00 of size 1024 next 258 2025-03-01 00:36:43.091934: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee58100 of size 1024 next 259 2025-03-01 00:36:43.091940: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee58500 of size 1024 next 260 2025-03-01 00:36:43.091953: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee58900 of size 1024 next 261 2025-03-01 00:36:43.091960: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee58d00 of size 1024 next 264 2025-03-01 00:36:43.091967: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee59100 of size 1024 next 265 2025-03-01 00:36:43.091973: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee59500 of size 1024 next 266 2025-03-01 00:36:43.091980: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee59900 of size 1024 next 267 2025-03-01 00:36:43.091987: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee59d00 of size 1024 next 268 2025-03-01 00:36:43.091994: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee5a100 of size 4096 next 270 2025-03-01 00:36:43.092000: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee5b100 of size 4096 next 271 2025-03-01 00:36:43.092007: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee5c100 of size 4096 next 272 2025-03-01 00:36:43.092014: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee5d100 of size 4096 next 273 2025-03-01 00:36:43.092021: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee5e100 of size 4096 next 274 2025-03-01 00:36:43.092027: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee5f100 of size 1024 next 275 2025-03-01 00:36:43.092034: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee5f500 of size 1024 next 276 2025-03-01 00:36:43.092041: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee5f900 of size 1024 next 277 2025-03-01 00:36:43.092047: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee5fd00 of size 1024 next 278 2025-03-01 00:36:43.092054: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee60100 of size 1024 next 279 2025-03-01 00:36:43.092061: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee60500 of size 1024 next 282 2025-03-01 00:36:43.092068: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee60900 of size 1024 next 283 2025-03-01 00:36:43.092074: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee60d00 of size 1024 next 284 2025-03-01 00:36:43.092081: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee61100 of size 1024 next 285 2025-03-01 00:36:43.092088: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee61500 of size 1024 next 286 2025-03-01 00:36:43.092095: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee61900 of size 4096 next 288 2025-03-01 00:36:43.092101: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee62900 of size 6144 next 27 2025-03-01 00:36:43.092108: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee64100 of size 147456 next 26 2025-03-01 00:36:43.092115: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee88100 of size 65536 next 47 2025-03-01 00:36:43.092122: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6ee98100 of size 65536 next 59 2025-03-01 00:36:43.092129: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6eea8100 of size 65536 next 65 2025-03-01 00:36:43.092137: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f0e6eeb8100 of size 294656 next 18446744073709551615 2025-03-01 00:36:43.092143: I tensorflow/core/common_runtime/bfc_allocator.cc:995] Summary of in-use Chunks by size: 2025-03-01 00:36:43.092156: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 65 Chunks of size 256 totalling 16.2KiB 2025-03-01 00:36:43.092164: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 40 Chunks of size 512 totalling 20.0KiB 2025-03-01 00:36:43.092172: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 250 Chunks of size 1024 totalling 250.0KiB 2025-03-01 00:36:43.092185: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 1280 totalling 1.2KiB 2025-03-01 00:36:43.092193: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 40 Chunks of size 2048 totalling 80.0KiB 2025-03-01 00:36:43.092200: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 117 Chunks of size 4096 totalling 468.0KiB 2025-03-01 00:36:43.092208: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 2 Chunks of size 6144 totalling 12.0KiB 2025-03-01 00:36:43.092216: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 7680 totalling 7.5KiB 2025-03-01 00:36:43.092223: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 10 Chunks of size 8192 totalling 80.0KiB 2025-03-01 00:36:43.092231: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 16384 totalling 16.0KiB 2025-03-01 00:36:43.092238: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 37632 totalling 36.8KiB 2025-03-01 00:36:43.092247: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 6 Chunks of size 65536 totalling 384.0KiB 2025-03-01 00:36:43.092258: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 131072 totalling 128.0KiB 2025-03-01 00:36:43.092268: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 3 Chunks of size 147456 totalling 432.0KiB 2025-03-01 00:36:43.092276: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 4 Chunks of size 262144 totalling 1.00MiB 2025-03-01 00:36:43.092284: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 294656 totalling 287.8KiB 2025-03-01 00:36:43.092292: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 2 Chunks of size 327680 totalling 640.0KiB 2025-03-01 00:36:43.092299: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 2 Chunks of size 524288 totalling 1.00MiB 2025-03-01 00:36:43.092307: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 3 Chunks of size 589824 totalling 1.69MiB 2025-03-01 00:36:43.092314: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 786432 totalling 768.0KiB 2025-03-01 00:36:43.092322: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 25 Chunks of size 1048576 totalling 25.00MiB 2025-03-01 00:36:43.092329: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 18 Chunks of size 1310720 totalling 22.50MiB 2025-03-01 00:36:43.092337: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 1441792 totalling 1.38MiB 2025-03-01 00:36:43.092344: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 1835008 totalling 1.75MiB 2025-03-01 00:36:43.092352: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 2 Chunks of size 2097152 totalling 4.00MiB 2025-03-01 00:36:43.092359: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 23 Chunks of size 2359296 totalling 51.75MiB 2025-03-01 00:36:43.092367: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 4194304 totalling 4.00MiB 2025-03-01 00:36:43.092374: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 6160384 totalling 5.88MiB 2025-03-01 00:36:43.092381: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 9437184 totalling 9.00MiB 2025-03-01 00:36:43.092389: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 10485760 totalling 10.00MiB 2025-03-01 00:36:43.092397: I tensorflow/core/common_runtime/bfc_allocator.cc:1002] Sum Total of in-use chunks: 142.48MiB 2025-03-01 00:36:43.092404: I tensorflow/core/common_runtime/bfc_allocator.cc:1004] total_region_allocated_bytes_: 176029696 memory_limit_: 176029696 available bytes: 0 curr_region_allocation_bytes_: 268435456 2025-03-01 00:36:43.092415: I tensorflow/core/common_runtime/bfc_allocator.cc:1010] Stats: Limit: 176029696 InUse: 149401088 MaxInUse: 161932800 NumAllocs: 2110 MaxAllocSize: 10485760 2025-03-01 00:36:43.092436: W tensorflow/core/common_runtime/bfc_allocator.cc:439] ____***************_**************************************_**_****************************_********* 2025-03-01 00:36:43.092492: W tensorflow/core/framework/op_kernel.cc:1753] OP_REQUIRES failed at random_op.cc:77 : Resource exhausted: OOM when allocating tensor with shape[3,3,512,512] and type float on /job:localhost/replica:0/task:0/device:GPU:0 by allocator GPU_0_bfc RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 Exception in mask_detect : OOM when allocating tensor with shape[3,3,512,512] and type float on /job:localhost/replica:0/task:0/device:GPU:0 by allocator GPU_0_bfc [Op:RandomUniform] we want to redo the detection Using TensorFlow backend. max_time_sub_proc : 3600 erreur pendant la detection Useless call to update_current_state in case -12 caffe_path_current : About to save ! 1 Inside saveOutput : final : True verbose : False eke 12-6-18 : saveMask need to be cleaned for new output ! ERROR : mask output needs to be a dictionnary now ! No output to save, continue without doing anything ! save missing photos in datou_result : After save, about to update current ! datou_cur_ids : [] len(datou.list_steps) : 1 output : -12 ERROR : 'int' object is not subscriptable reconnect to base ! warning , we can't find thcl infos in json_data warning , we can't find pdt infos in json_data #&_# TEST FAILED #&_# : tests/mask_test #&_# Error : invalid literal for int() with base 10: "'int' object is not subscriptable" /home/admin/workarea/git/Velours/python/tests/python_tests.py refs/heads/master_3bb8fc9eb89f6e73213a93d2f1429765ec1e113a SQL :INSERT INTO MTRAdmin.monitor_sys (name, type, server, version_code, result_str, result_bool, lien , test_group ,test_name) VALUES ('python_test3','1','marlene','refs/heads/master_3bb8fc9eb89f6e73213a93d2f1429765ec1e113a','{"mask_detection": "fail"}','0','http://marlene.fotonower-preprod.com/job/2025/March/01032025/python_test3//data_2/data_log/job/2025/March/01032025/python_test3/log-python3----short_python3--v--marlene-00:35:00.txt','mask_detection','unknown'); #&_# END OF TEST #&_# : tests/mask_test #&_# #&_# BEGIN OF TEST : tests/datou_test #&_# /home/admin/workarea/git/Velours/python/tests/datou_test.py Datou All Test python version used : 3 ############################### TEST sam ################################ TEST SAM Inside batchDatouExec : verbose : True ##### chargement datou SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4573 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4573 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4573 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4573 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! no param json to modify List Step Type Loaded in datou : sam list_input_json : [] ##### fin chargement datou ##### chargement data ##### Call load_data_input : nb_thread : 5 origin SELECT photo_id, url FROM MTRBack.photos ph WHERE photo_id IN (1189321094) Found this number of photos: 1 ##### Call download_photos : nb_thread : 5 begin to download photo : 1189321094 download finish for photo 1189321094 we have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB ##### After download_photos length of list_filenames : 1 ; length of list_pids : 1 ; length of list_args : 1 ##### After load_data_input time to download the photos : 0.2089242935180664 #### fin chargement data Blocking on flush ? No conitnuing About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! WARNING : we have an input that is not a photo, we should get rid of it Calling datou_exec Inside datou_exec : verbose : True number of steps : 1 step1:sam Sat Mar 1 00:36:43 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec After prepare type args : Here we display some param of map_info ! map_filenames : {'temp/1740785803_3759260_1189321094_9626af7f95d010f2a4fd524688d4ea22_76896585.png': 1189321094} map_photo_id_path_extension : {1189321094: {'path': 'temp/1740785803_3759260_1189321094_9626af7f95d010f2a4fd524688d4ea22_76896585.png', 'extension': 'png'}} map_subphoto_mainphoto : {} Beginning of datou step sam ! pht : 4677 Inside sam : nb paths : 1 ERROR in datou_step_exec, will save and exit ! CUDA error: out of memory CUDA kernel errors might be asynchronously reported at some other API call,so the stacktrace below might be incorrect. For debugging consider passing CUDA_LAUNCH_BLOCKING=1. File "/home/admin/workarea/git/Velours/python/mtr/datou/datou_lib.py", line 2329, in datou_exec output = datou_step_exec(sNext, args, cache, context, map_info, verbose, mtr_user_id) File "/home/admin/workarea/git/Velours/python/mtr/datou/datou_lib.py", line 2430, in datou_step_exec return lib_process.datou_step_sam(param, json_param, args, cache, context, map_info, verbose) File "/home/admin/workarea/git/Velours/python/mtr/datou/lib_step_exec/lib_step_process.py", line 367, in datou_step_sam sam.to(device=device) File "/home/admin/.local/lib/python3.8/site-packages/torch/nn/modules/module.py", line 927, in to return self._apply(convert) File "/home/admin/.local/lib/python3.8/site-packages/torch/nn/modules/module.py", line 579, in _apply module._apply(fn) File "/home/admin/.local/lib/python3.8/site-packages/torch/nn/modules/module.py", line 579, in _apply module._apply(fn) File "/home/admin/.local/lib/python3.8/site-packages/torch/nn/modules/module.py", line 579, in _apply module._apply(fn) File "/home/admin/.local/lib/python3.8/site-packages/torch/nn/modules/module.py", line 602, in _apply param_applied = fn(param) File "/home/admin/.local/lib/python3.8/site-packages/torch/nn/modules/module.py", line 925, in convert return t.to(device, dtype if t.is_floating_point() or t.is_complex() else None, non_blocking) [1189321094] map_info['map_portfolio_photo'] : {} final : True mtd_id 4573 list_pids : [1189321094] begin to insert list_values into mtr_datou_result : length of list_values in save_final : 1 insert ignore into MTRPhoto.mtr_datou_result (mtd_id, mtr_portfolio_id,mtr_photo_id,result,result_long,result_double,hashtag_id,proba, mtr_current_id) values (%s,%s,%s,%s,%s,%s,%s,%s,%s) on duplicate key update mtr_portfolio_id = mtr_portfolio_id list_values : [('4573', None, '1189321094', "[>, , , , , 'CUDA error: out of memory\\nCUDA kernel errors might be asynchronously reported at some other API call,so the stacktrace below might be incorrect.\\nFor debugging consider passing CUDA_LAUNCH_BLOCKING=1.']", '-1', '-1.0', '501120777', '1.0', None)] time used for this insertion : 0.1186981201171875 save_final ERROR in last step sam, CUDA error: out of memory CUDA kernel errors might be asynchronously reported at some other API call,so the stacktrace below might be incorrect. For debugging consider passing CUDA_LAUNCH_BLOCKING=1. time spend for datou_step_exec : 4.112873077392578 time spend to save output : 0.11951613426208496 total time spend for step 0 : 4.232389211654663 need to delete datou_research and reload, so keep current state 1 need to delete datou_research and reload, so keep current state 1 caffe_path_current : About to save ! 2 After save, about to update current ! datou_cur_ids : [] len(datou.list_steps) : 1 output : None ERROR nb objects espect : 98 nb_objects detect : 0 ERROR sam FAILED ############################### TEST frcnn ################################ test frcnn Inside batchDatouExec : verbose : True ##### chargement datou SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4184 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4184 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4184 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4184 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! no param json to modify List Step Type Loaded in datou : frcnn list_input_json : [] ##### fin chargement datou ##### chargement data ##### Call load_data_input : nb_thread : 5 origin SELECT photo_id, url FROM MTRBack.photos ph WHERE photo_id IN (917754606) Found this number of photos: 1 ##### Call download_photos : nb_thread : 5 begin to download photo : 917754606 download finish for photo 917754606 we have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB ##### After download_photos length of list_filenames : 1 ; length of list_pids : 1 ; length of list_args : 1 ##### After load_data_input time to download the photos : 0.09941768646240234 #### fin chargement data Blocking on flush ? No conitnuing About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : True number of steps : 1 step1:frcnn Sat Mar 1 00:36:47 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec After prepare type args : Here we display some param of map_info ! map_filenames : {'temp/1740785807_3759260_917754606_35f3c9ae49686a6be16030c6ec25c9ee.jpg': 917754606} map_photo_id_path_extension : {917754606: {'path': 'temp/1740785807_3759260_917754606_35f3c9ae49686a6be16030c6ec25c9ee.jpg', 'extension': 'jpg'}} map_subphoto_mainphoto : {} Beginning of datou step Faster rcnn ! classes : ['background', 'plaque'] pht : 4370 caffemodel_name (should be vgg16_immat_307 but not used because net loaded outside in the fonction) : {'id': 3375, 'mtr_user_id': 31, 'name': 'detection_plaque_valcor_010622', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,plaque', 'svm_portfolios_learning': '0,0', 'photo_hashtag_type': 4370, 'photo_desc_type': 5676, 'type_classification': 'caffe_faster_rcnn', 'hashtag_id_list': '0,0'} To loadFromThcl() model_param file didn't exist model_name : detection_plaque_valcor_010622 model_type : caffe_faster_rcnn list file need : ['caffemodel', 'test.prototxt'] file exist in s3 : ['caffemodel', 'test.prototxt'] file manque in s3 : [] WARNING: Logging before InitGoogleLogging() is written to STDERR E0301 00:36:49.359870 3759260 common.cpp:114] Cannot create Cublas handle. Cublas won't be available. E0301 00:36:49.366166 3759260 common.cpp:121] Cannot create Curand generator. Curand won't be available. F0301 00:36:49.386646 3759260 syncedmem.hpp:22] Check failed: error == cudaSuccess (2 vs. 0) out of memory *** Check failure stack trace: *** Command terminated by signal 6 7.57user 7.59system 1:21.49elapsed 18%CPU (0avgtext+0avgdata 1719356maxresident)k 1194408inputs+3480outputs (2500major+743121minor)pagefaults 0swaps