python /home/admin/mtr/script_for_cron.py -j python_test3 -m 12 -a ' --short_python3 -v ' -s python_test3 -M 0 -S 0 -U 100,100,120 import MySQLdb succeeded Import error (python version) python version = 3 warning , we can't find thcl infos in json_data warning , we can't find pdt infos in json_data list_job_run_as_list : ['mask_detection', 'datou', 'CacheModelData_queries', 'CachePhotoData_queries', 'test_fork', 'prepare_maskdata', 'portfolio_queries', 'sla_mensuel'] python version used : 3 liste_fichiers : [('tests/mask_test', True, 'Test mask-detection ', 'mask_detection'), ('tests/datou_test', True, 'Datou All Test', 'datou', 'all'), ('mtr/database_queries/CacheModelData_queries', True, 'Test Cache Model Data', 'CacheModelData_queries'), ('tests/cache_photo_data_test', True, 'Test local_cache_photo ', 'CachePhotoData_queries'), ('mtr/mask_rcnn/prepare_maskdata', True, 'test prepare mask data', 'prepare_maskdata', 'all'), ('mtr/database_queries/portfolio_queries', True, 'test portfolio queries', 'portfolio_queries'), ('prod/memo/memo', True, 'SLA Mensuel', 'sla_mensuel', 'all')] #&_# BEGIN OF TEST : tests/mask_test #&_# /home/admin/workarea/git/Velours/python/tests/mask_test.py Test mask-detection python version used : 3 ############################### TEST memory used ################################ free memory at begining : begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 515 run mask_detect Inside batchDatouExec : verbose : False # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : mask_detect list_input_json : [] origin BFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 1 ; length of list_pids : 1 ; length of list_args : 1 time to download the photos : 0.10819172859191895 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : False number of steps : 1 step1:mask_detect Tue May 27 06:35:27 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory havn't enough memory gpu , need / 3000 l 3632 free memory gpu now : 515 wait 20 seconds l 3637 free memory gpu now : 515 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 /home/admin/workarea/git/Velours/python/tests/python_tests.py:11: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses import imp 2025-05-27 06:35:49.726634: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-05-27 06:35:49.751044: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-05-27 06:35:49.753205: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f4a54000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-05-27 06:35:49.753284: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-05-27 06:35:49.757237: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-05-27 06:35:49.996015: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x3b5321f0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-05-27 06:35:49.996072: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-05-27 06:35:49.996816: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-27 06:35:49.997263: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-27 06:35:50.000293: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-27 06:35:50.003297: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-27 06:35:50.003794: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-27 06:35:50.006683: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-27 06:35:50.007954: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-27 06:35:50.013095: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-27 06:35:50.014132: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-27 06:35:50.014209: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-27 06:35:50.014769: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-27 06:35:50.014788: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-27 06:35:50.014799: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-27 06:35:50.015744: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 138 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl454 thcls : [{'id': 454, 'mtr_user_id': 31, 'name': 'mask_coco_origin', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'backgroud,person,bicycle,car,motorcycle,airplane,bus,train,truck,boat,trafficlight,firehydrant,stopsign,parkingmeter,bench,bird,cat,dog,horse,sheep,cow,elephant,bear,zebra,giraffe,backpack,umbrella,handbag,tie,suitcase,frisbee,skis,snowboard,sportsball,kite,baseballbat,baseballglove,skateboard,surfboard,tennisracket,bottle,wineglass,cup,fork,knife,spoon,bowl,banana,apple,sandwich,orange,broccoli,carrot,hotdog,pizza,donut,cake,chair,couch,pottedplant,bed,diningtable,toilet,tv,laptop,mouse,remote,keyboard,cellphone,microwave,oven,toaster,sink,refrigerator,book,clock,vase,scissors,teddybear,hairdrier,toothbrush', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 445, 'photo_desc_type': 3473, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0'}] thcl {'id': 454, 'mtr_user_id': 31, 'name': 'mask_coco_origin', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'backgroud,person,bicycle,car,motorcycle,airplane,bus,train,truck,boat,trafficlight,firehydrant,stopsign,parkingmeter,bench,bird,cat,dog,horse,sheep,cow,elephant,bear,zebra,giraffe,backpack,umbrella,handbag,tie,suitcase,frisbee,skis,snowboard,sportsball,kite,baseballbat,baseballglove,skateboard,surfboard,tennisracket,bottle,wineglass,cup,fork,knife,spoon,bowl,banana,apple,sandwich,orange,broccoli,carrot,hotdog,pizza,donut,cake,chair,couch,pottedplant,bed,diningtable,toilet,tv,laptop,mouse,remote,keyboard,cellphone,microwave,oven,toaster,sink,refrigerator,book,clock,vase,scissors,teddybear,hairdrier,toothbrush', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 445, 'photo_desc_type': 3473, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 3473 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (3473, 'mask_coco_origin', 16384, 25088, 'mask_coco_origin', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2018, 3, 19, 10, 42, 21), datetime.datetime(2018, 3, 19, 10, 42, 21)) {'thcl': {'id': 454, 'mtr_user_id': 31, 'name': 'mask_coco_origin', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'backgroud,person,bicycle,car,motorcycle,airplane,bus,train,truck,boat,trafficlight,firehydrant,stopsign,parkingmeter,bench,bird,cat,dog,horse,sheep,cow,elephant,bear,zebra,giraffe,backpack,umbrella,handbag,tie,suitcase,frisbee,skis,snowboard,sportsball,kite,baseballbat,baseballglove,skateboard,surfboard,tennisracket,bottle,wineglass,cup,fork,knife,spoon,bowl,banana,apple,sandwich,orange,broccoli,carrot,hotdog,pizza,donut,cake,chair,couch,pottedplant,bed,diningtable,toilet,tv,laptop,mouse,remote,keyboard,cellphone,microwave,oven,toaster,sink,refrigerator,book,clock,vase,scissors,teddybear,hairdrier,toothbrush', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 445, 'photo_desc_type': 3473, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['backgroud', 'person', 'bicycle', 'car', 'motorcycle', 'airplane', 'bus', 'train', 'truck', 'boat', 'trafficlight', 'firehydrant', 'stopsign', 'parkingmeter', 'bench', 'bird', 'cat', 'dog', 'horse', 'sheep', 'cow', 'elephant', 'bear', 'zebra', 'giraffe', 'backpack', 'umbrella', 'handbag', 'tie', 'suitcase', 'frisbee', 'skis', 'snowboard', 'sportsball', 'kite', 'baseballbat', 'baseballglove', 'skateboard', 'surfboard', 'tennisracket', 'bottle', 'wineglass', 'cup', 'fork', 'knife', 'spoon', 'bowl', 'banana', 'apple', 'sandwich', 'orange', 'broccoli', 'carrot', 'hotdog', 'pizza', 'donut', 'cake', 'chair', 'couch', 'pottedplant', 'bed', 'diningtable', 'toilet', 'tv', 'laptop', 'mouse', 'remote', 'keyboard', 'cellphone', 'microwave', 'oven', 'toaster', 'sink', 'refrigerator', 'book', 'clock', 'vase', 'scissors', 'teddybear', 'hairdrier', 'toothbrush'], 'list_hashtags_csv': 'backgroud,person,bicycle,car,motorcycle,airplane,bus,train,truck,boat,trafficlight,firehydrant,stopsign,parkingmeter,bench,bird,cat,dog,horse,sheep,cow,elephant,bear,zebra,giraffe,backpack,umbrella,handbag,tie,suitcase,frisbee,skis,snowboard,sportsball,kite,baseballbat,baseballglove,skateboard,surfboard,tennisracket,bottle,wineglass,cup,fork,knife,spoon,bowl,banana,apple,sandwich,orange,broccoli,carrot,hotdog,pizza,donut,cake,chair,couch,pottedplant,bed,diningtable,toilet,tv,laptop,mouse,remote,keyboard,cellphone,microwave,oven,toaster,sink,refrigerator,book,clock,vase,scissors,teddybear,hairdrier,toothbrush', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 445, 'svm_hashtag_type_desc': 3473, 'photo_desc_type': 3473, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['backgroud', 'person', 'bicycle', 'car', 'motorcycle', 'airplane', 'bus', 'train', 'truck', 'boat', 'trafficlight', 'firehydrant', 'stopsign', 'parkingmeter', 'bench', 'bird', 'cat', 'dog', 'horse', 'sheep', 'cow', 'elephant', 'bear', 'zebra', 'giraffe', 'backpack', 'umbrella', 'handbag', 'tie', 'suitcase', 'frisbee', 'skis', 'snowboard', 'sportsball', 'kite', 'baseballbat', 'baseballglove', 'skateboard', 'surfboard', 'tennisracket', 'bottle', 'wineglass', 'cup', 'fork', 'knife', 'spoon', 'bowl', 'banana', 'apple', 'sandwich', 'orange', 'broccoli', 'carrot', 'hotdog', 'pizza', 'donut', 'cake', 'chair', 'couch', 'pottedplant', 'bed', 'diningtable', 'toilet', 'tv', 'laptop', 'mouse', 'remote', 'keyboard', 'cellphone', 'microwave', 'oven', 'toaster', 'sink', 'refrigerator', 'book', 'clock', 'vase', 'scissors', 'teddybear', 'hairdrier', 'toothbrush'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME mask_coco_origin NUM_CLASSES 81 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 2025-05-27 06:35:50.553670: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-27 06:35:50.553761: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-27 06:35:50.553789: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-27 06:35:50.553815: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-27 06:35:50.553840: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-27 06:35:50.553865: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-27 06:35:50.553904: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-27 06:35:50.553930: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-27 06:35:50.555032: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-27 06:35:50.556161: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-27 06:35:50.556207: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-27 06:35:50.556232: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-27 06:35:50.556256: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-27 06:35:50.556280: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-27 06:35:50.556303: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-27 06:35:50.556326: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-27 06:35:50.556349: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-27 06:35:50.557077: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-27 06:35:50.557103: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-27 06:35:50.557112: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-27 06:35:50.557119: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-27 06:35:50.557809: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 138 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) 2025-05-27 06:36:02.021625: W tensorflow/core/common_runtime/bfc_allocator.cc:434] Allocator (GPU_0_bfc) ran out of memory trying to allocate 9.00MiB (rounded to 9437184) Current allocation summary follows. 2025-05-27 06:36:02.021688: I tensorflow/core/common_runtime/bfc_allocator.cc:934] BFCAllocator dump for GPU_0_bfc 2025-05-27 06:36:02.021709: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (256): Total Chunks: 62, Chunks in use: 62. 15.5KiB allocated for chunks. 15.5KiB in use in bin. 8.9KiB client-requested in use in bin. 2025-05-27 06:36:02.021727: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (512): Total Chunks: 40, Chunks in use: 40. 20.0KiB allocated for chunks. 20.0KiB in use in bin. 20.0KiB client-requested in use in bin. 2025-05-27 06:36:02.021744: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (1024): Total Chunks: 251, Chunks in use: 251. 251.2KiB allocated for chunks. 251.2KiB in use in bin. 251.0KiB client-requested in use in bin. 2025-05-27 06:36:02.021762: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (2048): Total Chunks: 30, Chunks in use: 30. 60.0KiB allocated for chunks. 60.0KiB in use in bin. 60.0KiB client-requested in use in bin. 2025-05-27 06:36:02.021779: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (4096): Total Chunks: 120, Chunks in use: 120. 487.5KiB allocated for chunks. 487.5KiB in use in bin. 480.0KiB client-requested in use in bin. 2025-05-27 06:36:02.021794: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (8192): Total Chunks: 0, Chunks in use: 0. 0B allocated for chunks. 0B in use in bin. 0B client-requested in use in bin. 2025-05-27 06:36:02.021828: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (16384): Total Chunks: 1, Chunks in use: 1. 16.0KiB allocated for chunks. 16.0KiB in use in bin. 16.0KiB client-requested in use in bin. 2025-05-27 06:36:02.021846: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (32768): Total Chunks: 1, Chunks in use: 1. 36.8KiB allocated for chunks. 36.8KiB in use in bin. 36.8KiB client-requested in use in bin. 2025-05-27 06:36:02.021863: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (65536): Total Chunks: 6, Chunks in use: 6. 384.0KiB allocated for chunks. 384.0KiB in use in bin. 384.0KiB client-requested in use in bin. 2025-05-27 06:36:02.021879: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (131072): Total Chunks: 4, Chunks in use: 4. 560.0KiB allocated for chunks. 560.0KiB in use in bin. 560.0KiB client-requested in use in bin. 2025-05-27 06:36:02.021896: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (262144): Total Chunks: 7, Chunks in use: 7. 1.91MiB allocated for chunks. 1.91MiB in use in bin. 1.75MiB client-requested in use in bin. 2025-05-27 06:36:02.021912: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (524288): Total Chunks: 8, Chunks in use: 6. 4.93MiB allocated for chunks. 3.44MiB in use in bin. 3.25MiB client-requested in use in bin. 2025-05-27 06:36:02.021929: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (1048576): Total Chunks: 48, Chunks in use: 45. 54.12MiB allocated for chunks. 50.62MiB in use in bin. 45.00MiB client-requested in use in bin. 2025-05-27 06:36:02.021945: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (2097152): Total Chunks: 28, Chunks in use: 25. 64.25MiB allocated for chunks. 55.75MiB in use in bin. 55.75MiB client-requested in use in bin. 2025-05-27 06:36:02.021961: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (4194304): Total Chunks: 0, Chunks in use: 0. 0B allocated for chunks. 0B in use in bin. 0B client-requested in use in bin. 2025-05-27 06:36:02.021977: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (8388608): Total Chunks: 1, Chunks in use: 1. 11.88MiB allocated for chunks. 11.88MiB in use in bin. 9.00MiB client-requested in use in bin. 2025-05-27 06:36:02.021992: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (16777216): Total Chunks: 0, Chunks in use: 0. 0B allocated for chunks. 0B in use in bin. 0B client-requested in use in bin. 2025-05-27 06:36:02.022008: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (33554432): Total Chunks: 0, Chunks in use: 0. 0B allocated for chunks. 0B in use in bin. 0B client-requested in use in bin. 2025-05-27 06:36:02.022023: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (67108864): Total Chunks: 0, Chunks in use: 0. 0B allocated for chunks. 0B in use in bin. 0B client-requested in use in bin. 2025-05-27 06:36:02.022037: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (134217728): Total Chunks: 0, Chunks in use: 0. 0B allocated for chunks. 0B in use in bin. 0B client-requested in use in bin. 2025-05-27 06:36:02.022052: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (268435456): Total Chunks: 0, Chunks in use: 0. 0B allocated for chunks. 0B in use in bin. 0B client-requested in use in bin. 2025-05-27 06:36:02.022068: I tensorflow/core/common_runtime/bfc_allocator.cc:957] Bin for 9.00MiB was 8.00MiB, Chunk State: 2025-05-27 06:36:02.022081: I tensorflow/core/common_runtime/bfc_allocator.cc:970] Next region of size 67108864 2025-05-27 06:36:02.022100: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4866000000 of size 2359296 next 370 2025-05-27 06:36:02.022114: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4866240000 of size 1048576 next 394 2025-05-27 06:36:02.022127: I tensorflow/core/common_runtime/bfc_allocator.cc:990] Free at 7f4866340000 of size 1310720 next 388 2025-05-27 06:36:02.022140: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4866480000 of size 2359296 next 387 2025-05-27 06:36:02.022162: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f48666c0000 of size 1048576 next 412 2025-05-27 06:36:02.022176: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f48667c0000 of size 1310720 next 406 2025-05-27 06:36:02.022189: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4866900000 of size 2359296 next 405 2025-05-27 06:36:02.022202: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4866b40000 of size 1048576 next 430 2025-05-27 06:36:02.022215: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4866c40000 of size 1310720 next 424 2025-05-27 06:36:02.022227: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4866d80000 of size 2359296 next 423 2025-05-27 06:36:02.022240: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4866fc0000 of size 1048576 next 447 2025-05-27 06:36:02.022253: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f48670c0000 of size 1310720 next 441 2025-05-27 06:36:02.022266: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4867200000 of size 2359296 next 440 2025-05-27 06:36:02.022278: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4867440000 of size 1048576 next 465 2025-05-27 06:36:02.022291: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4867540000 of size 1310720 next 459 2025-05-27 06:36:02.022304: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4867680000 of size 2359296 next 458 2025-05-27 06:36:02.022317: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f48678c0000 of size 1048576 next 483 2025-05-27 06:36:02.022329: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f48679c0000 of size 1310720 next 477 2025-05-27 06:36:02.022342: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4867b00000 of size 2359296 next 476 2025-05-27 06:36:02.022355: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4867d40000 of size 1048576 next 501 2025-05-27 06:36:02.022368: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4867e40000 of size 1310720 next 495 2025-05-27 06:36:02.022381: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4867f80000 of size 2359296 next 494 2025-05-27 06:36:02.022393: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f48681c0000 of size 1048576 next 519 2025-05-27 06:36:02.022406: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f48682c0000 of size 1310720 next 513 2025-05-27 06:36:02.022419: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4868400000 of size 2359296 next 512 2025-05-27 06:36:02.022431: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4868640000 of size 1048576 next 537 2025-05-27 06:36:02.022444: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4868740000 of size 1310720 next 531 2025-05-27 06:36:02.022457: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4868880000 of size 2359296 next 530 2025-05-27 06:36:02.022469: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4868ac0000 of size 1048576 next 555 2025-05-27 06:36:02.022482: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4868bc0000 of size 1310720 next 549 2025-05-27 06:36:02.022495: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4868d00000 of size 2359296 next 548 2025-05-27 06:36:02.022508: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4868f40000 of size 1048576 next 573 2025-05-27 06:36:02.022520: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4869040000 of size 1310720 next 567 2025-05-27 06:36:02.022533: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4869180000 of size 2359296 next 566 2025-05-27 06:36:02.022546: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f48693c0000 of size 1048576 next 591 2025-05-27 06:36:02.022567: I tensorflow/core/common_runtime/bfc_allocator.cc:990] Free at 7f48694c0000 of size 1310720 next 585 2025-05-27 06:36:02.022580: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4869600000 of size 2359296 next 584 2025-05-27 06:36:02.022593: I tensorflow/core/common_runtime/bfc_allocator.cc:990] Free at 7f4869840000 of size 2097152 next 597 2025-05-27 06:36:02.022606: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4869a40000 of size 2097152 next 596 2025-05-27 06:36:02.022619: I tensorflow/core/common_runtime/bfc_allocator.cc:990] Free at 7f4869c40000 of size 3932160 next 18446744073709551615 2025-05-27 06:36:02.022632: I tensorflow/core/common_runtime/bfc_allocator.cc:970] Next region of size 33554432 2025-05-27 06:36:02.022645: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486a000000 of size 2359296 next 245 2025-05-27 06:36:02.022658: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486a240000 of size 1048576 next 269 2025-05-27 06:36:02.022670: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486a340000 of size 1310720 next 263 2025-05-27 06:36:02.022683: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486a480000 of size 2359296 next 262 2025-05-27 06:36:02.022696: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486a6c0000 of size 1048576 next 287 2025-05-27 06:36:02.022708: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486a7c0000 of size 1310720 next 281 2025-05-27 06:36:02.022721: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486a900000 of size 2359296 next 280 2025-05-27 06:36:02.022734: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486ab40000 of size 1048576 next 304 2025-05-27 06:36:02.022747: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486ac40000 of size 1310720 next 298 2025-05-27 06:36:02.022759: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486ad80000 of size 2359296 next 297 2025-05-27 06:36:02.022772: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486afc0000 of size 1048576 next 322 2025-05-27 06:36:02.022785: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486b0c0000 of size 1310720 next 316 2025-05-27 06:36:02.022797: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486b200000 of size 2359296 next 315 2025-05-27 06:36:02.022810: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486b440000 of size 1048576 next 340 2025-05-27 06:36:02.022823: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486b540000 of size 1310720 next 334 2025-05-27 06:36:02.022835: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486b680000 of size 2359296 next 333 2025-05-27 06:36:02.022848: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486b8c0000 of size 1048576 next 358 2025-05-27 06:36:02.022861: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486b9c0000 of size 1310720 next 352 2025-05-27 06:36:02.022873: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486bb00000 of size 2359296 next 351 2025-05-27 06:36:02.022886: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486bd40000 of size 1048576 next 376 2025-05-27 06:36:02.022916: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486be40000 of size 1835008 next 18446744073709551615 2025-05-27 06:36:02.022932: I tensorflow/core/common_runtime/bfc_allocator.cc:970] Next region of size 16777216 2025-05-27 06:36:02.022945: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486c000000 of size 2359296 next 181 2025-05-27 06:36:02.022958: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486c240000 of size 2097152 next 196 2025-05-27 06:36:02.022971: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486c440000 of size 1048576 next 216 2025-05-27 06:36:02.022983: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486c540000 of size 1310720 next 209 2025-05-27 06:36:02.023005: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486c680000 of size 2359296 next 208 2025-05-27 06:36:02.023019: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486c8c0000 of size 1048576 next 234 2025-05-27 06:36:02.023031: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486c9c0000 of size 1310720 next 228 2025-05-27 06:36:02.023044: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486cb00000 of size 2359296 next 227 2025-05-27 06:36:02.023057: I tensorflow/core/common_runtime/bfc_allocator.cc:990] Free at 7f486cd40000 of size 2883584 next 18446744073709551615 2025-05-27 06:36:02.023069: I tensorflow/core/common_runtime/bfc_allocator.cc:970] Next region of size 12451840 2025-05-27 06:36:02.023082: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486d000000 of size 12451840 next 18446744073709551615 2025-05-27 06:36:02.023095: I tensorflow/core/common_runtime/bfc_allocator.cc:970] Next region of size 2097152 2025-05-27 06:36:02.023108: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e600000 of size 147456 next 55 2025-05-27 06:36:02.023121: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e624000 of size 65536 next 78 2025-05-27 06:36:02.023134: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e634000 of size 4096 next 191 2025-05-27 06:36:02.023147: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e635000 of size 4096 next 192 2025-05-27 06:36:02.023160: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e636000 of size 4096 next 193 2025-05-27 06:36:02.023173: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e637000 of size 256 next 194 2025-05-27 06:36:02.023185: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e637100 of size 256 next 195 2025-05-27 06:36:02.023198: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e637200 of size 4096 next 197 2025-05-27 06:36:02.023211: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e638200 of size 4096 next 198 2025-05-27 06:36:02.023223: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e639200 of size 4096 next 199 2025-05-27 06:36:02.023236: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e63a200 of size 4096 next 200 2025-05-27 06:36:02.023249: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e63b200 of size 4096 next 201 2025-05-27 06:36:02.023262: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e63c200 of size 1024 next 202 2025-05-27 06:36:02.023275: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e63c600 of size 1024 next 204 2025-05-27 06:36:02.023287: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e63ca00 of size 1024 next 205 2025-05-27 06:36:02.023300: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e63ce00 of size 1024 next 206 2025-05-27 06:36:02.023313: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e63d200 of size 1024 next 207 2025-05-27 06:36:02.023325: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e63d600 of size 1024 next 210 2025-05-27 06:36:02.023338: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e63da00 of size 1024 next 211 2025-05-27 06:36:02.023351: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e63de00 of size 1024 next 212 2025-05-27 06:36:02.023363: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e63e200 of size 1024 next 213 2025-05-27 06:36:02.023376: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e63e600 of size 1024 next 214 2025-05-27 06:36:02.023388: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e63ea00 of size 4096 next 215 2025-05-27 06:36:02.023401: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e63fa00 of size 4096 next 217 2025-05-27 06:36:02.023422: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e640a00 of size 4096 next 218 2025-05-27 06:36:02.023436: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e641a00 of size 4096 next 219 2025-05-27 06:36:02.023448: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e642a00 of size 4096 next 220 2025-05-27 06:36:02.023461: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e643a00 of size 1024 next 221 2025-05-27 06:36:02.023474: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e643e00 of size 1024 next 223 2025-05-27 06:36:02.023486: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e644200 of size 1024 next 224 2025-05-27 06:36:02.023499: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e644600 of size 1024 next 225 2025-05-27 06:36:02.023512: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e644a00 of size 1024 next 226 2025-05-27 06:36:02.023524: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e644e00 of size 1024 next 229 2025-05-27 06:36:02.023537: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e645200 of size 1024 next 230 2025-05-27 06:36:02.023550: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e645600 of size 1024 next 231 2025-05-27 06:36:02.023562: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e645a00 of size 1024 next 232 2025-05-27 06:36:02.023575: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e645e00 of size 1024 next 233 2025-05-27 06:36:02.023588: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e646200 of size 7680 next 72 2025-05-27 06:36:02.023601: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e648000 of size 147456 next 71 2025-05-27 06:36:02.023614: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e66c000 of size 131072 next 87 2025-05-27 06:36:02.023627: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e68c000 of size 4096 next 289 2025-05-27 06:36:02.023639: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e68d000 of size 4096 next 290 2025-05-27 06:36:02.023652: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e68e000 of size 4096 next 291 2025-05-27 06:36:02.023665: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e68f000 of size 1024 next 292 2025-05-27 06:36:02.023677: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e68f400 of size 1024 next 293 2025-05-27 06:36:02.023690: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e68f800 of size 1024 next 294 2025-05-27 06:36:02.023703: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e68fc00 of size 1024 next 295 2025-05-27 06:36:02.023715: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e690000 of size 1024 next 296 2025-05-27 06:36:02.023728: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e690400 of size 1024 next 299 2025-05-27 06:36:02.023741: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e690800 of size 1024 next 300 2025-05-27 06:36:02.023753: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e690c00 of size 1024 next 301 2025-05-27 06:36:02.023766: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e691000 of size 1024 next 302 2025-05-27 06:36:02.023779: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e691400 of size 1024 next 303 2025-05-27 06:36:02.023791: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e691800 of size 4096 next 305 2025-05-27 06:36:02.023804: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e692800 of size 4096 next 306 2025-05-27 06:36:02.023817: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e693800 of size 4096 next 307 2025-05-27 06:36:02.023838: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e694800 of size 4096 next 308 2025-05-27 06:36:02.023851: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e695800 of size 4096 next 309 2025-05-27 06:36:02.023864: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e696800 of size 1024 next 310 2025-05-27 06:36:02.023877: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e696c00 of size 1024 next 311 2025-05-27 06:36:02.023890: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e697000 of size 1024 next 312 2025-05-27 06:36:02.023902: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e697400 of size 1024 next 313 2025-05-27 06:36:02.023915: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e697800 of size 1024 next 314 2025-05-27 06:36:02.023928: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e697c00 of size 1024 next 317 2025-05-27 06:36:02.023940: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e698000 of size 1024 next 318 2025-05-27 06:36:02.023953: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e698400 of size 1024 next 319 2025-05-27 06:36:02.023966: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e698800 of size 1024 next 320 2025-05-27 06:36:02.023978: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e698c00 of size 1024 next 321 2025-05-27 06:36:02.023991: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e699000 of size 4096 next 323 2025-05-27 06:36:02.024004: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e69a000 of size 4096 next 324 2025-05-27 06:36:02.024016: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e69b000 of size 4096 next 325 2025-05-27 06:36:02.024029: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e69c000 of size 4096 next 326 2025-05-27 06:36:02.024042: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e69d000 of size 4096 next 327 2025-05-27 06:36:02.024054: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e69e000 of size 1024 next 328 2025-05-27 06:36:02.024067: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e69e400 of size 1024 next 329 2025-05-27 06:36:02.024080: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e69e800 of size 1024 next 330 2025-05-27 06:36:02.024093: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e69ec00 of size 1024 next 331 2025-05-27 06:36:02.024105: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e69f000 of size 1024 next 332 2025-05-27 06:36:02.024118: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e69f400 of size 1024 next 335 2025-05-27 06:36:02.024131: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e69f800 of size 1024 next 336 2025-05-27 06:36:02.024143: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e69fc00 of size 1024 next 337 2025-05-27 06:36:02.024156: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6a0000 of size 1024 next 338 2025-05-27 06:36:02.024169: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6a0400 of size 1024 next 339 2025-05-27 06:36:02.024181: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6a0800 of size 4096 next 341 2025-05-27 06:36:02.024194: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6a1800 of size 4096 next 342 2025-05-27 06:36:02.024207: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6a2800 of size 4096 next 343 2025-05-27 06:36:02.024219: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6a3800 of size 4096 next 344 2025-05-27 06:36:02.024232: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6a4800 of size 4096 next 345 2025-05-27 06:36:02.024253: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6a5800 of size 1024 next 346 2025-05-27 06:36:02.024266: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6a5c00 of size 1024 next 347 2025-05-27 06:36:02.024279: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6a6000 of size 1024 next 348 2025-05-27 06:36:02.024292: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6a6400 of size 1024 next 349 2025-05-27 06:36:02.024304: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6a6800 of size 1024 next 350 2025-05-27 06:36:02.024317: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6a6c00 of size 1024 next 353 2025-05-27 06:36:02.024330: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6a7000 of size 1024 next 354 2025-05-27 06:36:02.024342: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6a7400 of size 1024 next 355 2025-05-27 06:36:02.024355: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6a7800 of size 1024 next 356 2025-05-27 06:36:02.024368: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6a7c00 of size 1024 next 357 2025-05-27 06:36:02.024381: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6a8000 of size 4096 next 359 2025-05-27 06:36:02.024393: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6a9000 of size 4096 next 360 2025-05-27 06:36:02.024406: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6aa000 of size 4096 next 361 2025-05-27 06:36:02.024419: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6ab000 of size 4096 next 362 2025-05-27 06:36:02.024431: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6ac000 of size 4096 next 363 2025-05-27 06:36:02.024444: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6ad000 of size 1024 next 364 2025-05-27 06:36:02.024457: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6ad400 of size 1024 next 365 2025-05-27 06:36:02.024469: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6ad800 of size 1024 next 366 2025-05-27 06:36:02.024482: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6adc00 of size 1024 next 367 2025-05-27 06:36:02.024495: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6ae000 of size 1024 next 368 2025-05-27 06:36:02.024507: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6ae400 of size 1024 next 371 2025-05-27 06:36:02.024520: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6ae800 of size 1024 next 372 2025-05-27 06:36:02.024533: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6aec00 of size 1024 next 373 2025-05-27 06:36:02.024545: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6af000 of size 1024 next 374 2025-05-27 06:36:02.024558: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6af400 of size 1024 next 375 2025-05-27 06:36:02.024571: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6af800 of size 4096 next 377 2025-05-27 06:36:02.024583: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6b0800 of size 4096 next 378 2025-05-27 06:36:02.024596: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6b1800 of size 4096 next 379 2025-05-27 06:36:02.024609: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6b2800 of size 4096 next 380 2025-05-27 06:36:02.024621: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6b3800 of size 4096 next 381 2025-05-27 06:36:02.024634: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6b4800 of size 1024 next 382 2025-05-27 06:36:02.024647: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6b4c00 of size 1024 next 383 2025-05-27 06:36:02.024660: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6b5000 of size 1024 next 384 2025-05-27 06:36:02.024680: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6b5400 of size 1024 next 385 2025-05-27 06:36:02.024694: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6b5800 of size 1024 next 386 2025-05-27 06:36:02.024706: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6b5c00 of size 1024 next 389 2025-05-27 06:36:02.024719: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6b6000 of size 1024 next 390 2025-05-27 06:36:02.024732: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6b6400 of size 1024 next 391 2025-05-27 06:36:02.024744: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6b6800 of size 1024 next 392 2025-05-27 06:36:02.024757: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6b6c00 of size 1024 next 393 2025-05-27 06:36:02.024770: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6b7000 of size 4096 next 395 2025-05-27 06:36:02.024782: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6b8000 of size 4096 next 396 2025-05-27 06:36:02.024795: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6b9000 of size 4096 next 397 2025-05-27 06:36:02.024808: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6ba000 of size 4096 next 398 2025-05-27 06:36:02.024820: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6bb000 of size 4096 next 399 2025-05-27 06:36:02.024833: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6bc000 of size 1024 next 400 2025-05-27 06:36:02.024846: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6bc400 of size 1024 next 401 2025-05-27 06:36:02.024858: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6bc800 of size 1024 next 402 2025-05-27 06:36:02.024871: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6bcc00 of size 1024 next 403 2025-05-27 06:36:02.024884: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6bd000 of size 1024 next 404 2025-05-27 06:36:02.024896: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6bd400 of size 1024 next 407 2025-05-27 06:36:02.024909: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6bd800 of size 1024 next 408 2025-05-27 06:36:02.024922: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6bdc00 of size 1024 next 409 2025-05-27 06:36:02.024934: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6be000 of size 1024 next 410 2025-05-27 06:36:02.024947: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6be400 of size 1024 next 411 2025-05-27 06:36:02.024960: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6be800 of size 4096 next 413 2025-05-27 06:36:02.024972: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6bf800 of size 4096 next 414 2025-05-27 06:36:02.024985: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6c0800 of size 4096 next 415 2025-05-27 06:36:02.024998: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6c1800 of size 4096 next 416 2025-05-27 06:36:02.025010: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6c2800 of size 4096 next 417 2025-05-27 06:36:02.025023: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6c3800 of size 1024 next 418 2025-05-27 06:36:02.025036: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6c3c00 of size 1024 next 419 2025-05-27 06:36:02.025048: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6c4000 of size 1024 next 420 2025-05-27 06:36:02.025061: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6c4400 of size 1024 next 421 2025-05-27 06:36:02.025074: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6c4800 of size 1024 next 422 2025-05-27 06:36:02.025095: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6c4c00 of size 1024 next 425 2025-05-27 06:36:02.025108: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6c5000 of size 1024 next 426 2025-05-27 06:36:02.025121: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6c5400 of size 1024 next 427 2025-05-27 06:36:02.025134: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6c5800 of size 1024 next 428 2025-05-27 06:36:02.025146: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6c5c00 of size 1024 next 429 2025-05-27 06:36:02.025159: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6c6000 of size 4096 next 431 2025-05-27 06:36:02.025172: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6c7000 of size 4096 next 432 2025-05-27 06:36:02.025185: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6c8000 of size 4096 next 433 2025-05-27 06:36:02.025197: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6c9000 of size 4096 next 434 2025-05-27 06:36:02.025210: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6ca000 of size 4096 next 435 2025-05-27 06:36:02.025223: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6cb000 of size 1024 next 436 2025-05-27 06:36:02.025235: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6cb400 of size 1024 next 437 2025-05-27 06:36:02.025248: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6cb800 of size 1024 next 438 2025-05-27 06:36:02.025261: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6cbc00 of size 1024 next 103 2025-05-27 06:36:02.025274: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6cc000 of size 262144 next 102 2025-05-27 06:36:02.025287: I tensorflow/core/common_runtime/bfc_allocator.cc:990] Free at 7f486e70c000 of size 999424 next 18446744073709551615 2025-05-27 06:36:02.025299: I tensorflow/core/common_runtime/bfc_allocator.cc:970] Next region of size 4194304 2025-05-27 06:36:02.025312: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e800000 of size 589824 next 96 2025-05-27 06:36:02.025325: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e890000 of size 262144 next 117 2025-05-27 06:36:02.025338: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8d0000 of size 1024 next 439 2025-05-27 06:36:02.025351: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8d0400 of size 1024 next 442 2025-05-27 06:36:02.025363: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8d0800 of size 1024 next 443 2025-05-27 06:36:02.025376: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8d0c00 of size 1024 next 444 2025-05-27 06:36:02.025389: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8d1000 of size 1024 next 445 2025-05-27 06:36:02.025402: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8d1400 of size 1024 next 446 2025-05-27 06:36:02.025414: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8d1800 of size 4096 next 448 2025-05-27 06:36:02.025427: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8d2800 of size 4096 next 449 2025-05-27 06:36:02.025440: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8d3800 of size 4096 next 450 2025-05-27 06:36:02.025452: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8d4800 of size 4096 next 451 2025-05-27 06:36:02.025465: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8d5800 of size 4096 next 452 2025-05-27 06:36:02.025478: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8d6800 of size 1024 next 453 2025-05-27 06:36:02.025490: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8d6c00 of size 1024 next 454 2025-05-27 06:36:02.025512: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8d7000 of size 1024 next 455 2025-05-27 06:36:02.025525: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8d7400 of size 1024 next 456 2025-05-27 06:36:02.025537: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8d7800 of size 1024 next 457 2025-05-27 06:36:02.025550: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8d7c00 of size 1024 next 460 2025-05-27 06:36:02.025563: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8d8000 of size 1024 next 461 2025-05-27 06:36:02.025575: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8d8400 of size 1024 next 462 2025-05-27 06:36:02.025588: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8d8800 of size 1024 next 463 2025-05-27 06:36:02.025601: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8d8c00 of size 1024 next 464 2025-05-27 06:36:02.025613: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8d9000 of size 4096 next 466 2025-05-27 06:36:02.025626: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8da000 of size 4096 next 467 2025-05-27 06:36:02.025639: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8db000 of size 4096 next 468 2025-05-27 06:36:02.025652: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8dc000 of size 4096 next 469 2025-05-27 06:36:02.025665: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8dd000 of size 4096 next 470 2025-05-27 06:36:02.025678: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8de000 of size 1024 next 471 2025-05-27 06:36:02.025690: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8de400 of size 1024 next 472 2025-05-27 06:36:02.025703: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8de800 of size 1024 next 473 2025-05-27 06:36:02.025716: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8dec00 of size 1024 next 474 2025-05-27 06:36:02.025729: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8df000 of size 1024 next 475 2025-05-27 06:36:02.025742: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8df400 of size 1024 next 478 2025-05-27 06:36:02.025754: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8df800 of size 1024 next 479 2025-05-27 06:36:02.025767: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8dfc00 of size 1024 next 480 2025-05-27 06:36:02.025780: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8e0000 of size 1024 next 481 2025-05-27 06:36:02.025793: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8e0400 of size 1024 next 482 2025-05-27 06:36:02.025805: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8e0800 of size 4096 next 484 2025-05-27 06:36:02.025818: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8e1800 of size 4096 next 485 2025-05-27 06:36:02.025831: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8e2800 of size 4096 next 486 2025-05-27 06:36:02.025844: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8e3800 of size 4096 next 487 2025-05-27 06:36:02.025856: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8e4800 of size 4096 next 488 2025-05-27 06:36:02.025869: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8e5800 of size 1024 next 489 2025-05-27 06:36:02.025882: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8e5c00 of size 1024 next 490 2025-05-27 06:36:02.025895: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8e6000 of size 1024 next 491 2025-05-27 06:36:02.025907: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8e6400 of size 1024 next 492 2025-05-27 06:36:02.025928: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8e6800 of size 1024 next 493 2025-05-27 06:36:02.025941: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8e6c00 of size 1024 next 496 2025-05-27 06:36:02.025954: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8e7000 of size 1024 next 497 2025-05-27 06:36:02.025967: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8e7400 of size 1024 next 498 2025-05-27 06:36:02.025980: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8e7800 of size 1024 next 499 2025-05-27 06:36:02.025992: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8e7c00 of size 1024 next 500 2025-05-27 06:36:02.026005: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8e8000 of size 4096 next 502 2025-05-27 06:36:02.026018: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8e9000 of size 4096 next 503 2025-05-27 06:36:02.026031: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8ea000 of size 4096 next 504 2025-05-27 06:36:02.026043: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8eb000 of size 4096 next 505 2025-05-27 06:36:02.026056: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8ec000 of size 4096 next 506 2025-05-27 06:36:02.026069: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8ed000 of size 1024 next 507 2025-05-27 06:36:02.026081: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8ed400 of size 1024 next 508 2025-05-27 06:36:02.026094: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8ed800 of size 1024 next 509 2025-05-27 06:36:02.026107: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8edc00 of size 1024 next 510 2025-05-27 06:36:02.026119: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8ee000 of size 1024 next 511 2025-05-27 06:36:02.026132: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8ee400 of size 1024 next 514 2025-05-27 06:36:02.026145: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8ee800 of size 1024 next 515 2025-05-27 06:36:02.026158: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8eec00 of size 1024 next 516 2025-05-27 06:36:02.026170: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8ef000 of size 1024 next 517 2025-05-27 06:36:02.026183: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8ef400 of size 1024 next 518 2025-05-27 06:36:02.026196: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8ef800 of size 4096 next 520 2025-05-27 06:36:02.026208: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8f0800 of size 4096 next 521 2025-05-27 06:36:02.026221: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8f1800 of size 4096 next 522 2025-05-27 06:36:02.026234: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8f2800 of size 4096 next 523 2025-05-27 06:36:02.026246: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8f3800 of size 4096 next 524 2025-05-27 06:36:02.026259: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8f4800 of size 1024 next 525 2025-05-27 06:36:02.026272: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8f4c00 of size 1024 next 526 2025-05-27 06:36:02.026284: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8f5000 of size 1024 next 527 2025-05-27 06:36:02.026297: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8f5400 of size 1024 next 528 2025-05-27 06:36:02.026310: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8f5800 of size 1024 next 529 2025-05-27 06:36:02.026322: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8f5c00 of size 1024 next 532 2025-05-27 06:36:02.026335: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8f6000 of size 1024 next 533 2025-05-27 06:36:02.026356: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8f6400 of size 1024 next 534 2025-05-27 06:36:02.026369: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8f6800 of size 1024 next 535 2025-05-27 06:36:02.026382: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8f6c00 of size 1024 next 536 2025-05-27 06:36:02.026395: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8f7000 of size 4096 next 538 2025-05-27 06:36:02.026408: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8f8000 of size 4096 next 539 2025-05-27 06:36:02.026420: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8f9000 of size 4096 next 540 2025-05-27 06:36:02.026433: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8fa000 of size 4096 next 541 2025-05-27 06:36:02.026446: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8fb000 of size 4096 next 542 2025-05-27 06:36:02.026458: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8fc000 of size 1024 next 543 2025-05-27 06:36:02.026471: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8fc400 of size 1024 next 544 2025-05-27 06:36:02.026484: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8fc800 of size 1024 next 545 2025-05-27 06:36:02.026497: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8fcc00 of size 1024 next 546 2025-05-27 06:36:02.026509: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8fd000 of size 1024 next 547 2025-05-27 06:36:02.026522: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8fd400 of size 1024 next 550 2025-05-27 06:36:02.026535: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8fd800 of size 1024 next 551 2025-05-27 06:36:02.026547: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8fdc00 of size 1024 next 552 2025-05-27 06:36:02.026560: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8fe000 of size 1024 next 553 2025-05-27 06:36:02.026572: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8fe400 of size 1024 next 554 2025-05-27 06:36:02.026585: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8fe800 of size 4096 next 556 2025-05-27 06:36:02.026598: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8ff800 of size 4096 next 557 2025-05-27 06:36:02.026611: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e900800 of size 4096 next 558 2025-05-27 06:36:02.026623: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e901800 of size 4096 next 559 2025-05-27 06:36:02.026636: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e902800 of size 4096 next 560 2025-05-27 06:36:02.026648: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e903800 of size 1024 next 561 2025-05-27 06:36:02.026661: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e903c00 of size 1024 next 562 2025-05-27 06:36:02.026674: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e904000 of size 1024 next 563 2025-05-27 06:36:02.026687: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e904400 of size 1024 next 564 2025-05-27 06:36:02.026699: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e904800 of size 1024 next 565 2025-05-27 06:36:02.026712: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e904c00 of size 1024 next 568 2025-05-27 06:36:02.026725: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e905000 of size 1024 next 569 2025-05-27 06:36:02.026737: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e905400 of size 1024 next 570 2025-05-27 06:36:02.026750: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e905800 of size 1024 next 571 2025-05-27 06:36:02.026771: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e905c00 of size 1024 next 572 2025-05-27 06:36:02.026785: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e906000 of size 4096 next 574 2025-05-27 06:36:02.026798: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e907000 of size 4096 next 575 2025-05-27 06:36:02.026810: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e908000 of size 4096 next 576 2025-05-27 06:36:02.026823: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e909000 of size 4096 next 577 2025-05-27 06:36:02.026836: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e90a000 of size 4096 next 578 2025-05-27 06:36:02.026848: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e90b000 of size 1024 next 579 2025-05-27 06:36:02.026861: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e90b400 of size 1024 next 580 2025-05-27 06:36:02.026874: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e90b800 of size 1024 next 581 2025-05-27 06:36:02.026886: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e90bc00 of size 1024 next 582 2025-05-27 06:36:02.026910: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e90c000 of size 1024 next 583 2025-05-27 06:36:02.026926: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e90c400 of size 1024 next 586 2025-05-27 06:36:02.026939: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e90c800 of size 1024 next 587 2025-05-27 06:36:02.026951: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e90cc00 of size 1024 next 588 2025-05-27 06:36:02.026964: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e90d000 of size 1024 next 589 2025-05-27 06:36:02.026977: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e90d400 of size 1024 next 590 2025-05-27 06:36:02.026989: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e90d800 of size 4096 next 592 2025-05-27 06:36:02.027003: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e90e800 of size 6144 next 112 2025-05-27 06:36:02.027016: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e910000 of size 524288 next 111 2025-05-27 06:36:02.027028: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e990000 of size 262144 next 135 2025-05-27 06:36:02.027042: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e9d0000 of size 327680 next 124 2025-05-27 06:36:02.027054: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486ea20000 of size 589824 next 123 2025-05-27 06:36:02.027067: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486eab0000 of size 262144 next 152 2025-05-27 06:36:02.027080: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486eaf0000 of size 327680 next 142 2025-05-27 06:36:02.027093: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486eb40000 of size 786432 next 18446744073709551615 2025-05-27 06:36:02.027106: I tensorflow/core/common_runtime/bfc_allocator.cc:970] Next region of size 8388608 2025-05-27 06:36:02.027119: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486ec00000 of size 4096 next 593 2025-05-27 06:36:02.027131: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486ec01000 of size 4096 next 594 2025-05-27 06:36:02.027144: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486ec02000 of size 4096 next 595 2025-05-27 06:36:02.027157: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486ec03000 of size 2048 next 598 2025-05-27 06:36:02.027170: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486ec03800 of size 2048 next 599 2025-05-27 06:36:02.027183: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486ec04000 of size 2048 next 600 2025-05-27 06:36:02.027204: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486ec04800 of size 2048 next 601 2025-05-27 06:36:02.027218: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486ec05000 of size 2048 next 602 2025-05-27 06:36:02.027231: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486ec05800 of size 256 next 604 2025-05-27 06:36:02.027243: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486ec05900 of size 256 next 605 2025-05-27 06:36:02.027256: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486ec05a00 of size 256 next 606 2025-05-27 06:36:02.027269: I tensorflow/core/common_runtime/bfc_allocator.cc:990] Free at 7f486ec05b00 of size 566528 next 160 2025-05-27 06:36:02.027282: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486ec90000 of size 589824 next 158 2025-05-27 06:36:02.027295: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486ed20000 of size 524288 next 171 2025-05-27 06:36:02.027307: I tensorflow/core/common_runtime/bfc_allocator.cc:990] Free at 7f486eda0000 of size 1048576 next 222 2025-05-27 06:36:02.027320: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486eea0000 of size 1048576 next 190 2025-05-27 06:36:02.027333: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486efa0000 of size 1048576 next 189 2025-05-27 06:36:02.027346: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486f0a0000 of size 1048576 next 203 2025-05-27 06:36:02.027359: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486f1a0000 of size 1048576 next 251 2025-05-27 06:36:02.027372: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486f2a0000 of size 1441792 next 18446744073709551615 2025-05-27 06:36:02.027384: I tensorflow/core/common_runtime/bfc_allocator.cc:970] Next region of size 1048576 2025-05-27 06:36:02.027398: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace00000 of size 1280 next 1 2025-05-27 06:36:02.027411: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace00500 of size 256 next 5 2025-05-27 06:36:02.027423: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace00600 of size 256 next 8 2025-05-27 06:36:02.027436: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace00700 of size 256 next 9 2025-05-27 06:36:02.027449: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace00800 of size 256 next 10 2025-05-27 06:36:02.027461: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace00900 of size 256 next 11 2025-05-27 06:36:02.027474: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace00a00 of size 256 next 12 2025-05-27 06:36:02.027487: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace00b00 of size 256 next 13 2025-05-27 06:36:02.027500: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace00c00 of size 256 next 17 2025-05-27 06:36:02.027512: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace00d00 of size 256 next 19 2025-05-27 06:36:02.027525: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace00e00 of size 256 next 20 2025-05-27 06:36:02.027538: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace00f00 of size 256 next 21 2025-05-27 06:36:02.027550: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace01000 of size 256 next 22 2025-05-27 06:36:02.027563: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace01100 of size 256 next 24 2025-05-27 06:36:02.027576: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace01200 of size 256 next 25 2025-05-27 06:36:02.027589: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace01300 of size 256 next 23 2025-05-27 06:36:02.027602: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace01400 of size 256 next 28 2025-05-27 06:36:02.027627: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace01500 of size 256 next 29 2025-05-27 06:36:02.027640: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace01600 of size 256 next 30 2025-05-27 06:36:02.027652: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace01700 of size 256 next 31 2025-05-27 06:36:02.027665: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace01800 of size 256 next 33 2025-05-27 06:36:02.027678: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace01900 of size 256 next 34 2025-05-27 06:36:02.027691: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace01a00 of size 1024 next 32 2025-05-27 06:36:02.027703: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace01e00 of size 1024 next 37 2025-05-27 06:36:02.027716: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace02200 of size 1024 next 38 2025-05-27 06:36:02.027729: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace02600 of size 1024 next 39 2025-05-27 06:36:02.027742: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace02a00 of size 1024 next 40 2025-05-27 06:36:02.027754: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace02e00 of size 1024 next 41 2025-05-27 06:36:02.027767: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace03200 of size 1024 next 43 2025-05-27 06:36:02.027780: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace03600 of size 1024 next 44 2025-05-27 06:36:02.027792: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace03a00 of size 1024 next 45 2025-05-27 06:36:02.027805: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace03e00 of size 1024 next 46 2025-05-27 06:36:02.027818: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace04200 of size 256 next 48 2025-05-27 06:36:02.027830: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace04300 of size 256 next 49 2025-05-27 06:36:02.027843: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace04400 of size 256 next 50 2025-05-27 06:36:02.027856: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace04500 of size 256 next 51 2025-05-27 06:36:02.027868: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace04600 of size 256 next 52 2025-05-27 06:36:02.027881: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace04700 of size 256 next 53 2025-05-27 06:36:02.027894: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace04800 of size 256 next 56 2025-05-27 06:36:02.027907: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace04900 of size 256 next 57 2025-05-27 06:36:02.027919: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace04a00 of size 256 next 58 2025-05-27 06:36:02.027932: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace04b00 of size 256 next 14 2025-05-27 06:36:02.027945: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace04c00 of size 256 next 15 2025-05-27 06:36:02.027957: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace04d00 of size 256 next 16 2025-05-27 06:36:02.027970: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace04e00 of size 1024 next 60 2025-05-27 06:36:02.027983: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace05200 of size 1024 next 61 2025-05-27 06:36:02.027996: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace05600 of size 1024 next 62 2025-05-27 06:36:02.028009: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace05a00 of size 1024 next 63 2025-05-27 06:36:02.028023: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace05e00 of size 1024 next 64 2025-05-27 06:36:02.028035: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace06200 of size 256 next 66 2025-05-27 06:36:02.028056: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace06300 of size 256 next 67 2025-05-27 06:36:02.028070: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace06400 of size 256 next 68 2025-05-27 06:36:02.028082: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace06500 of size 256 next 69 2025-05-27 06:36:02.028095: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace06600 of size 256 next 70 2025-05-27 06:36:02.028108: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace06700 of size 256 next 73 2025-05-27 06:36:02.028121: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace06800 of size 256 next 74 2025-05-27 06:36:02.028133: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace06900 of size 256 next 75 2025-05-27 06:36:02.028146: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace06a00 of size 256 next 76 2025-05-27 06:36:02.028159: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace06b00 of size 256 next 77 2025-05-27 06:36:02.028171: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace06c00 of size 1024 next 79 2025-05-27 06:36:02.028184: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace07000 of size 1024 next 80 2025-05-27 06:36:02.028197: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace07400 of size 1024 next 81 2025-05-27 06:36:02.028210: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace07800 of size 1024 next 82 2025-05-27 06:36:02.028222: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace07c00 of size 1024 next 83 2025-05-27 06:36:02.028235: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace08000 of size 256 next 85 2025-05-27 06:36:02.028248: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace08100 of size 256 next 86 2025-05-27 06:36:02.028261: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace08200 of size 512 next 84 2025-05-27 06:36:02.028274: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace08400 of size 512 next 88 2025-05-27 06:36:02.028286: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace08600 of size 512 next 89 2025-05-27 06:36:02.028299: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace08800 of size 512 next 90 2025-05-27 06:36:02.028312: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace08a00 of size 512 next 91 2025-05-27 06:36:02.028325: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace08c00 of size 256 next 93 2025-05-27 06:36:02.028337: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace08d00 of size 256 next 94 2025-05-27 06:36:02.028350: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace08e00 of size 512 next 92 2025-05-27 06:36:02.028363: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace09000 of size 512 next 97 2025-05-27 06:36:02.028376: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace09200 of size 512 next 98 2025-05-27 06:36:02.028389: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace09400 of size 512 next 99 2025-05-27 06:36:02.028402: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace09600 of size 512 next 2 2025-05-27 06:36:02.028416: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace09800 of size 256 next 3 2025-05-27 06:36:02.028428: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace09900 of size 256 next 4 2025-05-27 06:36:02.028440: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace09a00 of size 16384 next 18 2025-05-27 06:36:02.028451: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace0da00 of size 256 next 100 2025-05-27 06:36:02.028463: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace0db00 of size 256 next 101 2025-05-27 06:36:02.028482: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace0dc00 of size 2048 next 104 2025-05-27 06:36:02.028494: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace0e400 of size 2048 next 105 2025-05-27 06:36:02.028506: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace0ec00 of size 2048 next 106 2025-05-27 06:36:02.028517: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace0f400 of size 2048 next 107 2025-05-27 06:36:02.028529: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace0fc00 of size 2048 next 108 2025-05-27 06:36:02.028541: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace10400 of size 256 next 109 2025-05-27 06:36:02.028552: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace10500 of size 256 next 110 2025-05-27 06:36:02.028564: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace10600 of size 2048 next 113 2025-05-27 06:36:02.028576: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace10e00 of size 2048 next 114 2025-05-27 06:36:02.028587: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace11600 of size 2048 next 115 2025-05-27 06:36:02.028599: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace11e00 of size 2048 next 116 2025-05-27 06:36:02.028611: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace12600 of size 2048 next 6 2025-05-27 06:36:02.028623: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace12e00 of size 37632 next 7 2025-05-27 06:36:02.028634: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace1c100 of size 512 next 118 2025-05-27 06:36:02.028646: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace1c300 of size 512 next 119 2025-05-27 06:36:02.028658: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace1c500 of size 512 next 120 2025-05-27 06:36:02.028669: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace1c700 of size 512 next 121 2025-05-27 06:36:02.028681: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace1c900 of size 512 next 122 2025-05-27 06:36:02.028692: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace1cb00 of size 512 next 125 2025-05-27 06:36:02.028704: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace1cd00 of size 512 next 126 2025-05-27 06:36:02.028715: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace1cf00 of size 512 next 127 2025-05-27 06:36:02.028727: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace1d100 of size 512 next 128 2025-05-27 06:36:02.028739: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace1d300 of size 512 next 129 2025-05-27 06:36:02.028750: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace1d500 of size 2048 next 130 2025-05-27 06:36:02.028762: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace1dd00 of size 2048 next 131 2025-05-27 06:36:02.028773: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace1e500 of size 2048 next 132 2025-05-27 06:36:02.028785: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace1ed00 of size 2048 next 133 2025-05-27 06:36:02.028797: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace1f500 of size 2048 next 134 2025-05-27 06:36:02.028808: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace1fd00 of size 512 next 136 2025-05-27 06:36:02.028820: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace1ff00 of size 512 next 137 2025-05-27 06:36:02.028831: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace20100 of size 512 next 138 2025-05-27 06:36:02.028843: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace20300 of size 512 next 139 2025-05-27 06:36:02.028862: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace20500 of size 512 next 140 2025-05-27 06:36:02.028874: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace20700 of size 512 next 141 2025-05-27 06:36:02.028886: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace20900 of size 512 next 143 2025-05-27 06:36:02.028897: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace20b00 of size 512 next 144 2025-05-27 06:36:02.028909: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace20d00 of size 512 next 145 2025-05-27 06:36:02.028921: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace20f00 of size 512 next 146 2025-05-27 06:36:02.028932: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace21100 of size 2048 next 147 2025-05-27 06:36:02.028944: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace21900 of size 2048 next 148 2025-05-27 06:36:02.028955: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace22100 of size 2048 next 149 2025-05-27 06:36:02.028967: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace22900 of size 2048 next 150 2025-05-27 06:36:02.028979: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace23100 of size 2048 next 151 2025-05-27 06:36:02.028990: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace23900 of size 512 next 153 2025-05-27 06:36:02.029002: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace23b00 of size 512 next 154 2025-05-27 06:36:02.029013: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace23d00 of size 512 next 155 2025-05-27 06:36:02.029025: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace23f00 of size 512 next 156 2025-05-27 06:36:02.029037: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace24100 of size 512 next 157 2025-05-27 06:36:02.029048: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace24300 of size 512 next 161 2025-05-27 06:36:02.029060: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace24500 of size 512 next 162 2025-05-27 06:36:02.029071: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace24700 of size 512 next 163 2025-05-27 06:36:02.029083: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace24900 of size 512 next 164 2025-05-27 06:36:02.029095: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace24b00 of size 512 next 165 2025-05-27 06:36:02.029106: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace24d00 of size 2048 next 166 2025-05-27 06:36:02.029118: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace25500 of size 2048 next 167 2025-05-27 06:36:02.029130: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace25d00 of size 2048 next 168 2025-05-27 06:36:02.029141: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace26500 of size 2048 next 169 2025-05-27 06:36:02.029153: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace26d00 of size 2048 next 170 2025-05-27 06:36:02.029164: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace27500 of size 1024 next 172 2025-05-27 06:36:02.029176: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace27900 of size 1024 next 173 2025-05-27 06:36:02.029188: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace27d00 of size 1024 next 174 2025-05-27 06:36:02.029199: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace28100 of size 1024 next 175 2025-05-27 06:36:02.029211: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace28500 of size 1024 next 176 2025-05-27 06:36:02.029222: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace28900 of size 256 next 178 2025-05-27 06:36:02.029242: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace28a00 of size 256 next 179 2025-05-27 06:36:02.029254: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace28b00 of size 1024 next 177 2025-05-27 06:36:02.029265: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace28f00 of size 1024 next 182 2025-05-27 06:36:02.029277: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace29300 of size 1024 next 183 2025-05-27 06:36:02.029288: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace29700 of size 1024 next 184 2025-05-27 06:36:02.029300: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace29b00 of size 1024 next 185 2025-05-27 06:36:02.029312: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace29f00 of size 256 next 187 2025-05-27 06:36:02.029323: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace2a000 of size 256 next 188 2025-05-27 06:36:02.029335: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace2a100 of size 4096 next 186 2025-05-27 06:36:02.029346: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace2b100 of size 4096 next 42 2025-05-27 06:36:02.029358: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace2c100 of size 65536 next 36 2025-05-27 06:36:02.029370: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace3c100 of size 65536 next 35 2025-05-27 06:36:02.029381: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace4c100 of size 4096 next 235 2025-05-27 06:36:02.029393: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace4d100 of size 4096 next 236 2025-05-27 06:36:02.029404: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace4e100 of size 4096 next 237 2025-05-27 06:36:02.029416: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace4f100 of size 4096 next 238 2025-05-27 06:36:02.029428: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace50100 of size 1024 next 239 2025-05-27 06:36:02.029439: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace50500 of size 1024 next 240 2025-05-27 06:36:02.029451: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace50900 of size 1024 next 241 2025-05-27 06:36:02.029462: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace50d00 of size 1024 next 242 2025-05-27 06:36:02.029474: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace51100 of size 1024 next 243 2025-05-27 06:36:02.029486: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace51500 of size 1024 next 246 2025-05-27 06:36:02.029497: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace51900 of size 1024 next 247 2025-05-27 06:36:02.029509: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace51d00 of size 1024 next 248 2025-05-27 06:36:02.029520: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace52100 of size 1024 next 249 2025-05-27 06:36:02.029532: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace52500 of size 1024 next 250 2025-05-27 06:36:02.029543: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace52900 of size 4096 next 252 2025-05-27 06:36:02.029555: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace53900 of size 4096 next 253 2025-05-27 06:36:02.029567: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace54900 of size 4096 next 254 2025-05-27 06:36:02.029578: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace55900 of size 4096 next 255 2025-05-27 06:36:02.029590: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace56900 of size 4096 next 256 2025-05-27 06:36:02.029601: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace57900 of size 1024 next 257 2025-05-27 06:36:02.029613: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace57d00 of size 1024 next 258 2025-05-27 06:36:02.029632: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace58100 of size 1024 next 259 2025-05-27 06:36:02.029644: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace58500 of size 1024 next 260 2025-05-27 06:36:02.029656: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace58900 of size 1024 next 261 2025-05-27 06:36:02.029667: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace58d00 of size 1024 next 264 2025-05-27 06:36:02.029679: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace59100 of size 1024 next 265 2025-05-27 06:36:02.029690: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace59500 of size 1024 next 266 2025-05-27 06:36:02.029702: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace59900 of size 1024 next 267 2025-05-27 06:36:02.029714: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace59d00 of size 1024 next 268 2025-05-27 06:36:02.029725: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace5a100 of size 4096 next 270 2025-05-27 06:36:02.029737: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace5b100 of size 4096 next 271 2025-05-27 06:36:02.029749: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace5c100 of size 4096 next 272 2025-05-27 06:36:02.029760: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace5d100 of size 4096 next 273 2025-05-27 06:36:02.029772: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace5e100 of size 4096 next 274 2025-05-27 06:36:02.029783: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace5f100 of size 1024 next 275 2025-05-27 06:36:02.029795: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace5f500 of size 1024 next 276 2025-05-27 06:36:02.029806: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace5f900 of size 1024 next 277 2025-05-27 06:36:02.029818: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace5fd00 of size 1024 next 278 2025-05-27 06:36:02.029830: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace60100 of size 1024 next 279 2025-05-27 06:36:02.029841: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace60500 of size 1024 next 282 2025-05-27 06:36:02.029853: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace60900 of size 1024 next 283 2025-05-27 06:36:02.029864: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace60d00 of size 1024 next 284 2025-05-27 06:36:02.029876: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace61100 of size 1024 next 285 2025-05-27 06:36:02.029887: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace61500 of size 1024 next 286 2025-05-27 06:36:02.029899: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace61900 of size 4096 next 288 2025-05-27 06:36:02.029911: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace62900 of size 6144 next 27 2025-05-27 06:36:02.029922: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace64100 of size 147456 next 26 2025-05-27 06:36:02.029934: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace88100 of size 65536 next 47 2025-05-27 06:36:02.029946: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace98100 of size 65536 next 59 2025-05-27 06:36:02.029957: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49acea8100 of size 65536 next 65 2025-05-27 06:36:02.029969: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49aceb8100 of size 294656 next 18446744073709551615 2025-05-27 06:36:02.029981: I tensorflow/core/common_runtime/bfc_allocator.cc:995] Summary of in-use Chunks by size: 2025-05-27 06:36:02.029996: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 62 Chunks of size 256 totalling 15.5KiB 2025-05-27 06:36:02.030018: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 40 Chunks of size 512 totalling 20.0KiB 2025-05-27 06:36:02.030031: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 250 Chunks of size 1024 totalling 250.0KiB 2025-05-27 06:36:02.030044: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 1280 totalling 1.2KiB 2025-05-27 06:36:02.030057: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 30 Chunks of size 2048 totalling 60.0KiB 2025-05-27 06:36:02.030070: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 117 Chunks of size 4096 totalling 468.0KiB 2025-05-27 06:36:02.030083: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 2 Chunks of size 6144 totalling 12.0KiB 2025-05-27 06:36:02.030096: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 7680 totalling 7.5KiB 2025-05-27 06:36:02.030109: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 16384 totalling 16.0KiB 2025-05-27 06:36:02.030122: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 37632 totalling 36.8KiB 2025-05-27 06:36:02.030136: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 6 Chunks of size 65536 totalling 384.0KiB 2025-05-27 06:36:02.030149: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 131072 totalling 128.0KiB 2025-05-27 06:36:02.030162: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 3 Chunks of size 147456 totalling 432.0KiB 2025-05-27 06:36:02.030175: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 4 Chunks of size 262144 totalling 1.00MiB 2025-05-27 06:36:02.030188: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 294656 totalling 287.8KiB 2025-05-27 06:36:02.030201: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 2 Chunks of size 327680 totalling 640.0KiB 2025-05-27 06:36:02.030214: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 2 Chunks of size 524288 totalling 1.00MiB 2025-05-27 06:36:02.030226: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 3 Chunks of size 589824 totalling 1.69MiB 2025-05-27 06:36:02.030239: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 786432 totalling 768.0KiB 2025-05-27 06:36:02.030252: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 25 Chunks of size 1048576 totalling 25.00MiB 2025-05-27 06:36:02.030265: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 18 Chunks of size 1310720 totalling 22.50MiB 2025-05-27 06:36:02.030278: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 1441792 totalling 1.38MiB 2025-05-27 06:36:02.030291: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 1835008 totalling 1.75MiB 2025-05-27 06:36:02.030304: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 2 Chunks of size 2097152 totalling 4.00MiB 2025-05-27 06:36:02.030317: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 23 Chunks of size 2359296 totalling 51.75MiB 2025-05-27 06:36:02.030330: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 12451840 totalling 11.88MiB 2025-05-27 06:36:02.030343: I tensorflow/core/common_runtime/bfc_allocator.cc:1002] Sum Total of in-use chunks: 125.38MiB 2025-05-27 06:36:02.030355: I tensorflow/core/common_runtime/bfc_allocator.cc:1004] total_region_allocated_bytes_: 145620992 memory_limit_: 145620992 available bytes: 0 curr_region_allocation_bytes_: 268435456 2025-05-27 06:36:02.030375: I tensorflow/core/common_runtime/bfc_allocator.cc:1010] Stats: Limit: 145620992 InUse: 131472128 MaxInUse: 131472128 NumAllocs: 2024 MaxAllocSize: 12451840 2025-05-27 06:36:02.030403: W tensorflow/core/common_runtime/bfc_allocator.cc:439] ********************************************__*********************************_********x*********** 2025-05-27 06:36:02.030447: W tensorflow/core/framework/op_kernel.cc:1753] OP_REQUIRES failed at cwise_ops_common.h:134 : Resource exhausted: OOM when allocating tensor with shape[3,3,512,512] and type float on /job:localhost/replica:0/task:0/device:GPU:0 by allocator GPU_0_bfc RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 Exception in mask_detect : OOM when allocating tensor with shape[3,3,512,512] and type float on /job:localhost/replica:0/task:0/device:GPU:0 by allocator GPU_0_bfc [Op:Mul] we want to redo the detection Using TensorFlow backend. max_time_sub_proc : 3600 erreur pendant la detection Useless call to update_current_state in case -12 caffe_path_current : About to save ! 1 Inside saveOutput : final : True verbose : False eke 12-6-18 : saveMask need to be cleaned for new output ! ERROR : mask output needs to be a dictionnary now ! No output to save, continue without doing anything ! save missing photos in datou_result : After save, about to update current ! datou_cur_ids : [] len(datou.list_steps) : 1 output : -12 free memory after detection : begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 88 ############################### TEST detect object ################################ run mask_detect Inside batchDatouExec : verbose : False Catched exception ! Connect or reconnect ! # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : mask_detect list_input_json : [] origin BFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 1 ; length of list_pids : 1 ; length of list_args : 1 time to download the photos : 0.1786048412322998 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : False number of steps : 1 step1:mask_detect Tue May 27 06:36:03 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory havn't enough memory gpu , need / 3000 l 3632 free memory gpu now : 515 wait 20 seconds l 3637 free memory gpu now : 515 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-05-27 06:36:26.258881: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-05-27 06:36:26.287179: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-05-27 06:36:26.289593: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f4a54000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-05-27 06:36:26.289647: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-05-27 06:36:26.293844: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-05-27 06:36:26.646247: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x3b534e50 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-05-27 06:36:26.646298: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-05-27 06:36:26.646999: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-27 06:36:26.647450: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-27 06:36:26.650093: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-27 06:36:26.653227: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-27 06:36:26.654808: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-27 06:36:26.659382: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-27 06:36:26.661119: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-27 06:36:26.669581: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-27 06:36:26.670812: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-27 06:36:26.671023: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-27 06:36:26.671683: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-27 06:36:26.671706: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-27 06:36:26.671719: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-27 06:36:26.672835: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 138 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl454 thcls : [{'id': 454, 'mtr_user_id': 31, 'name': 'mask_coco_origin', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'backgroud,person,bicycle,car,motorcycle,airplane,bus,train,truck,boat,trafficlight,firehydrant,stopsign,parkingmeter,bench,bird,cat,dog,horse,sheep,cow,elephant,bear,zebra,giraffe,backpack,umbrella,handbag,tie,suitcase,frisbee,skis,snowboard,sportsball,kite,baseballbat,baseballglove,skateboard,surfboard,tennisracket,bottle,wineglass,cup,fork,knife,spoon,bowl,banana,apple,sandwich,orange,broccoli,carrot,hotdog,pizza,donut,cake,chair,couch,pottedplant,bed,diningtable,toilet,tv,laptop,mouse,remote,keyboard,cellphone,microwave,oven,toaster,sink,refrigerator,book,clock,vase,scissors,teddybear,hairdrier,toothbrush', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 445, 'photo_desc_type': 3473, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0'}] thcl {'id': 454, 'mtr_user_id': 31, 'name': 'mask_coco_origin', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'backgroud,person,bicycle,car,motorcycle,airplane,bus,train,truck,boat,trafficlight,firehydrant,stopsign,parkingmeter,bench,bird,cat,dog,horse,sheep,cow,elephant,bear,zebra,giraffe,backpack,umbrella,handbag,tie,suitcase,frisbee,skis,snowboard,sportsball,kite,baseballbat,baseballglove,skateboard,surfboard,tennisracket,bottle,wineglass,cup,fork,knife,spoon,bowl,banana,apple,sandwich,orange,broccoli,carrot,hotdog,pizza,donut,cake,chair,couch,pottedplant,bed,diningtable,toilet,tv,laptop,mouse,remote,keyboard,cellphone,microwave,oven,toaster,sink,refrigerator,book,clock,vase,scissors,teddybear,hairdrier,toothbrush', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 445, 'photo_desc_type': 3473, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 3473 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (3473, 'mask_coco_origin', 16384, 25088, 'mask_coco_origin', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2018, 3, 19, 10, 42, 21), datetime.datetime(2018, 3, 19, 10, 42, 21)) {'thcl': {'id': 454, 'mtr_user_id': 31, 'name': 'mask_coco_origin', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'backgroud,person,bicycle,car,motorcycle,airplane,bus,train,truck,boat,trafficlight,firehydrant,stopsign,parkingmeter,bench,bird,cat,dog,horse,sheep,cow,elephant,bear,zebra,giraffe,backpack,umbrella,handbag,tie,suitcase,frisbee,skis,snowboard,sportsball,kite,baseballbat,baseballglove,skateboard,surfboard,tennisracket,bottle,wineglass,cup,fork,knife,spoon,bowl,banana,apple,sandwich,orange,broccoli,carrot,hotdog,pizza,donut,cake,chair,couch,pottedplant,bed,diningtable,toilet,tv,laptop,mouse,remote,keyboard,cellphone,microwave,oven,toaster,sink,refrigerator,book,clock,vase,scissors,teddybear,hairdrier,toothbrush', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 445, 'photo_desc_type': 3473, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['backgroud', 'person', 'bicycle', 'car', 'motorcycle', 'airplane', 'bus', 'train', 'truck', 'boat', 'trafficlight', 'firehydrant', 'stopsign', 'parkingmeter', 'bench', 'bird', 'cat', 'dog', 'horse', 'sheep', 'cow', 'elephant', 'bear', 'zebra', 'giraffe', 'backpack', 'umbrella', 'handbag', 'tie', 'suitcase', 'frisbee', 'skis', 'snowboard', 'sportsball', 'kite', 'baseballbat', 'baseballglove', 'skateboard', 'surfboard', 'tennisracket', 'bottle', 'wineglass', 'cup', 'fork', 'knife', 'spoon', 'bowl', 'banana', 'apple', 'sandwich', 'orange', 'broccoli', 'carrot', 'hotdog', 'pizza', 'donut', 'cake', 'chair', 'couch', 'pottedplant', 'bed', 'diningtable', 'toilet', 'tv', 'laptop', 'mouse', 'remote', 'keyboard', 'cellphone', 'microwave', 'oven', 'toaster', 'sink', 'refrigerator', 'book', 'clock', 'vase', 'scissors', 'teddybear', 'hairdrier', 'toothbrush'], 'list_hashtags_csv': 'backgroud,person,bicycle,car,motorcycle,airplane,bus,train,truck,boat,trafficlight,firehydrant,stopsign,parkingmeter,bench,bird,cat,dog,horse,sheep,cow,elephant,bear,zebra,giraffe,backpack,umbrella,handbag,tie,suitcase,frisbee,skis,snowboard,sportsball,kite,baseballbat,baseballglove,skateboard,surfboard,tennisracket,bottle,wineglass,cup,fork,knife,spoon,bowl,banana,apple,sandwich,orange,broccoli,carrot,hotdog,pizza,donut,cake,chair,couch,pottedplant,bed,diningtable,toilet,tv,laptop,mouse,remote,keyboard,cellphone,microwave,oven,toaster,sink,refrigerator,book,clock,vase,scissors,teddybear,hairdrier,toothbrush', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 445, 'svm_hashtag_type_desc': 3473, 'photo_desc_type': 3473, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['backgroud', 'person', 'bicycle', 'car', 'motorcycle', 'airplane', 'bus', 'train', 'truck', 'boat', 'trafficlight', 'firehydrant', 'stopsign', 'parkingmeter', 'bench', 'bird', 'cat', 'dog', 'horse', 'sheep', 'cow', 'elephant', 'bear', 'zebra', 'giraffe', 'backpack', 'umbrella', 'handbag', 'tie', 'suitcase', 'frisbee', 'skis', 'snowboard', 'sportsball', 'kite', 'baseballbat', 'baseballglove', 'skateboard', 'surfboard', 'tennisracket', 'bottle', 'wineglass', 'cup', 'fork', 'knife', 'spoon', 'bowl', 'banana', 'apple', 'sandwich', 'orange', 'broccoli', 'carrot', 'hotdog', 'pizza', 'donut', 'cake', 'chair', 'couch', 'pottedplant', 'bed', 'diningtable', 'toilet', 'tv', 'laptop', 'mouse', 'remote', 'keyboard', 'cellphone', 'microwave', 'oven', 'toaster', 'sink', 'refrigerator', 'book', 'clock', 'vase', 'scissors', 'teddybear', 'hairdrier', 'toothbrush'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME mask_coco_origin NUM_CLASSES 81 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 2025-05-27 06:36:27.335989: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-27 06:36:27.336063: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-27 06:36:27.336080: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-27 06:36:27.336096: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-27 06:36:27.336111: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-27 06:36:27.336126: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-27 06:36:27.336141: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-27 06:36:27.336156: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-27 06:36:27.336857: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-27 06:36:27.337783: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-27 06:36:27.337836: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-27 06:36:27.337861: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-27 06:36:27.337885: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-27 06:36:27.337909: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-27 06:36:27.337936: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-27 06:36:27.337961: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-27 06:36:27.337984: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-27 06:36:27.338672: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-27 06:36:27.338711: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-27 06:36:27.338720: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-27 06:36:27.338728: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-27 06:36:27.339488: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 138 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) 2025-05-27 06:36:39.053723: W tensorflow/core/common_runtime/bfc_allocator.cc:434] Allocator (GPU_0_bfc) ran out of memory trying to allocate 9.00MiB (rounded to 9437184) Current allocation summary follows. 2025-05-27 06:36:39.053834: I tensorflow/core/common_runtime/bfc_allocator.cc:934] BFCAllocator dump for GPU_0_bfc 2025-05-27 06:36:39.053847: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (256): Total Chunks: 62, Chunks in use: 62. 15.5KiB allocated for chunks. 15.5KiB in use in bin. 8.9KiB client-requested in use in bin. 2025-05-27 06:36:39.053856: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (512): Total Chunks: 40, Chunks in use: 40. 20.0KiB allocated for chunks. 20.0KiB in use in bin. 20.0KiB client-requested in use in bin. 2025-05-27 06:36:39.053865: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (1024): Total Chunks: 251, Chunks in use: 251. 251.2KiB allocated for chunks. 251.2KiB in use in bin. 251.0KiB client-requested in use in bin. 2025-05-27 06:36:39.053874: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (2048): Total Chunks: 30, Chunks in use: 30. 60.0KiB allocated for chunks. 60.0KiB in use in bin. 60.0KiB client-requested in use in bin. 2025-05-27 06:36:39.053883: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (4096): Total Chunks: 120, Chunks in use: 120. 487.5KiB allocated for chunks. 487.5KiB in use in bin. 480.0KiB client-requested in use in bin. 2025-05-27 06:36:39.053891: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (8192): Total Chunks: 0, Chunks in use: 0. 0B allocated for chunks. 0B in use in bin. 0B client-requested in use in bin. 2025-05-27 06:36:39.053899: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (16384): Total Chunks: 1, Chunks in use: 1. 16.0KiB allocated for chunks. 16.0KiB in use in bin. 16.0KiB client-requested in use in bin. 2025-05-27 06:36:39.053934: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (32768): Total Chunks: 1, Chunks in use: 1. 36.8KiB allocated for chunks. 36.8KiB in use in bin. 36.8KiB client-requested in use in bin. 2025-05-27 06:36:39.053943: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (65536): Total Chunks: 6, Chunks in use: 6. 384.0KiB allocated for chunks. 384.0KiB in use in bin. 384.0KiB client-requested in use in bin. 2025-05-27 06:36:39.053952: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (131072): Total Chunks: 4, Chunks in use: 4. 560.0KiB allocated for chunks. 560.0KiB in use in bin. 560.0KiB client-requested in use in bin. 2025-05-27 06:36:39.053960: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (262144): Total Chunks: 7, Chunks in use: 7. 1.91MiB allocated for chunks. 1.91MiB in use in bin. 1.75MiB client-requested in use in bin. 2025-05-27 06:36:39.053968: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (524288): Total Chunks: 8, Chunks in use: 6. 4.93MiB allocated for chunks. 3.44MiB in use in bin. 3.25MiB client-requested in use in bin. 2025-05-27 06:36:39.053976: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (1048576): Total Chunks: 48, Chunks in use: 45. 54.12MiB allocated for chunks. 50.62MiB in use in bin. 45.00MiB client-requested in use in bin. 2025-05-27 06:36:39.053985: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (2097152): Total Chunks: 28, Chunks in use: 25. 64.25MiB allocated for chunks. 55.75MiB in use in bin. 55.75MiB client-requested in use in bin. 2025-05-27 06:36:39.053992: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (4194304): Total Chunks: 0, Chunks in use: 0. 0B allocated for chunks. 0B in use in bin. 0B client-requested in use in bin. 2025-05-27 06:36:39.054001: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (8388608): Total Chunks: 1, Chunks in use: 1. 11.88MiB allocated for chunks. 11.88MiB in use in bin. 9.00MiB client-requested in use in bin. 2025-05-27 06:36:39.054009: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (16777216): Total Chunks: 0, Chunks in use: 0. 0B allocated for chunks. 0B in use in bin. 0B client-requested in use in bin. 2025-05-27 06:36:39.054016: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (33554432): Total Chunks: 0, Chunks in use: 0. 0B allocated for chunks. 0B in use in bin. 0B client-requested in use in bin. 2025-05-27 06:36:39.054023: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (67108864): Total Chunks: 0, Chunks in use: 0. 0B allocated for chunks. 0B in use in bin. 0B client-requested in use in bin. 2025-05-27 06:36:39.054031: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (134217728): Total Chunks: 0, Chunks in use: 0. 0B allocated for chunks. 0B in use in bin. 0B client-requested in use in bin. 2025-05-27 06:36:39.054038: I tensorflow/core/common_runtime/bfc_allocator.cc:941] Bin (268435456): Total Chunks: 0, Chunks in use: 0. 0B allocated for chunks. 0B in use in bin. 0B client-requested in use in bin. 2025-05-27 06:36:39.054047: I tensorflow/core/common_runtime/bfc_allocator.cc:957] Bin for 9.00MiB was 8.00MiB, Chunk State: 2025-05-27 06:36:39.054054: I tensorflow/core/common_runtime/bfc_allocator.cc:970] Next region of size 67108864 2025-05-27 06:36:39.054067: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4866000000 of size 2359296 next 370 2025-05-27 06:36:39.054075: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4866240000 of size 1048576 next 394 2025-05-27 06:36:39.054081: I tensorflow/core/common_runtime/bfc_allocator.cc:990] Free at 7f4866340000 of size 1310720 next 388 2025-05-27 06:36:39.054088: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4866480000 of size 2359296 next 387 2025-05-27 06:36:39.054094: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f48666c0000 of size 1048576 next 412 2025-05-27 06:36:39.054101: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f48667c0000 of size 1310720 next 406 2025-05-27 06:36:39.054114: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4866900000 of size 2359296 next 405 2025-05-27 06:36:39.054121: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4866b40000 of size 1048576 next 430 2025-05-27 06:36:39.054127: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4866c40000 of size 1310720 next 424 2025-05-27 06:36:39.054133: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4866d80000 of size 2359296 next 423 2025-05-27 06:36:39.054140: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4866fc0000 of size 1048576 next 447 2025-05-27 06:36:39.054147: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f48670c0000 of size 1310720 next 441 2025-05-27 06:36:39.054153: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4867200000 of size 2359296 next 440 2025-05-27 06:36:39.054160: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4867440000 of size 1048576 next 465 2025-05-27 06:36:39.054166: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4867540000 of size 1310720 next 459 2025-05-27 06:36:39.054173: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4867680000 of size 2359296 next 458 2025-05-27 06:36:39.054179: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f48678c0000 of size 1048576 next 483 2025-05-27 06:36:39.054186: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f48679c0000 of size 1310720 next 477 2025-05-27 06:36:39.054192: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4867b00000 of size 2359296 next 476 2025-05-27 06:36:39.054199: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4867d40000 of size 1048576 next 501 2025-05-27 06:36:39.054205: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4867e40000 of size 1310720 next 495 2025-05-27 06:36:39.054211: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4867f80000 of size 2359296 next 494 2025-05-27 06:36:39.054218: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f48681c0000 of size 1048576 next 519 2025-05-27 06:36:39.054224: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f48682c0000 of size 1310720 next 513 2025-05-27 06:36:39.054231: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4868400000 of size 2359296 next 512 2025-05-27 06:36:39.054237: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4868640000 of size 1048576 next 537 2025-05-27 06:36:39.054244: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4868740000 of size 1310720 next 531 2025-05-27 06:36:39.054250: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4868880000 of size 2359296 next 530 2025-05-27 06:36:39.054257: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4868ac0000 of size 1048576 next 555 2025-05-27 06:36:39.054263: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4868bc0000 of size 1310720 next 549 2025-05-27 06:36:39.054270: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4868d00000 of size 2359296 next 548 2025-05-27 06:36:39.054276: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4868f40000 of size 1048576 next 573 2025-05-27 06:36:39.054283: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4869040000 of size 1310720 next 567 2025-05-27 06:36:39.054289: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4869180000 of size 2359296 next 566 2025-05-27 06:36:39.054295: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f48693c0000 of size 1048576 next 591 2025-05-27 06:36:39.054302: I tensorflow/core/common_runtime/bfc_allocator.cc:990] Free at 7f48694c0000 of size 1310720 next 585 2025-05-27 06:36:39.054308: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4869600000 of size 2359296 next 584 2025-05-27 06:36:39.054320: I tensorflow/core/common_runtime/bfc_allocator.cc:990] Free at 7f4869840000 of size 2097152 next 597 2025-05-27 06:36:39.054327: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f4869a40000 of size 2097152 next 596 2025-05-27 06:36:39.054333: I tensorflow/core/common_runtime/bfc_allocator.cc:990] Free at 7f4869c40000 of size 3932160 next 18446744073709551615 2025-05-27 06:36:39.054340: I tensorflow/core/common_runtime/bfc_allocator.cc:970] Next region of size 33554432 2025-05-27 06:36:39.054347: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486a000000 of size 2359296 next 245 2025-05-27 06:36:39.054354: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486a240000 of size 1048576 next 269 2025-05-27 06:36:39.054360: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486a340000 of size 1310720 next 263 2025-05-27 06:36:39.054367: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486a480000 of size 2359296 next 262 2025-05-27 06:36:39.054373: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486a6c0000 of size 1048576 next 287 2025-05-27 06:36:39.054379: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486a7c0000 of size 1310720 next 281 2025-05-27 06:36:39.054386: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486a900000 of size 2359296 next 280 2025-05-27 06:36:39.054392: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486ab40000 of size 1048576 next 304 2025-05-27 06:36:39.054399: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486ac40000 of size 1310720 next 298 2025-05-27 06:36:39.054405: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486ad80000 of size 2359296 next 297 2025-05-27 06:36:39.054411: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486afc0000 of size 1048576 next 322 2025-05-27 06:36:39.054418: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486b0c0000 of size 1310720 next 316 2025-05-27 06:36:39.054425: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486b200000 of size 2359296 next 315 2025-05-27 06:36:39.054431: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486b440000 of size 1048576 next 340 2025-05-27 06:36:39.054438: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486b540000 of size 1310720 next 334 2025-05-27 06:36:39.054444: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486b680000 of size 2359296 next 333 2025-05-27 06:36:39.054451: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486b8c0000 of size 1048576 next 358 2025-05-27 06:36:39.054457: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486b9c0000 of size 1310720 next 352 2025-05-27 06:36:39.054463: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486bb00000 of size 2359296 next 351 2025-05-27 06:36:39.054470: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486bd40000 of size 1048576 next 376 2025-05-27 06:36:39.054476: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486be40000 of size 1835008 next 18446744073709551615 2025-05-27 06:36:39.054483: I tensorflow/core/common_runtime/bfc_allocator.cc:970] Next region of size 16777216 2025-05-27 06:36:39.054489: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486c000000 of size 2359296 next 181 2025-05-27 06:36:39.054496: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486c240000 of size 2097152 next 196 2025-05-27 06:36:39.054502: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486c440000 of size 1048576 next 216 2025-05-27 06:36:39.054509: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486c540000 of size 1310720 next 209 2025-05-27 06:36:39.054515: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486c680000 of size 2359296 next 208 2025-05-27 06:36:39.054522: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486c8c0000 of size 1048576 next 234 2025-05-27 06:36:39.054533: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486c9c0000 of size 1310720 next 228 2025-05-27 06:36:39.054540: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486cb00000 of size 2359296 next 227 2025-05-27 06:36:39.054547: I tensorflow/core/common_runtime/bfc_allocator.cc:990] Free at 7f486cd40000 of size 2883584 next 18446744073709551615 2025-05-27 06:36:39.054553: I tensorflow/core/common_runtime/bfc_allocator.cc:970] Next region of size 12451840 2025-05-27 06:36:39.054560: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486d000000 of size 12451840 next 18446744073709551615 2025-05-27 06:36:39.054567: I tensorflow/core/common_runtime/bfc_allocator.cc:970] Next region of size 2097152 2025-05-27 06:36:39.054573: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e600000 of size 147456 next 55 2025-05-27 06:36:39.054580: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e624000 of size 65536 next 78 2025-05-27 06:36:39.054587: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e634000 of size 4096 next 191 2025-05-27 06:36:39.054593: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e635000 of size 4096 next 192 2025-05-27 06:36:39.054600: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e636000 of size 4096 next 193 2025-05-27 06:36:39.054606: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e637000 of size 256 next 194 2025-05-27 06:36:39.054613: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e637100 of size 256 next 195 2025-05-27 06:36:39.054619: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e637200 of size 4096 next 197 2025-05-27 06:36:39.054625: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e638200 of size 4096 next 198 2025-05-27 06:36:39.054632: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e639200 of size 4096 next 199 2025-05-27 06:36:39.054638: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e63a200 of size 4096 next 200 2025-05-27 06:36:39.054644: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e63b200 of size 4096 next 201 2025-05-27 06:36:39.054651: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e63c200 of size 1024 next 202 2025-05-27 06:36:39.054657: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e63c600 of size 1024 next 204 2025-05-27 06:36:39.054664: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e63ca00 of size 1024 next 205 2025-05-27 06:36:39.054670: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e63ce00 of size 1024 next 206 2025-05-27 06:36:39.054676: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e63d200 of size 1024 next 207 2025-05-27 06:36:39.054683: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e63d600 of size 1024 next 210 2025-05-27 06:36:39.054689: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e63da00 of size 1024 next 211 2025-05-27 06:36:39.054695: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e63de00 of size 1024 next 212 2025-05-27 06:36:39.054702: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e63e200 of size 1024 next 213 2025-05-27 06:36:39.054708: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e63e600 of size 1024 next 214 2025-05-27 06:36:39.054714: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e63ea00 of size 4096 next 215 2025-05-27 06:36:39.054721: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e63fa00 of size 4096 next 217 2025-05-27 06:36:39.054727: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e640a00 of size 4096 next 218 2025-05-27 06:36:39.054733: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e641a00 of size 4096 next 219 2025-05-27 06:36:39.054745: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e642a00 of size 4096 next 220 2025-05-27 06:36:39.054751: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e643a00 of size 1024 next 221 2025-05-27 06:36:39.054758: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e643e00 of size 1024 next 223 2025-05-27 06:36:39.054764: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e644200 of size 1024 next 224 2025-05-27 06:36:39.054770: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e644600 of size 1024 next 225 2025-05-27 06:36:39.054777: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e644a00 of size 1024 next 226 2025-05-27 06:36:39.054783: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e644e00 of size 1024 next 229 2025-05-27 06:36:39.054789: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e645200 of size 1024 next 230 2025-05-27 06:36:39.054796: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e645600 of size 1024 next 231 2025-05-27 06:36:39.054802: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e645a00 of size 1024 next 232 2025-05-27 06:36:39.054808: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e645e00 of size 1024 next 233 2025-05-27 06:36:39.054815: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e646200 of size 7680 next 72 2025-05-27 06:36:39.054822: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e648000 of size 147456 next 71 2025-05-27 06:36:39.054828: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e66c000 of size 131072 next 87 2025-05-27 06:36:39.054835: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e68c000 of size 4096 next 289 2025-05-27 06:36:39.054841: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e68d000 of size 4096 next 290 2025-05-27 06:36:39.054847: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e68e000 of size 4096 next 291 2025-05-27 06:36:39.054854: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e68f000 of size 1024 next 292 2025-05-27 06:36:39.054860: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e68f400 of size 1024 next 293 2025-05-27 06:36:39.054867: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e68f800 of size 1024 next 294 2025-05-27 06:36:39.054873: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e68fc00 of size 1024 next 295 2025-05-27 06:36:39.054879: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e690000 of size 1024 next 296 2025-05-27 06:36:39.054886: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e690400 of size 1024 next 299 2025-05-27 06:36:39.054893: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e690800 of size 1024 next 300 2025-05-27 06:36:39.054914: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e690c00 of size 1024 next 301 2025-05-27 06:36:39.054922: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e691000 of size 1024 next 302 2025-05-27 06:36:39.054929: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e691400 of size 1024 next 303 2025-05-27 06:36:39.054935: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e691800 of size 4096 next 305 2025-05-27 06:36:39.054941: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e692800 of size 4096 next 306 2025-05-27 06:36:39.054948: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e693800 of size 4096 next 307 2025-05-27 06:36:39.054954: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e694800 of size 4096 next 308 2025-05-27 06:36:39.054961: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e695800 of size 4096 next 309 2025-05-27 06:36:39.054972: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e696800 of size 1024 next 310 2025-05-27 06:36:39.054980: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e696c00 of size 1024 next 311 2025-05-27 06:36:39.054988: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e697000 of size 1024 next 312 2025-05-27 06:36:39.054995: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e697400 of size 1024 next 313 2025-05-27 06:36:39.055002: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e697800 of size 1024 next 314 2025-05-27 06:36:39.055009: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e697c00 of size 1024 next 317 2025-05-27 06:36:39.055016: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e698000 of size 1024 next 318 2025-05-27 06:36:39.055022: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e698400 of size 1024 next 319 2025-05-27 06:36:39.055029: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e698800 of size 1024 next 320 2025-05-27 06:36:39.055036: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e698c00 of size 1024 next 321 2025-05-27 06:36:39.055043: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e699000 of size 4096 next 323 2025-05-27 06:36:39.055050: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e69a000 of size 4096 next 324 2025-05-27 06:36:39.055057: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e69b000 of size 4096 next 325 2025-05-27 06:36:39.055064: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e69c000 of size 4096 next 326 2025-05-27 06:36:39.055071: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e69d000 of size 4096 next 327 2025-05-27 06:36:39.055078: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e69e000 of size 1024 next 328 2025-05-27 06:36:39.055085: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e69e400 of size 1024 next 329 2025-05-27 06:36:39.055092: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e69e800 of size 1024 next 330 2025-05-27 06:36:39.055099: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e69ec00 of size 1024 next 331 2025-05-27 06:36:39.055106: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e69f000 of size 1024 next 332 2025-05-27 06:36:39.055113: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e69f400 of size 1024 next 335 2025-05-27 06:36:39.055120: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e69f800 of size 1024 next 336 2025-05-27 06:36:39.055127: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e69fc00 of size 1024 next 337 2025-05-27 06:36:39.055134: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6a0000 of size 1024 next 338 2025-05-27 06:36:39.055141: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6a0400 of size 1024 next 339 2025-05-27 06:36:39.055147: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6a0800 of size 4096 next 341 2025-05-27 06:36:39.055154: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6a1800 of size 4096 next 342 2025-05-27 06:36:39.055161: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6a2800 of size 4096 next 343 2025-05-27 06:36:39.055168: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6a3800 of size 4096 next 344 2025-05-27 06:36:39.055175: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6a4800 of size 4096 next 345 2025-05-27 06:36:39.055182: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6a5800 of size 1024 next 346 2025-05-27 06:36:39.055189: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6a5c00 of size 1024 next 347 2025-05-27 06:36:39.055201: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6a6000 of size 1024 next 348 2025-05-27 06:36:39.055208: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6a6400 of size 1024 next 349 2025-05-27 06:36:39.055215: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6a6800 of size 1024 next 350 2025-05-27 06:36:39.055222: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6a6c00 of size 1024 next 353 2025-05-27 06:36:39.055229: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6a7000 of size 1024 next 354 2025-05-27 06:36:39.055236: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6a7400 of size 1024 next 355 2025-05-27 06:36:39.055243: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6a7800 of size 1024 next 356 2025-05-27 06:36:39.055250: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6a7c00 of size 1024 next 357 2025-05-27 06:36:39.055257: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6a8000 of size 4096 next 359 2025-05-27 06:36:39.055264: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6a9000 of size 4096 next 360 2025-05-27 06:36:39.055271: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6aa000 of size 4096 next 361 2025-05-27 06:36:39.055278: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6ab000 of size 4096 next 362 2025-05-27 06:36:39.055285: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6ac000 of size 4096 next 363 2025-05-27 06:36:39.055291: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6ad000 of size 1024 next 364 2025-05-27 06:36:39.055299: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6ad400 of size 1024 next 365 2025-05-27 06:36:39.055305: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6ad800 of size 1024 next 366 2025-05-27 06:36:39.055312: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6adc00 of size 1024 next 367 2025-05-27 06:36:39.055319: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6ae000 of size 1024 next 368 2025-05-27 06:36:39.055326: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6ae400 of size 1024 next 371 2025-05-27 06:36:39.055333: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6ae800 of size 1024 next 372 2025-05-27 06:36:39.055340: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6aec00 of size 1024 next 373 2025-05-27 06:36:39.055347: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6af000 of size 1024 next 374 2025-05-27 06:36:39.055354: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6af400 of size 1024 next 375 2025-05-27 06:36:39.055361: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6af800 of size 4096 next 377 2025-05-27 06:36:39.055368: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6b0800 of size 4096 next 378 2025-05-27 06:36:39.055375: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6b1800 of size 4096 next 379 2025-05-27 06:36:39.055382: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6b2800 of size 4096 next 380 2025-05-27 06:36:39.055389: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6b3800 of size 4096 next 381 2025-05-27 06:36:39.055395: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6b4800 of size 1024 next 382 2025-05-27 06:36:39.055402: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6b4c00 of size 1024 next 383 2025-05-27 06:36:39.055409: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6b5000 of size 1024 next 384 2025-05-27 06:36:39.055416: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6b5400 of size 1024 next 385 2025-05-27 06:36:39.055423: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6b5800 of size 1024 next 386 2025-05-27 06:36:39.055435: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6b5c00 of size 1024 next 389 2025-05-27 06:36:39.055443: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6b6000 of size 1024 next 390 2025-05-27 06:36:39.055450: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6b6400 of size 1024 next 391 2025-05-27 06:36:39.055457: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6b6800 of size 1024 next 392 2025-05-27 06:36:39.055463: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6b6c00 of size 1024 next 393 2025-05-27 06:36:39.055470: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6b7000 of size 4096 next 395 2025-05-27 06:36:39.055477: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6b8000 of size 4096 next 396 2025-05-27 06:36:39.055484: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6b9000 of size 4096 next 397 2025-05-27 06:36:39.055491: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6ba000 of size 4096 next 398 2025-05-27 06:36:39.055498: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6bb000 of size 4096 next 399 2025-05-27 06:36:39.055505: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6bc000 of size 1024 next 400 2025-05-27 06:36:39.055512: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6bc400 of size 1024 next 401 2025-05-27 06:36:39.055519: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6bc800 of size 1024 next 402 2025-05-27 06:36:39.055526: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6bcc00 of size 1024 next 403 2025-05-27 06:36:39.055533: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6bd000 of size 1024 next 404 2025-05-27 06:36:39.055540: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6bd400 of size 1024 next 407 2025-05-27 06:36:39.055547: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6bd800 of size 1024 next 408 2025-05-27 06:36:39.055554: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6bdc00 of size 1024 next 409 2025-05-27 06:36:39.055561: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6be000 of size 1024 next 410 2025-05-27 06:36:39.055567: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6be400 of size 1024 next 411 2025-05-27 06:36:39.055574: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6be800 of size 4096 next 413 2025-05-27 06:36:39.055581: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6bf800 of size 4096 next 414 2025-05-27 06:36:39.055588: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6c0800 of size 4096 next 415 2025-05-27 06:36:39.055595: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6c1800 of size 4096 next 416 2025-05-27 06:36:39.055602: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6c2800 of size 4096 next 417 2025-05-27 06:36:39.055609: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6c3800 of size 1024 next 418 2025-05-27 06:36:39.055616: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6c3c00 of size 1024 next 419 2025-05-27 06:36:39.055623: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6c4000 of size 1024 next 420 2025-05-27 06:36:39.055630: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6c4400 of size 1024 next 421 2025-05-27 06:36:39.055637: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6c4800 of size 1024 next 422 2025-05-27 06:36:39.055644: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6c4c00 of size 1024 next 425 2025-05-27 06:36:39.055651: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6c5000 of size 1024 next 426 2025-05-27 06:36:39.055664: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6c5400 of size 1024 next 427 2025-05-27 06:36:39.055671: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6c5800 of size 1024 next 428 2025-05-27 06:36:39.055678: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6c5c00 of size 1024 next 429 2025-05-27 06:36:39.055685: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6c6000 of size 4096 next 431 2025-05-27 06:36:39.055692: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6c7000 of size 4096 next 432 2025-05-27 06:36:39.055699: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6c8000 of size 4096 next 433 2025-05-27 06:36:39.055706: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6c9000 of size 4096 next 434 2025-05-27 06:36:39.055713: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6ca000 of size 4096 next 435 2025-05-27 06:36:39.055720: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6cb000 of size 1024 next 436 2025-05-27 06:36:39.055727: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6cb400 of size 1024 next 437 2025-05-27 06:36:39.055734: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6cb800 of size 1024 next 438 2025-05-27 06:36:39.055741: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6cbc00 of size 1024 next 103 2025-05-27 06:36:39.055749: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e6cc000 of size 262144 next 102 2025-05-27 06:36:39.055756: I tensorflow/core/common_runtime/bfc_allocator.cc:990] Free at 7f486e70c000 of size 999424 next 18446744073709551615 2025-05-27 06:36:39.055763: I tensorflow/core/common_runtime/bfc_allocator.cc:970] Next region of size 4194304 2025-05-27 06:36:39.055770: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e800000 of size 589824 next 96 2025-05-27 06:36:39.055777: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e890000 of size 262144 next 117 2025-05-27 06:36:39.055784: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8d0000 of size 1024 next 439 2025-05-27 06:36:39.055791: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8d0400 of size 1024 next 442 2025-05-27 06:36:39.055798: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8d0800 of size 1024 next 443 2025-05-27 06:36:39.055805: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8d0c00 of size 1024 next 444 2025-05-27 06:36:39.055812: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8d1000 of size 1024 next 445 2025-05-27 06:36:39.055818: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8d1400 of size 1024 next 446 2025-05-27 06:36:39.055825: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8d1800 of size 4096 next 448 2025-05-27 06:36:39.055832: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8d2800 of size 4096 next 449 2025-05-27 06:36:39.055839: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8d3800 of size 4096 next 450 2025-05-27 06:36:39.055846: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8d4800 of size 4096 next 451 2025-05-27 06:36:39.055853: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8d5800 of size 4096 next 452 2025-05-27 06:36:39.055860: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8d6800 of size 1024 next 453 2025-05-27 06:36:39.055867: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8d6c00 of size 1024 next 454 2025-05-27 06:36:39.055874: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8d7000 of size 1024 next 455 2025-05-27 06:36:39.055881: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8d7400 of size 1024 next 456 2025-05-27 06:36:39.055893: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8d7800 of size 1024 next 457 2025-05-27 06:36:39.055900: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8d7c00 of size 1024 next 460 2025-05-27 06:36:39.055907: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8d8000 of size 1024 next 461 2025-05-27 06:36:39.055914: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8d8400 of size 1024 next 462 2025-05-27 06:36:39.055921: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8d8800 of size 1024 next 463 2025-05-27 06:36:39.055928: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8d8c00 of size 1024 next 464 2025-05-27 06:36:39.055935: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8d9000 of size 4096 next 466 2025-05-27 06:36:39.055942: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8da000 of size 4096 next 467 2025-05-27 06:36:39.055949: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8db000 of size 4096 next 468 2025-05-27 06:36:39.055956: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8dc000 of size 4096 next 469 2025-05-27 06:36:39.055963: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8dd000 of size 4096 next 470 2025-05-27 06:36:39.055969: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8de000 of size 1024 next 471 2025-05-27 06:36:39.055976: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8de400 of size 1024 next 472 2025-05-27 06:36:39.055983: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8de800 of size 1024 next 473 2025-05-27 06:36:39.055990: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8dec00 of size 1024 next 474 2025-05-27 06:36:39.055997: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8df000 of size 1024 next 475 2025-05-27 06:36:39.056004: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8df400 of size 1024 next 478 2025-05-27 06:36:39.056011: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8df800 of size 1024 next 479 2025-05-27 06:36:39.056018: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8dfc00 of size 1024 next 480 2025-05-27 06:36:39.056025: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8e0000 of size 1024 next 481 2025-05-27 06:36:39.056032: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8e0400 of size 1024 next 482 2025-05-27 06:36:39.056039: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8e0800 of size 4096 next 484 2025-05-27 06:36:39.056046: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8e1800 of size 4096 next 485 2025-05-27 06:36:39.056053: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8e2800 of size 4096 next 486 2025-05-27 06:36:39.056060: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8e3800 of size 4096 next 487 2025-05-27 06:36:39.056067: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8e4800 of size 4096 next 488 2025-05-27 06:36:39.056074: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8e5800 of size 1024 next 489 2025-05-27 06:36:39.056081: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8e5c00 of size 1024 next 490 2025-05-27 06:36:39.056088: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8e6000 of size 1024 next 491 2025-05-27 06:36:39.056095: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8e6400 of size 1024 next 492 2025-05-27 06:36:39.056102: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8e6800 of size 1024 next 493 2025-05-27 06:36:39.056109: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8e6c00 of size 1024 next 496 2025-05-27 06:36:39.056121: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8e7000 of size 1024 next 497 2025-05-27 06:36:39.056128: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8e7400 of size 1024 next 498 2025-05-27 06:36:39.056135: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8e7800 of size 1024 next 499 2025-05-27 06:36:39.056142: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8e7c00 of size 1024 next 500 2025-05-27 06:36:39.056149: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8e8000 of size 4096 next 502 2025-05-27 06:36:39.056155: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8e9000 of size 4096 next 503 2025-05-27 06:36:39.056162: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8ea000 of size 4096 next 504 2025-05-27 06:36:39.056169: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8eb000 of size 4096 next 505 2025-05-27 06:36:39.056176: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8ec000 of size 4096 next 506 2025-05-27 06:36:39.056183: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8ed000 of size 1024 next 507 2025-05-27 06:36:39.056190: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8ed400 of size 1024 next 508 2025-05-27 06:36:39.056197: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8ed800 of size 1024 next 509 2025-05-27 06:36:39.056204: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8edc00 of size 1024 next 510 2025-05-27 06:36:39.056211: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8ee000 of size 1024 next 511 2025-05-27 06:36:39.056218: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8ee400 of size 1024 next 514 2025-05-27 06:36:39.056225: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8ee800 of size 1024 next 515 2025-05-27 06:36:39.056232: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8eec00 of size 1024 next 516 2025-05-27 06:36:39.056239: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8ef000 of size 1024 next 517 2025-05-27 06:36:39.056246: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8ef400 of size 1024 next 518 2025-05-27 06:36:39.056253: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8ef800 of size 4096 next 520 2025-05-27 06:36:39.056260: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8f0800 of size 4096 next 521 2025-05-27 06:36:39.056267: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8f1800 of size 4096 next 522 2025-05-27 06:36:39.056274: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8f2800 of size 4096 next 523 2025-05-27 06:36:39.056281: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8f3800 of size 4096 next 524 2025-05-27 06:36:39.056288: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8f4800 of size 1024 next 525 2025-05-27 06:36:39.056294: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8f4c00 of size 1024 next 526 2025-05-27 06:36:39.056301: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8f5000 of size 1024 next 527 2025-05-27 06:36:39.056308: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8f5400 of size 1024 next 528 2025-05-27 06:36:39.056315: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8f5800 of size 1024 next 529 2025-05-27 06:36:39.056322: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8f5c00 of size 1024 next 532 2025-05-27 06:36:39.056329: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8f6000 of size 1024 next 533 2025-05-27 06:36:39.056336: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8f6400 of size 1024 next 534 2025-05-27 06:36:39.056343: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8f6800 of size 1024 next 535 2025-05-27 06:36:39.056355: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8f6c00 of size 1024 next 536 2025-05-27 06:36:39.056362: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8f7000 of size 4096 next 538 2025-05-27 06:36:39.056369: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8f8000 of size 4096 next 539 2025-05-27 06:36:39.056376: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8f9000 of size 4096 next 540 2025-05-27 06:36:39.056383: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8fa000 of size 4096 next 541 2025-05-27 06:36:39.056390: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8fb000 of size 4096 next 542 2025-05-27 06:36:39.056397: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8fc000 of size 1024 next 543 2025-05-27 06:36:39.056404: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8fc400 of size 1024 next 544 2025-05-27 06:36:39.056411: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8fc800 of size 1024 next 545 2025-05-27 06:36:39.056418: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8fcc00 of size 1024 next 546 2025-05-27 06:36:39.056425: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8fd000 of size 1024 next 547 2025-05-27 06:36:39.056432: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8fd400 of size 1024 next 550 2025-05-27 06:36:39.056438: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8fd800 of size 1024 next 551 2025-05-27 06:36:39.056445: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8fdc00 of size 1024 next 552 2025-05-27 06:36:39.056452: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8fe000 of size 1024 next 553 2025-05-27 06:36:39.056459: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8fe400 of size 1024 next 554 2025-05-27 06:36:39.056466: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8fe800 of size 4096 next 556 2025-05-27 06:36:39.056473: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e8ff800 of size 4096 next 557 2025-05-27 06:36:39.056480: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e900800 of size 4096 next 558 2025-05-27 06:36:39.056487: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e901800 of size 4096 next 559 2025-05-27 06:36:39.056494: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e902800 of size 4096 next 560 2025-05-27 06:36:39.056501: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e903800 of size 1024 next 561 2025-05-27 06:36:39.056508: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e903c00 of size 1024 next 562 2025-05-27 06:36:39.056515: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e904000 of size 1024 next 563 2025-05-27 06:36:39.056522: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e904400 of size 1024 next 564 2025-05-27 06:36:39.056529: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e904800 of size 1024 next 565 2025-05-27 06:36:39.056535: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e904c00 of size 1024 next 568 2025-05-27 06:36:39.056542: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e905000 of size 1024 next 569 2025-05-27 06:36:39.056549: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e905400 of size 1024 next 570 2025-05-27 06:36:39.056556: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e905800 of size 1024 next 571 2025-05-27 06:36:39.056563: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e905c00 of size 1024 next 572 2025-05-27 06:36:39.056570: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e906000 of size 4096 next 574 2025-05-27 06:36:39.056582: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e907000 of size 4096 next 575 2025-05-27 06:36:39.056589: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e908000 of size 4096 next 576 2025-05-27 06:36:39.056596: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e909000 of size 4096 next 577 2025-05-27 06:36:39.056603: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e90a000 of size 4096 next 578 2025-05-27 06:36:39.056610: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e90b000 of size 1024 next 579 2025-05-27 06:36:39.056617: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e90b400 of size 1024 next 580 2025-05-27 06:36:39.056624: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e90b800 of size 1024 next 581 2025-05-27 06:36:39.056631: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e90bc00 of size 1024 next 582 2025-05-27 06:36:39.056638: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e90c000 of size 1024 next 583 2025-05-27 06:36:39.056645: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e90c400 of size 1024 next 586 2025-05-27 06:36:39.056651: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e90c800 of size 1024 next 587 2025-05-27 06:36:39.056658: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e90cc00 of size 1024 next 588 2025-05-27 06:36:39.056665: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e90d000 of size 1024 next 589 2025-05-27 06:36:39.056672: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e90d400 of size 1024 next 590 2025-05-27 06:36:39.056679: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e90d800 of size 4096 next 592 2025-05-27 06:36:39.056686: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e90e800 of size 6144 next 112 2025-05-27 06:36:39.056694: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e910000 of size 524288 next 111 2025-05-27 06:36:39.056701: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e990000 of size 262144 next 135 2025-05-27 06:36:39.056708: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486e9d0000 of size 327680 next 124 2025-05-27 06:36:39.056715: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486ea20000 of size 589824 next 123 2025-05-27 06:36:39.056722: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486eab0000 of size 262144 next 152 2025-05-27 06:36:39.056729: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486eaf0000 of size 327680 next 142 2025-05-27 06:36:39.056737: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486eb40000 of size 786432 next 18446744073709551615 2025-05-27 06:36:39.056744: I tensorflow/core/common_runtime/bfc_allocator.cc:970] Next region of size 8388608 2025-05-27 06:36:39.056763: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486ec00000 of size 4096 next 593 2025-05-27 06:36:39.056770: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486ec01000 of size 4096 next 594 2025-05-27 06:36:39.056777: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486ec02000 of size 4096 next 595 2025-05-27 06:36:39.056784: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486ec03000 of size 2048 next 598 2025-05-27 06:36:39.056791: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486ec03800 of size 2048 next 599 2025-05-27 06:36:39.056798: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486ec04000 of size 2048 next 600 2025-05-27 06:36:39.056805: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486ec04800 of size 2048 next 601 2025-05-27 06:36:39.056812: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486ec05000 of size 2048 next 602 2025-05-27 06:36:39.056828: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486ec05800 of size 256 next 604 2025-05-27 06:36:39.056835: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486ec05900 of size 256 next 605 2025-05-27 06:36:39.056842: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486ec05a00 of size 256 next 606 2025-05-27 06:36:39.056849: I tensorflow/core/common_runtime/bfc_allocator.cc:990] Free at 7f486ec05b00 of size 566528 next 160 2025-05-27 06:36:39.056856: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486ec90000 of size 589824 next 158 2025-05-27 06:36:39.056863: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486ed20000 of size 524288 next 171 2025-05-27 06:36:39.056870: I tensorflow/core/common_runtime/bfc_allocator.cc:990] Free at 7f486eda0000 of size 1048576 next 222 2025-05-27 06:36:39.056877: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486eea0000 of size 1048576 next 190 2025-05-27 06:36:39.056884: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486efa0000 of size 1048576 next 189 2025-05-27 06:36:39.056891: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486f0a0000 of size 1048576 next 203 2025-05-27 06:36:39.056898: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486f1a0000 of size 1048576 next 251 2025-05-27 06:36:39.056906: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f486f2a0000 of size 1441792 next 18446744073709551615 2025-05-27 06:36:39.056912: I tensorflow/core/common_runtime/bfc_allocator.cc:970] Next region of size 1048576 2025-05-27 06:36:39.056920: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace00000 of size 1280 next 1 2025-05-27 06:36:39.056927: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace00500 of size 256 next 5 2025-05-27 06:36:39.056934: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace00600 of size 256 next 8 2025-05-27 06:36:39.056941: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace00700 of size 256 next 9 2025-05-27 06:36:39.056948: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace00800 of size 256 next 10 2025-05-27 06:36:39.056955: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace00900 of size 256 next 11 2025-05-27 06:36:39.056962: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace00a00 of size 256 next 12 2025-05-27 06:36:39.056969: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace00b00 of size 256 next 13 2025-05-27 06:36:39.056975: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace00c00 of size 256 next 17 2025-05-27 06:36:39.056982: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace00d00 of size 256 next 19 2025-05-27 06:36:39.056989: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace00e00 of size 256 next 20 2025-05-27 06:36:39.056996: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace00f00 of size 256 next 21 2025-05-27 06:36:39.057003: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace01000 of size 256 next 22 2025-05-27 06:36:39.057010: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace01100 of size 256 next 24 2025-05-27 06:36:39.057017: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace01200 of size 256 next 25 2025-05-27 06:36:39.057024: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace01300 of size 256 next 23 2025-05-27 06:36:39.057031: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace01400 of size 256 next 28 2025-05-27 06:36:39.057038: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace01500 of size 256 next 29 2025-05-27 06:36:39.057045: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace01600 of size 256 next 30 2025-05-27 06:36:39.057056: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace01700 of size 256 next 31 2025-05-27 06:36:39.057064: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace01800 of size 256 next 33 2025-05-27 06:36:39.057070: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace01900 of size 256 next 34 2025-05-27 06:36:39.057078: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace01a00 of size 1024 next 32 2025-05-27 06:36:39.057084: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace01e00 of size 1024 next 37 2025-05-27 06:36:39.057091: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace02200 of size 1024 next 38 2025-05-27 06:36:39.057098: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace02600 of size 1024 next 39 2025-05-27 06:36:39.057106: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace02a00 of size 1024 next 40 2025-05-27 06:36:39.057113: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace02e00 of size 1024 next 41 2025-05-27 06:36:39.057119: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace03200 of size 1024 next 43 2025-05-27 06:36:39.057127: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace03600 of size 1024 next 44 2025-05-27 06:36:39.057133: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace03a00 of size 1024 next 45 2025-05-27 06:36:39.057140: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace03e00 of size 1024 next 46 2025-05-27 06:36:39.057147: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace04200 of size 256 next 48 2025-05-27 06:36:39.057154: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace04300 of size 256 next 49 2025-05-27 06:36:39.057161: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace04400 of size 256 next 50 2025-05-27 06:36:39.057168: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace04500 of size 256 next 51 2025-05-27 06:36:39.057175: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace04600 of size 256 next 52 2025-05-27 06:36:39.057182: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace04700 of size 256 next 53 2025-05-27 06:36:39.057189: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace04800 of size 256 next 56 2025-05-27 06:36:39.057196: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace04900 of size 256 next 57 2025-05-27 06:36:39.057203: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace04a00 of size 256 next 58 2025-05-27 06:36:39.057210: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace04b00 of size 256 next 14 2025-05-27 06:36:39.057217: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace04c00 of size 256 next 15 2025-05-27 06:36:39.057224: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace04d00 of size 256 next 16 2025-05-27 06:36:39.057232: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace04e00 of size 1024 next 60 2025-05-27 06:36:39.057239: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace05200 of size 1024 next 61 2025-05-27 06:36:39.057245: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace05600 of size 1024 next 62 2025-05-27 06:36:39.057252: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace05a00 of size 1024 next 63 2025-05-27 06:36:39.057258: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace05e00 of size 1024 next 64 2025-05-27 06:36:39.057264: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace06200 of size 256 next 66 2025-05-27 06:36:39.057271: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace06300 of size 256 next 67 2025-05-27 06:36:39.057277: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace06400 of size 256 next 68 2025-05-27 06:36:39.057289: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace06500 of size 256 next 69 2025-05-27 06:36:39.057295: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace06600 of size 256 next 70 2025-05-27 06:36:39.057302: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace06700 of size 256 next 73 2025-05-27 06:36:39.057308: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace06800 of size 256 next 74 2025-05-27 06:36:39.057314: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace06900 of size 256 next 75 2025-05-27 06:36:39.057321: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace06a00 of size 256 next 76 2025-05-27 06:36:39.057327: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace06b00 of size 256 next 77 2025-05-27 06:36:39.057334: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace06c00 of size 1024 next 79 2025-05-27 06:36:39.057340: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace07000 of size 1024 next 80 2025-05-27 06:36:39.057346: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace07400 of size 1024 next 81 2025-05-27 06:36:39.057353: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace07800 of size 1024 next 82 2025-05-27 06:36:39.057359: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace07c00 of size 1024 next 83 2025-05-27 06:36:39.057365: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace08000 of size 256 next 85 2025-05-27 06:36:39.057372: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace08100 of size 256 next 86 2025-05-27 06:36:39.057378: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace08200 of size 512 next 84 2025-05-27 06:36:39.057385: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace08400 of size 512 next 88 2025-05-27 06:36:39.057391: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace08600 of size 512 next 89 2025-05-27 06:36:39.057398: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace08800 of size 512 next 90 2025-05-27 06:36:39.057404: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace08a00 of size 512 next 91 2025-05-27 06:36:39.057410: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace08c00 of size 256 next 93 2025-05-27 06:36:39.057417: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace08d00 of size 256 next 94 2025-05-27 06:36:39.057423: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace08e00 of size 512 next 92 2025-05-27 06:36:39.057429: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace09000 of size 512 next 97 2025-05-27 06:36:39.057436: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace09200 of size 512 next 98 2025-05-27 06:36:39.057442: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace09400 of size 512 next 99 2025-05-27 06:36:39.057448: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace09600 of size 512 next 2 2025-05-27 06:36:39.057455: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace09800 of size 256 next 3 2025-05-27 06:36:39.057461: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace09900 of size 256 next 4 2025-05-27 06:36:39.057468: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace09a00 of size 16384 next 18 2025-05-27 06:36:39.057474: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace0da00 of size 256 next 100 2025-05-27 06:36:39.057481: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace0db00 of size 256 next 101 2025-05-27 06:36:39.057487: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace0dc00 of size 2048 next 104 2025-05-27 06:36:39.057493: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace0e400 of size 2048 next 105 2025-05-27 06:36:39.057504: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace0ec00 of size 2048 next 106 2025-05-27 06:36:39.057511: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace0f400 of size 2048 next 107 2025-05-27 06:36:39.057518: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace0fc00 of size 2048 next 108 2025-05-27 06:36:39.057524: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace10400 of size 256 next 109 2025-05-27 06:36:39.057530: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace10500 of size 256 next 110 2025-05-27 06:36:39.057537: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace10600 of size 2048 next 113 2025-05-27 06:36:39.057543: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace10e00 of size 2048 next 114 2025-05-27 06:36:39.057549: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace11600 of size 2048 next 115 2025-05-27 06:36:39.057556: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace11e00 of size 2048 next 116 2025-05-27 06:36:39.057562: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace12600 of size 2048 next 6 2025-05-27 06:36:39.057569: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace12e00 of size 37632 next 7 2025-05-27 06:36:39.057575: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace1c100 of size 512 next 118 2025-05-27 06:36:39.057582: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace1c300 of size 512 next 119 2025-05-27 06:36:39.057588: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace1c500 of size 512 next 120 2025-05-27 06:36:39.057594: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace1c700 of size 512 next 121 2025-05-27 06:36:39.057601: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace1c900 of size 512 next 122 2025-05-27 06:36:39.057607: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace1cb00 of size 512 next 125 2025-05-27 06:36:39.057613: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace1cd00 of size 512 next 126 2025-05-27 06:36:39.057620: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace1cf00 of size 512 next 127 2025-05-27 06:36:39.057626: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace1d100 of size 512 next 128 2025-05-27 06:36:39.057633: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace1d300 of size 512 next 129 2025-05-27 06:36:39.057639: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace1d500 of size 2048 next 130 2025-05-27 06:36:39.057645: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace1dd00 of size 2048 next 131 2025-05-27 06:36:39.057652: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace1e500 of size 2048 next 132 2025-05-27 06:36:39.057658: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace1ed00 of size 2048 next 133 2025-05-27 06:36:39.057664: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace1f500 of size 2048 next 134 2025-05-27 06:36:39.057671: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace1fd00 of size 512 next 136 2025-05-27 06:36:39.057677: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace1ff00 of size 512 next 137 2025-05-27 06:36:39.057683: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace20100 of size 512 next 138 2025-05-27 06:36:39.057690: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace20300 of size 512 next 139 2025-05-27 06:36:39.057696: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace20500 of size 512 next 140 2025-05-27 06:36:39.057702: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace20700 of size 512 next 141 2025-05-27 06:36:39.057714: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace20900 of size 512 next 143 2025-05-27 06:36:39.057720: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace20b00 of size 512 next 144 2025-05-27 06:36:39.057727: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace20d00 of size 512 next 145 2025-05-27 06:36:39.057733: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace20f00 of size 512 next 146 2025-05-27 06:36:39.057740: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace21100 of size 2048 next 147 2025-05-27 06:36:39.057746: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace21900 of size 2048 next 148 2025-05-27 06:36:39.057752: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace22100 of size 2048 next 149 2025-05-27 06:36:39.057759: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace22900 of size 2048 next 150 2025-05-27 06:36:39.057765: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace23100 of size 2048 next 151 2025-05-27 06:36:39.057771: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace23900 of size 512 next 153 2025-05-27 06:36:39.057778: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace23b00 of size 512 next 154 2025-05-27 06:36:39.057784: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace23d00 of size 512 next 155 2025-05-27 06:36:39.057790: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace23f00 of size 512 next 156 2025-05-27 06:36:39.057797: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace24100 of size 512 next 157 2025-05-27 06:36:39.057803: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace24300 of size 512 next 161 2025-05-27 06:36:39.057809: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace24500 of size 512 next 162 2025-05-27 06:36:39.057816: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace24700 of size 512 next 163 2025-05-27 06:36:39.057822: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace24900 of size 512 next 164 2025-05-27 06:36:39.057828: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace24b00 of size 512 next 165 2025-05-27 06:36:39.057835: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace24d00 of size 2048 next 166 2025-05-27 06:36:39.057841: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace25500 of size 2048 next 167 2025-05-27 06:36:39.057848: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace25d00 of size 2048 next 168 2025-05-27 06:36:39.057854: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace26500 of size 2048 next 169 2025-05-27 06:36:39.057861: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace26d00 of size 2048 next 170 2025-05-27 06:36:39.057867: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace27500 of size 1024 next 172 2025-05-27 06:36:39.057873: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace27900 of size 1024 next 173 2025-05-27 06:36:39.057880: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace27d00 of size 1024 next 174 2025-05-27 06:36:39.057886: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace28100 of size 1024 next 175 2025-05-27 06:36:39.057892: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace28500 of size 1024 next 176 2025-05-27 06:36:39.057899: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace28900 of size 256 next 178 2025-05-27 06:36:39.057905: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace28a00 of size 256 next 179 2025-05-27 06:36:39.057911: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace28b00 of size 1024 next 177 2025-05-27 06:36:39.057918: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace28f00 of size 1024 next 182 2025-05-27 06:36:39.057929: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace29300 of size 1024 next 183 2025-05-27 06:36:39.057936: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace29700 of size 1024 next 184 2025-05-27 06:36:39.057942: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace29b00 of size 1024 next 185 2025-05-27 06:36:39.057948: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace29f00 of size 256 next 187 2025-05-27 06:36:39.057955: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace2a000 of size 256 next 188 2025-05-27 06:36:39.057961: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace2a100 of size 4096 next 186 2025-05-27 06:36:39.057968: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace2b100 of size 4096 next 42 2025-05-27 06:36:39.057974: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace2c100 of size 65536 next 36 2025-05-27 06:36:39.057980: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace3c100 of size 65536 next 35 2025-05-27 06:36:39.057987: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace4c100 of size 4096 next 235 2025-05-27 06:36:39.057993: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace4d100 of size 4096 next 236 2025-05-27 06:36:39.057999: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace4e100 of size 4096 next 237 2025-05-27 06:36:39.058006: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace4f100 of size 4096 next 238 2025-05-27 06:36:39.058012: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace50100 of size 1024 next 239 2025-05-27 06:36:39.058019: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace50500 of size 1024 next 240 2025-05-27 06:36:39.058025: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace50900 of size 1024 next 241 2025-05-27 06:36:39.058031: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace50d00 of size 1024 next 242 2025-05-27 06:36:39.058038: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace51100 of size 1024 next 243 2025-05-27 06:36:39.058044: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace51500 of size 1024 next 246 2025-05-27 06:36:39.058050: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace51900 of size 1024 next 247 2025-05-27 06:36:39.058057: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace51d00 of size 1024 next 248 2025-05-27 06:36:39.058063: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace52100 of size 1024 next 249 2025-05-27 06:36:39.058069: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace52500 of size 1024 next 250 2025-05-27 06:36:39.058076: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace52900 of size 4096 next 252 2025-05-27 06:36:39.058082: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace53900 of size 4096 next 253 2025-05-27 06:36:39.058088: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace54900 of size 4096 next 254 2025-05-27 06:36:39.058095: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace55900 of size 4096 next 255 2025-05-27 06:36:39.058101: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace56900 of size 4096 next 256 2025-05-27 06:36:39.058107: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace57900 of size 1024 next 257 2025-05-27 06:36:39.058114: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace57d00 of size 1024 next 258 2025-05-27 06:36:39.058120: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace58100 of size 1024 next 259 2025-05-27 06:36:39.058126: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace58500 of size 1024 next 260 2025-05-27 06:36:39.058138: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace58900 of size 1024 next 261 2025-05-27 06:36:39.058145: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace58d00 of size 1024 next 264 2025-05-27 06:36:39.058151: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace59100 of size 1024 next 265 2025-05-27 06:36:39.058157: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace59500 of size 1024 next 266 2025-05-27 06:36:39.058164: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace59900 of size 1024 next 267 2025-05-27 06:36:39.058170: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace59d00 of size 1024 next 268 2025-05-27 06:36:39.058176: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace5a100 of size 4096 next 270 2025-05-27 06:36:39.058183: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace5b100 of size 4096 next 271 2025-05-27 06:36:39.058189: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace5c100 of size 4096 next 272 2025-05-27 06:36:39.058195: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace5d100 of size 4096 next 273 2025-05-27 06:36:39.058202: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace5e100 of size 4096 next 274 2025-05-27 06:36:39.058208: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace5f100 of size 1024 next 275 2025-05-27 06:36:39.058215: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace5f500 of size 1024 next 276 2025-05-27 06:36:39.058221: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace5f900 of size 1024 next 277 2025-05-27 06:36:39.058227: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace5fd00 of size 1024 next 278 2025-05-27 06:36:39.058234: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace60100 of size 1024 next 279 2025-05-27 06:36:39.058240: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace60500 of size 1024 next 282 2025-05-27 06:36:39.058246: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace60900 of size 1024 next 283 2025-05-27 06:36:39.058253: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace60d00 of size 1024 next 284 2025-05-27 06:36:39.058259: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace61100 of size 1024 next 285 2025-05-27 06:36:39.058265: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace61500 of size 1024 next 286 2025-05-27 06:36:39.058272: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace61900 of size 4096 next 288 2025-05-27 06:36:39.058278: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace62900 of size 6144 next 27 2025-05-27 06:36:39.058285: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace64100 of size 147456 next 26 2025-05-27 06:36:39.058291: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace88100 of size 65536 next 47 2025-05-27 06:36:39.058297: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49ace98100 of size 65536 next 59 2025-05-27 06:36:39.058304: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49acea8100 of size 65536 next 65 2025-05-27 06:36:39.058310: I tensorflow/core/common_runtime/bfc_allocator.cc:990] InUse at 7f49aceb8100 of size 294656 next 18446744073709551615 2025-05-27 06:36:39.058317: I tensorflow/core/common_runtime/bfc_allocator.cc:995] Summary of in-use Chunks by size: 2025-05-27 06:36:39.058330: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 62 Chunks of size 256 totalling 15.5KiB 2025-05-27 06:36:39.058338: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 40 Chunks of size 512 totalling 20.0KiB 2025-05-27 06:36:39.058346: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 250 Chunks of size 1024 totalling 250.0KiB 2025-05-27 06:36:39.058358: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 1280 totalling 1.2KiB 2025-05-27 06:36:39.058366: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 30 Chunks of size 2048 totalling 60.0KiB 2025-05-27 06:36:39.058373: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 117 Chunks of size 4096 totalling 468.0KiB 2025-05-27 06:36:39.058380: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 2 Chunks of size 6144 totalling 12.0KiB 2025-05-27 06:36:39.058387: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 7680 totalling 7.5KiB 2025-05-27 06:36:39.058394: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 16384 totalling 16.0KiB 2025-05-27 06:36:39.058401: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 37632 totalling 36.8KiB 2025-05-27 06:36:39.058408: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 6 Chunks of size 65536 totalling 384.0KiB 2025-05-27 06:36:39.058416: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 131072 totalling 128.0KiB 2025-05-27 06:36:39.058423: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 3 Chunks of size 147456 totalling 432.0KiB 2025-05-27 06:36:39.058430: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 4 Chunks of size 262144 totalling 1.00MiB 2025-05-27 06:36:39.058437: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 294656 totalling 287.8KiB 2025-05-27 06:36:39.058444: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 2 Chunks of size 327680 totalling 640.0KiB 2025-05-27 06:36:39.058451: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 2 Chunks of size 524288 totalling 1.00MiB 2025-05-27 06:36:39.058458: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 3 Chunks of size 589824 totalling 1.69MiB 2025-05-27 06:36:39.058465: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 786432 totalling 768.0KiB 2025-05-27 06:36:39.058473: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 25 Chunks of size 1048576 totalling 25.00MiB 2025-05-27 06:36:39.058480: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 18 Chunks of size 1310720 totalling 22.50MiB 2025-05-27 06:36:39.058487: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 1441792 totalling 1.38MiB 2025-05-27 06:36:39.058494: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 1835008 totalling 1.75MiB 2025-05-27 06:36:39.058501: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 2 Chunks of size 2097152 totalling 4.00MiB 2025-05-27 06:36:39.058508: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 23 Chunks of size 2359296 totalling 51.75MiB 2025-05-27 06:36:39.058515: I tensorflow/core/common_runtime/bfc_allocator.cc:998] 1 Chunks of size 12451840 totalling 11.88MiB 2025-05-27 06:36:39.058522: I tensorflow/core/common_runtime/bfc_allocator.cc:1002] Sum Total of in-use chunks: 125.38MiB 2025-05-27 06:36:39.058529: I tensorflow/core/common_runtime/bfc_allocator.cc:1004] total_region_allocated_bytes_: 145620992 memory_limit_: 145620992 available bytes: 0 curr_region_allocation_bytes_: 268435456 2025-05-27 06:36:39.058540: I tensorflow/core/common_runtime/bfc_allocator.cc:1010] Stats: Limit: 145620992 InUse: 131472128 MaxInUse: 131472128 NumAllocs: 2024 MaxAllocSize: 12451840 2025-05-27 06:36:39.058560: W tensorflow/core/common_runtime/bfc_allocator.cc:439] ********************************************__*********************************_********x*********** 2025-05-27 06:36:39.058617: W tensorflow/core/framework/op_kernel.cc:1753] OP_REQUIRES failed at cwise_ops_common.h:134 : Resource exhausted: OOM when allocating tensor with shape[3,3,512,512] and type float on /job:localhost/replica:0/task:0/device:GPU:0 by allocator GPU_0_bfc RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 Exception in mask_detect : OOM when allocating tensor with shape[3,3,512,512] and type float on /job:localhost/replica:0/task:0/device:GPU:0 by allocator GPU_0_bfc [Op:Mul] we want to redo the detection Using TensorFlow backend. max_time_sub_proc : 3600 erreur pendant la detection Useless call to update_current_state in case -12 caffe_path_current : About to save ! 1 Inside saveOutput : final : True verbose : False eke 12-6-18 : saveMask need to be cleaned for new output ! ERROR : mask output needs to be a dictionnary now ! No output to save, continue without doing anything ! save missing photos in datou_result : After save, about to update current ! datou_cur_ids : [] len(datou.list_steps) : 1 output : -12 ERROR : 'int' object is not subscriptable reconnect to base ! warning , we can't find thcl infos in json_data warning , we can't find pdt infos in json_data #&_# TEST FAILED #&_# : tests/mask_test #&_# Error : invalid literal for int() with base 10: "'int' object is not subscriptable" /home/admin/workarea/git/Velours/python/tests/python_tests.py refs/heads/master_5b33f60c5f6905fea072b7d2a40445920ab89df0 SQL :INSERT INTO MTRAdmin.monitor_sys (name, type, server, version_code, result_str, result_bool, lien , test_group ,test_name) VALUES ('python_test3','1','marlene','refs/heads/master_5b33f60c5f6905fea072b7d2a40445920ab89df0','{"mask_detection": "fail"}','0','http://marlene.fotonower-preprod.com/job/2025/May/27052025/python_test3//data_2/data_log/job/2025/May/27052025/python_test3/log-python3----short_python3--v--marlene-06:35:00.txt','mask_detection','unknown'); #&_# END OF TEST #&_# : tests/mask_test #&_# #&_# BEGIN OF TEST : tests/datou_test #&_# /home/admin/workarea/git/Velours/python/tests/datou_test.py Datou All Test python version used : 3 ############################### TEST sam ################################ TEST SAM Inside batchDatouExec : verbose : True ##### chargement datou SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4573 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4573 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4573 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4573 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! no param json to modify List Step Type Loaded in datou : sam list_input_json : [] ##### fin chargement datou ##### chargement data ##### Call load_data_input : nb_thread : 5 origin SELECT photo_id, url FROM MTRBack.photos ph WHERE photo_id IN (1189321094) Found this number of photos: 1 ##### Call download_photos : nb_thread : 5 begin to download photo : 1189321094 download finish for photo 1189321094 we have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB ##### After download_photos length of list_filenames : 1 ; length of list_pids : 1 ; length of list_args : 1 ##### After load_data_input time to download the photos : 0.22725534439086914 #### fin chargement data Blocking on flush ? No conitnuing About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! WARNING : we have an input that is not a photo, we should get rid of it Calling datou_exec Inside datou_exec : verbose : True number of steps : 1 step1:sam Tue May 27 06:36:39 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec After prepare type args : Here we display some param of map_info ! map_filenames : {'temp/1748320599_3175816_1189321094_9626af7f95d010f2a4fd524688d4ea22_76896585.png': 1189321094} map_photo_id_path_extension : {1189321094: {'path': 'temp/1748320599_3175816_1189321094_9626af7f95d010f2a4fd524688d4ea22_76896585.png', 'extension': 'png'}} map_subphoto_mainphoto : {} Beginning of datou step sam ! pht : 4677 Inside sam : nb paths : 1 ERROR in datou_step_exec, will save and exit ! CUDA error: out of memory CUDA kernel errors might be asynchronously reported at some other API call,so the stacktrace below might be incorrect. For debugging consider passing CUDA_LAUNCH_BLOCKING=1. File "/home/admin/workarea/git/Velours/python/mtr/datou/datou_lib.py", line 2329, in datou_exec output = datou_step_exec(sNext, args, cache, context, map_info, verbose, mtr_user_id) File "/home/admin/workarea/git/Velours/python/mtr/datou/datou_lib.py", line 2430, in datou_step_exec return lib_process.datou_step_sam(param, json_param, args, cache, context, map_info, verbose) File "/home/admin/workarea/git/Velours/python/mtr/datou/lib_step_exec/lib_step_process.py", line 367, in datou_step_sam sam.to(device=device) File "/home/admin/.local/lib/python3.8/site-packages/torch/nn/modules/module.py", line 927, in to return self._apply(convert) File "/home/admin/.local/lib/python3.8/site-packages/torch/nn/modules/module.py", line 579, in _apply module._apply(fn) File "/home/admin/.local/lib/python3.8/site-packages/torch/nn/modules/module.py", line 579, in _apply module._apply(fn) File "/home/admin/.local/lib/python3.8/site-packages/torch/nn/modules/module.py", line 579, in _apply module._apply(fn) File "/home/admin/.local/lib/python3.8/site-packages/torch/nn/modules/module.py", line 602, in _apply param_applied = fn(param) File "/home/admin/.local/lib/python3.8/site-packages/torch/nn/modules/module.py", line 925, in convert return t.to(device, dtype if t.is_floating_point() or t.is_complex() else None, non_blocking) [1189321094] map_info['map_portfolio_photo'] : {} final : True mtd_id 4573 list_pids : [1189321094] begin to insert list_values into mtr_datou_result : length of list_values in save_final : 1 insert ignore into MTRPhoto.mtr_datou_result (mtd_id, mtr_portfolio_id,mtr_photo_id,result,result_long,result_double,hashtag_id,proba, mtr_current_id) values (%s,%s,%s,%s,%s,%s,%s,%s,%s) on duplicate key update mtr_portfolio_id = mtr_portfolio_id list_values : [('4573', None, '1189321094', "[>, , , , , 'CUDA error: out of memory\\nCUDA kernel errors might be asynchronously reported at some other API call,so the stacktrace below might be incorrect.\\nFor debugging consider passing CUDA_LAUNCH_BLOCKING=1.']", '-1', '-1.0', '501120777', '1.0', None)] time used for this insertion : 0.014503002166748047 save_final ERROR in last step sam, CUDA error: out of memory CUDA kernel errors might be asynchronously reported at some other API call,so the stacktrace below might be incorrect. For debugging consider passing CUDA_LAUNCH_BLOCKING=1. time spend for datou_step_exec : 4.071182489395142 time spend to save output : 0.015674114227294922 total time spend for step 0 : 4.0868566036224365 need to delete datou_research and reload, so keep current state 1 need to delete datou_research and reload, so keep current state 1 caffe_path_current : About to save ! 2 After save, about to update current ! datou_cur_ids : [] len(datou.list_steps) : 1 output : None ERROR nb objects espect : 98 nb_objects detect : 0 ERROR sam FAILED ############################### TEST frcnn ################################ test frcnn Inside batchDatouExec : verbose : True ##### chargement datou SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4184 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4184 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4184 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4184 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! no param json to modify List Step Type Loaded in datou : frcnn list_input_json : [] ##### fin chargement datou ##### chargement data ##### Call load_data_input : nb_thread : 5 origin SELECT photo_id, url FROM MTRBack.photos ph WHERE photo_id IN (917754606) Found this number of photos: 1 ##### Call download_photos : nb_thread : 5 begin to download photo : 917754606 download finish for photo 917754606 we have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB ##### After download_photos length of list_filenames : 1 ; length of list_pids : 1 ; length of list_args : 1 ##### After load_data_input time to download the photos : 0.11021924018859863 #### fin chargement data Blocking on flush ? No conitnuing About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : True number of steps : 1 step1:frcnn Tue May 27 06:36:43 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec After prepare type args : Here we display some param of map_info ! map_filenames : {'temp/1748320603_3175816_917754606_35f3c9ae49686a6be16030c6ec25c9ee.jpg': 917754606} map_photo_id_path_extension : {917754606: {'path': 'temp/1748320603_3175816_917754606_35f3c9ae49686a6be16030c6ec25c9ee.jpg', 'extension': 'jpg'}} map_subphoto_mainphoto : {} Beginning of datou step Faster rcnn ! classes : ['background', 'plaque'] pht : 4370 caffemodel_name (should be vgg16_immat_307 but not used because net loaded outside in the fonction) : {'id': 3375, 'mtr_user_id': 31, 'name': 'detection_plaque_valcor_010622', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,plaque', 'svm_portfolios_learning': '0,0', 'photo_hashtag_type': 4370, 'photo_desc_type': 5676, 'type_classification': 'caffe_faster_rcnn', 'hashtag_id_list': '0,0'} To loadFromThcl() model_param file didn't exist model_name : detection_plaque_valcor_010622 model_type : caffe_faster_rcnn list file need : ['caffemodel', 'test.prototxt'] file exist in s3 : ['caffemodel', 'test.prototxt'] file manque in s3 : [] WARNING: Logging before InitGoogleLogging() is written to STDERR E0527 06:36:45.293383 3175816 common.cpp:114] Cannot create Cublas handle. Cublas won't be available. E0527 06:36:45.298352 3175816 common.cpp:121] Cannot create Curand generator. Curand won't be available. F0527 06:36:45.309885 3175816 syncedmem.hpp:22] Check failed: error == cudaSuccess (2 vs. 0) out of memory *** Check failure stack trace: *** Command terminated by signal 6 7.59user 7.96system 1:20.87elapsed 19%CPU (0avgtext+0avgdata 1611240maxresident)k 1524640inputs+3480outputs (3953major+693997minor)pagefaults 0swaps