python /home/admin/mtr/script_for_cron.py -j python_test3 -m 12 -a ' --short_python3 -v ' -s python_test3 -M 0 -S 0 -U 100,100,120 import MySQLdb succeeded Import error (python version) python version = 3 warning , we can't find thcl infos in json_data warning , we can't find pdt infos in json_data list_job_run_as_list : ['mask_detection', 'datou', 'CacheModelData_queries', 'CachePhotoData_queries', 'test_fork', 'prepare_maskdata', 'portfolio_queries', 'sla_mensuel'] python version used : 3 liste_fichiers : [('tests/mask_test', True, 'Test mask-detection ', 'mask_detection'), ('tests/datou_test', True, 'Datou All Test', 'datou', 'all'), ('mtr/database_queries/CacheModelData_queries', True, 'Test Cache Model Data', 'CacheModelData_queries'), ('tests/cache_photo_data_test', True, 'Test local_cache_photo ', 'CachePhotoData_queries'), ('mtr/mask_rcnn/prepare_maskdata', True, 'test prepare mask data', 'prepare_maskdata', 'all'), ('mtr/database_queries/portfolio_queries', True, 'test portfolio queries', 'portfolio_queries'), ('prod/memo/memo', True, 'SLA Mensuel', 'sla_mensuel', 'all')] #&_# BEGIN OF TEST : tests/mask_test #&_# /home/admin/workarea/git/Velours/python/tests/mask_test.py Test mask-detection python version used : 3 ############################### TEST memory used ################################ free memory at begining : begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 10814 run mask_detect Inside batchDatouExec : verbose : False # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : mask_detect list_input_json : [] origin BFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 1 ; length of list_pids : 1 ; length of list_args : 1 time to download the photos : 0.16033411026000977 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : False number of steps : 1 step1:mask_detect Mon Apr 14 03:35:26 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10814 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 /home/admin/workarea/git/Velours/python/tests/python_tests.py:11: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses import imp 2025-04-14 03:35:30.378780: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-04-14 03:35:30.411316: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-04-14 03:35:30.413394: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f1100000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-04-14 03:35:30.413452: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-04-14 03:35:30.417519: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-04-14 03:35:30.697676: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x1c83c2c0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-04-14 03:35:30.697719: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-04-14 03:35:30.699778: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-04-14 03:35:30.701253: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-04-14 03:35:30.731253: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-04-14 03:35:30.748249: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-04-14 03:35:30.751645: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-04-14 03:35:30.783312: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-04-14 03:35:30.788484: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-04-14 03:35:30.839527: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-04-14 03:35:30.841270: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-04-14 03:35:30.841339: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-04-14 03:35:30.842992: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-04-14 03:35:30.843013: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-04-14 03:35:30.843024: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-04-14 03:35:30.844706: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10023 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl454 thcls : [{'id': 454, 'mtr_user_id': 31, 'name': 'mask_coco_origin', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'backgroud,person,bicycle,car,motorcycle,airplane,bus,train,truck,boat,trafficlight,firehydrant,stopsign,parkingmeter,bench,bird,cat,dog,horse,sheep,cow,elephant,bear,zebra,giraffe,backpack,umbrella,handbag,tie,suitcase,frisbee,skis,snowboard,sportsball,kite,baseballbat,baseballglove,skateboard,surfboard,tennisracket,bottle,wineglass,cup,fork,knife,spoon,bowl,banana,apple,sandwich,orange,broccoli,carrot,hotdog,pizza,donut,cake,chair,couch,pottedplant,bed,diningtable,toilet,tv,laptop,mouse,remote,keyboard,cellphone,microwave,oven,toaster,sink,refrigerator,book,clock,vase,scissors,teddybear,hairdrier,toothbrush', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 445, 'photo_desc_type': 3473, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0'}] thcl {'id': 454, 'mtr_user_id': 31, 'name': 'mask_coco_origin', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'backgroud,person,bicycle,car,motorcycle,airplane,bus,train,truck,boat,trafficlight,firehydrant,stopsign,parkingmeter,bench,bird,cat,dog,horse,sheep,cow,elephant,bear,zebra,giraffe,backpack,umbrella,handbag,tie,suitcase,frisbee,skis,snowboard,sportsball,kite,baseballbat,baseballglove,skateboard,surfboard,tennisracket,bottle,wineglass,cup,fork,knife,spoon,bowl,banana,apple,sandwich,orange,broccoli,carrot,hotdog,pizza,donut,cake,chair,couch,pottedplant,bed,diningtable,toilet,tv,laptop,mouse,remote,keyboard,cellphone,microwave,oven,toaster,sink,refrigerator,book,clock,vase,scissors,teddybear,hairdrier,toothbrush', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 445, 'photo_desc_type': 3473, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 3473 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (3473, 'mask_coco_origin', 16384, 25088, 'mask_coco_origin', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2018, 3, 19, 10, 42, 21), datetime.datetime(2018, 3, 19, 10, 42, 21)) {'thcl': {'id': 454, 'mtr_user_id': 31, 'name': 'mask_coco_origin', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'backgroud,person,bicycle,car,motorcycle,airplane,bus,train,truck,boat,trafficlight,firehydrant,stopsign,parkingmeter,bench,bird,cat,dog,horse,sheep,cow,elephant,bear,zebra,giraffe,backpack,umbrella,handbag,tie,suitcase,frisbee,skis,snowboard,sportsball,kite,baseballbat,baseballglove,skateboard,surfboard,tennisracket,bottle,wineglass,cup,fork,knife,spoon,bowl,banana,apple,sandwich,orange,broccoli,carrot,hotdog,pizza,donut,cake,chair,couch,pottedplant,bed,diningtable,toilet,tv,laptop,mouse,remote,keyboard,cellphone,microwave,oven,toaster,sink,refrigerator,book,clock,vase,scissors,teddybear,hairdrier,toothbrush', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 445, 'photo_desc_type': 3473, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['backgroud', 'person', 'bicycle', 'car', 'motorcycle', 'airplane', 'bus', 'train', 'truck', 'boat', 'trafficlight', 'firehydrant', 'stopsign', 'parkingmeter', 'bench', 'bird', 'cat', 'dog', 'horse', 'sheep', 'cow', 'elephant', 'bear', 'zebra', 'giraffe', 'backpack', 'umbrella', 'handbag', 'tie', 'suitcase', 'frisbee', 'skis', 'snowboard', 'sportsball', 'kite', 'baseballbat', 'baseballglove', 'skateboard', 'surfboard', 'tennisracket', 'bottle', 'wineglass', 'cup', 'fork', 'knife', 'spoon', 'bowl', 'banana', 'apple', 'sandwich', 'orange', 'broccoli', 'carrot', 'hotdog', 'pizza', 'donut', 'cake', 'chair', 'couch', 'pottedplant', 'bed', 'diningtable', 'toilet', 'tv', 'laptop', 'mouse', 'remote', 'keyboard', 'cellphone', 'microwave', 'oven', 'toaster', 'sink', 'refrigerator', 'book', 'clock', 'vase', 'scissors', 'teddybear', 'hairdrier', 'toothbrush'], 'list_hashtags_csv': 'backgroud,person,bicycle,car,motorcycle,airplane,bus,train,truck,boat,trafficlight,firehydrant,stopsign,parkingmeter,bench,bird,cat,dog,horse,sheep,cow,elephant,bear,zebra,giraffe,backpack,umbrella,handbag,tie,suitcase,frisbee,skis,snowboard,sportsball,kite,baseballbat,baseballglove,skateboard,surfboard,tennisracket,bottle,wineglass,cup,fork,knife,spoon,bowl,banana,apple,sandwich,orange,broccoli,carrot,hotdog,pizza,donut,cake,chair,couch,pottedplant,bed,diningtable,toilet,tv,laptop,mouse,remote,keyboard,cellphone,microwave,oven,toaster,sink,refrigerator,book,clock,vase,scissors,teddybear,hairdrier,toothbrush', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 445, 'svm_hashtag_type_desc': 3473, 'photo_desc_type': 3473, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['backgroud', 'person', 'bicycle', 'car', 'motorcycle', 'airplane', 'bus', 'train', 'truck', 'boat', 'trafficlight', 'firehydrant', 'stopsign', 'parkingmeter', 'bench', 'bird', 'cat', 'dog', 'horse', 'sheep', 'cow', 'elephant', 'bear', 'zebra', 'giraffe', 'backpack', 'umbrella', 'handbag', 'tie', 'suitcase', 'frisbee', 'skis', 'snowboard', 'sportsball', 'kite', 'baseballbat', 'baseballglove', 'skateboard', 'surfboard', 'tennisracket', 'bottle', 'wineglass', 'cup', 'fork', 'knife', 'spoon', 'bowl', 'banana', 'apple', 'sandwich', 'orange', 'broccoli', 'carrot', 'hotdog', 'pizza', 'donut', 'cake', 'chair', 'couch', 'pottedplant', 'bed', 'diningtable', 'toilet', 'tv', 'laptop', 'mouse', 'remote', 'keyboard', 'cellphone', 'microwave', 'oven', 'toaster', 'sink', 'refrigerator', 'book', 'clock', 'vase', 'scissors', 'teddybear', 'hairdrier', 'toothbrush'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME mask_coco_origin NUM_CLASSES 81 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 2025-04-14 03:35:31.430429: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-04-14 03:35:31.430507: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-04-14 03:35:31.430528: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-04-14 03:35:31.430546: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-04-14 03:35:31.430564: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-04-14 03:35:31.430582: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-04-14 03:35:31.430610: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-04-14 03:35:31.430629: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-04-14 03:35:31.432234: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-04-14 03:35:31.433624: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-04-14 03:35:31.433659: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-04-14 03:35:31.433677: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-04-14 03:35:31.433695: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-04-14 03:35:31.433712: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-04-14 03:35:31.433729: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-04-14 03:35:31.433745: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-04-14 03:35:31.433762: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-04-14 03:35:31.435364: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-04-14 03:35:31.435404: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-04-14 03:35:31.435415: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-04-14 03:35:31.435424: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-04-14 03:35:31.436749: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10023 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : mask_coco_origin model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-04-14 03:35:39.977796: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-04-14 03:35:40.332745: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/mask_coco_origin /data/models_weight/mask_coco_origin/mask_model.h5 size_local : 257557808 size in s3 : 257557808 create time local : 2021-08-09 05:27:17 create time in s3 : 2021-08-06 19:45:17 mask_model.h5 already exist and didn't need to update list_images length : 1 NEW PHOTO Processing 1 images image shape: (480, 640, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 89) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 Detection mask done ! Trying to reset tf kernel 648599 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5525 tf kernel not reseted sub process len(results) : 1 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 1 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 10814 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl454 Catched exception ! Connect or reconnect ! thcls : [{'id': 454, 'mtr_user_id': 31, 'name': 'mask_coco_origin', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'backgroud,person,bicycle,car,motorcycle,airplane,bus,train,truck,boat,trafficlight,firehydrant,stopsign,parkingmeter,bench,bird,cat,dog,horse,sheep,cow,elephant,bear,zebra,giraffe,backpack,umbrella,handbag,tie,suitcase,frisbee,skis,snowboard,sportsball,kite,baseballbat,baseballglove,skateboard,surfboard,tennisracket,bottle,wineglass,cup,fork,knife,spoon,bowl,banana,apple,sandwich,orange,broccoli,carrot,hotdog,pizza,donut,cake,chair,couch,pottedplant,bed,diningtable,toilet,tv,laptop,mouse,remote,keyboard,cellphone,microwave,oven,toaster,sink,refrigerator,book,clock,vase,scissors,teddybear,hairdrier,toothbrush', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 445, 'photo_desc_type': 3473, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0'}] thcl {'id': 454, 'mtr_user_id': 31, 'name': 'mask_coco_origin', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'backgroud,person,bicycle,car,motorcycle,airplane,bus,train,truck,boat,trafficlight,firehydrant,stopsign,parkingmeter,bench,bird,cat,dog,horse,sheep,cow,elephant,bear,zebra,giraffe,backpack,umbrella,handbag,tie,suitcase,frisbee,skis,snowboard,sportsball,kite,baseballbat,baseballglove,skateboard,surfboard,tennisracket,bottle,wineglass,cup,fork,knife,spoon,bowl,banana,apple,sandwich,orange,broccoli,carrot,hotdog,pizza,donut,cake,chair,couch,pottedplant,bed,diningtable,toilet,tv,laptop,mouse,remote,keyboard,cellphone,microwave,oven,toaster,sink,refrigerator,book,clock,vase,scissors,teddybear,hairdrier,toothbrush', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 445, 'photo_desc_type': 3473, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 3473 ['backgroud', 'person', 'bicycle', 'car', 'motorcycle', 'airplane', 'bus', 'train', 'truck', 'boat', 'trafficlight', 'firehydrant', 'stopsign', 'parkingmeter', 'bench', 'bird', 'cat', 'dog', 'horse', 'sheep', 'cow', 'elephant', 'bear', 'zebra', 'giraffe', 'backpack', 'umbrella', 'handbag', 'tie', 'suitcase', 'frisbee', 'skis', 'snowboard', 'sportsball', 'kite', 'baseballbat', 'baseballglove', 'skateboard', 'surfboard', 'tennisracket', 'bottle', 'wineglass', 'cup', 'fork', 'knife', 'spoon', 'bowl', 'banana', 'apple', 'sandwich', 'orange', 'broccoli', 'carrot', 'hotdog', 'pizza', 'donut', 'cake', 'chair', 'couch', 'pottedplant', 'bed', 'diningtable', 'toilet', 'tv', 'laptop', 'mouse', 'remote', 'keyboard', 'cellphone', 'microwave', 'oven', 'toaster', 'sink', 'refrigerator', 'book', 'clock', 'vase', 'scissors', 'teddybear', 'hairdrier', 'toothbrush'] time for calcul the mask position with numpy : 0.0005443096160888672 nb_pixel_total : 15551 time to create 1 rle with old method : 0.018654346466064453 length of segment : 256 time for calcul the mask position with numpy : 0.0024907588958740234 nb_pixel_total : 145330 time to create 1 rle with old method : 0.16350650787353516 length of segment : 371 time for calcul the mask position with numpy : 0.00026297569274902344 nb_pixel_total : 14253 time to create 1 rle with old method : 0.017159223556518555 length of segment : 151 time for calcul the mask position with numpy : 0.00018644332885742188 nb_pixel_total : 5614 time to create 1 rle with old method : 0.01037907600402832 length of segment : 48 time for calcul the mask position with numpy : 6.29425048828125e-05 nb_pixel_total : 1825 time to create 1 rle with old method : 0.002527475357055664 length of segment : 39 time spent for convertir_results : 0.9549248218536377 time spend for datou_step_exec : 20.31548309326172 time spend to save output : 4.0531158447265625e-05 total time spend for step 1 : 20.315523624420166 caffe_path_current : About to save ! 1 Inside saveOutput : final : True verbose : False eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 3329 chid ids of type : 445 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 0 begin to insert list_values into mtr_datou_result : length of list_values in save_final : 1 time used for this insertion : 0.018065452575683594 save missing photos in datou_result : After save, about to update current ! datou_cur_ids : [] len(datou.list_steps) : 1 output : {'957285035': [[(957285035, 492601069, 445, 0, 186, 22, 282, 0.9954893, [(140, 26, 6), (135, 27, 15), (133, 28, 18), (131, 29, 22), (127, 30, 27), (10, 31, 1), (120, 31, 35), (8, 32, 13), (27, 32, 3), (115, 32, 41), (7, 33, 52), (109, 33, 48), (6, 34, 70), (103, 34, 55), (5, 35, 154), (4, 36, 155), (3, 37, 156), (3, 38, 156), (3, 39, 156), (2, 40, 157), (2, 41, 157), (2, 42, 157), (2, 43, 157), (2, 44, 157), (2, 45, 157), (1, 46, 158), (1, 47, 158), (1, 48, 158), (1, 49, 157), (1, 50, 157), (1, 51, 156), (1, 52, 156), (1, 53, 155), (1, 54, 154), (1, 55, 152), (1, 56, 149), (1, 57, 145), (1, 58, 141), (1, 59, 136), (1, 60, 133), (1, 61, 130), (1, 62, 127), (1, 63, 126), (1, 64, 124), (1, 65, 123), (1, 66, 121), (1, 67, 120), (1, 68, 118), (1, 69, 117), (1, 70, 116), (1, 71, 115), (1, 72, 114), (1, 73, 113), (1, 74, 112), (1, 75, 111), (1, 76, 110), (1, 77, 108), (1, 78, 108), (1, 79, 107), (1, 80, 106), (1, 81, 105), (2, 82, 104), (2, 83, 103), (2, 84, 103), (2, 85, 102), (2, 86, 102), (2, 87, 101), (2, 88, 100), (2, 89, 99), (2, 90, 99), (2, 91, 98), (2, 92, 97), (2, 93, 96), (2, 94, 95), (2, 95, 93), (2, 96, 91), (2, 97, 90), (2, 98, 89), (2, 99, 87), (2, 100, 86), (2, 101, 86), (2, 102, 85), (2, 103, 84), (2, 104, 83), (2, 105, 83), (2, 106, 82), (2, 107, 81), (2, 108, 80), (2, 109, 80), (2, 110, 79), (2, 111, 78), (2, 112, 77), (2, 113, 76), (1, 114, 76), (1, 115, 75), (1, 116, 74), (1, 117, 73), (1, 118, 72), (1, 119, 71), (1, 120, 71), (1, 121, 70), (1, 122, 69), (1, 123, 69), (1, 124, 68), (1, 125, 68), (1, 126, 67), (1, 127, 67), (1, 128, 66), (1, 129, 66), (1, 130, 66), (1, 131, 65), (1, 132, 65), (1, 133, 64), (1, 134, 63), (1, 135, 63), (1, 136, 62), (1, 137, 61), (1, 138, 60), (1, 139, 60), (1, 140, 59), (1, 141, 58), (1, 142, 58), (1, 143, 57), (1, 144, 56), (1, 145, 56), (1, 146, 55), (1, 147, 54), (1, 148, 54), (1, 149, 53), (1, 150, 52), (1, 151, 52), (1, 152, 51), (1, 153, 50), (1, 154, 49), (1, 155, 48), (1, 156, 47), (1, 157, 46), (1, 158, 45), (1, 159, 45), (1, 160, 44), (1, 161, 43), (1, 162, 42), (1, 163, 41), (1, 164, 41), (1, 165, 40), (1, 166, 40), (1, 167, 39), (1, 168, 38), (1, 169, 37), (1, 170, 36), (1, 171, 35), (1, 172, 34), (1, 173, 34), (1, 174, 33), (1, 175, 33), (1, 176, 32), (1, 177, 32), (1, 178, 32), (1, 179, 32), (1, 180, 31), (1, 181, 31), (1, 182, 31), (1, 183, 30), (1, 184, 30), (1, 185, 30), (1, 186, 29), (1, 187, 29), (1, 188, 29), (1, 189, 28), (1, 190, 28), (1, 191, 27), (1, 192, 27), (1, 193, 26), (1, 194, 26), (1, 195, 26), (1, 196, 26), (1, 197, 26), (1, 198, 26), (1, 199, 26), (1, 200, 25), (1, 201, 25), (1, 202, 25), (1, 203, 25), (1, 204, 25), (1, 205, 25), (1, 206, 25), (1, 207, 25), (1, 208, 25), (1, 209, 25), (1, 210, 25), (1, 211, 25), (1, 212, 25), (1, 213, 25), (1, 214, 25), (1, 215, 25), (1, 216, 25), (1, 217, 25), (1, 218, 25), (1, 219, 25), (1, 220, 24), (1, 221, 24), (1, 222, 24), (1, 223, 24), (1, 224, 24), (1, 225, 24), (1, 226, 25), (1, 227, 25), (1, 228, 25), (2, 229, 24), (2, 230, 24), (2, 231, 24), (2, 232, 23), (2, 233, 23), (2, 234, 23), (2, 235, 23), (2, 236, 23), (2, 237, 23), (2, 238, 23), (2, 239, 23), (2, 240, 23), (2, 241, 23), (2, 242, 23), (2, 243, 23), (2, 244, 23), (2, 245, 23), (2, 246, 23), (2, 247, 23), (2, 248, 23), (2, 249, 24), (2, 250, 24), (2, 251, 23), (2, 252, 23), (2, 253, 23), (2, 254, 23), (2, 255, 23), (2, 256, 23), (2, 257, 23), (2, 258, 23), (2, 259, 23), (2, 260, 23), (2, 261, 23), (3, 262, 22), (3, 263, 22), (3, 264, 22), (3, 265, 22), (4, 266, 21), (4, 267, 21), (5, 268, 20), (5, 269, 20), (6, 270, 19), (7, 271, 17), (8, 272, 16), (8, 273, 16), (9, 274, 13), (11, 275, 9), (15, 276, 2)], ['16,276,8,273,2,261,2,229,1,228,1,114,2,113,2,82,1,81,1,46,3,37,8,32,20,32,21,33,58,33,59,34,75,34,76,35,102,35,114,33,120,31,130,30,135,27,145,26,152,29,158,35,158,48,154,54,141,58,128,61,119,67,105,81,103,86,96,94,89,98,81,109,71,119,65,132,60,138,52,151,45,158,40,166,34,172,29,188,26,193,25,200,25,219,24,232,24,270,23,273']), (957285035, 492601069, 445, 29, 591, 24, 419, 0.9923649, [(316, 37, 22), (272, 38, 86), (253, 39, 130), (238, 40, 151), (199, 41, 196), (189, 42, 213), (180, 43, 238), (175, 44, 250), (172, 45, 257), (169, 46, 265), (166, 47, 274), (162, 48, 284), (159, 49, 294), (157, 50, 304), (155, 51, 311), (153, 52, 317), (151, 53, 323), (149, 54, 330), (148, 55, 334), (146, 56, 337), (144, 57, 341), (142, 58, 344), (140, 59, 347), (138, 60, 350), (136, 61, 353), (134, 62, 356), (132, 63, 358), (130, 64, 361), (128, 65, 364), (126, 66, 367), (124, 67, 370), (122, 68, 373), (120, 69, 376), (118, 70, 379), (117, 71, 381), (115, 72, 385), (114, 73, 387), (113, 74, 389), (112, 75, 391), (112, 76, 393), (111, 77, 395), (110, 78, 397), (109, 79, 399), (109, 80, 400), (108, 81, 402), (107, 82, 404), (107, 83, 404), (106, 84, 406), (105, 85, 408), (105, 86, 409), (104, 87, 410), (104, 88, 411), (103, 89, 413), (102, 90, 415), (101, 91, 417), (100, 92, 420), (98, 93, 423), (97, 94, 426), (96, 95, 428), (94, 96, 431), (93, 97, 433), (92, 98, 435), (91, 99, 437), (90, 100, 439), (89, 101, 441), (89, 102, 441), (89, 103, 442), (89, 104, 443), (89, 105, 444), (89, 106, 444), (89, 107, 445), (89, 108, 446), (89, 109, 447), (89, 110, 448), (89, 111, 449), (89, 112, 450), (89, 113, 451), (89, 114, 453), (89, 115, 454), (89, 116, 455), (88, 117, 456), (88, 118, 457), (87, 119, 459), (87, 120, 459), (86, 121, 461), (85, 122, 462), (85, 123, 463), (84, 124, 464), (84, 125, 465), (83, 126, 466), (82, 127, 468), (82, 128, 468), (81, 129, 470), (80, 130, 471), (78, 131, 473), (76, 132, 476), (75, 133, 477), (73, 134, 480), (71, 135, 482), (70, 136, 484), (68, 137, 486), (67, 138, 488), (65, 139, 490), (64, 140, 492), (63, 141, 493), (61, 142, 496), (60, 143, 497), (59, 144, 499), (58, 145, 501), (58, 146, 501), (57, 147, 503), (57, 148, 504), (57, 149, 505), (56, 150, 507), (56, 151, 507), (55, 152, 509), (55, 153, 510), (54, 154, 511), (54, 155, 512), (54, 156, 513), (53, 157, 514), (53, 158, 514), (52, 159, 516), (52, 160, 516), (52, 161, 516), (51, 162, 517), (51, 163, 517), (50, 164, 518), (50, 165, 518), (49, 166, 519), (49, 167, 520), (48, 168, 521), (48, 169, 521), (47, 170, 522), (47, 171, 522), (46, 172, 523), (46, 173, 523), (46, 174, 523), (45, 175, 524), (45, 176, 523), (44, 177, 524), (44, 178, 524), (44, 179, 524), (43, 180, 525), (43, 181, 525), (42, 182, 525), (42, 183, 525), (42, 184, 525), (41, 185, 526), (41, 186, 526), (40, 187, 526), (39, 188, 526), (39, 189, 525), (38, 190, 526), (38, 191, 525), (37, 192, 525), (37, 193, 523), (36, 194, 523), (36, 195, 523), (36, 196, 522), (35, 197, 522), (35, 198, 521), (34, 199, 521), (34, 200, 521), (34, 201, 520), (34, 202, 520), (34, 203, 520), (34, 204, 519), (34, 205, 519), (33, 206, 520), (33, 207, 519), (33, 208, 519), (33, 209, 519), (33, 210, 518), (33, 211, 518), (33, 212, 518), (33, 213, 517), (32, 214, 518), (32, 215, 517), (32, 216, 517), (32, 217, 516), (32, 218, 515), (32, 219, 514), (32, 220, 513), (32, 221, 512), (32, 222, 511), (32, 223, 510), (32, 224, 508), (32, 225, 507), (32, 226, 505), (32, 227, 504), (32, 228, 503), (32, 229, 502), (32, 230, 502), (32, 231, 501), (32, 232, 500), (32, 233, 499), (32, 234, 498), (32, 235, 497), (31, 236, 496), (31, 237, 495), (31, 238, 494), (31, 239, 493), (31, 240, 491), (31, 241, 490), (31, 242, 488), (31, 243, 487), (31, 244, 486), (31, 245, 485), (31, 246, 483), (31, 247, 482), (31, 248, 480), (31, 249, 479), (31, 250, 477), (31, 251, 475), (31, 252, 473), (31, 253, 472), (31, 254, 470), (31, 255, 468), (31, 256, 467), (31, 257, 465), (31, 258, 464), (31, 259, 463), (31, 260, 462), (31, 261, 461), (31, 262, 459), (31, 263, 458), (31, 264, 456), (31, 265, 455), (31, 266, 453), (31, 267, 451), (31, 268, 449), (31, 269, 448), (31, 270, 447), (31, 271, 445), (31, 272, 444), (31, 273, 443), (32, 274, 441), (32, 275, 440), (32, 276, 438), (32, 277, 437), (32, 278, 435), (32, 279, 434), (32, 280, 432), (33, 281, 429), (33, 282, 427), (33, 283, 426), (33, 284, 424), (33, 285, 423), (34, 286, 421), (34, 287, 420), (34, 288, 419), (35, 289, 416), (35, 290, 415), (35, 291, 414), (36, 292, 411), (36, 293, 410), (37, 294, 407), (37, 295, 406), (38, 296, 403), (38, 297, 401), (39, 298, 399), (39, 299, 397), (41, 300, 394), (42, 301, 392), (43, 302, 389), (44, 303, 387), (45, 304, 385), (46, 305, 382), (47, 306, 380), (47, 307, 378), (48, 308, 376), (49, 309, 373), (50, 310, 370), (51, 311, 368), (51, 312, 367), (52, 313, 365), (54, 314, 362), (55, 315, 360), (56, 316, 359), (58, 317, 356), (61, 318, 352), (64, 319, 349), (67, 320, 345), (70, 321, 341), (73, 322, 338), (75, 323, 335), (78, 324, 332), (80, 325, 329), (82, 326, 327), (84, 327, 324), (86, 328, 322), (88, 329, 320), (90, 330, 317), (93, 331, 314), (96, 332, 311), (99, 333, 307), (102, 334, 304), (105, 335, 300), (108, 336, 297), (111, 337, 294), (113, 338, 291), (115, 339, 289), (117, 340, 286), (119, 341, 283), (121, 342, 281), (123, 343, 278), (125, 344, 275), (127, 345, 272), (129, 346, 269), (132, 347, 266), (135, 348, 262), (138, 349, 258), (141, 350, 255), (143, 351, 252), (145, 352, 250), (147, 353, 247), (149, 354, 245), (151, 355, 242), (152, 356, 241), (154, 357, 239), (156, 358, 237), (159, 359, 233), (161, 360, 231), (163, 361, 229), (165, 362, 227), (167, 363, 224), (169, 364, 222), (170, 365, 221), (172, 366, 219), (173, 367, 218), (174, 368, 216), (175, 369, 215), (177, 370, 213), (178, 371, 212), (180, 372, 209), (183, 373, 206), (185, 374, 204), (188, 375, 200), (191, 376, 197), (193, 377, 194), (196, 378, 191), (199, 379, 188), (201, 380, 185), (203, 381, 183), (205, 382, 180), (207, 383, 178), (208, 384, 176), (210, 385, 174), (212, 386, 171), (213, 387, 169), (215, 388, 166), (218, 389, 162), (221, 390, 158), (225, 391, 153), (228, 392, 149), (232, 393, 144), (235, 394, 140), (238, 395, 136), (241, 396, 133), (245, 397, 128), (248, 398, 124), (252, 399, 119), (257, 400, 113), (263, 401, 105), (272, 402, 94), (283, 403, 82), (296, 404, 66), (306, 405, 53), (313, 406, 38), (321, 407, 23)], ['321,407,305,404,263,401,215,388,198,378,178,371,168,363,140,349,129,346,110,336,90,330,77,323,56,316,39,299,31,273,31,236,34,199,58,145,79,131,89,116,89,101,104,88,115,72,159,49,180,43,199,41,237,41,272,38,337,37,382,39,402,43,417,43,481,55,543,116,556,143,566,156,568,167,566,186,554,199,548,216,528,235,496,256,471,275,420,309,403,339,392,355,389,371,383,385,369,400,358,405']), (957285035, 492601069, 445, 485, 636, 23, 174, 0.97113603, [(540, 24, 21), (626, 24, 3), (531, 25, 49), (594, 25, 40), (527, 26, 107), (523, 27, 111), (520, 28, 114), (517, 29, 118), (516, 30, 119), (515, 31, 120), (513, 32, 122), (512, 33, 123), (510, 34, 125), (509, 35, 126), (507, 36, 128), (506, 37, 129), (504, 38, 131), (503, 39, 132), (501, 40, 134), (500, 41, 135), (499, 42, 136), (498, 43, 137), (497, 44, 138), (496, 45, 139), (496, 46, 139), (495, 47, 140), (495, 48, 140), (494, 49, 141), (493, 50, 142), (492, 51, 143), (491, 52, 144), (491, 53, 144), (490, 54, 145), (490, 55, 145), (490, 56, 145), (490, 57, 146), (490, 58, 146), (490, 59, 146), (491, 60, 145), (491, 61, 145), (491, 62, 145), (492, 63, 144), (493, 64, 143), (494, 65, 142), (495, 66, 141), (496, 67, 139), (497, 68, 138), (498, 69, 138), (499, 70, 137), (500, 71, 136), (501, 72, 135), (503, 73, 133), (503, 74, 133), (505, 75, 131), (506, 76, 130), (507, 77, 129), (508, 78, 128), (509, 79, 127), (510, 80, 126), (511, 81, 125), (512, 82, 124), (513, 83, 123), (514, 84, 122), (515, 85, 121), (516, 86, 120), (517, 87, 119), (518, 88, 118), (519, 89, 117), (521, 90, 115), (521, 91, 115), (522, 92, 114), (523, 93, 113), (524, 94, 112), (525, 95, 111), (526, 96, 110), (527, 97, 109), (529, 98, 107), (530, 99, 106), (532, 100, 104), (533, 101, 103), (534, 102, 102), (535, 103, 101), (536, 104, 100), (538, 105, 98), (540, 106, 96), (541, 107, 95), (543, 108, 93), (546, 109, 90), (548, 110, 88), (549, 111, 87), (551, 112, 84), (552, 113, 83), (553, 114, 82), (555, 115, 80), (556, 116, 79), (556, 117, 79), (557, 118, 78), (558, 119, 77), (559, 120, 76), (560, 121, 75), (560, 122, 75), (561, 123, 74), (561, 124, 74), (561, 125, 74), (562, 126, 73), (562, 127, 73), (563, 128, 72), (563, 129, 72), (564, 130, 70), (564, 131, 70), (565, 132, 69), (565, 133, 68), (565, 134, 68), (565, 135, 67), (566, 136, 65), (566, 137, 64), (566, 138, 64), (566, 139, 62), (566, 140, 61), (566, 141, 59), (566, 142, 57), (566, 143, 56), (566, 144, 55), (566, 145, 54), (567, 146, 53), (567, 147, 52), (567, 148, 51), (568, 149, 50), (568, 150, 49), (568, 151, 48), (568, 152, 47), (569, 153, 45), (569, 154, 44), (570, 155, 42), (570, 156, 42), (570, 157, 41), (571, 158, 39), (571, 159, 39), (572, 160, 37), (572, 161, 37), (573, 162, 35), (573, 163, 34), (573, 164, 34), (574, 165, 32), (575, 166, 30), (577, 167, 28), (578, 168, 26), (581, 169, 22), (585, 170, 18), (587, 171, 15), (591, 172, 8)], ['598,172,591,172,584,169,578,168,573,164,573,162,568,152,568,149,566,145,566,136,565,132,561,125,560,121,556,116,547,109,543,108,536,104,531,99,527,97,491,62,490,54,495,48,496,45,501,40,514,32,517,29,531,25,539,25,540,24,560,24,561,25,579,25,580,26,593,26,594,25,633,25,634,29,634,56,635,57,635,111,634,112,634,129,632,134,629,138,623,141,619,145,617,149,611,155,608,161,604,166']), (957285035, 492601069, 445, 280, 481, 2, 55, 0.82956356, [(291, 3, 129), (284, 4, 146), (282, 5, 151), (281, 6, 154), (281, 7, 156), (281, 8, 157), (281, 9, 158), (281, 10, 160), (281, 11, 162), (281, 12, 165), (281, 13, 167), (281, 14, 169), (281, 15, 171), (281, 16, 173), (281, 17, 174), (281, 18, 175), (281, 19, 177), (281, 20, 178), (281, 21, 179), (281, 22, 180), (281, 23, 181), (281, 24, 182), (281, 25, 183), (281, 26, 184), (281, 27, 185), (281, 28, 185), (281, 29, 185), (282, 30, 185), (283, 31, 27), (337, 31, 131), (371, 32, 97), (401, 33, 68), (409, 34, 61), (419, 35, 52), (424, 36, 48), (429, 37, 44), (432, 38, 41), (434, 39, 40), (436, 40, 39), (438, 41, 37), (441, 42, 35), (444, 43, 32), (448, 44, 29), (452, 45, 25), (454, 46, 23), (459, 47, 17), (463, 48, 12), (468, 49, 5)], ['472,49,468,49,467,48,459,47,458,46,454,46,451,44,448,44,447,43,444,43,440,41,438,41,428,36,424,36,423,35,419,35,418,34,409,34,408,33,401,33,400,32,371,32,370,31,337,31,336,30,283,31,281,29,281,6,284,4,290,4,291,3,419,3,420,4,429,4,430,5,432,5,436,7,441,11,445,12,453,16,456,19,457,19,465,27,465,29,472,37,476,44,476,46']), (957285035, 492601069, 445, 456, 547, 6, 45, 0.7410796, [(482, 8, 19), (463, 9, 4), (481, 9, 44), (457, 10, 12), (479, 10, 50), (457, 11, 13), (476, 11, 56), (457, 12, 15), (475, 12, 65), (457, 13, 84), (457, 14, 85), (457, 15, 89), (457, 16, 89), (458, 17, 88), (459, 18, 87), (460, 19, 86), (461, 20, 80), (464, 21, 71), (466, 22, 63), (467, 23, 59), (468, 24, 55), (469, 25, 52), (469, 26, 51), (470, 27, 48), (471, 28, 46), (471, 29, 44), (472, 30, 42), (473, 31, 39), (473, 32, 38), (474, 33, 36), (475, 34, 33), (475, 35, 32), (476, 36, 30), (476, 37, 29), (477, 38, 26), (478, 39, 23), (479, 40, 20), (480, 41, 17), (488, 42, 5)], ['492,42,488,42,487,41,480,41,476,37,475,34,473,32,469,25,465,21,461,20,457,16,457,10,466,9,470,12,474,13,476,11,480,10,482,8,500,8,501,9,524,9,525,10,528,10,532,12,539,12,542,15,545,15,545,19,535,20,534,21,529,21,525,23,523,23,513,30,512,30,504,37,496,41,493,41'])], 'temp/1744594526_648272_957285035_a42482e51c93c8025d243dd179aee85b.jpg']} free memory after detection : begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 10814 ############################### TEST detect object ################################ run mask_detect Inside batchDatouExec : verbose : False # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : mask_detect list_input_json : [] origin BFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 1 ; length of list_pids : 1 ; length of list_args : 1 time to download the photos : 0.414046049118042 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : False number of steps : 1 step1:mask_detect Mon Apr 14 03:38:07 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10814 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-04-14 03:38:09.526697: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-04-14 03:38:09.551120: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-04-14 03:38:09.553164: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f10fc000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-04-14 03:38:09.553208: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-04-14 03:38:09.556673: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-04-14 03:38:09.765565: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x1d6352a0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-04-14 03:38:09.765608: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-04-14 03:38:09.766967: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-04-14 03:38:09.767340: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-04-14 03:38:09.770160: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-04-14 03:38:09.772631: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-04-14 03:38:09.773087: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-04-14 03:38:09.776177: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-04-14 03:38:09.777128: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-04-14 03:38:09.780872: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-04-14 03:38:09.782243: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-04-14 03:38:09.782299: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-04-14 03:38:09.783022: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-04-14 03:38:09.783039: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-04-14 03:38:09.783048: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-04-14 03:38:09.784443: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10023 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-04-14 03:38:09.857130: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-04-14 03:38:09.857215: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-04-14 03:38:09.857239: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-04-14 03:38:09.857260: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-04-14 03:38:09.857281: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-04-14 03:38:09.857301: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-04-14 03:38:09.857321: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-04-14 03:38:09.857341: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-04-14 03:38:09.858985: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-04-14 03:38:09.860240: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-04-14 03:38:09.860277: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-04-14 03:38:09.860298: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-04-14 03:38:09.860317: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-04-14 03:38:09.860336: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-04-14 03:38:09.860356: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-04-14 03:38:09.860375: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-04-14 03:38:09.860395: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-04-14 03:38:09.861984: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-04-14 03:38:09.862014: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-04-14 03:38:09.862024: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-04-14 03:38:09.862033: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-04-14 03:38:09.863692: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10023 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (3473, 'mask_coco_origin', 16384, 25088, 'mask_coco_origin', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2018, 3, 19, 10, 42, 21), datetime.datetime(2018, 3, 19, 10, 42, 21)) {'thcl': {'id': 454, 'mtr_user_id': 31, 'name': 'mask_coco_origin', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'backgroud,person,bicycle,car,motorcycle,airplane,bus,train,truck,boat,trafficlight,firehydrant,stopsign,parkingmeter,bench,bird,cat,dog,horse,sheep,cow,elephant,bear,zebra,giraffe,backpack,umbrella,handbag,tie,suitcase,frisbee,skis,snowboard,sportsball,kite,baseballbat,baseballglove,skateboard,surfboard,tennisracket,bottle,wineglass,cup,fork,knife,spoon,bowl,banana,apple,sandwich,orange,broccoli,carrot,hotdog,pizza,donut,cake,chair,couch,pottedplant,bed,diningtable,toilet,tv,laptop,mouse,remote,keyboard,cellphone,microwave,oven,toaster,sink,refrigerator,book,clock,vase,scissors,teddybear,hairdrier,toothbrush', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 445, 'photo_desc_type': 3473, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['backgroud', 'person', 'bicycle', 'car', 'motorcycle', 'airplane', 'bus', 'train', 'truck', 'boat', 'trafficlight', 'firehydrant', 'stopsign', 'parkingmeter', 'bench', 'bird', 'cat', 'dog', 'horse', 'sheep', 'cow', 'elephant', 'bear', 'zebra', 'giraffe', 'backpack', 'umbrella', 'handbag', 'tie', 'suitcase', 'frisbee', 'skis', 'snowboard', 'sportsball', 'kite', 'baseballbat', 'baseballglove', 'skateboard', 'surfboard', 'tennisracket', 'bottle', 'wineglass', 'cup', 'fork', 'knife', 'spoon', 'bowl', 'banana', 'apple', 'sandwich', 'orange', 'broccoli', 'carrot', 'hotdog', 'pizza', 'donut', 'cake', 'chair', 'couch', 'pottedplant', 'bed', 'diningtable', 'toilet', 'tv', 'laptop', 'mouse', 'remote', 'keyboard', 'cellphone', 'microwave', 'oven', 'toaster', 'sink', 'refrigerator', 'book', 'clock', 'vase', 'scissors', 'teddybear', 'hairdrier', 'toothbrush'], 'list_hashtags_csv': 'backgroud,person,bicycle,car,motorcycle,airplane,bus,train,truck,boat,trafficlight,firehydrant,stopsign,parkingmeter,bench,bird,cat,dog,horse,sheep,cow,elephant,bear,zebra,giraffe,backpack,umbrella,handbag,tie,suitcase,frisbee,skis,snowboard,sportsball,kite,baseballbat,baseballglove,skateboard,surfboard,tennisracket,bottle,wineglass,cup,fork,knife,spoon,bowl,banana,apple,sandwich,orange,broccoli,carrot,hotdog,pizza,donut,cake,chair,couch,pottedplant,bed,diningtable,toilet,tv,laptop,mouse,remote,keyboard,cellphone,microwave,oven,toaster,sink,refrigerator,book,clock,vase,scissors,teddybear,hairdrier,toothbrush', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 445, 'svm_hashtag_type_desc': 3473, 'photo_desc_type': 3473, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['backgroud', 'person', 'bicycle', 'car', 'motorcycle', 'airplane', 'bus', 'train', 'truck', 'boat', 'trafficlight', 'firehydrant', 'stopsign', 'parkingmeter', 'bench', 'bird', 'cat', 'dog', 'horse', 'sheep', 'cow', 'elephant', 'bear', 'zebra', 'giraffe', 'backpack', 'umbrella', 'handbag', 'tie', 'suitcase', 'frisbee', 'skis', 'snowboard', 'sportsball', 'kite', 'baseballbat', 'baseballglove', 'skateboard', 'surfboard', 'tennisracket', 'bottle', 'wineglass', 'cup', 'fork', 'knife', 'spoon', 'bowl', 'banana', 'apple', 'sandwich', 'orange', 'broccoli', 'carrot', 'hotdog', 'pizza', 'donut', 'cake', 'chair', 'couch', 'pottedplant', 'bed', 'diningtable', 'toilet', 'tv', 'laptop', 'mouse', 'remote', 'keyboard', 'cellphone', 'microwave', 'oven', 'toaster', 'sink', 'refrigerator', 'book', 'clock', 'vase', 'scissors', 'teddybear', 'hairdrier', 'toothbrush'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME mask_coco_origin NUM_CLASSES 81 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : mask_coco_origin model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-04-14 03:38:18.004914: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-04-14 03:38:18.185879: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/mask_coco_origin /data/models_weight/mask_coco_origin/mask_model.h5 size_local : 257557808 size in s3 : 257557808 create time local : 2021-08-09 05:27:17 create time in s3 : 2021-08-06 19:45:17 mask_model.h5 already exist and didn't need to update list_images length : 1 NEW PHOTO Processing 1 images image shape: (720, 1280, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 89) min: 0.00000 max: 1280.00000 nb d'objets trouves : 4 Detection mask done ! Trying to reset tf kernel 652718 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5525 tf kernel not reseted sub process len(results) : 1 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 1 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 10814 list_Values should be empty [] ['backgroud', 'person', 'bicycle', 'car', 'motorcycle', 'airplane', 'bus', 'train', 'truck', 'boat', 'trafficlight', 'firehydrant', 'stopsign', 'parkingmeter', 'bench', 'bird', 'cat', 'dog', 'horse', 'sheep', 'cow', 'elephant', 'bear', 'zebra', 'giraffe', 'backpack', 'umbrella', 'handbag', 'tie', 'suitcase', 'frisbee', 'skis', 'snowboard', 'sportsball', 'kite', 'baseballbat', 'baseballglove', 'skateboard', 'surfboard', 'tennisracket', 'bottle', 'wineglass', 'cup', 'fork', 'knife', 'spoon', 'bowl', 'banana', 'apple', 'sandwich', 'orange', 'broccoli', 'carrot', 'hotdog', 'pizza', 'donut', 'cake', 'chair', 'couch', 'pottedplant', 'bed', 'diningtable', 'toilet', 'tv', 'laptop', 'mouse', 'remote', 'keyboard', 'cellphone', 'microwave', 'oven', 'toaster', 'sink', 'refrigerator', 'book', 'clock', 'vase', 'scissors', 'teddybear', 'hairdrier', 'toothbrush'] time for calcul the mask position with numpy : 0.0006654262542724609 nb_pixel_total : 16901 time to create 1 rle with old method : 0.023688793182373047 length of segment : 107 time for calcul the mask position with numpy : 0.018773794174194336 nb_pixel_total : 480959 time to create 1 rle with new method : 0.028521060943603516 length of segment : 632 time for calcul the mask position with numpy : 0.0007996559143066406 nb_pixel_total : 36586 time to create 1 rle with old method : 0.04084587097167969 length of segment : 132 time for calcul the mask position with numpy : 8.96453857421875e-05 nb_pixel_total : 4793 time to create 1 rle with old method : 0.005662202835083008 length of segment : 51 time spent for convertir_results : 0.6592469215393066 time spend for datou_step_exec : 17.386192321777344 time spend to save output : 5.53131103515625e-05 total time spend for step 1 : 17.386247634887695 caffe_path_current : About to save ! 1 Inside saveOutput : final : True verbose : False eke 12-6-18 : saveMask need to be cleaned for new output ! Catched exception ! Connect or reconnect ! Number saved : None batch 1 Loaded 412 chid ids of type : 445 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 0 begin to insert list_values into mtr_datou_result : length of list_values in save_final : 1 time used for this insertion : 0.012800455093383789 save missing photos in datou_result : After save, about to update current ! datou_cur_ids : [] len(datou.list_steps) : 1 output : {'917855882': [[(917855882, 492601069, 445, 1092, 1280, 0, 108, 0.9988379, [(1205, 1, 58), (1165, 2, 105), (1159, 3, 113), (1149, 4, 124), (1113, 5, 161), (1100, 6, 174), (1097, 7, 177), (1095, 8, 179), (1095, 9, 179), (1095, 10, 179), (1095, 11, 179), (1095, 12, 179), (1095, 13, 179), (1095, 14, 178), (1095, 15, 178), (1095, 16, 178), (1095, 17, 178), (1095, 18, 177), (1095, 19, 177), (1095, 20, 177), (1095, 21, 177), (1095, 22, 177), (1095, 23, 178), (1095, 24, 178), (1095, 25, 178), (1095, 26, 179), (1095, 27, 179), (1095, 28, 180), (1095, 29, 181), (1095, 30, 182), (1095, 31, 183), (1095, 32, 183), (1095, 33, 184), (1095, 34, 184), (1096, 35, 183), (1096, 36, 183), (1096, 37, 184), (1097, 38, 183), (1097, 39, 183), (1097, 40, 183), (1098, 41, 182), (1098, 42, 182), (1098, 43, 182), (1099, 44, 181), (1099, 45, 181), (1099, 46, 181), (1100, 47, 180), (1100, 48, 180), (1101, 49, 179), (1101, 50, 179), (1102, 51, 178), (1102, 52, 178), (1103, 53, 177), (1103, 54, 177), (1104, 55, 176), (1104, 56, 176), (1104, 57, 176), (1104, 58, 176), (1105, 59, 175), (1105, 60, 175), (1105, 61, 175), (1105, 62, 175), (1105, 63, 175), (1106, 64, 174), (1106, 65, 174), (1106, 66, 174), (1106, 67, 174), (1106, 68, 174), (1106, 69, 174), (1106, 70, 174), (1106, 71, 174), (1106, 72, 174), (1106, 73, 174), (1107, 74, 173), (1107, 75, 173), (1107, 76, 173), (1107, 77, 173), (1107, 78, 173), (1107, 79, 173), (1108, 80, 172), (1108, 81, 172), (1109, 82, 171), (1110, 83, 170), (1110, 84, 170), (1111, 85, 169), (1112, 86, 168), (1113, 87, 166), (1114, 88, 165), (1115, 89, 164), (1117, 90, 162), (1120, 91, 159), (1138, 92, 141), (1146, 93, 133), (1154, 94, 125), (1167, 95, 112), (1177, 96, 102), (1183, 97, 95), (1185, 98, 93), (1187, 99, 90), (1188, 100, 55), (1264, 100, 11), (1190, 101, 50), (1191, 102, 46), (1194, 103, 40), (1197, 104, 34), (1202, 105, 25), (1207, 106, 16)], ['1222,106,1207,106,1206,105,1197,104,1191,102,1182,96,1176,95,1167,95,1166,94,1154,94,1153,93,1146,93,1145,92,1137,91,1120,91,1115,89,1110,84,1107,79,1106,73,1106,64,1104,55,1099,46,1095,34,1095,8,1100,6,1112,6,1113,5,1148,5,1149,4,1158,4,1165,2,1204,2,1205,1,1262,1,1269,2,1273,5,1273,13,1271,18,1271,22,1273,27,1277,31,1279,37,1279,86,1278,87,1278,96,1274,100,1264,100,1263,99,1243,99,1230,104']), (917855882, 492601069, 445, 52, 1128, 16, 668, 0.9977192, [(709, 22, 25), (924, 22, 49), (607, 23, 148), (893, 23, 104), (598, 24, 236), (847, 24, 161), (589, 25, 428), (581, 26, 445), (574, 27, 459), (569, 28, 466), (565, 29, 472), (560, 30, 480), (555, 31, 487), (550, 32, 495), (544, 33, 503), (538, 34, 512), (531, 35, 521), (527, 36, 527), (522, 37, 535), (518, 38, 541), (514, 39, 548), (510, 40, 554), (506, 41, 561), (502, 42, 567), (499, 43, 572), (495, 44, 578), (493, 45, 582), (490, 46, 586), (488, 47, 590), (487, 48, 592), (485, 49, 595), (483, 50, 598), (482, 51, 600), (481, 52, 602), (480, 53, 603), (479, 54, 605), (478, 55, 606), (476, 56, 608), (475, 57, 610), (474, 58, 611), (473, 59, 613), (472, 60, 614), (470, 61, 616), (469, 62, 618), (468, 63, 619), (466, 64, 621), (465, 65, 623), (464, 66, 624), (462, 67, 626), (461, 68, 628), (459, 69, 630), (458, 70, 631), (456, 71, 633), (455, 72, 635), (453, 73, 637), (452, 74, 638), (451, 75, 639), (449, 76, 641), (448, 77, 642), (447, 78, 643), (446, 79, 644), (445, 80, 645), (443, 81, 647), (442, 82, 648), (441, 83, 649), (440, 84, 650), (439, 85, 651), (438, 86, 652), (437, 87, 653), (436, 88, 654), (435, 89, 655), (434, 90, 656), (433, 91, 657), (432, 92, 658), (431, 93, 659), (430, 94, 660), (429, 95, 661), (428, 96, 662), (427, 97, 663), (425, 98, 665), (423, 99, 667), (421, 100, 669), (419, 101, 671), (417, 102, 673), (413, 103, 677), (410, 104, 680), (405, 105, 685), (401, 106, 689), (397, 107, 693), (392, 108, 698), (387, 109, 703), (382, 110, 708), (377, 111, 713), (373, 112, 717), (369, 113, 721), (365, 114, 725), (362, 115, 728), (358, 116, 732), (356, 117, 734), (353, 118, 737), (351, 119, 739), (349, 120, 741), (346, 121, 744), (344, 122, 746), (341, 123, 749), (338, 124, 752), (335, 125, 755), (331, 126, 759), (327, 127, 763), (323, 128, 767), (319, 129, 770), (314, 130, 775), (308, 131, 781), (303, 132, 786), (294, 133, 795), (287, 134, 802), (279, 135, 810), (273, 136, 816), (267, 137, 822), (262, 138, 827), (258, 139, 831), (255, 140, 834), (252, 141, 837), (250, 142, 839), (247, 143, 842), (245, 144, 844), (242, 145, 847), (240, 146, 849), (237, 147, 852), (234, 148, 855), (230, 149, 859), (226, 150, 863), (220, 151, 869), (213, 152, 876), (207, 153, 882), (200, 154, 889), (193, 155, 896), (187, 156, 902), (184, 157, 905), (181, 158, 908), (178, 159, 911), (176, 160, 913), (174, 161, 915), (172, 162, 917), (170, 163, 919), (168, 164, 921), (167, 165, 922), (165, 166, 924), (164, 167, 925), (162, 168, 927), (161, 169, 928), (159, 170, 930), (157, 171, 932), (155, 172, 934), (153, 173, 935), (151, 174, 937), (149, 175, 939), (146, 176, 942), (144, 177, 944), (142, 178, 946), (140, 179, 948), (139, 180, 949), (137, 181, 951), (136, 182, 952), (134, 183, 954), (133, 184, 955), (132, 185, 956), (131, 186, 957), (130, 187, 958), (129, 188, 959), (128, 189, 960), (127, 190, 960), (126, 191, 961), (126, 192, 961), (125, 193, 962), (124, 194, 963), (123, 195, 964), (122, 196, 965), (122, 197, 965), (121, 198, 966), (120, 199, 967), (119, 200, 968), (118, 201, 969), (117, 202, 970), (116, 203, 971), (114, 204, 973), (113, 205, 973), (112, 206, 974), (111, 207, 975), (109, 208, 977), (108, 209, 978), (107, 210, 979), (106, 211, 980), (105, 212, 981), (104, 213, 982), (103, 214, 983), (102, 215, 984), (101, 216, 985), (101, 217, 984), (100, 218, 985), (100, 219, 985), (99, 220, 986), (98, 221, 987), (98, 222, 987), (97, 223, 988), (97, 224, 988), (96, 225, 988), (96, 226, 988), (95, 227, 989), (95, 228, 989), (94, 229, 990), (94, 230, 990), (94, 231, 990), (93, 232, 990), (93, 233, 990), (92, 234, 991), (92, 235, 991), (92, 236, 991), (91, 237, 992), (91, 238, 991), (91, 239, 991), (91, 240, 991), (91, 241, 990), (90, 242, 991), (90, 243, 990), (90, 244, 990), (90, 245, 989), (90, 246, 989), (89, 247, 990), (89, 248, 989), (89, 249, 989), (89, 250, 988), (89, 251, 988), (88, 252, 988), (88, 253, 988), (88, 254, 987), (88, 255, 986), (88, 256, 986), (87, 257, 986), (87, 258, 986), (87, 259, 985), (87, 260, 984), (87, 261, 983), (86, 262, 983), (86, 263, 983), (86, 264, 982), (86, 265, 981), (85, 266, 981), (85, 267, 980), (85, 268, 980), (85, 269, 979), (84, 270, 979), (84, 271, 979), (84, 272, 978), (83, 273, 979), (83, 274, 978), (83, 275, 977), (82, 276, 978), (82, 277, 977), (82, 278, 977), (81, 279, 977), (81, 280, 977), (81, 281, 977), (80, 282, 977), (80, 283, 977), (80, 284, 976), (79, 285, 977), (79, 286, 976), (79, 287, 976), (78, 288, 976), (78, 289, 976), (78, 290, 975), (77, 291, 976), (77, 292, 975), (77, 293, 975), (76, 294, 975), (76, 295, 975), (76, 296, 974), (75, 297, 975), (75, 298, 974), (75, 299, 974), (74, 300, 974), (74, 301, 974), (73, 302, 974), (73, 303, 974), (72, 304, 974), (72, 305, 974), (71, 306, 974), (71, 307, 973), (71, 308, 972), (70, 309, 972), (70, 310, 971), (70, 311, 970), (70, 312, 968), (69, 313, 968), (69, 314, 966), (69, 315, 964), (69, 316, 962), (68, 317, 961), (68, 318, 959), (68, 319, 957), (68, 320, 956), (67, 321, 955), (67, 322, 954), (67, 323, 952), (67, 324, 951), (66, 325, 951), (66, 326, 950), (66, 327, 948), (66, 328, 947), (66, 329, 946), (65, 330, 946), (65, 331, 945), (65, 332, 945), (65, 333, 944), (65, 334, 942), (65, 335, 941), (65, 336, 940), (65, 337, 939), (65, 338, 937), (65, 339, 936), (64, 340, 936), (64, 341, 934), (64, 342, 932), (64, 343, 930), (64, 344, 928), (64, 345, 926), (64, 346, 925), (64, 347, 923), (64, 348, 922), (64, 349, 920), (64, 350, 919), (64, 351, 918), (63, 352, 918), (63, 353, 917), (63, 354, 916), (63, 355, 915), (63, 356, 914), (63, 357, 912), (63, 358, 911), (63, 359, 910), (63, 360, 909), (63, 361, 908), (63, 362, 907), (63, 363, 905), (63, 364, 904), (63, 365, 902), (63, 366, 901), (63, 367, 899), (63, 368, 898), (63, 369, 896), (62, 370, 895), (62, 371, 893), (62, 372, 892), (62, 373, 890), (62, 374, 889), (62, 375, 887), (62, 376, 886), (62, 377, 885), (62, 378, 884), (62, 379, 883), (63, 380, 881), (63, 381, 880), (63, 382, 878), (63, 383, 877), (63, 384, 876), (63, 385, 875), (63, 386, 874), (63, 387, 873), (64, 388, 871), (64, 389, 870), (64, 390, 869), (64, 391, 868), (64, 392, 867), (64, 393, 866), (64, 394, 864), (64, 395, 863), (65, 396, 861), (65, 397, 860), (65, 398, 859), (65, 399, 858), (65, 400, 857), (65, 401, 856), (65, 402, 854), (65, 403, 853), (65, 404, 851), (65, 405, 850), (65, 406, 848), (66, 407, 846), (66, 408, 844), (66, 409, 843), (66, 410, 842), (66, 411, 841), (66, 412, 840), (66, 413, 838), (66, 414, 837), (66, 415, 836), (66, 416, 835), (66, 417, 834), (66, 418, 834), (66, 419, 833), (67, 420, 831), (67, 421, 830), (67, 422, 829), (67, 423, 829), (67, 424, 828), (67, 425, 827), (67, 426, 826), (67, 427, 825), (67, 428, 824), (68, 429, 822), (68, 430, 820), (68, 431, 819), (68, 432, 818), (68, 433, 816), (68, 434, 815), (68, 435, 813), (68, 436, 811), (69, 437, 808), (69, 438, 807), (69, 439, 805), (69, 440, 804), (69, 441, 803), (69, 442, 801), (69, 443, 800), (70, 444, 798), (70, 445, 797), (70, 446, 796), (70, 447, 796), (71, 448, 794), (71, 449, 794), (72, 450, 792), (72, 451, 791), (73, 452, 790), (73, 453, 789), (74, 454, 788), (74, 455, 787), (75, 456, 786), (75, 457, 785), (76, 458, 784), (76, 459, 783), (77, 460, 782), (77, 461, 781), (77, 462, 781), (78, 463, 779), (78, 464, 779), (79, 465, 777), (79, 466, 777), (79, 467, 776), (80, 468, 775), (80, 469, 774), (80, 470, 774), (81, 471, 772), (81, 472, 771), (82, 473, 770), (82, 474, 769), (83, 475, 767), (83, 476, 766), (83, 477, 765), (84, 478, 764), (84, 479, 763), (85, 480, 761), (85, 481, 760), (85, 482, 759), (86, 483, 756), (86, 484, 755), (87, 485, 753), (87, 486, 751), (87, 487, 750), (88, 488, 748), (88, 489, 747), (88, 490, 746), (89, 491, 744), (89, 492, 743), (90, 493, 741), (90, 494, 740), (91, 495, 739), (92, 496, 737), (92, 497, 736), (93, 498, 735), (94, 499, 733), (94, 500, 732), (95, 501, 731), (96, 502, 729), (97, 503, 728), (98, 504, 726), (99, 505, 724), (99, 506, 724), (100, 507, 722), (101, 508, 721), (103, 509, 718), (104, 510, 717), (105, 511, 715), (106, 512, 714), (107, 513, 712), (108, 514, 711), (110, 515, 708), (111, 516, 707), (113, 517, 704), (114, 518, 703), (115, 519, 701), (117, 520, 699), (118, 521, 697), (119, 522, 695), (121, 523, 693), (122, 524, 691), (124, 525, 689), (125, 526, 687), (127, 527, 684), (128, 528, 683), (129, 529, 681), (131, 530, 678), (132, 531, 676), (134, 532, 674), (135, 533, 672), (137, 534, 669), (138, 535, 667), (140, 536, 664), (141, 537, 662), (143, 538, 659), (145, 539, 656), (146, 540, 654), (148, 541, 651), (149, 542, 649), (151, 543, 646), (153, 544, 643), (155, 545, 640), (156, 546, 638), (158, 547, 635), (159, 548, 633), (161, 549, 630), (163, 550, 627), (164, 551, 626), (166, 552, 623), (167, 553, 621), (169, 554, 619), (170, 555, 617), (172, 556, 614), (173, 557, 613), (174, 558, 611), (176, 559, 609), (177, 560, 607), (179, 561, 605), (180, 562, 603), (181, 563, 602), (183, 564, 599), (185, 565, 597), (187, 566, 595), (189, 567, 592), (192, 568, 589), (195, 569, 586), (198, 570, 582), (201, 571, 579), (204, 572, 576), (207, 573, 572), (209, 574, 570), (212, 575, 567), (215, 576, 563), (218, 577, 560), (221, 578, 556), (224, 579, 553), (226, 580, 551), (228, 581, 548), (230, 582, 546), (232, 583, 543), (234, 584, 541), (236, 585, 538), (237, 586, 537), (239, 587, 534), (240, 588, 532), (242, 589, 529), (244, 590, 526), (245, 591, 524), (247, 592, 521), (249, 593, 518), (251, 594, 515), (254, 595, 510), (256, 596, 507), (258, 597, 503), (261, 598, 498), (264, 599, 494), (267, 600, 489), (271, 601, 484), (275, 602, 478), (278, 603, 474), (281, 604, 470), (284, 605, 466), (287, 606, 462), (290, 607, 458), (293, 608, 454), (295, 609, 451), (298, 610, 447), (300, 611, 443), (303, 612, 439), (305, 613, 436), (308, 614, 432), (310, 615, 428), (312, 616, 425), (315, 617, 420), (317, 618, 416), (320, 619, 412), (322, 620, 408), (325, 621, 403), (328, 622, 398), (330, 623, 393), (333, 624, 387), (335, 625, 382), (338, 626, 377), (341, 627, 371), (345, 628, 365), (349, 629, 359), (353, 630, 353), (357, 631, 347), (360, 632, 342), (364, 633, 336), (368, 634, 330), (373, 635, 323), (378, 636, 315), (383, 637, 307), (389, 638, 298), (395, 639, 286), (401, 640, 273), (408, 641, 259), (415, 642, 244), (430, 643, 221), (447, 644, 196), (463, 645, 173), (477, 646, 153), (492, 647, 132), (507, 648, 111), (520, 649, 92), (535, 650, 56)], ['535,650,506,647,415,642,341,627,292,607,258,597,223,578,181,563,101,508,88,490,70,447,64,395,63,352,71,306,85,269,91,237,101,216,134,183,187,156,225,151,279,135,318,130,358,116,416,103,443,81,495,44,531,35,607,23,755,24,892,24,924,22,996,23,1032,27,1082,52,1089,72,1088,172,1082,237,1045,305,969,362,949,374,889,429,865,446,851,473,829,494,807,532,789,550,773,586,739,614,686,638,611,649']), (917855882, 492601069, 445, 0, 438, 0, 116, 0.991941, [(127, 1, 140), (94, 2, 205), (59, 3, 273), (338, 3, 59), (22, 4, 380), (19, 5, 386), (16, 6, 391), (15, 7, 393), (14, 8, 395), (14, 9, 396), (13, 10, 398), (12, 11, 399), (12, 12, 399), (11, 13, 401), (10, 14, 402), (11, 15, 402), (11, 16, 403), (12, 17, 403), (12, 18, 404), (12, 19, 405), (12, 20, 405), (12, 21, 405), (12, 22, 406), (12, 23, 406), (12, 24, 406), (12, 25, 407), (12, 26, 407), (12, 27, 407), (12, 28, 408), (12, 29, 408), (12, 30, 408), (12, 31, 408), (12, 32, 408), (12, 33, 408), (12, 34, 409), (12, 35, 409), (12, 36, 409), (12, 37, 409), (12, 38, 409), (12, 39, 409), (12, 40, 409), (12, 41, 409), (12, 42, 409), (12, 43, 410), (12, 44, 410), (12, 45, 409), (12, 46, 409), (12, 47, 409), (12, 48, 409), (12, 49, 409), (12, 50, 409), (12, 51, 409), (12, 52, 408), (12, 53, 408), (12, 54, 407), (12, 55, 406), (12, 56, 405), (12, 57, 404), (12, 58, 402), (11, 59, 402), (11, 60, 401), (11, 61, 401), (11, 62, 400), (11, 63, 399), (11, 64, 399), (11, 65, 398), (11, 66, 397), (11, 67, 396), (11, 68, 395), (11, 69, 395), (11, 70, 394), (11, 71, 394), (11, 72, 394), (11, 73, 393), (11, 74, 393), (11, 75, 393), (11, 76, 393), (11, 77, 393), (11, 78, 393), (11, 79, 392), (11, 80, 392), (10, 81, 393), (10, 82, 394), (10, 83, 394), (9, 84, 396), (9, 85, 263), (284, 85, 121), (9, 86, 75), (96, 86, 30), (141, 86, 120), (292, 86, 112), (9, 87, 71), (151, 87, 105), (294, 87, 110), (8, 88, 67), (160, 88, 92), (295, 88, 108), (8, 89, 63), (175, 89, 74), (296, 89, 107), (7, 90, 61), (204, 90, 41), (297, 90, 105), (7, 91, 57), (298, 91, 104), (7, 92, 53), (299, 92, 103), (6, 93, 50), (300, 93, 101), (7, 94, 46), (303, 94, 96), (7, 95, 44), (305, 95, 93), (7, 96, 42), (308, 96, 88), (7, 97, 40), (310, 97, 85), (7, 98, 38), (312, 98, 82), (8, 99, 34), (314, 99, 79), (8, 100, 32), (316, 100, 75), (8, 101, 29), (319, 101, 71), (13, 102, 19), (324, 102, 63), (20, 103, 6), (331, 103, 51), (337, 104, 37), (344, 105, 22), (351, 106, 2)], ['344,105,330,102,319,101,307,95,300,93,283,84,261,85,244,90,204,90,203,89,175,89,160,88,140,85,125,86,83,86,56,92,36,101,26,102,8,101,6,93,11,80,11,59,12,58,12,17,10,14,16,6,22,4,58,4,59,3,93,3,94,2,126,2,127,1,266,1,267,2,298,2,299,3,396,3,406,6,416,19,420,34,420,51,411,60,405,68,402,81,404,85,401,92,386,102,374,103,365,105']), (917855882, 492601069, 445, 390, 550, 0, 54, 0.9391504, [(414, 0, 7), (441, 0, 60), (508, 0, 28), (402, 1, 142), (401, 2, 146), (402, 3, 145), (404, 4, 143), (406, 5, 140), (408, 6, 137), (410, 7, 134), (411, 8, 132), (412, 9, 130), (413, 10, 127), (414, 11, 125), (415, 12, 123), (415, 13, 122), (416, 14, 120), (417, 15, 117), (417, 16, 116), (418, 17, 114), (418, 18, 113), (418, 19, 111), (418, 20, 109), (419, 21, 107), (419, 22, 105), (419, 23, 103), (419, 24, 102), (420, 25, 99), (420, 26, 97), (420, 27, 95), (420, 28, 94), (421, 29, 91), (421, 30, 90), (422, 31, 88), (422, 32, 88), (422, 33, 87), (423, 34, 84), (423, 35, 82), (423, 36, 81), (424, 37, 79), (424, 38, 77), (424, 39, 75), (424, 40, 73), (424, 41, 71), (425, 42, 67), (425, 43, 66), (426, 44, 62), (426, 45, 6), (433, 45, 52), (443, 46, 30), (450, 47, 1)], ['449,46,443,46,442,45,426,45,424,41,424,37,423,36,422,31,420,28,420,25,419,24,419,21,418,20,418,17,417,15,409,6,402,3,402,1,413,1,414,0,420,0,421,1,440,1,441,0,500,0,501,1,507,1,508,0,535,0,536,1,543,1,546,2,546,4,542,8,530,18,527,19,525,21,522,22,520,24,512,28,508,33,505,34,502,37,494,41,492,41,490,43,488,43,484,45,473,45,472,46'])], 'temp/1744594686_648272_917855882_da0fa7b7e6b5b551fe26c0ba8713276d.jpg']} ############################### TEST POLYGON ################################ Inside batchDatouExec : verbose : False # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : mask_detect list_input_json : [] origin BFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 1 ; length of list_pids : 1 ; length of list_args : 1 time to download the photos : 0.2885286808013916 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : False number of steps : 1 step1:mask_detect Mon Apr 14 03:38:57 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10814 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-04-14 03:38:59.876673: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-04-14 03:38:59.908483: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-04-14 03:38:59.911077: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f10fc000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-04-14 03:38:59.911160: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-04-14 03:38:59.915885: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-04-14 03:39:00.159281: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x1d679d30 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-04-14 03:39:00.159334: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-04-14 03:39:00.160812: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-04-14 03:39:00.161253: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-04-14 03:39:00.164387: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-04-14 03:39:00.166970: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-04-14 03:39:00.167393: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-04-14 03:39:00.170318: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-04-14 03:39:00.171715: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-04-14 03:39:00.176100: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-04-14 03:39:00.177552: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-04-14 03:39:00.177633: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-04-14 03:39:00.178351: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-04-14 03:39:00.178366: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-04-14 03:39:00.178375: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-04-14 03:39:00.179734: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10023 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-04-14 03:39:00.256476: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-04-14 03:39:00.256618: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-04-14 03:39:00.256645: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-04-14 03:39:00.256669: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-04-14 03:39:00.256693: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-04-14 03:39:00.256717: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-04-14 03:39:00.256739: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-04-14 03:39:00.256763: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-04-14 03:39:00.258342: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-04-14 03:39:00.259612: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-04-14 03:39:00.259666: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-04-14 03:39:00.259686: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-04-14 03:39:00.259704: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-04-14 03:39:00.259725: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-04-14 03:39:00.259743: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-04-14 03:39:00.259759: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-04-14 03:39:00.259776: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-04-14 03:39:00.260961: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-04-14 03:39:00.260995: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-04-14 03:39:00.261002: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-04-14 03:39:00.261009: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-04-14 03:39:00.262235: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10023 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (3473, 'mask_coco_origin', 16384, 25088, 'mask_coco_origin', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2018, 3, 19, 10, 42, 21), datetime.datetime(2018, 3, 19, 10, 42, 21)) {'thcl': {'id': 454, 'mtr_user_id': 31, 'name': 'mask_coco_origin', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'backgroud,person,bicycle,car,motorcycle,airplane,bus,train,truck,boat,trafficlight,firehydrant,stopsign,parkingmeter,bench,bird,cat,dog,horse,sheep,cow,elephant,bear,zebra,giraffe,backpack,umbrella,handbag,tie,suitcase,frisbee,skis,snowboard,sportsball,kite,baseballbat,baseballglove,skateboard,surfboard,tennisracket,bottle,wineglass,cup,fork,knife,spoon,bowl,banana,apple,sandwich,orange,broccoli,carrot,hotdog,pizza,donut,cake,chair,couch,pottedplant,bed,diningtable,toilet,tv,laptop,mouse,remote,keyboard,cellphone,microwave,oven,toaster,sink,refrigerator,book,clock,vase,scissors,teddybear,hairdrier,toothbrush', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 445, 'photo_desc_type': 3473, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['backgroud', 'person', 'bicycle', 'car', 'motorcycle', 'airplane', 'bus', 'train', 'truck', 'boat', 'trafficlight', 'firehydrant', 'stopsign', 'parkingmeter', 'bench', 'bird', 'cat', 'dog', 'horse', 'sheep', 'cow', 'elephant', 'bear', 'zebra', 'giraffe', 'backpack', 'umbrella', 'handbag', 'tie', 'suitcase', 'frisbee', 'skis', 'snowboard', 'sportsball', 'kite', 'baseballbat', 'baseballglove', 'skateboard', 'surfboard', 'tennisracket', 'bottle', 'wineglass', 'cup', 'fork', 'knife', 'spoon', 'bowl', 'banana', 'apple', 'sandwich', 'orange', 'broccoli', 'carrot', 'hotdog', 'pizza', 'donut', 'cake', 'chair', 'couch', 'pottedplant', 'bed', 'diningtable', 'toilet', 'tv', 'laptop', 'mouse', 'remote', 'keyboard', 'cellphone', 'microwave', 'oven', 'toaster', 'sink', 'refrigerator', 'book', 'clock', 'vase', 'scissors', 'teddybear', 'hairdrier', 'toothbrush'], 'list_hashtags_csv': 'backgroud,person,bicycle,car,motorcycle,airplane,bus,train,truck,boat,trafficlight,firehydrant,stopsign,parkingmeter,bench,bird,cat,dog,horse,sheep,cow,elephant,bear,zebra,giraffe,backpack,umbrella,handbag,tie,suitcase,frisbee,skis,snowboard,sportsball,kite,baseballbat,baseballglove,skateboard,surfboard,tennisracket,bottle,wineglass,cup,fork,knife,spoon,bowl,banana,apple,sandwich,orange,broccoli,carrot,hotdog,pizza,donut,cake,chair,couch,pottedplant,bed,diningtable,toilet,tv,laptop,mouse,remote,keyboard,cellphone,microwave,oven,toaster,sink,refrigerator,book,clock,vase,scissors,teddybear,hairdrier,toothbrush', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 445, 'svm_hashtag_type_desc': 3473, 'photo_desc_type': 3473, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['backgroud', 'person', 'bicycle', 'car', 'motorcycle', 'airplane', 'bus', 'train', 'truck', 'boat', 'trafficlight', 'firehydrant', 'stopsign', 'parkingmeter', 'bench', 'bird', 'cat', 'dog', 'horse', 'sheep', 'cow', 'elephant', 'bear', 'zebra', 'giraffe', 'backpack', 'umbrella', 'handbag', 'tie', 'suitcase', 'frisbee', 'skis', 'snowboard', 'sportsball', 'kite', 'baseballbat', 'baseballglove', 'skateboard', 'surfboard', 'tennisracket', 'bottle', 'wineglass', 'cup', 'fork', 'knife', 'spoon', 'bowl', 'banana', 'apple', 'sandwich', 'orange', 'broccoli', 'carrot', 'hotdog', 'pizza', 'donut', 'cake', 'chair', 'couch', 'pottedplant', 'bed', 'diningtable', 'toilet', 'tv', 'laptop', 'mouse', 'remote', 'keyboard', 'cellphone', 'microwave', 'oven', 'toaster', 'sink', 'refrigerator', 'book', 'clock', 'vase', 'scissors', 'teddybear', 'hairdrier', 'toothbrush'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME mask_coco_origin NUM_CLASSES 81 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : mask_coco_origin model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-04-14 03:39:09.716148: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-04-14 03:39:09.896092: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/mask_coco_origin /data/models_weight/mask_coco_origin/mask_model.h5 size_local : 257557808 size in s3 : 257557808 create time local : 2021-08-09 05:27:17 create time in s3 : 2021-08-06 19:45:17 mask_model.h5 already exist and didn't need to update list_images length : 1 NEW PHOTO Processing 1 images image shape: (2448, 2448, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 89) min: 0.00000 max: 2448.00000 nb d'objets trouves : 1 Detection mask done ! Trying to reset tf kernel 654121 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5525 tf kernel not reseted sub process len(results) : 1 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 1 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 10814 list_Values should be empty [] ['backgroud', 'person', 'bicycle', 'car', 'motorcycle', 'airplane', 'bus', 'train', 'truck', 'boat', 'trafficlight', 'firehydrant', 'stopsign', 'parkingmeter', 'bench', 'bird', 'cat', 'dog', 'horse', 'sheep', 'cow', 'elephant', 'bear', 'zebra', 'giraffe', 'backpack', 'umbrella', 'handbag', 'tie', 'suitcase', 'frisbee', 'skis', 'snowboard', 'sportsball', 'kite', 'baseballbat', 'baseballglove', 'skateboard', 'surfboard', 'tennisracket', 'bottle', 'wineglass', 'cup', 'fork', 'knife', 'spoon', 'bowl', 'banana', 'apple', 'sandwich', 'orange', 'broccoli', 'carrot', 'hotdog', 'pizza', 'donut', 'cake', 'chair', 'couch', 'pottedplant', 'bed', 'diningtable', 'toilet', 'tv', 'laptop', 'mouse', 'remote', 'keyboard', 'cellphone', 'microwave', 'oven', 'toaster', 'sink', 'refrigerator', 'book', 'clock', 'vase', 'scissors', 'teddybear', 'hairdrier', 'toothbrush'] time for calcul the mask position with numpy : 0.9467198848724365 nb_pixel_total : 3693261 time to create 1 rle with new method : 1.5063292980194092 length of segment : 2041 time spent for convertir_results : 3.50217342376709 time spend for datou_step_exec : 22.11514687538147 time spend to save output : 3.218650817871094e-05 total time spend for step 1 : 22.11517906188965 caffe_path_current : About to save ! 1 Inside saveOutput : final : True verbose : False eke 12-6-18 : saveMask need to be cleaned for new output ! Catched exception ! Connect or reconnect ! Number saved : None batch 1 Loaded 721 chid ids of type : 445 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 0 begin to insert list_values into mtr_datou_result : length of list_values in save_final : 1 time used for this insertion : 0.013705253601074219 save missing photos in datou_result : After save, about to update current ! datou_cur_ids : [] len(datou.list_steps) : 1 output : {'917877156': [[(917877156, 492601069, 445, 7, 2268, 118, 2241, 0.985031, [(675, 120, 112), (520, 121, 481), (1050, 121, 381), (502, 122, 947), (486, 123, 981), (470, 124, 1015), (455, 125, 1046), (442, 126, 1092), (429, 127, 1136), (417, 128, 1168), (405, 129, 1187), (394, 130, 1205), (383, 131, 1222), (373, 132, 1239), (368, 133, 1250), (366, 134, 1258), (363, 135, 1266), (361, 136, 1274), (359, 137, 1281), (357, 138, 1288), (355, 139, 1295), (353, 140, 1302), (351, 141, 1309), (349, 142, 1315), (347, 143, 1320), (345, 144, 1326), (343, 145, 1331), (342, 146, 1335), (340, 147, 1340), (338, 148, 1345), (337, 149, 1349), (335, 150, 1354), (334, 151, 1358), (332, 152, 1363), (331, 153, 1366), (330, 154, 1370), (328, 155, 1374), (327, 156, 1378), (326, 157, 1381), (325, 158, 1385), (323, 159, 1389), (322, 160, 1393), (321, 161, 1397), (319, 162, 1402), (318, 163, 1406), (317, 164, 1410), (315, 165, 1415), (314, 166, 1419), (312, 167, 1424), (310, 168, 1429), (309, 169, 1434), (307, 170, 1439), (305, 171, 1444), (304, 172, 1448), (302, 173, 1453), (300, 174, 1458), (298, 175, 1463), (296, 176, 1469), (294, 177, 1474), (292, 178, 1480), (289, 179, 1487), (286, 180, 1493), (283, 181, 1500), (280, 182, 1508), (278, 183, 1514), (275, 184, 1521), (272, 185, 1529), (269, 186, 1536), (266, 187, 1544), (263, 188, 1552), (260, 189, 1561), (257, 190, 1569), (254, 191, 1579), (251, 192, 1588), (248, 193, 1597), (245, 194, 1606), (242, 195, 1615), (239, 196, 1624), (237, 197, 1631), (234, 198, 1640), (231, 199, 1648), (228, 200, 1657), (225, 201, 1665), (222, 202, 1673), (219, 203, 1682), (216, 204, 1689), (213, 205, 1694), (210, 206, 1699), (208, 207, 1702), (206, 208, 1706), (204, 209, 1710), (203, 210, 1712), (201, 211, 1716), (199, 212, 1719), (198, 213, 1722), (196, 214, 1725), (195, 215, 1727), (193, 216, 1730), (192, 217, 1733), (191, 218, 1735), (189, 219, 1738), (188, 220, 1740), (187, 221, 1742), (186, 222, 1744), (185, 223, 1746), (183, 224, 1749), (182, 225, 1751), (181, 226, 1753), (180, 227, 1755), (179, 228, 1757), (178, 229, 1759), (177, 230, 1761), (176, 231, 1762), (176, 232, 1763), (175, 233, 1765), (174, 234, 1767), (173, 235, 1768), (172, 236, 1770), (171, 237, 1772), (170, 238, 1774), (169, 239, 1776), (168, 240, 1777), (167, 241, 1779), (166, 242, 1781), (165, 243, 1783), (164, 244, 1785), (163, 245, 1787), (162, 246, 1789), (161, 247, 1791), (159, 248, 1794), (158, 249, 1796), (157, 250, 1798), (156, 251, 1800), (154, 252, 1803), (153, 253, 1805), (152, 254, 1807), (151, 255, 1809), (149, 256, 1812), (148, 257, 1815), (146, 258, 1818), (145, 259, 1820), (143, 260, 1824), (142, 261, 1826), (140, 262, 1829), (138, 263, 1833), (137, 264, 1835), (135, 265, 1839), (133, 266, 1842), (132, 267, 1845), (130, 268, 1849), (128, 269, 1852), (126, 270, 1856), (125, 271, 1859), (124, 272, 1862), (122, 273, 1865), (121, 274, 1868), (120, 275, 1871), (119, 276, 1873), (118, 277, 1876), (116, 278, 1879), (115, 279, 1881), (114, 280, 1884), (113, 281, 1886), (112, 282, 1888), (111, 283, 1890), (110, 284, 1892), (109, 285, 1895), (108, 286, 1897), (108, 287, 1898), (107, 288, 1900), (106, 289, 1902), (105, 290, 1904), (104, 291, 1906), (103, 292, 1908), (103, 293, 1909), (102, 294, 1911), (101, 295, 1912), (101, 296, 1913), (100, 297, 1915), (99, 298, 1917), (99, 299, 1918), (98, 300, 1919), (97, 301, 1921), (97, 302, 1922), (96, 303, 1924), (95, 304, 1925), (95, 305, 1926), (94, 306, 1928), (94, 307, 1928), (93, 308, 1930), (93, 309, 1930), (93, 310, 1931), (93, 311, 1931), (92, 312, 1933), (92, 313, 1933), (92, 314, 1934), (92, 315, 1934), (91, 316, 1936), (91, 317, 1936), (91, 318, 1937), (91, 319, 1937), (90, 320, 1939), (90, 321, 1939), (90, 322, 1940), (89, 323, 1941), (89, 324, 1942), (89, 325, 1943), (89, 326, 1943), (88, 327, 1945), (88, 328, 1945), (88, 329, 1946), (87, 330, 1948), (87, 331, 1948), (87, 332, 1949), (87, 333, 1949), (86, 334, 1951), (86, 335, 1952), (86, 336, 1952), (85, 337, 1954), (85, 338, 1955), (85, 339, 1955), (85, 340, 1956), (84, 341, 1958), (84, 342, 1959), (84, 343, 1959), (83, 344, 1961), (83, 345, 1962), (83, 346, 1963), (83, 347, 1963), (82, 348, 1965), (82, 349, 1966), (82, 350, 1967), (81, 351, 1969), (81, 352, 1970), (81, 353, 1970), (80, 354, 1972), (80, 355, 1973), (80, 356, 1974), (80, 357, 1975), (79, 358, 1977), (79, 359, 1978), (79, 360, 1979), (78, 361, 1981), (78, 362, 1982), (78, 363, 1983), (77, 364, 1985), (77, 365, 1986), (77, 366, 1987), (76, 367, 1989), (76, 368, 1990), (76, 369, 1991), (76, 370, 1992), (75, 371, 1994), (75, 372, 1995), (75, 373, 1996), (74, 374, 1998), (74, 375, 1999), (74, 376, 2000), (73, 377, 2002), (73, 378, 2003), (73, 379, 2004), (72, 380, 2005), (72, 381, 2006), (72, 382, 2007), (71, 383, 2009), (71, 384, 2009), (71, 385, 2010), (70, 386, 2012), (70, 387, 2012), (70, 388, 2013), (70, 389, 2013), (69, 390, 2015), (69, 391, 2015), (69, 392, 2016), (68, 393, 2017), (68, 394, 2018), (68, 395, 2019), (67, 396, 2020), (67, 397, 2021), (67, 398, 2021), (66, 399, 2023), (66, 400, 2023), (65, 401, 2025), (65, 402, 2025), (65, 403, 2026), (64, 404, 2027), (64, 405, 2028), (64, 406, 2028), (63, 407, 2030), (63, 408, 2030), (63, 409, 2031), (62, 410, 2032), (62, 411, 2033), (61, 412, 2034), (61, 413, 2034), (61, 414, 2035), (60, 415, 2036), (60, 416, 2037), (59, 417, 2038), (59, 418, 2039), (58, 419, 2040), (58, 420, 2041), (58, 421, 2041), (57, 422, 2042), (57, 423, 2043), (56, 424, 2044), (56, 425, 2045), (55, 426, 2046), (55, 427, 2047), (54, 428, 2048), (54, 429, 2048), (53, 430, 2050), (53, 431, 2050), (52, 432, 2052), (52, 433, 2052), (51, 434, 2053), (51, 435, 2054), (50, 436, 2055), (50, 437, 2055), (49, 438, 2057), (49, 439, 2057), (48, 440, 2059), (48, 441, 2059), (47, 442, 2060), (47, 443, 2061), (46, 444, 2062), (46, 445, 2062), (45, 446, 2064), (45, 447, 2064), (44, 448, 2065), (44, 449, 2066), (43, 450, 2067), (43, 451, 2068), (42, 452, 2069), (42, 453, 2069), (41, 454, 2071), (41, 455, 2071), (40, 456, 2072), (40, 457, 2073), (39, 458, 2074), (39, 459, 2074), (39, 460, 2074), (39, 461, 2075), (38, 462, 2076), (38, 463, 2076), (38, 464, 2077), (38, 465, 2077), (38, 466, 2077), (38, 467, 2078), (37, 468, 2079), (37, 469, 2079), (37, 470, 2080), (37, 471, 2080), (37, 472, 2080), (37, 473, 2081), (36, 474, 2082), (36, 475, 2082), (36, 476, 2083), (36, 477, 2083), (36, 478, 2083), (36, 479, 2084), (36, 480, 2084), (35, 481, 2085), (35, 482, 2086), (35, 483, 2086), (35, 484, 2087), (35, 485, 2087), (35, 486, 2087), (34, 487, 2089), (34, 488, 2089), (34, 489, 2089), (34, 490, 2090), (34, 491, 2090), (34, 492, 2091), (34, 493, 2091), (33, 494, 2093), (33, 495, 2093), (33, 496, 2093), (33, 497, 2094), (33, 498, 2094), (33, 499, 2095), (33, 500, 2095), (32, 501, 2097), (32, 502, 2097), (32, 503, 2098), (32, 504, 2098), (32, 505, 2099), (32, 506, 2099), (32, 507, 2100), (31, 508, 2101), (31, 509, 2102), (31, 510, 2102), (31, 511, 2103), (31, 512, 2103), (31, 513, 2104), (31, 514, 2104), (30, 515, 2106), (30, 516, 2106), (30, 517, 2107), (30, 518, 2108), (30, 519, 2108), (30, 520, 2109), (30, 521, 2109), (30, 522, 2110), (29, 523, 2112), (29, 524, 2112), (29, 525, 2113), (29, 526, 2114), (29, 527, 2114), (29, 528, 2115), (29, 529, 2116), (28, 530, 2117), (28, 531, 2118), (28, 532, 2119), (28, 533, 2120), (28, 534, 2120), (28, 535, 2121), (28, 536, 2121), (28, 537, 2121), (28, 538, 2122), (28, 539, 2122), (28, 540, 2122), (28, 541, 2123), (27, 542, 2124), (27, 543, 2124), (27, 544, 2125), (27, 545, 2125), (27, 546, 2125), (27, 547, 2126), (27, 548, 2126), (27, 549, 2126), (27, 550, 2127), (27, 551, 2127), (27, 552, 2127), (27, 553, 2128), (27, 554, 2128), (27, 555, 2128), (27, 556, 2128), (27, 557, 2129), (27, 558, 2129), (27, 559, 2129), (26, 560, 2131), (26, 561, 2131), (26, 562, 2131), (26, 563, 2131), (26, 564, 2132), (26, 565, 2132), (26, 566, 2132), (26, 567, 2132), (26, 568, 2133), (26, 569, 2133), (26, 570, 2133), (26, 571, 2134), (26, 572, 2134), (26, 573, 2134), (26, 574, 2134), (26, 575, 2135), (26, 576, 2135), (26, 577, 2135), (26, 578, 2135), (25, 579, 2137), (25, 580, 2137), (25, 581, 2137), (25, 582, 2137), (25, 583, 2137), (25, 584, 2138), (25, 585, 2138), (25, 586, 2138), (25, 587, 2138), (25, 588, 2139), (25, 589, 2139), (25, 590, 2139), (25, 591, 2139), (25, 592, 2140), (25, 593, 2140), (25, 594, 2140), (25, 595, 2140), (25, 596, 2140), (25, 597, 2141), (24, 598, 2142), (24, 599, 2142), (24, 600, 2142), (24, 601, 2142), (24, 602, 2143), (24, 603, 2143), (24, 604, 2143), (24, 605, 2143), (24, 606, 2143), (24, 607, 2144), (24, 608, 2144), (24, 609, 2144), (24, 610, 2144), (24, 611, 2144), (24, 612, 2144), (24, 613, 2145), (24, 614, 2145), (24, 615, 2145), (24, 616, 2145), (24, 617, 2145), (24, 618, 2145), (23, 619, 2146), (23, 620, 2146), (23, 621, 2146), (23, 622, 2146), (23, 623, 2146), (23, 624, 2146), (23, 625, 2146), (23, 626, 2146), (23, 627, 2146), (23, 628, 2146), (23, 629, 2147), (23, 630, 2147), (23, 631, 2147), (23, 632, 2147), (23, 633, 2147), (23, 634, 2147), (23, 635, 2147), (23, 636, 2147), (23, 637, 2147), (23, 638, 2147), (23, 639, 2147), (23, 640, 2147), (23, 641, 2147), (23, 642, 2147), (22, 643, 2148), (22, 644, 2148), (22, 645, 2149), (22, 646, 2149), (22, 647, 2149), (22, 648, 2149), (22, 649, 2149), (22, 650, 2149), (22, 651, 2149), (22, 652, 2149), (22, 653, 2149), (22, 654, 2149), (22, 655, 2149), (22, 656, 2149), (22, 657, 2149), (22, 658, 2149), (22, 659, 2149), (22, 660, 2149), (22, 661, 2149), (22, 662, 2150), (22, 663, 2150), (22, 664, 2150), (22, 665, 2150), (22, 666, 2150), (22, 667, 2150), (21, 668, 2151), (21, 669, 2151), (21, 670, 2151), (21, 671, 2151), (21, 672, 2151), (21, 673, 2151), (21, 674, 2151), (21, 675, 2151), (21, 676, 2151), (21, 677, 2151), (21, 678, 2151), (21, 679, 2152), (21, 680, 2152), (21, 681, 2152), (21, 682, 2152), (21, 683, 2152), (21, 684, 2152), (21, 685, 2152), (21, 686, 2152), (21, 687, 2152), (21, 688, 2152), (21, 689, 2152), (21, 690, 2152), (21, 691, 2152), (21, 692, 2152), (21, 693, 2152), (21, 694, 2152), (21, 695, 2152), (21, 696, 2151), (22, 697, 2150), (22, 698, 2150), (22, 699, 2150), (22, 700, 2150), (22, 701, 2150), (22, 702, 2150), (22, 703, 2150), (22, 704, 2150), (22, 705, 2150), (22, 706, 2150), (22, 707, 2150), (22, 708, 2150), (22, 709, 2150), (23, 710, 2149), (23, 711, 2149), (23, 712, 2149), (23, 713, 2149), (23, 714, 2149), (23, 715, 2149), (23, 716, 2149), (23, 717, 2149), (23, 718, 2148), (23, 719, 2148), (23, 720, 2148), (23, 721, 2148), (24, 722, 2147), (24, 723, 2147), (24, 724, 2147), (24, 725, 2147), (24, 726, 2147), (24, 727, 2147), (24, 728, 2147), (24, 729, 2147), (24, 730, 2147), (24, 731, 2147), (24, 732, 2147), (24, 733, 2147), (25, 734, 2146), (25, 735, 2146), (25, 736, 2146), (25, 737, 2146), (25, 738, 2146), (25, 739, 2146), (25, 740, 2145), (25, 741, 2145), (25, 742, 2145), (25, 743, 2145), (25, 744, 2145), (25, 745, 2145), (26, 746, 2144), (26, 747, 2144), (26, 748, 2144), (26, 749, 2144), (26, 750, 2144), (26, 751, 2144), (26, 752, 2144), (26, 753, 2144), (26, 754, 2144), (26, 755, 2144), (26, 756, 2144), (26, 757, 2144), (27, 758, 2143), (27, 759, 2143), (27, 760, 2143), (27, 761, 2142), (27, 762, 2142), (27, 763, 2142), (27, 764, 2142), (27, 765, 2142), (27, 766, 2142), (27, 767, 2142), (27, 768, 2142), (27, 769, 2142), (27, 770, 2142), (27, 771, 2142), (27, 772, 2142), (27, 773, 2142), (27, 774, 2142), (27, 775, 2142), (27, 776, 2142), (27, 777, 2142), (27, 778, 2142), (27, 779, 2142), (27, 780, 2141), (27, 781, 2141), (27, 782, 2141), (27, 783, 2141), (27, 784, 2141), (27, 785, 2141), (27, 786, 2141), (27, 787, 2141), (27, 788, 2141), (26, 789, 2142), (26, 790, 2142), (26, 791, 2142), (26, 792, 2142), (26, 793, 2142), (26, 794, 2142), (26, 795, 2142), (26, 796, 2142), (26, 797, 2142), (26, 798, 2142), (26, 799, 2141), (26, 800, 2141), (26, 801, 2141), (26, 802, 2141), (26, 803, 2141), (26, 804, 2141), (26, 805, 2141), (26, 806, 2141), (26, 807, 2141), (26, 808, 2141), (26, 809, 2141), (26, 810, 2141), (26, 811, 2141), (26, 812, 2141), (26, 813, 2141), (26, 814, 2141), (26, 815, 2141), (26, 816, 2141), (26, 817, 2140), (26, 818, 2140), (26, 819, 2140), (26, 820, 2140), (26, 821, 2140), (26, 822, 2140), (26, 823, 2140), (26, 824, 2140), (26, 825, 2140), (26, 826, 2140), (26, 827, 2140), (26, 828, 2140), (26, 829, 2140), (26, 830, 2140), (26, 831, 2140), (26, 832, 2140), (26, 833, 2140), (26, 834, 2139), (26, 835, 2139), (26, 836, 2139), (26, 837, 2139), (26, 838, 2139), (26, 839, 2139), (26, 840, 2138), (26, 841, 2138), (26, 842, 2138), (26, 843, 2137), (26, 844, 2137), (26, 845, 2137), (26, 846, 2136), (26, 847, 2136), (26, 848, 2135), (26, 849, 2135), (26, 850, 2135), (26, 851, 2134), (26, 852, 2134), (26, 853, 2133), (27, 854, 2132), (27, 855, 2131), (27, 856, 2131), (27, 857, 2130), (27, 858, 2130), (27, 859, 2130), (27, 860, 2129), (27, 861, 2129), (27, 862, 2128), (27, 863, 2128), (27, 864, 2127), (27, 865, 2127), (27, 866, 2126), (27, 867, 2126), (27, 868, 2125), (27, 869, 2125), (27, 870, 2124), (27, 871, 2123), (27, 872, 2123), (27, 873, 2122), (28, 874, 2121), (28, 875, 2120), (28, 876, 2120), (28, 877, 2119), (28, 878, 2118), (28, 879, 2118), (28, 880, 2117), (28, 881, 2117), (28, 882, 2116), (28, 883, 2116), (28, 884, 2115), (28, 885, 2115), (28, 886, 2114), (28, 887, 2113), (28, 888, 2113), (28, 889, 2112), (28, 890, 2112), (28, 891, 2111), (29, 892, 2110), (29, 893, 2109), (29, 894, 2109), (29, 895, 2108), (29, 896, 2108), (29, 897, 2108), (29, 898, 2107), (29, 899, 2107), (29, 900, 2106), (29, 901, 2106), (29, 902, 2105), (29, 903, 2105), (29, 904, 2104), (29, 905, 2104), (29, 906, 2104), (29, 907, 2103), (29, 908, 2103), (29, 909, 2102), (30, 910, 2101), (30, 911, 2101), (30, 912, 2100), (30, 913, 2100), (30, 914, 2099), (30, 915, 2099), (30, 916, 2099), (30, 917, 2099), (30, 918, 2098), (30, 919, 2098), (29, 920, 2099), (29, 921, 2099), (29, 922, 2098), (29, 923, 2098), (29, 924, 2098), (29, 925, 2098), (29, 926, 2097), (29, 927, 2097), (29, 928, 2097), (29, 929, 2097), (29, 930, 2097), (29, 931, 2096), (29, 932, 2096), (29, 933, 2096), (29, 934, 2096), (29, 935, 2095), (29, 936, 2095), (29, 937, 2095), (29, 938, 2095), (29, 939, 2095), (29, 940, 2094), (29, 941, 2094), (29, 942, 2094), (29, 943, 2094), (29, 944, 2093), (29, 945, 2093), (29, 946, 2093), (29, 947, 2093), (29, 948, 2093), (28, 949, 2093), (28, 950, 2093), (28, 951, 2093), (28, 952, 2093), (28, 953, 2093), (28, 954, 2092), (28, 955, 2092), (28, 956, 2092), (28, 957, 2092), (28, 958, 2092), (28, 959, 2091), (28, 960, 2091), (28, 961, 2091), (28, 962, 2091), (28, 963, 2091), (28, 964, 2090), (28, 965, 2090), (28, 966, 2090), (28, 967, 2090), (28, 968, 2090), (28, 969, 2089), (28, 970, 2089), (28, 971, 2089), (28, 972, 2089), (28, 973, 2089), (28, 974, 2089), (28, 975, 2088), (28, 976, 2088), (28, 977, 2088), (28, 978, 2088), (27, 979, 2089), (27, 980, 2089), (27, 981, 2088), (27, 982, 2088), (27, 983, 2088), (27, 984, 2088), (27, 985, 2088), (27, 986, 2088), (27, 987, 2087), (27, 988, 2087), (27, 989, 2087), (27, 990, 2087), (27, 991, 2086), (27, 992, 2086), (27, 993, 2086), (27, 994, 2086), (27, 995, 2085), (27, 996, 2085), (27, 997, 2085), (27, 998, 2084), (27, 999, 2084), (27, 1000, 2084), (28, 1001, 2082), (28, 1002, 2082), (28, 1003, 2082), (28, 1004, 2081), (28, 1005, 2081), (28, 1006, 2081), (28, 1007, 2080), (28, 1008, 2080), (28, 1009, 2080), (28, 1010, 2079), (28, 1011, 2079), (28, 1012, 2079), (28, 1013, 2078), (28, 1014, 2078), (28, 1015, 2077), (28, 1016, 2077), (28, 1017, 2077), (28, 1018, 2076), (28, 1019, 2076), (28, 1020, 2076), (28, 1021, 2075), (28, 1022, 2075), (28, 1023, 2074), (28, 1024, 2074), (28, 1025, 2074), (28, 1026, 2073), (28, 1027, 2073), (28, 1028, 2073), (28, 1029, 2072), (29, 1030, 2071), (29, 1031, 2070), (29, 1032, 2070), (29, 1033, 2069), (29, 1034, 2069), (29, 1035, 2069), (29, 1036, 2068), (29, 1037, 2068), (29, 1038, 2067), (29, 1039, 2067), (29, 1040, 2067), (29, 1041, 2066), (29, 1042, 2066), (29, 1043, 2065), (29, 1044, 2065), (29, 1045, 2064), (29, 1046, 2064), (29, 1047, 2063), (29, 1048, 2063), (29, 1049, 2063), (29, 1050, 2062), (29, 1051, 2062), (29, 1052, 2061), (29, 1053, 2061), (29, 1054, 2060), (29, 1055, 2060), (29, 1056, 2059), (29, 1057, 2059), (30, 1058, 2057), (30, 1059, 2057), (30, 1060, 2056), (30, 1061, 2056), (30, 1062, 2055), (30, 1063, 2055), (30, 1064, 2054), (30, 1065, 2054), (30, 1066, 2053), (30, 1067, 2052), (30, 1068, 2052), (30, 1069, 2051), (30, 1070, 2050), (30, 1071, 2049), (30, 1072, 2049), (30, 1073, 2048), (30, 1074, 2047), (30, 1075, 2046), (30, 1076, 2045), (30, 1077, 2044), (30, 1078, 2043), (30, 1079, 2042), (29, 1080, 2042), (29, 1081, 2041), (29, 1082, 2040), (29, 1083, 2039), (29, 1084, 2038), (29, 1085, 2037), (29, 1086, 2036), (29, 1087, 2035), (29, 1088, 2034), (29, 1089, 2033), (29, 1090, 2032), (29, 1091, 2031), (29, 1092, 2030), (29, 1093, 2029), (29, 1094, 2028), (29, 1095, 2027), (29, 1096, 2026), (29, 1097, 2026), (29, 1098, 2025), (29, 1099, 2024), (29, 1100, 2023), (29, 1101, 2022), (29, 1102, 2021), (29, 1103, 2021), (29, 1104, 2020), (29, 1105, 2019), (29, 1106, 2019), (29, 1107, 2018), (29, 1108, 2017), (29, 1109, 2016), (29, 1110, 2016), (29, 1111, 2015), (29, 1112, 2014), (29, 1113, 2014), (29, 1114, 2013), (29, 1115, 2013), (29, 1116, 2012), (29, 1117, 2011), (29, 1118, 2011), (29, 1119, 2010), (29, 1120, 2010), (29, 1121, 2009), (29, 1122, 2009), (29, 1123, 2008), (29, 1124, 2007), (29, 1125, 2007), (29, 1126, 2006), (29, 1127, 2006), (29, 1128, 2005), (29, 1129, 2005), (29, 1130, 2004), (29, 1131, 2004), (29, 1132, 2003), (29, 1133, 2003), (29, 1134, 2003), (28, 1135, 2003), (28, 1136, 2003), (28, 1137, 2002), (28, 1138, 2002), (28, 1139, 2001), (28, 1140, 2001), (28, 1141, 2001), (28, 1142, 2000), (28, 1143, 2000), (28, 1144, 2000), (28, 1145, 1999), (28, 1146, 1999), (28, 1147, 1999), (28, 1148, 1998), (28, 1149, 1998), (28, 1150, 1998), (28, 1151, 1997), (29, 1152, 1996), (29, 1153, 1996), (29, 1154, 1995), (29, 1155, 1995), (29, 1156, 1995), (29, 1157, 1994), (29, 1158, 1994), (29, 1159, 1994), (29, 1160, 1993), (29, 1161, 1993), (29, 1162, 1993), (29, 1163, 1992), (29, 1164, 1992), (29, 1165, 1991), (29, 1166, 1991), (29, 1167, 1991), (29, 1168, 1990), (29, 1169, 1990), (29, 1170, 1989), (29, 1171, 1989), (29, 1172, 1989), (29, 1173, 1988), (29, 1174, 1988), (29, 1175, 1987), (29, 1176, 1987), (29, 1177, 1987), (29, 1178, 1986), (29, 1179, 1986), (29, 1180, 1985), (29, 1181, 1985), (29, 1182, 1985), (29, 1183, 1984), (29, 1184, 1984), (29, 1185, 1983), (29, 1186, 1983), (29, 1187, 1982), (29, 1188, 1982), (29, 1189, 1981), (29, 1190, 1981), (29, 1191, 1981), (29, 1192, 1980), (29, 1193, 1980), (29, 1194, 1979), (29, 1195, 1979), (29, 1196, 1978), (29, 1197, 1978), (29, 1198, 1977), (29, 1199, 1977), (29, 1200, 1976), (29, 1201, 1976), (29, 1202, 1975), (29, 1203, 1975), (29, 1204, 1974), (29, 1205, 1974), (29, 1206, 1973), (29, 1207, 1973), (29, 1208, 1972), (29, 1209, 1971), (29, 1210, 1971), (29, 1211, 1970), (29, 1212, 1970), (29, 1213, 1969), (29, 1214, 1969), (29, 1215, 1968), (29, 1216, 1967), (29, 1217, 1967), (29, 1218, 1966), (29, 1219, 1965), (29, 1220, 1965), (29, 1221, 1964), (29, 1222, 1963), (29, 1223, 1963), (29, 1224, 1962), (29, 1225, 1961), (29, 1226, 1960), (29, 1227, 1960), (29, 1228, 1959), (29, 1229, 1958), (29, 1230, 1957), (29, 1231, 1956), (29, 1232, 1955), (29, 1233, 1955), (29, 1234, 1954), (29, 1235, 1953), (29, 1236, 1952), (29, 1237, 1951), (29, 1238, 1951), (29, 1239, 1950), (29, 1240, 1949), (30, 1241, 1947), (30, 1242, 1947), (30, 1243, 1946), (30, 1244, 1945), (30, 1245, 1945), (30, 1246, 1944), (30, 1247, 1943), (30, 1248, 1943), (30, 1249, 1942), (30, 1250, 1941), (30, 1251, 1941), (30, 1252, 1940), (30, 1253, 1940), (30, 1254, 1939), (30, 1255, 1938), (30, 1256, 1938), (30, 1257, 1937), (30, 1258, 1937), (30, 1259, 1936), (30, 1260, 1936), (30, 1261, 1935), (30, 1262, 1935), (30, 1263, 1934), (30, 1264, 1934), (30, 1265, 1933), (30, 1266, 1933), (30, 1267, 1932), (30, 1268, 1932), (30, 1269, 1931), (30, 1270, 1931), (30, 1271, 1930), (30, 1272, 1930), (30, 1273, 1929), (30, 1274, 1929), (30, 1275, 1929), (30, 1276, 1928), (30, 1277, 1928), (30, 1278, 1927), (30, 1279, 1927), (30, 1280, 1927), (30, 1281, 1926), (30, 1282, 1926), (30, 1283, 1925), (30, 1284, 1925), (30, 1285, 1925), (30, 1286, 1924), (30, 1287, 1924), (30, 1288, 1924), (30, 1289, 1923), (30, 1290, 1923), (30, 1291, 1923), (30, 1292, 1922), (30, 1293, 1922), (30, 1294, 1922), (30, 1295, 1921), (30, 1296, 1921), (30, 1297, 1921), (30, 1298, 1921), (30, 1299, 1920), (30, 1300, 1920), (30, 1301, 1920), (30, 1302, 1920), (30, 1303, 1920), (30, 1304, 1919), (30, 1305, 1919), (30, 1306, 1919), (30, 1307, 1919), (30, 1308, 1918), (30, 1309, 1918), (30, 1310, 1918), (30, 1311, 1918), (31, 1312, 1916), (31, 1313, 1916), (31, 1314, 1916), (31, 1315, 1916), (31, 1316, 1915), (31, 1317, 1915), (31, 1318, 1915), (31, 1319, 1915), (31, 1320, 1914), (31, 1321, 1914), (31, 1322, 1914), (31, 1323, 1914), (31, 1324, 1913), (31, 1325, 1913), (31, 1326, 1913), (31, 1327, 1912), (31, 1328, 1912), (31, 1329, 1912), (31, 1330, 1912), (31, 1331, 1911), (31, 1332, 1911), (31, 1333, 1911), (31, 1334, 1911), (31, 1335, 1910), (31, 1336, 1910), (31, 1337, 1910), (31, 1338, 1909), (31, 1339, 1909), (32, 1340, 1908), (32, 1341, 1908), (32, 1342, 1907), (32, 1343, 1907), (32, 1344, 1907), (32, 1345, 1907), (32, 1346, 1906), (32, 1347, 1906), (32, 1348, 1906), (32, 1349, 1905), (32, 1350, 1905), (32, 1351, 1905), (32, 1352, 1904), (32, 1353, 1904), (32, 1354, 1904), (32, 1355, 1904), (32, 1356, 1903), (32, 1357, 1903), (32, 1358, 1903), (32, 1359, 1902), (32, 1360, 1902), (32, 1361, 1902), (32, 1362, 1901), (32, 1363, 1901), (32, 1364, 1901), (32, 1365, 1900), (33, 1366, 1899), (33, 1367, 1899), (33, 1368, 1899), (33, 1369, 1898), (33, 1370, 1898), (33, 1371, 1897), (33, 1372, 1897), (33, 1373, 1896), (33, 1374, 1896), (33, 1375, 1895), (33, 1376, 1895), (33, 1377, 1894), (33, 1378, 1894), (33, 1379, 1893), (33, 1380, 1892), (33, 1381, 1892), (34, 1382, 1890), (34, 1383, 1890), (34, 1384, 1889), (34, 1385, 1888), (34, 1386, 1888), (34, 1387, 1887), (34, 1388, 1886), (34, 1389, 1886), (34, 1390, 1885), (34, 1391, 1884), (34, 1392, 1884), (34, 1393, 1883), (34, 1394, 1882), (35, 1395, 1881), (35, 1396, 1880), (35, 1397, 1879), (35, 1398, 1878), (35, 1399, 1878), (35, 1400, 1877), (35, 1401, 1876), (35, 1402, 1875), (35, 1403, 1874), (35, 1404, 1873), (35, 1405, 1872), (35, 1406, 1872), (35, 1407, 1871), (35, 1408, 1870), (36, 1409, 1868), (36, 1410, 1867), (36, 1411, 1866), (36, 1412, 1865), (36, 1413, 1864), (36, 1414, 1863), (36, 1415, 1862), (36, 1416, 1862), (36, 1417, 1861), (36, 1418, 1860), (36, 1419, 1859), (36, 1420, 1859), (36, 1421, 1858), (37, 1422, 1856), (37, 1423, 1855), (37, 1424, 1855), (37, 1425, 1854), (37, 1426, 1853), (37, 1427, 1853), (37, 1428, 1852), (37, 1429, 1851), (37, 1430, 1851), (37, 1431, 1850), (37, 1432, 1850), (37, 1433, 1849), (37, 1434, 1848), (38, 1435, 1847), (38, 1436, 1846), (38, 1437, 1846), (38, 1438, 1845), (38, 1439, 1845), (38, 1440, 1844), (38, 1441, 1844), (38, 1442, 1843), (38, 1443, 1843), (38, 1444, 1842), (38, 1445, 1842), (38, 1446, 1842), (38, 1447, 1841), (38, 1448, 1841), (38, 1449, 1841), (38, 1450, 1841), (38, 1451, 1840), (38, 1452, 1840), (39, 1453, 1839), (39, 1454, 1839), (39, 1455, 1839), (39, 1456, 1838), (39, 1457, 1838), (39, 1458, 1838), (39, 1459, 1838), (39, 1460, 1838), (39, 1461, 1837), (39, 1462, 1837), (39, 1463, 1837), (39, 1464, 1837), (39, 1465, 1836), (39, 1466, 1836), (39, 1467, 1836), (39, 1468, 1836), (39, 1469, 1836), (39, 1470, 1835), (39, 1471, 1835), (39, 1472, 1835), (39, 1473, 1835), (39, 1474, 1835), (39, 1475, 1834), (39, 1476, 1834), (39, 1477, 1834), (39, 1478, 1834), (39, 1479, 1834), (39, 1480, 1834), (39, 1481, 1833), (39, 1482, 1833), (39, 1483, 1833), (39, 1484, 1833), (39, 1485, 1833), (39, 1486, 1832), (39, 1487, 1832), (39, 1488, 1832), (39, 1489, 1832), (39, 1490, 1832), (39, 1491, 1831), (39, 1492, 1831), (39, 1493, 1831), (39, 1494, 1831), (40, 1495, 1830), (40, 1496, 1830), (40, 1497, 1829), (40, 1498, 1829), (40, 1499, 1829), (40, 1500, 1829), (40, 1501, 1829), (40, 1502, 1829), (40, 1503, 1828), (40, 1504, 1828), (40, 1505, 1828), (40, 1506, 1828), (40, 1507, 1828), (40, 1508, 1827), (40, 1509, 1827), (40, 1510, 1827), (40, 1511, 1827), (40, 1512, 1827), (40, 1513, 1827), (40, 1514, 1827), (40, 1515, 1826), (40, 1516, 1826), (40, 1517, 1826), (40, 1518, 1826), (40, 1519, 1826), (40, 1520, 1826), (40, 1521, 1825), (40, 1522, 1825), (40, 1523, 1825), (40, 1524, 1825), (40, 1525, 1825), (40, 1526, 1825), (40, 1527, 1825), (40, 1528, 1825), (40, 1529, 1824), (40, 1530, 1824), (40, 1531, 1824), (40, 1532, 1824), (40, 1533, 1824), (40, 1534, 1824), (40, 1535, 1824), (40, 1536, 1824), (40, 1537, 1823), (41, 1538, 1822), (41, 1539, 1822), (41, 1540, 1822), (41, 1541, 1822), (41, 1542, 1822), (41, 1543, 1822), (41, 1544, 1822), (41, 1545, 1821), (41, 1546, 1821), (41, 1547, 1821), (41, 1548, 1821), (41, 1549, 1821), (41, 1550, 1821), (41, 1551, 1821), (41, 1552, 1821), (41, 1553, 1820), (41, 1554, 1820), (41, 1555, 1820), (41, 1556, 1820), (41, 1557, 1820), (41, 1558, 1820), (41, 1559, 1820), (41, 1560, 1820), (41, 1561, 1819), (41, 1562, 1819), (41, 1563, 1819), (41, 1564, 1819), (41, 1565, 1819), (41, 1566, 1819), (41, 1567, 1819), (41, 1568, 1819), (41, 1569, 1818), (41, 1570, 1818), (41, 1571, 1818), (41, 1572, 1818), (41, 1573, 1818), (41, 1574, 1818), (41, 1575, 1818), (41, 1576, 1818), (41, 1577, 1817), (41, 1578, 1817), (41, 1579, 1817), (41, 1580, 1817), (41, 1581, 1817), (42, 1582, 1816), (42, 1583, 1816), (42, 1584, 1815), (42, 1585, 1815), (42, 1586, 1815), (42, 1587, 1815), (42, 1588, 1815), (42, 1589, 1815), (42, 1590, 1815), (42, 1591, 1815), (42, 1592, 1814), (42, 1593, 1814), (42, 1594, 1814), (42, 1595, 1814), (42, 1596, 1814), (42, 1597, 1814), (42, 1598, 1814), (42, 1599, 1814), (42, 1600, 1813), (42, 1601, 1813), (42, 1602, 1813), (42, 1603, 1813), (41, 1604, 1814), (41, 1605, 1814), (41, 1606, 1814), (41, 1607, 1814), (41, 1608, 1814), (41, 1609, 1813), (41, 1610, 1813), (41, 1611, 1813), (41, 1612, 1813), (41, 1613, 1813), (41, 1614, 1813), (41, 1615, 1813), (41, 1616, 1813), (41, 1617, 1813), (41, 1618, 1812), (41, 1619, 1812), (41, 1620, 1812), (41, 1621, 1812), (41, 1622, 1812), (41, 1623, 1812), (41, 1624, 1812), (41, 1625, 1812), (41, 1626, 1811), (41, 1627, 1811), (40, 1628, 1812), (40, 1629, 1812), (40, 1630, 1812), (40, 1631, 1812), (40, 1632, 1812), (40, 1633, 1812), (40, 1634, 1811), (40, 1635, 1811), (40, 1636, 1811), (40, 1637, 1811), (40, 1638, 1811), (40, 1639, 1811), (40, 1640, 1811), (40, 1641, 1811), (40, 1642, 1810), (40, 1643, 1810), (40, 1644, 1810), (40, 1645, 1810), (40, 1646, 1810), (40, 1647, 1810), (40, 1648, 1810), (40, 1649, 1809), (40, 1650, 1809), (40, 1651, 1809), (39, 1652, 1810), (39, 1653, 1810), (39, 1654, 1810), (39, 1655, 1810), (39, 1656, 1810), (39, 1657, 1809), (39, 1658, 1809), (39, 1659, 1809), (39, 1660, 1809), (39, 1661, 1809), (39, 1662, 1809), (39, 1663, 1809), (39, 1664, 1808), (39, 1665, 1808), (39, 1666, 1808), (39, 1667, 1808), (39, 1668, 1808), (39, 1669, 1808), (39, 1670, 1808), (39, 1671, 1807), (39, 1672, 1807), (39, 1673, 1807), (39, 1674, 1807), (39, 1675, 1806), (39, 1676, 1806), (39, 1677, 1806), (40, 1678, 1805), (40, 1679, 1804), (40, 1680, 1804), (40, 1681, 1804), (40, 1682, 1804), (40, 1683, 1803), (41, 1684, 1802), (41, 1685, 1802), (41, 1686, 1802), (41, 1687, 1801), (41, 1688, 1801), (41, 1689, 1801), (42, 1690, 1800), (42, 1691, 1799), (42, 1692, 1799), (42, 1693, 1799), (42, 1694, 1798), (42, 1695, 1798), (43, 1696, 1797), (43, 1697, 1797), (43, 1698, 1796), (43, 1699, 1796), (43, 1700, 1796), (43, 1701, 1795), (44, 1702, 1794), (44, 1703, 1794), (44, 1704, 1793), (44, 1705, 1793), (44, 1706, 1793), (44, 1707, 1793), (45, 1708, 1791), (45, 1709, 1791), (45, 1710, 1791), (45, 1711, 1790), (45, 1712, 1790), (46, 1713, 1789), (46, 1714, 1788), (46, 1715, 1788), (46, 1716, 1788), (46, 1717, 1787), (46, 1718, 1787), (47, 1719, 1785), (47, 1720, 1785), (47, 1721, 1785), (47, 1722, 1784), (47, 1723, 1784), (48, 1724, 1783), (48, 1725, 1782), (48, 1726, 1782), (48, 1727, 1782), (48, 1728, 1781), (49, 1729, 1780), (49, 1730, 1779), (49, 1731, 1779), (49, 1732, 1779), (50, 1733, 1777), (50, 1734, 1777), (50, 1735, 1776), (50, 1736, 1776), (50, 1737, 1776), (51, 1738, 1774), (51, 1739, 1774), (51, 1740, 1773), (51, 1741, 1773), (51, 1742, 1772), (52, 1743, 1771), (52, 1744, 1771), (52, 1745, 1770), (52, 1746, 1770), (52, 1747, 1769), (53, 1748, 1768), (53, 1749, 1767), (53, 1750, 1767), (53, 1751, 1767), (53, 1752, 1766), (53, 1753, 1766), (53, 1754, 1765), (53, 1755, 1765), (53, 1756, 1765), (53, 1757, 1764), (53, 1758, 1764), (53, 1759, 1763), (53, 1760, 1763), (53, 1761, 1763), (53, 1762, 1762), (53, 1763, 1762), (53, 1764, 1762), (53, 1765, 1761), (53, 1766, 1761), (53, 1767, 1760), (53, 1768, 1760), (53, 1769, 1760), (53, 1770, 1759), (53, 1771, 1759), (53, 1772, 1759), (53, 1773, 1758), (53, 1774, 1758), (53, 1775, 1758), (53, 1776, 1757), (53, 1777, 1757), (53, 1778, 1757), (53, 1779, 1756), (53, 1780, 1756), (53, 1781, 1756), (53, 1782, 1755), (53, 1783, 1755), (53, 1784, 1755), (53, 1785, 1754), (53, 1786, 1754), (53, 1787, 1754), (53, 1788, 1753), (53, 1789, 1753), (53, 1790, 1753), (53, 1791, 1753), (53, 1792, 1752), (53, 1793, 1752), (53, 1794, 1752), (53, 1795, 1751), (53, 1796, 1751), (53, 1797, 1751), (53, 1798, 1750), (53, 1799, 1750), (53, 1800, 1750), (53, 1801, 1750), (53, 1802, 1749), (53, 1803, 1749), (53, 1804, 1749), (53, 1805, 1748), (53, 1806, 1748), (53, 1807, 1748), (53, 1808, 1748), (53, 1809, 1747), (54, 1810, 1746), (54, 1811, 1746), (54, 1812, 1745), (54, 1813, 1745), (54, 1814, 1745), (54, 1815, 1745), (54, 1816, 1744), (54, 1817, 1744), (54, 1818, 1744), (54, 1819, 1744), (54, 1820, 1743), (54, 1821, 1743), (54, 1822, 1743), (54, 1823, 1743), (54, 1824, 1742), (54, 1825, 1742), (55, 1826, 1741), (55, 1827, 1740), (56, 1828, 1739), (56, 1829, 1739), (57, 1830, 1737), (57, 1831, 1737), (58, 1832, 1736), (58, 1833, 1735), (59, 1834, 1734), (59, 1835, 1734), (60, 1836, 1732), (60, 1837, 1732), (61, 1838, 1731), (61, 1839, 1730), (62, 1840, 1729), (62, 1841, 1729), (62, 1842, 1728), (63, 1843, 1727), (63, 1844, 1726), (64, 1845, 1725), (64, 1846, 1725), (65, 1847, 1723), (65, 1848, 1723), (66, 1849, 1722), (66, 1850, 1721), (67, 1851, 1720), (67, 1852, 1720), (68, 1853, 1718), (68, 1854, 1718), (68, 1855, 1718), (69, 1856, 1716), (69, 1857, 1716), (70, 1858, 1714), (70, 1859, 1714), (71, 1860, 1713), (71, 1861, 1712), (72, 1862, 1711), (72, 1863, 1711), (72, 1864, 1710), (73, 1865, 1709), (73, 1866, 1708), (74, 1867, 1707), (74, 1868, 1707), (75, 1869, 1705), (75, 1870, 1705), (76, 1871, 1703), (76, 1872, 1703), (76, 1873, 1703), (77, 1874, 1701), (77, 1875, 1701), (78, 1876, 1699), (78, 1877, 1699), (79, 1878, 1698), (79, 1879, 1697), (79, 1880, 1697), (80, 1881, 1695), (80, 1882, 1695), (81, 1883, 1693), (81, 1884, 1693), (82, 1885, 1692), (82, 1886, 1691), (82, 1887, 1691), (83, 1888, 1689), (83, 1889, 1689), (84, 1890, 1687), (84, 1891, 1687), (84, 1892, 1687), (85, 1893, 1685), (85, 1894, 1685), (86, 1895, 1683), (86, 1896, 1683), (87, 1897, 1681), (87, 1898, 1681), (87, 1899, 1680), (88, 1900, 1679), (88, 1901, 1678), (88, 1902, 1678), (89, 1903, 1677), (89, 1904, 1676), (90, 1905, 1675), (90, 1906, 1674), (90, 1907, 1674), (91, 1908, 1672), (91, 1909, 1672), (91, 1910, 1671), (92, 1911, 1670), (92, 1912, 1669), (93, 1913, 1667), (93, 1914, 1667), (93, 1915, 1666), (94, 1916, 1665), (94, 1917, 1664), (95, 1918, 1663), (95, 1919, 1662), (96, 1920, 1661), (96, 1921, 1660), (97, 1922, 1658), (97, 1923, 1658), (97, 1924, 1657), (98, 1925, 1656), (98, 1926, 1655), (99, 1927, 1653), (99, 1928, 1653), (100, 1929, 1651), (100, 1930, 1651), (101, 1931, 1649), (101, 1932, 1648), (102, 1933, 1647), (102, 1934, 1646), (103, 1935, 1644), (103, 1936, 1644), (104, 1937, 1642), (104, 1938, 1641), (105, 1939, 1640), (106, 1940, 1638), (106, 1941, 1637), (107, 1942, 1635), (107, 1943, 1635), (108, 1944, 1633), (108, 1945, 1632), (109, 1946, 1630), (110, 1947, 1628), (110, 1948, 1628), (111, 1949, 1626), (112, 1950, 1624), (112, 1951, 1623), (113, 1952, 1622), (114, 1953, 1620), (114, 1954, 1619), (115, 1955, 1617), (116, 1956, 1616), (116, 1957, 1615), (117, 1958, 1613), (118, 1959, 1611), (119, 1960, 1610), (119, 1961, 1609), (120, 1962, 1607), (121, 1963, 1605), (122, 1964, 75), (215, 1964, 1511), (122, 1965, 64), (222, 1965, 1503), (123, 1966, 53), (229, 1966, 1495), (124, 1967, 42), (236, 1967, 1488), (125, 1968, 32), (243, 1968, 1480), (126, 1969, 22), (250, 1969, 1472), (127, 1970, 13), (258, 1970, 1464), (127, 1971, 6), (265, 1971, 1456), (273, 1972, 1447), (280, 1973, 1440), (288, 1974, 1431), (293, 1975, 1425), (298, 1976, 1419), (303, 1977, 1413), (308, 1978, 1407), (313, 1979, 1401), (318, 1980, 1395), (324, 1981, 1388), (330, 1982, 1381), (337, 1983, 1373), (343, 1984, 1366), (350, 1985, 1358), (358, 1986, 1349), (365, 1987, 1340), (372, 1988, 1332), (376, 1989, 1327), (380, 1990, 1322), (384, 1991, 1317), (388, 1992, 1311), (393, 1993, 1305), (397, 1994, 1300), (401, 1995, 1294), (406, 1996, 1288), (410, 1997, 1283), (415, 1998, 1276), (420, 1999, 1270), (425, 2000, 1263), (430, 2001, 1257), (435, 2002, 1250), (440, 2003, 1244), (445, 2004, 1237), (451, 2005, 1230), (456, 2006, 1223), (461, 2007, 1217), (466, 2008, 1210), (471, 2009, 1203), (476, 2010, 1196), (481, 2011, 1190), (486, 2012, 1183), (492, 2013, 1175), (497, 2014, 1168), (503, 2015, 1160), (508, 2016, 1073), (514, 2017, 1063), (519, 2018, 1054), (525, 2019, 1044), (531, 2020, 1034), (536, 2021, 1025), (541, 2022, 1016), (546, 2023, 1008), (551, 2024, 999), (556, 2025, 990), (561, 2026, 982), (565, 2027, 974), (570, 2028, 965), (574, 2029, 958), (579, 2030, 950), (583, 2031, 942), (587, 2032, 935), (591, 2033, 928), (595, 2034, 920), (599, 2035, 913), (603, 2036, 906), (607, 2037, 899), (611, 2038, 892), (614, 2039, 883), (617, 2040, 870), (619, 2041, 857), (622, 2042, 844), (624, 2043, 833), (627, 2044, 820), (629, 2045, 808), (631, 2046, 797), (634, 2047, 786), (636, 2048, 780), (638, 2049, 775), (640, 2050, 770), (642, 2051, 765), (643, 2052, 761), (645, 2053, 756), (647, 2054, 751), (649, 2055, 746), (650, 2056, 742), (652, 2057, 736), (654, 2058, 731), (656, 2059, 726), (658, 2060, 720), (660, 2061, 715), (662, 2062, 709), (664, 2063, 704), (666, 2064, 698), (669, 2065, 691), (671, 2066, 685), (673, 2067, 679), (675, 2068, 673), (678, 2069, 666), (680, 2070, 660), (683, 2071, 652), (685, 2072, 644), (688, 2073, 636), (691, 2074, 628), (694, 2075, 619), (699, 2076, 609), (703, 2077, 599), (708, 2078, 588), (712, 2079, 578), (717, 2080, 568), (721, 2081, 558), (725, 2082, 547), (730, 2083, 536), (734, 2084, 526), (738, 2085, 516), (743, 2086, 506), (747, 2087, 497), (751, 2088, 488), (755, 2089, 479), (760, 2090, 469), (764, 2091, 460), (768, 2092, 451), (772, 2093, 443), (776, 2094, 434), (779, 2095, 427), (782, 2096, 419), (786, 2097, 411), (789, 2098, 404), (792, 2099, 397), (795, 2100, 390), (799, 2101, 382), (802, 2102, 375), (805, 2103, 370), (808, 2104, 364), (811, 2105, 359), (814, 2106, 354), (818, 2107, 347), (821, 2108, 342), (824, 2109, 337), (827, 2110, 332), (830, 2111, 327), (833, 2112, 322), (836, 2113, 317), (839, 2114, 312), (842, 2115, 307), (845, 2116, 302), (848, 2117, 297), (851, 2118, 292), (854, 2119, 288), (857, 2120, 283), (861, 2121, 277), (863, 2122, 273), (866, 2123, 269), (869, 2124, 264), (872, 2125, 259), (875, 2126, 255), (877, 2127, 251), (880, 2128, 246), (883, 2129, 241), (886, 2130, 237), (890, 2131, 231), (893, 2132, 226), (896, 2133, 221), (899, 2134, 215), (903, 2135, 209), (906, 2136, 204), (910, 2137, 198), (913, 2138, 193), (917, 2139, 186), (920, 2140, 181), (924, 2141, 174), (928, 2142, 165), (932, 2143, 154), (936, 2144, 142), (946, 2145, 124), (957, 2146, 105), (967, 2147, 86), (978, 2148, 67), (989, 2149, 48), (1001, 2150, 27), (1013, 2151, 6)], ['946,2145,775,2093,685,2072,610,2037,371,1987,214,1963,127,1971,54,1825,53,1748,39,1677,41,1538,29,1240,29,892,21,696,27,542,39,458,93,308,116,278,210,206,291,179,373,132,520,121,1430,121,1584,128,1663,142,1768,178,1904,204,2012,294,2098,420,2148,535,2168,613,2165,833,2128,914,2112,994,2078,1072,2031,1132,2001,1207,1958,1273,1931,1368,1879,1444,1846,1670,1796,1823,1756,1920,1662,2015,1581,2015,1496,2039,1420,2046,1339,2070,1177,2101,1097,2141'])], 'temp/1744594737_648272_917877156_a9c2d4b99270c9302def4ed40606e685.jpg']} nb pixel non reg : 3692295 nb pixel common : 3689037 proportion of common points : 0.9991176219668255 [('test release memory', 'SUCCESS', True), ('test detect objet', 'SUCCESS', True), ('test polygone', 'SUCCESS', True)] res_total : True #&_# TEST SUCCEEDED #&_# : tests/mask_test #&_# /home/admin/workarea/git/Velours/python/tests/python_tests.py refs/heads/master_80aab10e0219982fef52d1eae72d1bddac86cb8e SQL :INSERT INTO MTRAdmin.monitor_sys (name, type, server, version_code, result_str, result_bool, lien , test_group ,test_name) VALUES ('python_test3','1','marlene','refs/heads/master_80aab10e0219982fef52d1eae72d1bddac86cb8e','{"mask_detection": "success"}','1','http://marlene.fotonower-preprod.com/job/2025/April/14042025/python_test3//data_2/data_log/job/2025/April/14042025/python_test3/log-python3----short_python3--v--marlene-03:35:00.txt','mask_detection','unknown'); #&_# END OF TEST #&_# : tests/mask_test #&_# #&_# BEGIN OF TEST : tests/datou_test #&_# /home/admin/workarea/git/Velours/python/tests/datou_test.py Datou All Test python version used : 3 ############################### TEST sam ################################ TEST SAM Inside batchDatouExec : verbose : True ##### chargement datou SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4573 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4573 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4573 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4573 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! no param json to modify List Step Type Loaded in datou : sam list_input_json : [] ##### fin chargement datou ##### chargement data ##### Call load_data_input : nb_thread : 5 origin SELECT photo_id, url FROM MTRBack.photos ph WHERE photo_id IN (1189321094) Found this number of photos: 1 ##### Call download_photos : nb_thread : 5 begin to download photo : 1189321094 download finish for photo 1189321094 we have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB ##### After download_photos length of list_filenames : 1 ; length of list_pids : 1 ; length of list_args : 1 ##### After load_data_input time to download the photos : 0.5552518367767334 #### fin chargement data Blocking on flush ? No conitnuing About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! WARNING : we have an input that is not a photo, we should get rid of it Calling datou_exec Inside datou_exec : verbose : True number of steps : 1 step1:sam Mon Apr 14 03:55:27 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec After prepare type args : Here we display some param of map_info ! map_filenames : {'temp/1744595726_648272_1189321094_9626af7f95d010f2a4fd524688d4ea22_76896585.png': 1189321094} map_photo_id_path_extension : {1189321094: {'path': 'temp/1744595726_648272_1189321094_9626af7f95d010f2a4fd524688d4ea22_76896585.png', 'extension': 'png'}} map_subphoto_mainphoto : {} Beginning of datou step sam ! pht : 4677 Inside sam : nb paths : 1 (640, 960, 3) time for calcul the mask position with numpy : 0.0020020008087158203 nb_pixel_total : 14003 time to create 1 rle with old method : 0.01652073860168457 time for calcul the mask position with numpy : 0.0019192695617675781 nb_pixel_total : 83843 time to create 1 rle with old method : 0.09599709510803223 time for calcul the mask position with numpy : 0.0014700889587402344 nb_pixel_total : 3765 time to create 1 rle with old method : 0.004621982574462891 time for calcul the mask position with numpy : 0.0014679431915283203 nb_pixel_total : 5626 time to create 1 rle with old method : 0.006957530975341797 time for calcul the mask position with numpy : 0.0015037059783935547 nb_pixel_total : 8620 time to create 1 rle with old method : 0.010454654693603516 time for calcul the mask position with numpy : 0.001523733139038086 nb_pixel_total : 16403 time to create 1 rle with old method : 0.01941084861755371 time for calcul the mask position with numpy : 0.0014522075653076172 nb_pixel_total : 6645 time to create 1 rle with old method : 0.008287429809570312 time for calcul the mask position with numpy : 0.0014758110046386719 nb_pixel_total : 4276 time to create 1 rle with old method : 0.0051422119140625 time for calcul the mask position with numpy : 0.001399993896484375 nb_pixel_total : 343 time to create 1 rle with old method : 0.00047016143798828125 time for calcul the mask position with numpy : 0.0014545917510986328 nb_pixel_total : 2935 time to create 1 rle with old method : 0.0036907196044921875 time for calcul the mask position with numpy : 0.0014629364013671875 nb_pixel_total : 9509 time to create 1 rle with old method : 0.011561870574951172 time for calcul the mask position with numpy : 0.0014190673828125 nb_pixel_total : 2340 time to create 1 rle with old method : 0.0028629302978515625 time for calcul the mask position with numpy : 0.0015358924865722656 nb_pixel_total : 29397 time to create 1 rle with old method : 0.035251617431640625 time for calcul the mask position with numpy : 0.0014891624450683594 nb_pixel_total : 7572 time to create 1 rle with old method : 0.009078741073608398 time for calcul the mask position with numpy : 0.001438140869140625 nb_pixel_total : 3171 time to create 1 rle with old method : 0.003967761993408203 time for calcul the mask position with numpy : 0.00148773193359375 nb_pixel_total : 9891 time to create 1 rle with old method : 0.012027978897094727 time for calcul the mask position with numpy : 0.0014972686767578125 nb_pixel_total : 12666 time to create 1 rle with old method : 0.015850305557250977 time for calcul the mask position with numpy : 0.0013499259948730469 nb_pixel_total : 1220 time to create 1 rle with old method : 0.0016100406646728516 time for calcul the mask position with numpy : 0.0014903545379638672 nb_pixel_total : 10824 time to create 1 rle with old method : 0.012891769409179688 time for calcul the mask position with numpy : 0.001445770263671875 nb_pixel_total : 2370 time to create 1 rle with old method : 0.0030193328857421875 time for calcul the mask position with numpy : 0.0014467239379882812 nb_pixel_total : 4247 time to create 1 rle with old method : 0.005506992340087891 time for calcul the mask position with numpy : 0.001453399658203125 nb_pixel_total : 3952 time to create 1 rle with old method : 0.004878997802734375 time for calcul the mask position with numpy : 0.0014431476593017578 nb_pixel_total : 5505 time to create 1 rle with old method : 0.0067555904388427734 time for calcul the mask position with numpy : 0.001310586929321289 nb_pixel_total : 714 time to create 1 rle with old method : 0.0009822845458984375 time for calcul the mask position with numpy : 0.0015177726745605469 nb_pixel_total : 13143 time to create 1 rle with old method : 0.015765666961669922 time for calcul the mask position with numpy : 0.0014309883117675781 nb_pixel_total : 2079 time to create 1 rle with old method : 0.002549409866333008 time for calcul the mask position with numpy : 0.0014309883117675781 nb_pixel_total : 2656 time to create 1 rle with old method : 0.0035598278045654297 time for calcul the mask position with numpy : 0.0015048980712890625 nb_pixel_total : 16339 time to create 1 rle with old method : 0.02261185646057129 time for calcul the mask position with numpy : 0.0014948844909667969 nb_pixel_total : 12013 time to create 1 rle with old method : 0.01452493667602539 time for calcul the mask position with numpy : 0.001432180404663086 nb_pixel_total : 875 time to create 1 rle with old method : 0.0012052059173583984 time for calcul the mask position with numpy : 0.0014162063598632812 nb_pixel_total : 929 time to create 1 rle with old method : 0.0013823509216308594 time for calcul the mask position with numpy : 0.0016236305236816406 nb_pixel_total : 38956 time to create 1 rle with old method : 0.045931100845336914 time for calcul the mask position with numpy : 0.0015799999237060547 nb_pixel_total : 28180 time to create 1 rle with old method : 0.03336620330810547 time for calcul the mask position with numpy : 0.0014350414276123047 nb_pixel_total : 1636 time to create 1 rle with old method : 0.0020895004272460938 time for calcul the mask position with numpy : 0.0014164447784423828 nb_pixel_total : 1555 time to create 1 rle with old method : 0.0020265579223632812 time for calcul the mask position with numpy : 0.0014290809631347656 nb_pixel_total : 3533 time to create 1 rle with old method : 0.004317045211791992 time for calcul the mask position with numpy : 0.001478433609008789 nb_pixel_total : 4178 time to create 1 rle with old method : 0.005105018615722656 time for calcul the mask position with numpy : 0.0013589859008789062 nb_pixel_total : 1438 time to create 1 rle with old method : 0.0019025802612304688 time for calcul the mask position with numpy : 0.0014526844024658203 nb_pixel_total : 15068 time to create 1 rle with old method : 0.01808023452758789 time for calcul the mask position with numpy : 0.0014548301696777344 nb_pixel_total : 8602 time to create 1 rle with old method : 0.010472297668457031 time for calcul the mask position with numpy : 0.0013647079467773438 nb_pixel_total : 2494 time to create 1 rle with old method : 0.0031576156616210938 time for calcul the mask position with numpy : 0.0014278888702392578 nb_pixel_total : 2752 time to create 1 rle with old method : 0.0035674571990966797 time for calcul the mask position with numpy : 0.0015897750854492188 nb_pixel_total : 2782 time to create 1 rle with old method : 0.003839254379272461 time for calcul the mask position with numpy : 0.0014677047729492188 nb_pixel_total : 5453 time to create 1 rle with old method : 0.0067424774169921875 time for calcul the mask position with numpy : 0.0014231204986572266 nb_pixel_total : 1638 time to create 1 rle with old method : 0.002165555953979492 time for calcul the mask position with numpy : 0.001522064208984375 nb_pixel_total : 18400 time to create 1 rle with old method : 0.021822690963745117 time for calcul the mask position with numpy : 0.001478433609008789 nb_pixel_total : 3328 time to create 1 rle with old method : 0.004052639007568359 time for calcul the mask position with numpy : 0.0014197826385498047 nb_pixel_total : 1025 time to create 1 rle with old method : 0.0012683868408203125 time for calcul the mask position with numpy : 0.0013968944549560547 nb_pixel_total : 4125 time to create 1 rle with old method : 0.00522160530090332 time for calcul the mask position with numpy : 0.0014286041259765625 nb_pixel_total : 1244 time to create 1 rle with old method : 0.001567840576171875 time for calcul the mask position with numpy : 0.0014743804931640625 nb_pixel_total : 10577 time to create 1 rle with old method : 0.012840509414672852 time for calcul the mask position with numpy : 0.001382589340209961 nb_pixel_total : 2257 time to create 1 rle with old method : 0.0027151107788085938 time for calcul the mask position with numpy : 0.0014307498931884766 nb_pixel_total : 3821 time to create 1 rle with old method : 0.004856586456298828 time for calcul the mask position with numpy : 0.0014717578887939453 nb_pixel_total : 2411 time to create 1 rle with old method : 0.0031371116638183594 time for calcul the mask position with numpy : 0.0013811588287353516 nb_pixel_total : 2385 time to create 1 rle with old method : 0.0030639171600341797 time for calcul the mask position with numpy : 0.0014216899871826172 nb_pixel_total : 337 time to create 1 rle with old method : 0.0004818439483642578 time for calcul the mask position with numpy : 0.0014159679412841797 nb_pixel_total : 577 time to create 1 rle with old method : 0.0007822513580322266 time for calcul the mask position with numpy : 0.0013802051544189453 nb_pixel_total : 861 time to create 1 rle with old method : 0.001108407974243164 time for calcul the mask position with numpy : 0.001390695571899414 nb_pixel_total : 594 time to create 1 rle with old method : 0.0007920265197753906 time for calcul the mask position with numpy : 0.0014147758483886719 nb_pixel_total : 1072 time to create 1 rle with old method : 0.001390695571899414 time for calcul the mask position with numpy : 0.0014369487762451172 nb_pixel_total : 888 time to create 1 rle with old method : 0.0011658668518066406 time for calcul the mask position with numpy : 0.0014185905456542969 nb_pixel_total : 1208 time to create 1 rle with old method : 0.0016057491302490234 time for calcul the mask position with numpy : 0.0014259815216064453 nb_pixel_total : 1705 time to create 1 rle with old method : 0.002179384231567383 time for calcul the mask position with numpy : 0.001430511474609375 nb_pixel_total : 2772 time to create 1 rle with old method : 0.0034384727478027344 time for calcul the mask position with numpy : 0.0014197826385498047 nb_pixel_total : 692 time to create 1 rle with old method : 0.0009489059448242188 time for calcul the mask position with numpy : 0.0014188289642333984 nb_pixel_total : 1056 time to create 1 rle with old method : 0.0014057159423828125 time for calcul the mask position with numpy : 0.0014176368713378906 nb_pixel_total : 1741 time to create 1 rle with old method : 0.0021085739135742188 time for calcul the mask position with numpy : 0.0014445781707763672 nb_pixel_total : 585 time to create 1 rle with old method : 0.0007812976837158203 time for calcul the mask position with numpy : 0.0014300346374511719 nb_pixel_total : 3099 time to create 1 rle with old method : 0.003868579864501953 time for calcul the mask position with numpy : 0.0014047622680664062 nb_pixel_total : 7499 time to create 1 rle with old method : 0.008926153182983398 time for calcul the mask position with numpy : 0.0013375282287597656 nb_pixel_total : 1336 time to create 1 rle with old method : 0.0017709732055664062 time for calcul the mask position with numpy : 0.0014150142669677734 nb_pixel_total : 1010 time to create 1 rle with old method : 0.0012345314025878906 time for calcul the mask position with numpy : 0.0014529228210449219 nb_pixel_total : 16689 time to create 1 rle with old method : 0.0205535888671875 time for calcul the mask position with numpy : 0.0013289451599121094 nb_pixel_total : 267 time to create 1 rle with old method : 0.000331878662109375 time for calcul the mask position with numpy : 0.0014193058013916016 nb_pixel_total : 9077 time to create 1 rle with old method : 0.010931253433227539 time for calcul the mask position with numpy : 0.0014309883117675781 nb_pixel_total : 1514 time to create 1 rle with old method : 0.0018286705017089844 time for calcul the mask position with numpy : 0.0013539791107177734 nb_pixel_total : 971 time to create 1 rle with old method : 0.0012373924255371094 time for calcul the mask position with numpy : 0.0013260841369628906 nb_pixel_total : 1413 time to create 1 rle with old method : 0.0017507076263427734 time for calcul the mask position with numpy : 0.001416921615600586 nb_pixel_total : 248 time to create 1 rle with old method : 0.0003669261932373047 time for calcul the mask position with numpy : 0.0013260841369628906 nb_pixel_total : 888 time to create 1 rle with old method : 0.0011589527130126953 time for calcul the mask position with numpy : 0.0013613700866699219 nb_pixel_total : 619 time to create 1 rle with old method : 0.0007662773132324219 time for calcul the mask position with numpy : 0.0013995170593261719 nb_pixel_total : 8479 time to create 1 rle with old method : 0.009993553161621094 time for calcul the mask position with numpy : 0.0013206005096435547 nb_pixel_total : 221 time to create 1 rle with old method : 0.0003910064697265625 time for calcul the mask position with numpy : 0.0014111995697021484 nb_pixel_total : 735 time to create 1 rle with old method : 0.0009775161743164062 time for calcul the mask position with numpy : 0.001369476318359375 nb_pixel_total : 1633 time to create 1 rle with old method : 0.002032756805419922 time for calcul the mask position with numpy : 0.0013120174407958984 nb_pixel_total : 1035 time to create 1 rle with old method : 0.0013096332550048828 time for calcul the mask position with numpy : 0.0013723373413085938 nb_pixel_total : 419 time to create 1 rle with old method : 0.0005173683166503906 time for calcul the mask position with numpy : 0.0013394355773925781 nb_pixel_total : 2248 time to create 1 rle with old method : 0.0028183460235595703 time for calcul the mask position with numpy : 0.0013446807861328125 nb_pixel_total : 5009 time to create 1 rle with old method : 0.006204128265380859 time for calcul the mask position with numpy : 0.0014200210571289062 nb_pixel_total : 595 time to create 1 rle with old method : 0.0008385181427001953 time for calcul the mask position with numpy : 0.0014123916625976562 nb_pixel_total : 299 time to create 1 rle with old method : 0.00046181678771972656 time for calcul the mask position with numpy : 0.0013210773468017578 nb_pixel_total : 860 time to create 1 rle with old method : 0.0011658668518066406 time for calcul the mask position with numpy : 0.0014040470123291016 nb_pixel_total : 1133 time to create 1 rle with old method : 0.0014333724975585938 time for calcul the mask position with numpy : 0.0014178752899169922 nb_pixel_total : 1205 time to create 1 rle with old method : 0.0014636516571044922 time for calcul the mask position with numpy : 0.0013887882232666016 nb_pixel_total : 1319 time to create 1 rle with old method : 0.0017516613006591797 time for calcul the mask position with numpy : 0.0013310909271240234 nb_pixel_total : 884 time to create 1 rle with old method : 0.0011529922485351562 time for calcul the mask position with numpy : 0.0013775825500488281 nb_pixel_total : 946 time to create 1 rle with old method : 0.0012593269348144531 time for calcul the mask position with numpy : 0.0014569759368896484 nb_pixel_total : 1612 time to create 1 rle with old method : 0.0020275115966796875 time for calcul the mask position with numpy : 0.0013973712921142578 nb_pixel_total : 949 time to create 1 rle with old method : 0.001241445541381836 insert ignore into MTRPhoto.crop_hashtag_ids (photo_id, hashtag_id, `type`,x0,x1,y0,y1,score) VALUES (%s,%s,%s,%s,%s,%s,%s,%s) batch 1 Loaded 99 chid ids of type : 4677 Number RLEs to save : 8920 INSERT IGNORE INTO MTRPhoto.crop_segments (`crop_hashtag_id`, `x0`, `y0`, `length`) VALUES (%s, %s, %s , %s) first line : ('3767148964', '325', '495', '8') ... last line : ('3767149062', '331', '38', '1') INSERT IGNORE INTO MTRPhoto.crop_sum_segments (`crop_hashtag_id`, `sum_segments`) VALUES (%s, %s) TO DO : save crop sub photo not yet done ! After datou_step_exec type output : map_portfolio_photo : len 0 keys : dict_keys([]) Inside saveOutput : final : True verbose : True saveOutput not yet implemented for datou_step.type : sam we use saveGeneral [1189321094] map_info['map_portfolio_photo'] : {} final : True mtd_id 4573 list_pids : [1189321094] Looping around the photos to save general results len do output : 1 /1189321094Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4573', None, None, None, None, None, None, None, None) ('4573', None, '1189321094', None, None, None, None, None, None) begin to insert list_values into mtr_datou_result : length of list_values in save_final : 3 insert ignore into MTRPhoto.mtr_datou_result (mtd_id, mtr_portfolio_id,mtr_photo_id,result,result_long,result_double,hashtag_id,proba, mtr_current_id) values (%s,%s,%s,%s,%s,%s,%s,%s,%s) on duplicate key update mtr_portfolio_id = mtr_portfolio_id list_values : [('4573', None, '1189321094', 'None', None, None, None, None, None)] time used for this insertion : 0.013321876525878906 save_final save missing photos in datou_result : time spend for datou_step_exec : 13.277539730072021 time spend to save output : 0.013519525527954102 total time spend for step 1 : 13.291059255599976 caffe_path_current : About to save ! 2 After save, about to update current ! datou_cur_ids : [] len(datou.list_steps) : 1 output : {'1189321094': [[, , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , ], 'temp/1744595726_648272_1189321094_9626af7f95d010f2a4fd524688d4ea22_76896585.png']} nb_objects detect : 99 ############################### TEST frcnn ################################ test frcnn Inside batchDatouExec : verbose : True ##### chargement datou SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4184 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4184 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4184 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4184 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! no param json to modify List Step Type Loaded in datou : frcnn list_input_json : [] ##### fin chargement datou ##### chargement data ##### Call load_data_input : nb_thread : 5 origin SELECT photo_id, url FROM MTRBack.photos ph WHERE photo_id IN (917754606) Found this number of photos: 1 ##### Call download_photos : nb_thread : 5 begin to download photo : 917754606 download finish for photo 917754606 we have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB ##### After download_photos length of list_filenames : 1 ; length of list_pids : 1 ; length of list_args : 1 ##### After load_data_input time to download the photos : 0.3707427978515625 #### fin chargement data Blocking on flush ? No conitnuing About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : True number of steps : 1 step1:frcnn Mon Apr 14 03:55:41 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec After prepare type args : Here we display some param of map_info ! map_filenames : {'temp/1744595740_648272_917754606_35f3c9ae49686a6be16030c6ec25c9ee.jpg': 917754606} map_photo_id_path_extension : {917754606: {'path': 'temp/1744595740_648272_917754606_35f3c9ae49686a6be16030c6ec25c9ee.jpg', 'extension': 'jpg'}} map_subphoto_mainphoto : {} Beginning of datou step Faster rcnn ! classes : ['background', 'plaque'] pht : 4370 caffemodel_name (should be vgg16_immat_307 but not used because net loaded outside in the fonction) : {'id': 3375, 'mtr_user_id': 31, 'name': 'detection_plaque_valcor_010622', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,plaque', 'svm_portfolios_learning': '0,0', 'photo_hashtag_type': 4370, 'photo_desc_type': 5676, 'type_classification': 'caffe_faster_rcnn', 'hashtag_id_list': '0,0'} To loadFromThcl() model_param file didn't exist model_name : detection_plaque_valcor_010622 model_type : caffe_faster_rcnn list file need : ['caffemodel', 'test.prototxt'] file exist in s3 : ['caffemodel', 'test.prototxt'] file manque in s3 : [] local folder : /data/models_weight/detection_plaque_valcor_010622 /data/models_weight/detection_plaque_valcor_010622/caffemodel size_local : 349723073 size in s3 : 349723073 create time local : 2022-07-12 14:12:27 create time in s3 : 2022-06-01 15:05:56 caffemodel already exist and didn't need to update /data/models_weight/detection_plaque_valcor_010622/test.prototxt size_local : 7163 size in s3 : 7163 create time local : 2022-07-12 14:12:27 create time in s3 : 2022-06-01 15:05:55 test.prototxt already exist and didn't need to update prototxt : /data/models_weight/detection_plaque_valcor_010622/test.prototxt caffemodel : /data/models_weight/detection_plaque_valcor_010622/caffemodel Loaded network /data/models_weight/detection_plaque_valcor_010622/caffemodel About to compute detect_faster_rcnn : len(args) : 1 Inside frcnn step exec : nb paths : 1 image_path : temp/1744595740_648272_917754606_35f3c9ae49686a6be16030c6ec25c9ee.jpg image_size (600, 800, 3) [[[ 4 6 6] [ 5 7 7] [ 6 8 8] ... [207 215 214] [206 214 213] [206 214 213]] [[ 4 6 6] [ 5 7 7] [ 6 8 8] ... [207 215 214] [206 214 213] [206 214 213]] [[ 4 6 6] [ 5 7 7] [ 6 8 8] ... [207 215 214] [206 214 213] [206 214 213]] ... [[ 14 16 16] [ 13 15 15] [ 11 13 13] ... [198 206 205] [198 206 205] [198 206 205]] [[ 16 18 18] [ 14 16 16] [ 11 13 13] ... [206 214 213] [206 214 213] [206 214 213]] [[ 13 15 15] [ 12 14 14] [ 9 11 11] ... [210 218 217] [210 218 217] [210 218 217]]] Detection took 0.072s for 300 object proposals c : plaque list_crops.shape (72, 5) proba : 0.06384041 (374.12732, 293.9198, 430.81006, 317.80902) proba : 0.052186415 (382.17505, 297.1884, 552.3555, 344.6602) proba : 0.0122717675 (345.35748, 272.42984, 468.85632, 320.72415) We are managing local photo_id len de result frcnn : 1 After datou_step_exec type output : time spend for datou_step_exec : 2.7517669200897217 time spend to save output : 0.0001201629638671875 total time spend for step 1 : 2.751887083053589 caffe_path_current : About to save ! 1 Inside saveOutput : final : True verbose : True Inside saveFrcnn : final : True verbose : True threshold to save the result : 0.1 output flattener : [(0, 493029425, 4370, 374, 430, 293, 317, 0.06384041, None), (0, 493029425, 4370, 382, 552, 297, 344, 0.052186415, None), (0, 493029425, 4370, 345, 468, 272, 320, 0.0122717675, None)] Warning : no hashtag_ids to insert in the database final : True begin to insert list_values into mtr_datou_result : length of list_values in save_final : 1 insert ignore into MTRPhoto.mtr_datou_result (mtd_id, mtr_portfolio_id,mtr_photo_id,result,result_long,result_double,hashtag_id,proba, mtr_current_id) values (%s,%s,%s,%s,%s,%s,%s,%s,%s) on duplicate key update mtr_portfolio_id = mtr_portfolio_id list_values : [('4184', None, '917754606', '0', 0, '0', 493061979, '0', None)] time used for this insertion : 0.17463064193725586 [917754606] map_info['map_portfolio_photo'] : {} final : True mtd_id 4184 list_pids : [917754606] Looping around the photos to save general results len do output : 1 /0 before output type Managing all output in save final without adding information in the mtr_datou_result ('4184', None, None, None, None, None, None, None, None) ('4184', None, '917754606', None, None, None, None, None, None) begin to insert list_values into mtr_datou_result : length of list_values in save_final : 1 insert ignore into MTRPhoto.mtr_datou_result (mtd_id, mtr_portfolio_id,mtr_photo_id,result,result_long,result_double,hashtag_id,proba, mtr_current_id) values (%s,%s,%s,%s,%s,%s,%s,%s,%s) on duplicate key update mtr_portfolio_id = mtr_portfolio_id list_values : [('4184', None, '917754606', None, None, None, None, None, None)] time used for this insertion : 0.0121307373046875 save_final save missing photos in datou_result : After save, about to update current ! datou_cur_ids : [] len(datou.list_steps) : 1 output : {0: [[(0, 493029425, 4370, 374, 430, 293, 317, 0.06384041, None), (0, 493029425, 4370, 382, 552, 297, 344, 0.052186415, None), (0, 493029425, 4370, 345, 468, 272, 320, 0.0122717675, None)], 'temp/1744595740_648272_917754606_35f3c9ae49686a6be16030c6ec25c9ee.jpg']} ############################### TEST thcl ################################ TEST THCL Inside batchDatouExec : verbose : True ##### chargement datou SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=2 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=2 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 2 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=2 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : step 1 thcl is not linked in the step_by_step architecture ! WARNING : step 2 argmax is not linked in the step_by_step architecture ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! DataTypes for each output/input checked ! no param json to modify List Step Type Loaded in datou : thcl, argmax list_input_json : [] ##### fin chargement datou ##### chargement data ##### Call load_data_input : nb_thread : 5 origin SELECT photo_id, url FROM MTRBack.photos ph WHERE photo_id IN (916235064) Found this number of photos: 1 ##### Call download_photos : nb_thread : 5 begin to download photo : 916235064 download finish for photo 916235064 we have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB ##### After download_photos length of list_filenames : 1 ; length of list_pids : 1 ; length of list_args : 1 ##### After load_data_input time to download the photos : 0.38039493560791016 #### fin chargement data Blocking on flush ? No conitnuing About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : True number of steps : 2 step1:thcl Mon Apr 14 03:55:44 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec After prepare type args : Here we display some param of map_info ! map_filenames : {'temp/1744595744_648272_916235064_6293d1bb790dc6902450e7c572b7d10b.jpg': 916235064} map_photo_id_path_extension : {916235064: {'path': 'temp/1744595744_648272_916235064_6293d1bb790dc6902450e7c572b7d10b.jpg', 'extension': 'jpg'}} map_subphoto_mainphoto : {} Beginning of datou step Thcl ! multi_thcl or not :False multi_thcl_cond or not :False dic_thcl : {'355': 1} we are using the classfication for only one thcl 355 In convert_file_to_np l 337 : 1 l343 1 l357 after caffe.io.load_image dimension du image : (3, (66, 66, 3)) dimension displayed ! time to import caffe and check if the image exist : 0.009982824325561523 time to convert the images to numpy array : 0.0008914470672607422 total time to convert the images to numpy array : 0.011177778244018555 list photo_ids error: [] list photo_ids correct : [916235064] number of photos to traite : 1 try to delete the photos incorrect in DB tagging for thcl : 355 To do loadFromThcl(), then load ParamDescType : thcl355 get_desc_type_from_thcl : type of cat SELECT id, mtr_user_id, name, pb_hashtag_id, hashtag_id_list, button_legend_list, portfolio_id_lists, photo_hashtag_type, photo_desc_type, svm_limit, limit_tagging, is_public, live, created_at, updated_at, type_classification FROM MTRDatou.classification_theme WHERE `id` IN (355) thcls : [{'id': 355, 'mtr_user_id': 31, 'name': 'car_360_1027', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'c_elysee_1027_gao__port_506302,mokka_1027_gao__port_506374,captur_1027_gao__port_506399,sorento_1027_gao__port_506192,navara_1027_gao__port_506205,xc90_1027_gao__port_506350,saxo_1027_gao__port_506052,trafic_1027_gao__port_506295,punto_evo_1027_gao__port_506066,5_1027_gao__port_506117,250_1027_gao__port_506065,d_max_1027_gao__port_506125,panamera_1027_gao__port_506387,alhambra_1027_gao__port_506381,x6_1027_gao__port_506349,vitara_1027_gao__port_506328,fiesta_1027_gao__port_506377,qashqai_1027_gao__port_506286,147_1027_gao__port_506124,c5_1027_gao__port_506172,q5_1027_gao__port_506206,giulia_1027_gao__port_506178,karl_1027_gao__port_506371,mehari_1027_gao__port_506076,911_1027_gao__port_506114,508_1027_gao__port_506329,idea_1027_gao__port_506122,megane_1027_gao__port_506220,ghibli_1027_gao__port_506174,touareg_1027_gao__port_506224,i10_1027_gao__port_506232,jumper_1027_gao__port_506234,classe_clk_1027_gao__port_506173,kuga_1027_gao__port_506181,ct_1027_gao__port_506323,leon_1027_gao__port_506326,ds5_1027_gao__port_506376,cordoba_1027_gao__port_506048,classe_cla_1027_gao__port_506400,jumpy_1027_gao__port_506179,avensis_1027_gao__port_506311,juke_1027_gao__port_506325,4008_1027_gao__port_506402,190_series_1027_gao__port_506051,serie_3_1027_gao__port_506294,q7_1027_gao__port_506318,glc_1027_gao__port_506303,grand_vitara_1027_gao__port_506175,s40_1027_gao__port_506099,toledo_1027_gao__port_506061,5008_1027_gao__port_506337,continental_1027_gao__port_506250,coupe_1027_gao__port_506082,iq_1027_gao__port_506166,407_1027_gao__port_506133,touran_1027_gao__port_506308,300c_1027_gao__port_506078,classe_gl_1027_gao__port_506340,vivaro_1027_gao__port_506310,sl_1027_gao__port_506100,elise_1027_gao__port_506121,1007_1027_gao__port_506070,i40_1027_gao__port_506218,bipper_tepee_1027_gao__port_506227,focus_1027_gao__port_506272,primera_1027_gao__port_506147,r4_1027_gao__port_506160,a8_1027_gao__port_506265,boxer_1027_gao__port_506202,s5_1027_gao__port_506222,r21_1027_gao__port_506093,c3_1027_gao__port_506257,santa_fe_1027_gao__port_506208,m4_1027_gao__port_506344,safrane_1027_gao__port_506077,classe_gle_1027_gao__port_506395,0_1027_gao__port_506094,ix35_1027_gao__port_506219,carens_1027_gao__port_506298,classe_a_1027_gao__port_506339,ix20_1027_gao__port_506343,note_1027_gao__port_506365,a5_1027_gao__port_506200,sx4_1027_gao__port_506348,sandero_1027_gao__port_506198,3008_1027_gao__port_506385,q50_1027_gao__port_506239,latitude_1027_gao__port_506236,v40_1027_gao__port_506391,xsara_1027_gao__port_506087,grand_c_max_1027_gao__port_506342,swift_1027_gao__port_506149,serie_1_1027_gao__port_506184,xc70_1027_gao__port_506393,master_1027_gao__port_506203,clio_1027_gao__port_506280,duster_1027_gao__port_506216,traveller_1027_gao__port_506403,tipo_1027_gao__port_506355,rav_4_1027_gao__port_506332,coccinelle_1027_gao__port_506259,spacetourer_1027_gao__port_506401,xe_1027_gao__port_506357,ds3_1027_gao__port_506324,mx_5_1027_gao__port_506098,land_cruiser_1027_gao__port_506315,classe_b_1027_gao__port_506335,806_1027_gao__port_506088,rx_8_1027_gao__port_506046,spark_1027_gao__port_506185,6_1027_gao__port_506171,bravo_1027_gao__port_506080,nx_1027_gao__port_506345,sharan_1027_gao__port_506347,x_type_1027_gao__port_506067,jimny_1027_gao__port_506233,wrangler_1027_gao__port_506225,c_crosser_1027_gao__port_506312,v70_1027_gao__port_506278,classe_e_1027_gao__port_506300,classe_v_1027_gao__port_506258,m3_1027_gao__port_506182,abarth_500_1027_gao__port_506226,serie_6_1027_gao__port_506262,modus_1027_gao__port_506146,3_1027_gao__port_506113,405_1027_gao__port_506108,allroad_1027_gao__port_506297,auris_1027_gao__port_506322,galaxy_1027_gao__port_506143,giulietta_1027_gao__port_506363,106_1027_gao__port_506073,classe_m_1027_gao__port_506154,espace_1027_gao__port_506313,panda_1027_gao__port_506189,rcz_1027_gao__port_506197,4007_1027_gao__port_506162,classe_cl_1027_gao__port_506249,leaf_1027_gao__port_506139,octavia_1027_gao__port_506237,ds4_1027_gao__port_506336,freelander_1027_gao__port_506084,evasion_1027_gao__port_506109,punto_1027_gao__port_506106,2cv_1027_gao__port_506045,x4_1027_gao__port_506392,antara_1027_gao__port_506247,murano_1027_gao__port_506316,alto_1027_gao__port_506201,meriva_1027_gao__port_506353,orlando_1027_gao__port_506305,new_beetle_1027_gao__port_506050,306_1027_gao__port_506145,tiguan_1027_gao__port_506362,s_type_1027_gao__port_506101,c1_1027_gao__port_506128,vectra_1027_gao__port_506044,outlander_1027_gao__port_506317,307_1027_gao__port_506074,a6_s6_1027_gao__port_506134,nemo_combi_1027_gao__port_506196,berlingo_1027_gao__port_506194,partner_1027_gao__port_506285,cayenne_1027_gao__port_506177,quattroporte_1027_gao__port_506240,c_max_1027_gao__port_506282,fabia_1027_gao__port_506396,cx_3_1027_gao__port_506281,x_trail_1027_gao__port_506264,scirocco_1027_gao__port_506276,matiz_1027_gao__port_506144,tigra_1027_gao__port_506069,escort_1027_gao__port_506091,c2_1027_gao__port_506081,mini_1027_gao__port_506168,i30_1027_gao__port_506291,picanto_1027_gao__port_506238,mito_1027_gao__port_506072,impreza_1027_gao__port_506085,kangoo_1027_gao__port_506235,a4_1027_gao__port_506193,cayman_1027_gao__port_506268,sportage_1027_gao__port_506148,up_1027_gao__port_506356,optima_1027_gao__port_506386,defender_1027_gao__port_506229,serie_2_1027_gao__port_506256,edge_1027_gao__port_506187,r19_1027_gao__port_506110,jetta_1027_gao__port_506304,eos_1027_gao__port_506115,accord_1027_gao__port_506214,yaris_1027_gao__port_506334,classe_cls_1027_gao__port_506289,polo_1027_gao__port_506361,serie_4_1027_gao__port_506366,mini_cabriolet_1027_gao__port_506204,prius_1027_gao__port_506190,lodgy_1027_gao__port_506188,serie_7_1027_gao__port_506307,c15_1027_gao__port_506055,kadjar_1027_gao__port_506389,insignia_1027_gao__port_506364,308_1027_gao__port_506279,roomster_1027_gao__port_506241,80_1027_gao__port_506057,309_1027_gao__port_506063,tucson_1027_gao__port_506320,x3_1027_gao__port_506212,xf_1027_gao__port_506263,2008_1027_gao__port_506394,passat_1027_gao__port_506306,compass_1027_gao__port_506260,twingo_1027_gao__port_506309,micra_1027_gao__port_506221,golf_1027_gao__port_506155,soul_1027_gao__port_506176,rapid_1027_gao__port_506398,forester_1027_gao__port_506360,slk_1027_gao__port_506210,forfour_1027_gao__port_506341,serie_5_1027_gao__port_506209,xj_1027_gao__port_506170,pajero_1027_gao__port_506097,agila_1027_gao__port_506119,a6_1027_gao__port_506163,fox_1027_gao__port_506092,boxster_1027_gao__port_506267,altea_1027_gao__port_506246,samurai_1027_gao__port_506047,trax_1027_gao__port_506296,getz_1027_gao__port_506058,cherokee_1027_gao__port_506269,koleos_1027_gao__port_506378,z_series_1027_gao__port_506123,ecosport_1027_gao__port_506271,space_star_1027_gao__port_506277,rs3_sportback_1027_gao__port_506207,civic_1027_gao__port_506141,talisman_1027_gao__port_506390,f_pace_1027_gao__port_506314,classe_c_1027_gao__port_506299,tt_1027_gao__port_506075,pathfinder_1027_gao__port_506183,156_1027_gao__port_506157,cx_5_1027_gao__port_506228,scenic_1027_gao__port_506255,yeti_1027_gao__port_506358,mustang_1027_gao__port_506053,stilo_1027_gao__port_506060,ateca_1027_gao__port_506382,fiorino_1027_gao__port_506217,classe_glk_1027_gao__port_506290,fortwo_1027_gao__port_506230,cruze_1027_gao__port_506186,107_1027_gao__port_506213,aygo_1027_gao__port_506248,rx_1027_gao__port_506354,500_1027_gao__port_506245,bora_1027_gao__port_506104,transit_1027_gao__port_506111,pt_cruiser_1027_gao__port_506054,patrol_1027_gao__port_506068,r8_1027_gao__port_506156,xm_1027_gao__port_506102,s60_1027_gao__port_506191,aveo_1027_gao__port_506158,captiva_1027_gao__port_506159,ax_1027_gao__port_506153,rexton_1027_gao__port_506107,camaro_1027_gao__port_506056,ypsilon_1027_gao__port_506131,delta_1027_gao__port_506165,c4_1027_gao__port_506370,zx_1027_gao__port_506161,verso_1027_gao__port_506242,superb_1027_gao__port_506327,r5_1027_gao__port_506253,caddy_1027_gao__port_506330,x5_1027_gao__port_506243,f_type_1027_gao__port_506231,fusion_1027_gao__port_506096,dokker_1027_gao__port_506331,205_1027_gao__port_506062,macan_1027_gao__port_506195,tourneo_1027_gao__port_506369,108_1027_gao__port_506384,9_3_1027_gao__port_506071,mondeo_1027_gao__port_506116,cr_v_1027_gao__port_506164,c30_1027_gao__port_506090,pulsar_1027_gao__port_506397,ibiza_1027_gao__port_506273,a1_1027_gao__port_506338,matrix_1027_gao__port_506140,carnival_1027_gao__port_506136,xantia_1027_gao__port_506086,terrano_1027_gao__port_506083,q3_1027_gao__port_506275,hr_v_1027_gao__port_506283,expert_1027_gao__port_506142,multivan_1027_gao__port_506383,venga_1027_gao__port_506380,scudo_1027_gao__port_506129,laguna_1027_gao__port_506368,vel_satis_1027_gao__port_506130,b_max_1027_gao__port_506367,ignis_1027_gao__port_506292,159_1027_gao__port_506064,grande_punto_1027_gao__port_506138,logan_1027_gao__port_506167,s_max_1027_gao__port_506223,caravelle_1027_gao__port_506351,adam_1027_gao__port_506079,406_1027_gao__port_506132,q30_1027_gao__port_506293,almera_1027_gao__port_506089,corsa_1027_gao__port_506095,corolla_1027_gao__port_506120,xc60_1027_gao__port_506388,viano_1027_gao__port_506211,pro_cee_d_1027_gao__port_506274,a3_1027_gao__port_506321,v50_1027_gao__port_506150,voyager_1027_gao__port_506169,corvette_1027_gao__port_506049,rio_1027_gao__port_506379,jazz_1027_gao__port_506252,200_1027_gao__port_506112,tts_1027_gao__port_506199,zafira_1027_gao__port_506287,asx_1027_gao__port_506266,607_1027_gao__port_506118,207_1027_gao__port_506103,classe_s_1027_gao__port_506301,c6_1027_gao__port_506105,express_1027_gao__port_506137,classe_gla_1027_gao__port_506352,v60_1027_gao__port_506333,ka_1027_gao__port_506180,range_rover_1027_gao__port_506254,discovery_1027_gao__port_506375,classe_r_1027_gao__port_506270,transporter_1027_gao__port_506319,cee_d_1027_gao__port_506288,zoe_1027_gao__port_506244,i20_1027_gao__port_506284,gtv_1027_gao__port_506059,s4_avant_1027_gao__port_506261,x1_1027_gao__port_506372,autres_1027_gao__port_506127,208_1027_gao__port_506359,c8_1027_gao__port_506135,astra_1027_gao__port_506215,2_1027_gao__port_506151,doblo_1027_gao__port_506251,807_1027_gao__port_506152,206_1027_gao__port_506126,a7_1027_gao__port_506373,renegade_1027_gao__port_506346', 'svm_portfolios_learning': '506302,506374,506399,506192,506205,506350,506052,506295,506066,506117,506065,506125,506387,506381,506349,506328,506377,506286,506124,506172,506206,506178,506371,506076,506114,506329,506122,506220,506174,506224,506232,506234,506173,506181,506323,506326,506376,506048,506400,506179,506311,506325,506402,506051,506294,506318,506303,506175,506099,506061,506337,506250,506082,506166,506133,506308,506078,506340,506310,506100,506121,506070,506218,506227,506272,506147,506160,506265,506202,506222,506093,506257,506208,506344,506077,506395,506094,506219,506298,506339,506343,506365,506200,506348,506198,506385,506239,506236,506391,506087,506342,506149,506184,506393,506203,506280,506216,506403,506355,506332,506259,506401,506357,506324,506098,506315,506335,506088,506046,506185,506171,506080,506345,506347,506067,506233,506225,506312,506278,506300,506258,506182,506226,506262,506146,506113,506108,506297,506322,506143,506363,506073,506154,506313,506189,506197,506162,506249,506139,506237,506336,506084,506109,506106,506045,506392,506247,506316,506201,506353,506305,506050,506145,506362,506101,506128,506044,506317,506074,506134,506196,506194,506285,506177,506240,506282,506396,506281,506264,506276,506144,506069,506091,506081,506168,506291,506238,506072,506085,506235,506193,506268,506148,506356,506386,506229,506256,506187,506110,506304,506115,506214,506334,506289,506361,506366,506204,506190,506188,506307,506055,506389,506364,506279,506241,506057,506063,506320,506212,506263,506394,506306,506260,506309,506221,506155,506176,506398,506360,506210,506341,506209,506170,506097,506119,506163,506092,506267,506246,506047,506296,506058,506269,506378,506123,506271,506277,506207,506141,506390,506314,506299,506075,506183,506157,506228,506255,506358,506053,506060,506382,506217,506290,506230,506186,506213,506248,506354,506245,506104,506111,506054,506068,506156,506102,506191,506158,506159,506153,506107,506056,506131,506165,506370,506161,506242,506327,506253,506330,506243,506231,506096,506331,506062,506195,506369,506384,506071,506116,506164,506090,506397,506273,506338,506140,506136,506086,506083,506275,506283,506142,506383,506380,506129,506368,506130,506367,506292,506064,506138,506167,506223,506351,506079,506132,506293,506089,506095,506120,506388,506211,506274,506321,506150,506169,506049,506379,506252,506112,506199,506287,506266,506118,506103,506301,506105,506137,506352,506333,506180,506254,506375,506270,506319,506288,506244,506284,506059,506261,506372,506127,506359,506135,506215,506151,506251,506152,506126,506373,506346', 'photo_hashtag_type': 332, 'photo_desc_type': 3390, 'type_classification': 'caffe', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0'}] thcl {'id': 355, 'mtr_user_id': 31, 'name': 'car_360_1027', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'c_elysee_1027_gao__port_506302,mokka_1027_gao__port_506374,captur_1027_gao__port_506399,sorento_1027_gao__port_506192,navara_1027_gao__port_506205,xc90_1027_gao__port_506350,saxo_1027_gao__port_506052,trafic_1027_gao__port_506295,punto_evo_1027_gao__port_506066,5_1027_gao__port_506117,250_1027_gao__port_506065,d_max_1027_gao__port_506125,panamera_1027_gao__port_506387,alhambra_1027_gao__port_506381,x6_1027_gao__port_506349,vitara_1027_gao__port_506328,fiesta_1027_gao__port_506377,qashqai_1027_gao__port_506286,147_1027_gao__port_506124,c5_1027_gao__port_506172,q5_1027_gao__port_506206,giulia_1027_gao__port_506178,karl_1027_gao__port_506371,mehari_1027_gao__port_506076,911_1027_gao__port_506114,508_1027_gao__port_506329,idea_1027_gao__port_506122,megane_1027_gao__port_506220,ghibli_1027_gao__port_506174,touareg_1027_gao__port_506224,i10_1027_gao__port_506232,jumper_1027_gao__port_506234,classe_clk_1027_gao__port_506173,kuga_1027_gao__port_506181,ct_1027_gao__port_506323,leon_1027_gao__port_506326,ds5_1027_gao__port_506376,cordoba_1027_gao__port_506048,classe_cla_1027_gao__port_506400,jumpy_1027_gao__port_506179,avensis_1027_gao__port_506311,juke_1027_gao__port_506325,4008_1027_gao__port_506402,190_series_1027_gao__port_506051,serie_3_1027_gao__port_506294,q7_1027_gao__port_506318,glc_1027_gao__port_506303,grand_vitara_1027_gao__port_506175,s40_1027_gao__port_506099,toledo_1027_gao__port_506061,5008_1027_gao__port_506337,continental_1027_gao__port_506250,coupe_1027_gao__port_506082,iq_1027_gao__port_506166,407_1027_gao__port_506133,touran_1027_gao__port_506308,300c_1027_gao__port_506078,classe_gl_1027_gao__port_506340,vivaro_1027_gao__port_506310,sl_1027_gao__port_506100,elise_1027_gao__port_506121,1007_1027_gao__port_506070,i40_1027_gao__port_506218,bipper_tepee_1027_gao__port_506227,focus_1027_gao__port_506272,primera_1027_gao__port_506147,r4_1027_gao__port_506160,a8_1027_gao__port_506265,boxer_1027_gao__port_506202,s5_1027_gao__port_506222,r21_1027_gao__port_506093,c3_1027_gao__port_506257,santa_fe_1027_gao__port_506208,m4_1027_gao__port_506344,safrane_1027_gao__port_506077,classe_gle_1027_gao__port_506395,0_1027_gao__port_506094,ix35_1027_gao__port_506219,carens_1027_gao__port_506298,classe_a_1027_gao__port_506339,ix20_1027_gao__port_506343,note_1027_gao__port_506365,a5_1027_gao__port_506200,sx4_1027_gao__port_506348,sandero_1027_gao__port_506198,3008_1027_gao__port_506385,q50_1027_gao__port_506239,latitude_1027_gao__port_506236,v40_1027_gao__port_506391,xsara_1027_gao__port_506087,grand_c_max_1027_gao__port_506342,swift_1027_gao__port_506149,serie_1_1027_gao__port_506184,xc70_1027_gao__port_506393,master_1027_gao__port_506203,clio_1027_gao__port_506280,duster_1027_gao__port_506216,traveller_1027_gao__port_506403,tipo_1027_gao__port_506355,rav_4_1027_gao__port_506332,coccinelle_1027_gao__port_506259,spacetourer_1027_gao__port_506401,xe_1027_gao__port_506357,ds3_1027_gao__port_506324,mx_5_1027_gao__port_506098,land_cruiser_1027_gao__port_506315,classe_b_1027_gao__port_506335,806_1027_gao__port_506088,rx_8_1027_gao__port_506046,spark_1027_gao__port_506185,6_1027_gao__port_506171,bravo_1027_gao__port_506080,nx_1027_gao__port_506345,sharan_1027_gao__port_506347,x_type_1027_gao__port_506067,jimny_1027_gao__port_506233,wrangler_1027_gao__port_506225,c_crosser_1027_gao__port_506312,v70_1027_gao__port_506278,classe_e_1027_gao__port_506300,classe_v_1027_gao__port_506258,m3_1027_gao__port_506182,abarth_500_1027_gao__port_506226,serie_6_1027_gao__port_506262,modus_1027_gao__port_506146,3_1027_gao__port_506113,405_1027_gao__port_506108,allroad_1027_gao__port_506297,auris_1027_gao__port_506322,galaxy_1027_gao__port_506143,giulietta_1027_gao__port_506363,106_1027_gao__port_506073,classe_m_1027_gao__port_506154,espace_1027_gao__port_506313,panda_1027_gao__port_506189,rcz_1027_gao__port_506197,4007_1027_gao__port_506162,classe_cl_1027_gao__port_506249,leaf_1027_gao__port_506139,octavia_1027_gao__port_506237,ds4_1027_gao__port_506336,freelander_1027_gao__port_506084,evasion_1027_gao__port_506109,punto_1027_gao__port_506106,2cv_1027_gao__port_506045,x4_1027_gao__port_506392,antara_1027_gao__port_506247,murano_1027_gao__port_506316,alto_1027_gao__port_506201,meriva_1027_gao__port_506353,orlando_1027_gao__port_506305,new_beetle_1027_gao__port_506050,306_1027_gao__port_506145,tiguan_1027_gao__port_506362,s_type_1027_gao__port_506101,c1_1027_gao__port_506128,vectra_1027_gao__port_506044,outlander_1027_gao__port_506317,307_1027_gao__port_506074,a6_s6_1027_gao__port_506134,nemo_combi_1027_gao__port_506196,berlingo_1027_gao__port_506194,partner_1027_gao__port_506285,cayenne_1027_gao__port_506177,quattroporte_1027_gao__port_506240,c_max_1027_gao__port_506282,fabia_1027_gao__port_506396,cx_3_1027_gao__port_506281,x_trail_1027_gao__port_506264,scirocco_1027_gao__port_506276,matiz_1027_gao__port_506144,tigra_1027_gao__port_506069,escort_1027_gao__port_506091,c2_1027_gao__port_506081,mini_1027_gao__port_506168,i30_1027_gao__port_506291,picanto_1027_gao__port_506238,mito_1027_gao__port_506072,impreza_1027_gao__port_506085,kangoo_1027_gao__port_506235,a4_1027_gao__port_506193,cayman_1027_gao__port_506268,sportage_1027_gao__port_506148,up_1027_gao__port_506356,optima_1027_gao__port_506386,defender_1027_gao__port_506229,serie_2_1027_gao__port_506256,edge_1027_gao__port_506187,r19_1027_gao__port_506110,jetta_1027_gao__port_506304,eos_1027_gao__port_506115,accord_1027_gao__port_506214,yaris_1027_gao__port_506334,classe_cls_1027_gao__port_506289,polo_1027_gao__port_506361,serie_4_1027_gao__port_506366,mini_cabriolet_1027_gao__port_506204,prius_1027_gao__port_506190,lodgy_1027_gao__port_506188,serie_7_1027_gao__port_506307,c15_1027_gao__port_506055,kadjar_1027_gao__port_506389,insignia_1027_gao__port_506364,308_1027_gao__port_506279,roomster_1027_gao__port_506241,80_1027_gao__port_506057,309_1027_gao__port_506063,tucson_1027_gao__port_506320,x3_1027_gao__port_506212,xf_1027_gao__port_506263,2008_1027_gao__port_506394,passat_1027_gao__port_506306,compass_1027_gao__port_506260,twingo_1027_gao__port_506309,micra_1027_gao__port_506221,golf_1027_gao__port_506155,soul_1027_gao__port_506176,rapid_1027_gao__port_506398,forester_1027_gao__port_506360,slk_1027_gao__port_506210,forfour_1027_gao__port_506341,serie_5_1027_gao__port_506209,xj_1027_gao__port_506170,pajero_1027_gao__port_506097,agila_1027_gao__port_506119,a6_1027_gao__port_506163,fox_1027_gao__port_506092,boxster_1027_gao__port_506267,altea_1027_gao__port_506246,samurai_1027_gao__port_506047,trax_1027_gao__port_506296,getz_1027_gao__port_506058,cherokee_1027_gao__port_506269,koleos_1027_gao__port_506378,z_series_1027_gao__port_506123,ecosport_1027_gao__port_506271,space_star_1027_gao__port_506277,rs3_sportback_1027_gao__port_506207,civic_1027_gao__port_506141,talisman_1027_gao__port_506390,f_pace_1027_gao__port_506314,classe_c_1027_gao__port_506299,tt_1027_gao__port_506075,pathfinder_1027_gao__port_506183,156_1027_gao__port_506157,cx_5_1027_gao__port_506228,scenic_1027_gao__port_506255,yeti_1027_gao__port_506358,mustang_1027_gao__port_506053,stilo_1027_gao__port_506060,ateca_1027_gao__port_506382,fiorino_1027_gao__port_506217,classe_glk_1027_gao__port_506290,fortwo_1027_gao__port_506230,cruze_1027_gao__port_506186,107_1027_gao__port_506213,aygo_1027_gao__port_506248,rx_1027_gao__port_506354,500_1027_gao__port_506245,bora_1027_gao__port_506104,transit_1027_gao__port_506111,pt_cruiser_1027_gao__port_506054,patrol_1027_gao__port_506068,r8_1027_gao__port_506156,xm_1027_gao__port_506102,s60_1027_gao__port_506191,aveo_1027_gao__port_506158,captiva_1027_gao__port_506159,ax_1027_gao__port_506153,rexton_1027_gao__port_506107,camaro_1027_gao__port_506056,ypsilon_1027_gao__port_506131,delta_1027_gao__port_506165,c4_1027_gao__port_506370,zx_1027_gao__port_506161,verso_1027_gao__port_506242,superb_1027_gao__port_506327,r5_1027_gao__port_506253,caddy_1027_gao__port_506330,x5_1027_gao__port_506243,f_type_1027_gao__port_506231,fusion_1027_gao__port_506096,dokker_1027_gao__port_506331,205_1027_gao__port_506062,macan_1027_gao__port_506195,tourneo_1027_gao__port_506369,108_1027_gao__port_506384,9_3_1027_gao__port_506071,mondeo_1027_gao__port_506116,cr_v_1027_gao__port_506164,c30_1027_gao__port_506090,pulsar_1027_gao__port_506397,ibiza_1027_gao__port_506273,a1_1027_gao__port_506338,matrix_1027_gao__port_506140,carnival_1027_gao__port_506136,xantia_1027_gao__port_506086,terrano_1027_gao__port_506083,q3_1027_gao__port_506275,hr_v_1027_gao__port_506283,expert_1027_gao__port_506142,multivan_1027_gao__port_506383,venga_1027_gao__port_506380,scudo_1027_gao__port_506129,laguna_1027_gao__port_506368,vel_satis_1027_gao__port_506130,b_max_1027_gao__port_506367,ignis_1027_gao__port_506292,159_1027_gao__port_506064,grande_punto_1027_gao__port_506138,logan_1027_gao__port_506167,s_max_1027_gao__port_506223,caravelle_1027_gao__port_506351,adam_1027_gao__port_506079,406_1027_gao__port_506132,q30_1027_gao__port_506293,almera_1027_gao__port_506089,corsa_1027_gao__port_506095,corolla_1027_gao__port_506120,xc60_1027_gao__port_506388,viano_1027_gao__port_506211,pro_cee_d_1027_gao__port_506274,a3_1027_gao__port_506321,v50_1027_gao__port_506150,voyager_1027_gao__port_506169,corvette_1027_gao__port_506049,rio_1027_gao__port_506379,jazz_1027_gao__port_506252,200_1027_gao__port_506112,tts_1027_gao__port_506199,zafira_1027_gao__port_506287,asx_1027_gao__port_506266,607_1027_gao__port_506118,207_1027_gao__port_506103,classe_s_1027_gao__port_506301,c6_1027_gao__port_506105,express_1027_gao__port_506137,classe_gla_1027_gao__port_506352,v60_1027_gao__port_506333,ka_1027_gao__port_506180,range_rover_1027_gao__port_506254,discovery_1027_gao__port_506375,classe_r_1027_gao__port_506270,transporter_1027_gao__port_506319,cee_d_1027_gao__port_506288,zoe_1027_gao__port_506244,i20_1027_gao__port_506284,gtv_1027_gao__port_506059,s4_avant_1027_gao__port_506261,x1_1027_gao__port_506372,autres_1027_gao__port_506127,208_1027_gao__port_506359,c8_1027_gao__port_506135,astra_1027_gao__port_506215,2_1027_gao__port_506151,doblo_1027_gao__port_506251,807_1027_gao__port_506152,206_1027_gao__port_506126,a7_1027_gao__port_506373,renegade_1027_gao__port_506346', 'svm_portfolios_learning': '506302,506374,506399,506192,506205,506350,506052,506295,506066,506117,506065,506125,506387,506381,506349,506328,506377,506286,506124,506172,506206,506178,506371,506076,506114,506329,506122,506220,506174,506224,506232,506234,506173,506181,506323,506326,506376,506048,506400,506179,506311,506325,506402,506051,506294,506318,506303,506175,506099,506061,506337,506250,506082,506166,506133,506308,506078,506340,506310,506100,506121,506070,506218,506227,506272,506147,506160,506265,506202,506222,506093,506257,506208,506344,506077,506395,506094,506219,506298,506339,506343,506365,506200,506348,506198,506385,506239,506236,506391,506087,506342,506149,506184,506393,506203,506280,506216,506403,506355,506332,506259,506401,506357,506324,506098,506315,506335,506088,506046,506185,506171,506080,506345,506347,506067,506233,506225,506312,506278,506300,506258,506182,506226,506262,506146,506113,506108,506297,506322,506143,506363,506073,506154,506313,506189,506197,506162,506249,506139,506237,506336,506084,506109,506106,506045,506392,506247,506316,506201,506353,506305,506050,506145,506362,506101,506128,506044,506317,506074,506134,506196,506194,506285,506177,506240,506282,506396,506281,506264,506276,506144,506069,506091,506081,506168,506291,506238,506072,506085,506235,506193,506268,506148,506356,506386,506229,506256,506187,506110,506304,506115,506214,506334,506289,506361,506366,506204,506190,506188,506307,506055,506389,506364,506279,506241,506057,506063,506320,506212,506263,506394,506306,506260,506309,506221,506155,506176,506398,506360,506210,506341,506209,506170,506097,506119,506163,506092,506267,506246,506047,506296,506058,506269,506378,506123,506271,506277,506207,506141,506390,506314,506299,506075,506183,506157,506228,506255,506358,506053,506060,506382,506217,506290,506230,506186,506213,506248,506354,506245,506104,506111,506054,506068,506156,506102,506191,506158,506159,506153,506107,506056,506131,506165,506370,506161,506242,506327,506253,506330,506243,506231,506096,506331,506062,506195,506369,506384,506071,506116,506164,506090,506397,506273,506338,506140,506136,506086,506083,506275,506283,506142,506383,506380,506129,506368,506130,506367,506292,506064,506138,506167,506223,506351,506079,506132,506293,506089,506095,506120,506388,506211,506274,506321,506150,506169,506049,506379,506252,506112,506199,506287,506266,506118,506103,506301,506105,506137,506352,506333,506180,506254,506375,506270,506319,506288,506244,506284,506059,506261,506372,506127,506359,506135,506215,506151,506251,506152,506126,506373,506346', 'photo_hashtag_type': 332, 'photo_desc_type': 3390, 'type_classification': 'caffe', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 3390 SELECT * FROM MTRDatou.photo_desc_type_params WHERE id in (3390) FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (3390, 'car_360_1027', 16384, 25088, 'car_360_1027', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2017, 10, 28, 12, 29, 27), datetime.datetime(2017, 10, 28, 12, 29, 27)) To loadFromThcl() : net_3390 begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 6717 max_wait_temp : 1 max_wait : 0 SELECT * FROM MTRDatou.photo_desc_type_params WHERE id in (3390) FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (3390, 'car_360_1027', 16384, 25088, 'car_360_1027', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2017, 10, 28, 12, 29, 27), datetime.datetime(2017, 10, 28, 12, 29, 27)) param : , param.caffemodel : car_360_1027 None mean_file_type : mean_file_path : prototxt_file_path : model : car_360_1027 Inside get_net Inside get_net before cache_data_model model_param file didn't exist Inside get_net before CDM.load_model_par_type model_name : car_360_1027 model_type : caffe list file need : ['caffemodel', 'deploy_conv_normal.prototxt', 'deploy_fc.prototxt', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file exist in s3 : ['caffemodel', 'deploy_conv_normal.prototxt', 'deploy_fc.prototxt', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file manque in s3 : [] local folder : /data/models_weight/car_360_1027 /data/models_weight/car_360_1027/caffemodel size_local : 542944640 size in s3 : 542944640 create time local : 2021-08-09 05:28:34 create time in s3 : 2021-08-06 17:57:43 caffemodel already exist and didn't need to update /data/models_weight/car_360_1027/deploy_conv_normal.prototxt size_local : 4626 size in s3 : 4626 create time local : 2021-08-09 05:28:34 create time in s3 : 2021-08-06 17:57:42 deploy_conv_normal.prototxt already exist and didn't need to update /data/models_weight/car_360_1027/deploy_fc.prototxt size_local : 1132 size in s3 : 1132 create time local : 2021-08-09 05:28:34 create time in s3 : 2021-08-06 17:57:43 deploy_fc.prototxt already exist and didn't need to update /data/models_weight/car_360_1027/deploy.prototxt size_local : 5654 size in s3 : 5654 create time local : 2021-08-09 05:28:34 create time in s3 : 2021-08-06 17:57:42 deploy.prototxt already exist and didn't need to update /data/models_weight/car_360_1027/mean.npy size_local : 1572944 size in s3 : 1572944 create time local : 2021-08-09 05:28:34 create time in s3 : 2021-08-06 17:57:55 mean.npy already exist and didn't need to update /data/models_weight/car_360_1027/synset_words.txt size_local : 13687 size in s3 : 13687 create time local : 2021-08-09 05:28:34 create time in s3 : 2021-08-06 17:57:43 synset_words.txt already exist and didn't need to update Inside get_net after CDM.load_model_par_type After if not only_with_local_cache: /home/admin/workarea/install/caffe_cuda8_python3/python/:/home/admin/workarea/install/darknet/:/home/admin/workarea/git/Velours/python:/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python:/home/admin/mtr/.credentials:/home/admin/workarea/install/caffe/python:/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools/:/home/admin/workarea/git/fotonowerpip/:/home/admin/workarea/install/segment-anything:/home/admin//workarea/git/pyfvs/ Here before set mode gpu Doing nothing but we could set mode gpu after set mode gpu prototxt_filename : /data/models_weight/car_360_1027/deploy.prototxt caffemodel_filename : /data/models_weight/car_360_1027/caffemodel now we set caffe to gpu mode before predict begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 6717 max_wait_temp : 1 max_wait : 0 dict_keys(['prob', 'pool5']) time used to do the prepocess of the images : 0.01614069938659668 time used to do the prediction : 0.1285228729248047 save descriptor for thcl : 355 (1, 512, 7, 7) Got the blobs of the net to insert : [0, 0, 0, 0, 0, 0, 0, 0, 0, 0] code_as_byte_string:b'0000000000'| time to traite the descriptors : 0.050314903259277344 Testing : ['916235064'] In select_photos_meta_from_ids: SELECT photo_id, url, FROM_UNIXTIME(uploaded_at), latitude, longitude, text FROM MTRBack.photos WHERE photo_id IN (916235064) Catched exception ! Connect or reconnect ! result : {916235064: {'photo_id': 916235064, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2017/10/14/6293d1bb790dc6902450e7c572b7d10b.jpg', 'latitude': 0.0, 'longitude': 0.0, 'text': None}} list_photo_exists : [916235064] storage_type for insertDescriptorsMulti : 1 To insert : 916235064 Catched exception ! Connect or reconnect ! Error ! (1205, 'Lock wait timeout exceeded; try restarting transaction') time to insert the descriptors : 58.481403827667236 After datou_step_exec type output : map_portfolio_photo : len 0 keys : dict_keys([]) Inside saveOutput : final : False verbose : True time used to find the portfolios of the photos select button_legend_list from MTRDatou.classification_theme where id = 355 SAVE THCL, output : {'916235064': [[('916235064', 'c_elysee_1027_gao__port_506302', 0.0018818459, 332, '355'), ('916235064', 'mokka_1027_gao__port_506374', 0.0011633802, 332, '355'), ('916235064', 'captur_1027_gao__port_506399', 0.00081585767, 332, '355'), ('916235064', 'sorento_1027_gao__port_506192', 0.001177218, 332, '355'), ('916235064', 'navara_1027_gao__port_506205', 0.0025852483, 332, '355'), ('916235064', 'xc90_1027_gao__port_506350', 0.004172124, 332, '355'), ('916235064', 'saxo_1027_gao__port_506052', 0.0034800153, 332, '355'), ('916235064', 'trafic_1027_gao__port_506295', 0.0073657124, 332, '355'), ('916235064', 'punto_evo_1027_gao__port_506066', 0.0021884309, 332, '355'), ('916235064', '5_1027_gao__port_506117', 0.0005797675, 332, '355'), ('916235064', '250_1027_gao__port_506065', 0.004591528, 332, '355'), ('916235064', 'd_max_1027_gao__port_506125', 0.003159003, 332, '355'), ('916235064', 'panamera_1027_gao__port_506387', 0.002251211, 332, '355'), ('916235064', 'alhambra_1027_gao__port_506381', 0.0053199683, 332, '355'), ('916235064', 'x6_1027_gao__port_506349', 0.0011002539, 332, '355'), ('916235064', 'vitara_1027_gao__port_506328', 0.005401414, 332, '355'), ('916235064', 'fiesta_1027_gao__port_506377', 0.0039190976, 332, '355'), ('916235064', 'qashqai_1027_gao__port_506286', 0.0014787024, 332, '355'), ('916235064', '147_1027_gao__port_506124', 0.001978365, 332, '355'), ('916235064', 'c5_1027_gao__port_506172', 0.0012441602, 332, '355'), ('916235064', 'q5_1027_gao__port_506206', 0.0015051432, 332, '355'), ('916235064', 'giulia_1027_gao__port_506178', 0.0021702624, 332, '355'), ('916235064', 'karl_1027_gao__port_506371', 0.0027089226, 332, '355'), ('916235064', 'mehari_1027_gao__port_506076', 0.004702556, 332, '355'), ('916235064', '911_1027_gao__port_506114', 0.0019424001, 332, '355'), ('916235064', '508_1027_gao__port_506329', 0.0009587339, 332, '355'), ('916235064', 'idea_1027_gao__port_506122', 0.0007699078, 332, '355'), ('916235064', 'megane_1027_gao__port_506220', 0.001947014, 332, '355'), ('916235064', 'ghibli_1027_gao__port_506174', 0.0013729697, 332, '355'), ('916235064', 'touareg_1027_gao__port_506224', 0.0016205292, 332, '355'), ('916235064', 'i10_1027_gao__port_506232', 0.0013924416, 332, '355'), ('916235064', 'jumper_1027_gao__port_506234', 0.010041308, 332, '355'), ('916235064', 'classe_clk_1027_gao__port_506173', 0.0010793279, 332, '355'), ('916235064', 'kuga_1027_gao__port_506181', 0.0008447081, 332, '355'), ('916235064', 'ct_1027_gao__port_506323', 0.0012521509, 332, '355'), ('916235064', 'leon_1027_gao__port_506326', 0.0025848965, 332, '355'), ('916235064', 'ds5_1027_gao__port_506376', 0.0012429934, 332, '355'), ('916235064', 'cordoba_1027_gao__port_506048', 0.0028649278, 332, '355'), ('916235064', 'classe_cla_1027_gao__port_506400', 0.0012950462, 332, '355'), ('916235064', 'jumpy_1027_gao__port_506179', 0.010335465, 332, '355'), ('916235064', 'avensis_1027_gao__port_506311', 0.0018771206, 332, '355'), ('916235064', 'juke_1027_gao__port_506325', 0.0011346036, 332, '355'), ('916235064', '4008_1027_gao__port_506402', 0.0015760906, 332, '355'), ('916235064', '190_series_1027_gao__port_506051', 0.003980021, 332, '355'), ('916235064', 'serie_3_1027_gao__port_506294', 0.0028745937, 332, '355'), ('916235064', 'q7_1027_gao__port_506318', 0.0023357423, 332, '355'), ('916235064', 'glc_1027_gao__port_506303', 0.0012112366, 332, '355'), ('916235064', 'grand_vitara_1027_gao__port_506175', 0.0011447711, 332, '355'), ('916235064', 's40_1027_gao__port_506099', 0.0022342403, 332, '355'), ('916235064', 'toledo_1027_gao__port_506061', 0.0017467113, 332, '355'), ('916235064', '5008_1027_gao__port_506337', 0.004699372, 332, '355'), ('916235064', 'continental_1027_gao__port_506250', 0.0021925198, 332, '355'), ('916235064', 'coupe_1027_gao__port_506082', 0.002263097, 332, '355'), ('916235064', 'iq_1027_gao__port_506166', 0.0018171074, 332, '355'), ('916235064', '407_1027_gao__port_506133', 0.00090567983, 332, '355'), ('916235064', 'touran_1027_gao__port_506308', 0.0020400246, 332, '355'), ('916235064', '300c_1027_gao__port_506078', 0.0025333876, 332, '355'), ('916235064', 'classe_gl_1027_gao__port_506340', 0.004489513, 332, '355'), ('916235064', 'vivaro_1027_gao__port_506310', 0.0034245506, 332, '355'), ('916235064', 'sl_1027_gao__port_506100', 0.0031357133, 332, '355'), ('916235064', 'elise_1027_gao__port_506121', 0.0010257986, 332, '355'), ('916235064', '1007_1027_gao__port_506070', 0.0015351297, 332, '355'), ('916235064', 'i40_1027_gao__port_506218', 0.00059146405, 332, '355'), ('916235064', 'bipper_tepee_1027_gao__port_506227', 0.0040307157, 332, '355'), ('916235064', 'focus_1027_gao__port_506272', 0.001158712, 332, '355'), ('916235064', 'primera_1027_gao__port_506147', 0.001215494, 332, '355'), ('916235064', 'r4_1027_gao__port_506160', 0.014968789, 332, '355'), ('916235064', 'a8_1027_gao__port_506265', 0.0011321252, 332, '355'), ('916235064', 'boxer_1027_gao__port_506202', 0.010540452, 332, '355'), ('916235064', 's5_1027_gao__port_506222', 0.0011988844, 332, '355'), ('916235064', 'r21_1027_gao__port_506093', 0.0041846572, 332, '355'), ('916235064', 'c3_1027_gao__port_506257', 0.0023635454, 332, '355'), ('916235064', 'santa_fe_1027_gao__port_506208', 0.0016325855, 332, '355'), ('916235064', 'm4_1027_gao__port_506344', 0.0015573069, 332, '355'), ('916235064', 'safrane_1027_gao__port_506077', 0.001395554, 332, '355'), ('916235064', 'classe_gle_1027_gao__port_506395', 0.0021982074, 332, '355'), ('916235064', '0_1027_gao__port_506094', 0.008829086, 332, '355'), ('916235064', 'ix35_1027_gao__port_506219', 0.0014613521, 332, '355'), ('916235064', 'carens_1027_gao__port_506298', 0.00088247895, 332, '355'), ('916235064', 'classe_a_1027_gao__port_506339', 0.0024707916, 332, '355'), ('916235064', 'ix20_1027_gao__port_506343', 0.0010092391, 332, '355'), ('916235064', 'note_1027_gao__port_506365', 0.0015965098, 332, '355'), ('916235064', 'a5_1027_gao__port_506200', 0.0015333149, 332, '355'), ('916235064', 'sx4_1027_gao__port_506348', 0.0014915518, 332, '355'), ('916235064', 'sandero_1027_gao__port_506198', 0.0014587687, 332, '355'), ('916235064', '3008_1027_gao__port_506385', 0.0056454996, 332, '355'), ('916235064', 'q50_1027_gao__port_506239', 0.0011165348, 332, '355'), ('916235064', 'latitude_1027_gao__port_506236', 0.0008018903, 332, '355'), ('916235064', 'v40_1027_gao__port_506391', 0.0017147185, 332, '355'), ('916235064', 'xsara_1027_gao__port_506087', 0.000982348, 332, '355'), ('916235064', 'grand_c_max_1027_gao__port_506342', 0.0017956819, 332, '355'), ('916235064', 'swift_1027_gao__port_506149', 0.0015019798, 332, '355'), ('916235064', 'serie_1_1027_gao__port_506184', 0.0015144085, 332, '355'), ('916235064', 'xc70_1027_gao__port_506393', 0.0036204509, 332, '355'), ('916235064', 'master_1027_gao__port_506203', 0.007955671, 332, '355'), ('916235064', 'clio_1027_gao__port_506280', 0.0029581208, 332, '355'), ('916235064', 'duster_1027_gao__port_506216', 0.00074436184, 332, '355'), ('916235064', 'traveller_1027_gao__port_506403', 0.0042934897, 332, '355'), ('916235064', 'tipo_1027_gao__port_506355', 0.0010932067, 332, '355'), ('916235064', 'rav_4_1027_gao__port_506332', 0.0013604457, 332, '355'), ('916235064', 'coccinelle_1027_gao__port_506259', 0.0034950632, 332, '355'), ('916235064', 'spacetourer_1027_gao__port_506401', 0.0030963356, 332, '355'), ('916235064', 'xe_1027_gao__port_506357', 0.0014476352, 332, '355'), ('916235064', 'ds3_1027_gao__port_506324', 0.001309358, 332, '355'), ('916235064', 'mx_5_1027_gao__port_506098', 0.002589712, 332, '355'), ('916235064', 'land_cruiser_1027_gao__port_506315', 0.00953079, 332, '355'), ('916235064', 'classe_b_1027_gao__port_506335', 0.0017215029, 332, '355'), ('916235064', '806_1027_gao__port_506088', 0.002561644, 332, '355'), ('916235064', 'rx_8_1027_gao__port_506046', 0.003623827, 332, '355'), ('916235064', 'spark_1027_gao__port_506185', 0.0010077556, 332, '355'), ('916235064', '6_1027_gao__port_506171', 0.0011183724, 332, '355'), ('916235064', 'bravo_1027_gao__port_506080', 0.0014652095, 332, '355'), ('916235064', 'nx_1027_gao__port_506345', 0.0013685883, 332, '355'), ('916235064', 'sharan_1027_gao__port_506347', 0.005092448, 332, '355'), ('916235064', 'x_type_1027_gao__port_506067', 0.00078037824, 332, '355'), ('916235064', 'jimny_1027_gao__port_506233', 0.004605999, 332, '355'), ('916235064', 'wrangler_1027_gao__port_506225', 0.0017995241, 332, '355'), ('916235064', 'c_crosser_1027_gao__port_506312', 0.0015929595, 332, '355'), ('916235064', 'v70_1027_gao__port_506278', 0.0019680823, 332, '355'), ('916235064', 'classe_e_1027_gao__port_506300', 0.0017370965, 332, '355'), ('916235064', 'classe_v_1027_gao__port_506258', 0.012730353, 332, '355'), ('916235064', 'm3_1027_gao__port_506182', 0.002338079, 332, '355'), ('916235064', 'abarth_500_1027_gao__port_506226', 0.004044769, 332, '355'), ('916235064', 'serie_6_1027_gao__port_506262', 0.0011321165, 332, '355'), ('916235064', 'modus_1027_gao__port_506146', 0.0018291577, 332, '355'), ('916235064', '3_1027_gao__port_506113', 0.0015083979, 332, '355'), ('916235064', '405_1027_gao__port_506108', 0.008053965, 332, '355'), ('916235064', 'allroad_1027_gao__port_506297', 0.0010598573, 332, '355'), ('916235064', 'auris_1027_gao__port_506322', 0.0011523543, 332, '355'), ('916235064', 'galaxy_1027_gao__port_506143', 0.002514357, 332, '355'), ('916235064', 'giulietta_1027_gao__port_506363', 0.0008652968, 332, '355'), ('916235064', '106_1027_gao__port_506073', 0.008268587, 332, '355'), ('916235064', 'classe_m_1027_gao__port_506154', 0.0030014038, 332, '355'), ('916235064', 'espace_1027_gao__port_506313', 0.0010645754, 332, '355'), ('916235064', 'panda_1027_gao__port_506189', 0.009029863, 332, '355'), ('916235064', 'rcz_1027_gao__port_506197', 0.00112965, 332, '355'), ('916235064', '4007_1027_gao__port_506162', 0.00067929487, 332, '355'), ('916235064', 'classe_cl_1027_gao__port_506249', 0.001085951, 332, '355'), ('916235064', 'leaf_1027_gao__port_506139', 0.0018033804, 332, '355'), ('916235064', 'octavia_1027_gao__port_506237', 0.001860204, 332, '355'), ('916235064', 'ds4_1027_gao__port_506336', 0.0024161513, 332, '355'), ('916235064', 'freelander_1027_gao__port_506084', 0.0023471527, 332, '355'), ('916235064', 'evasion_1027_gao__port_506109', 0.003113938, 332, '355'), ('916235064', 'punto_1027_gao__port_506106', 0.0019492968, 332, '355'), ('916235064', '2cv_1027_gao__port_506045', 0.007973663, 332, '355'), ('916235064', 'x4_1027_gao__port_506392', 0.0017953702, 332, '355'), ('916235064', 'antara_1027_gao__port_506247', 0.0012471718, 332, '355'), ('916235064', 'murano_1027_gao__port_506316', 0.00060882384, 332, '355'), ('916235064', 'alto_1027_gao__port_506201', 0.0092321765, 332, '355'), ('916235064', 'meriva_1027_gao__port_506353', 0.0013765957, 332, '355'), ('916235064', 'orlando_1027_gao__port_506305', 0.0018463947, 332, '355'), ('916235064', 'new_beetle_1027_gao__port_506050', 0.001163701, 332, '355'), ('916235064', '306_1027_gao__port_506145', 0.0035068605, 332, '355'), ('916235064', 'tiguan_1027_gao__port_506362', 0.0026825825, 332, '355'), ('916235064', 's_type_1027_gao__port_506101', 0.0011385313, 332, '355'), ('916235064', 'c1_1027_gao__port_506128', 0.0027514447, 332, '355'), ('916235064', 'vectra_1027_gao__port_506044', 0.0011989236, 332, '355'), ('916235064', 'outlander_1027_gao__port_506317', 0.0017126013, 332, '355'), ('916235064', '307_1027_gao__port_506074', 0.0020013188, 332, '355'), ('916235064', 'a6_s6_1027_gao__port_506134', 0.0016573755, 332, '355'), ('916235064', 'nemo_combi_1027_gao__port_506196', 0.002266694, 332, '355'), ('916235064', 'berlingo_1027_gao__port_506194', 0.004663429, 332, '355'), ('916235064', 'partner_1027_gao__port_506285', 0.0039408654, 332, '355'), ('916235064', 'cayenne_1027_gao__port_506177', 0.003799044, 332, '355'), ('916235064', 'quattroporte_1027_gao__port_506240', 0.0024446321, 332, '355'), ('916235064', 'c_max_1027_gao__port_506282', 0.0013124144, 332, '355'), ('916235064', 'fabia_1027_gao__port_506396', 0.005299154, 332, '355'), ('916235064', 'cx_3_1027_gao__port_506281', 0.0014464402, 332, '355'), ('916235064', 'x_trail_1027_gao__port_506264', 0.0018312613, 332, '355'), ('916235064', 'scirocco_1027_gao__port_506276', 0.0047918987, 332, '355'), ('916235064', 'matiz_1027_gao__port_506144', 0.0017560394, 332, '355'), ('916235064', 'tigra_1027_gao__port_506069', 0.00085433543, 332, '355'), ('916235064', 'escort_1027_gao__port_506091', 0.004839542, 332, '355'), ('916235064', 'c2_1027_gao__port_506081', 0.0014905573, 332, '355'), ('916235064', 'mini_1027_gao__port_506168', 0.001192198, 332, '355'), ('916235064', 'i30_1027_gao__port_506291', 0.00063261745, 332, '355'), ('916235064', 'picanto_1027_gao__port_506238', 0.002975051, 332, '355'), ('916235064', 'mito_1027_gao__port_506072', 0.00150818, 332, '355'), ('916235064', 'impreza_1027_gao__port_506085', 0.002019473, 332, '355'), ('916235064', 'kangoo_1027_gao__port_506235', 0.0065844413, 332, '355'), ('916235064', 'a4_1027_gao__port_506193', 0.0019878373, 332, '355'), ('916235064', 'cayman_1027_gao__port_506268', 0.0018145904, 332, '355'), ('916235064', 'sportage_1027_gao__port_506148', 0.0014273971, 332, '355'), ('916235064', 'up_1027_gao__port_506356', 0.0068629626, 332, '355'), ('916235064', 'optima_1027_gao__port_506386', 0.00089187705, 332, '355'), ('916235064', 'defender_1027_gao__port_506229', 0.00671989, 332, '355'), ('916235064', 'serie_2_1027_gao__port_506256', 0.002228245, 332, '355'), ('916235064', 'edge_1027_gao__port_506187', 0.00087474263, 332, '355'), ('916235064', 'r19_1027_gao__port_506110', 0.004942177, 332, '355'), ('916235064', 'jetta_1027_gao__port_506304', 0.0036195198, 332, '355'), ('916235064', 'eos_1027_gao__port_506115', 0.00389262, 332, '355'), ('916235064', 'accord_1027_gao__port_506214', 0.002013153, 332, '355'), ('916235064', 'yaris_1027_gao__port_506334', 0.0032337043, 332, '355'), ('916235064', 'classe_cls_1027_gao__port_506289', 0.00078522245, 332, '355'), ('916235064', 'polo_1027_gao__port_506361', 0.0043107923, 332, '355'), ('916235064', 'serie_4_1027_gao__port_506366', 0.001147977, 332, '355'), ('916235064', 'mini_cabriolet_1027_gao__port_506204', 0.00083780166, 332, '355'), ('916235064', 'prius_1027_gao__port_506190', 0.0011489823, 332, '355'), ('916235064', 'lodgy_1027_gao__port_506188', 0.0020177069, 332, '355'), ('916235064', 'serie_7_1027_gao__port_506307', 0.001248023, 332, '355'), ('916235064', 'c15_1027_gao__port_506055', 0.017704977, 332, '355'), ('916235064', 'kadjar_1027_gao__port_506389', 0.0012508971, 332, '355'), ('916235064', 'insignia_1027_gao__port_506364', 0.0016438252, 332, '355'), ('916235064', '308_1027_gao__port_506279', 0.0021240395, 332, '355'), ('916235064', 'roomster_1027_gao__port_506241', 0.0018015137, 332, '355'), ('916235064', '80_1027_gao__port_506057', 0.0046138493, 332, '355'), ('916235064', '309_1027_gao__port_506063', 0.013523393, 332, '355'), ('916235064', 'tucson_1027_gao__port_506320', 0.002123675, 332, '355'), ('916235064', 'x3_1027_gao__port_506212', 0.00089791697, 332, '355'), ('916235064', 'xf_1027_gao__port_506263', 0.0011170743, 332, '355'), ('916235064', '2008_1027_gao__port_506394', 0.0026419489, 332, '355'), ('916235064', 'passat_1027_gao__port_506306', 0.0014975345, 332, '355'), ('916235064', 'compass_1027_gao__port_506260', 0.0032563622, 332, '355'), ('916235064', 'twingo_1027_gao__port_506309', 0.0065000295, 332, '355'), ('916235064', 'micra_1027_gao__port_506221', 0.0035867258, 332, '355'), ('916235064', 'golf_1027_gao__port_506155', 0.0031929996, 332, '355'), ('916235064', 'soul_1027_gao__port_506176', 0.0012890648, 332, '355'), ('916235064', 'rapid_1027_gao__port_506398', 0.0025915494, 332, '355'), ('916235064', 'forester_1027_gao__port_506360', 0.0022760774, 332, '355'), ('916235064', 'slk_1027_gao__port_506210', 0.0015845458, 332, '355'), ('916235064', 'forfour_1027_gao__port_506341', 0.0021801228, 332, '355'), ('916235064', 'serie_5_1027_gao__port_506209', 0.0013697603, 332, '355'), ('916235064', 'xj_1027_gao__port_506170', 0.0026017872, 332, '355'), ('916235064', 'pajero_1027_gao__port_506097', 0.0052104313, 332, '355'), ('916235064', 'agila_1027_gao__port_506119', 0.0048496127, 332, '355'), ('916235064', 'a6_1027_gao__port_506163', 0.001891263, 332, '355'), ('916235064', 'fox_1027_gao__port_506092', 0.0008464592, 332, '355'), ('916235064', 'boxster_1027_gao__port_506267', 0.0015946812, 332, '355'), ('916235064', 'altea_1027_gao__port_506246', 0.0021396924, 332, '355'), ('916235064', 'samurai_1027_gao__port_506047', 0.0062493277, 332, '355'), ('916235064', 'trax_1027_gao__port_506296', 0.0019440075, 332, '355'), ('916235064', 'getz_1027_gao__port_506058', 0.0016383564, 332, '355'), ('916235064', 'cherokee_1027_gao__port_506269', 0.0029810395, 332, '355'), ('916235064', 'koleos_1027_gao__port_506378', 0.0015591932, 332, '355'), ('916235064', 'z_series_1027_gao__port_506123', 0.0016566606, 332, '355'), ('916235064', 'ecosport_1027_gao__port_506271', 0.0013230657, 332, '355'), ('916235064', 'space_star_1027_gao__port_506277', 0.002114577, 332, '355'), ('916235064', 'rs3_sportback_1027_gao__port_506207', 0.0019125191, 332, '355'), ('916235064', 'civic_1027_gao__port_506141', 0.0026899702, 332, '355'), ('916235064', 'talisman_1027_gao__port_506390', 0.00076144346, 332, '355'), ('916235064', 'f_pace_1027_gao__port_506314', 0.0016168508, 332, '355'), ('916235064', 'classe_c_1027_gao__port_506299', 0.0017946889, 332, '355'), ('916235064', 'tt_1027_gao__port_506075', 0.0013937595, 332, '355'), ('916235064', 'pathfinder_1027_gao__port_506183', 0.0016514243, 332, '355'), ('916235064', '156_1027_gao__port_506157', 0.0015448101, 332, '355'), ('916235064', 'cx_5_1027_gao__port_506228', 0.0014418025, 332, '355'), ('916235064', 'scenic_1027_gao__port_506255', 0.0016084961, 332, '355'), ('916235064', 'yeti_1027_gao__port_506358', 0.0020913507, 332, '355'), ('916235064', 'mustang_1027_gao__port_506053', 0.010053856, 332, '355'), ('916235064', 'stilo_1027_gao__port_506060', 0.0010833016, 332, '355'), ('916235064', 'ateca_1027_gao__port_506382', 0.0017009579, 332, '355'), ('916235064', 'fiorino_1027_gao__port_506217', 0.009199695, 332, '355'), ('916235064', 'classe_glk_1027_gao__port_506290', 0.0017017132, 332, '355'), ('916235064', 'fortwo_1027_gao__port_506230', 0.0016011284, 332, '355'), ('916235064', 'cruze_1027_gao__port_506186', 0.0010053917, 332, '355'), ('916235064', '107_1027_gao__port_506213', 0.0016280592, 332, '355'), ('916235064', 'aygo_1027_gao__port_506248', 0.0032425788, 332, '355'), ('916235064', 'rx_1027_gao__port_506354', 0.0010633111, 332, '355'), ('916235064', '500_1027_gao__port_506245', 0.0016359419, 332, '355'), ('916235064', 'bora_1027_gao__port_506104', 0.0038170696, 332, '355'), ('916235064', 'transit_1027_gao__port_506111', 0.0048604147, 332, '355'), ('916235064', 'pt_cruiser_1027_gao__port_506054', 0.0019170406, 332, '355'), ('916235064', 'patrol_1027_gao__port_506068', 0.0042387126, 332, '355'), ('916235064', 'r8_1027_gao__port_506156', 0.0012725756, 332, '355'), ('916235064', 'xm_1027_gao__port_506102', 0.0022671907, 332, '355'), ('916235064', 's60_1027_gao__port_506191', 0.003199839, 332, '355'), ('916235064', 'aveo_1027_gao__port_506158', 0.0038410125, 332, '355'), ('916235064', 'captiva_1027_gao__port_506159', 0.0017191969, 332, '355'), ('916235064', 'ax_1027_gao__port_506153', 0.006895143, 332, '355'), ('916235064', 'rexton_1027_gao__port_506107', 0.0013020593, 332, '355'), ('916235064', 'camaro_1027_gao__port_506056', 0.0024909033, 332, '355'), ('916235064', 'ypsilon_1027_gao__port_506131', 0.0019549974, 332, '355'), ('916235064', 'delta_1027_gao__port_506165', 0.0014000811, 332, '355'), ('916235064', 'c4_1027_gao__port_506370', 0.0013006722, 332, '355'), ('916235064', 'zx_1027_gao__port_506161', 0.004593432, 332, '355'), ('916235064', 'verso_1027_gao__port_506242', 0.0007719911, 332, '355'), ('916235064', 'superb_1027_gao__port_506327', 0.0019940494, 332, '355'), ('916235064', 'r5_1027_gao__port_506253', 0.009544694, 332, '355'), ('916235064', 'caddy_1027_gao__port_506330', 0.013822748, 332, '355'), ('916235064', 'x5_1027_gao__port_506243', 0.0011204727, 332, '355'), ('916235064', 'f_type_1027_gao__port_506231', 0.0008300259, 332, '355'), ('916235064', 'fusion_1027_gao__port_506096', 0.0012669386, 332, '355'), ('916235064', 'dokker_1027_gao__port_506331', 0.005359079, 332, '355'), ('916235064', '205_1027_gao__port_506062', 0.0066845077, 332, '355'), ('916235064', 'macan_1027_gao__port_506195', 0.0015576736, 332, '355'), ('916235064', 'tourneo_1027_gao__port_506369', 0.006400589, 332, '355'), ('916235064', '108_1027_gao__port_506384', 0.005264336, 332, '355'), ('916235064', '9_3_1027_gao__port_506071', 0.0008376543, 332, '355'), ('916235064', 'mondeo_1027_gao__port_506116', 0.0014397795, 332, '355'), ('916235064', 'cr_v_1027_gao__port_506164', 0.0016414701, 332, '355'), ('916235064', 'c30_1027_gao__port_506090', 0.0017486655, 332, '355'), ('916235064', 'pulsar_1027_gao__port_506397', 0.001201991, 332, '355'), ('916235064', 'ibiza_1027_gao__port_506273', 0.003722766, 332, '355'), ('916235064', 'a1_1027_gao__port_506338', 0.0012350014, 332, '355'), ('916235064', 'matrix_1027_gao__port_506140', 0.00070774334, 332, '355'), ('916235064', 'carnival_1027_gao__port_506136', 0.0022811654, 332, '355'), ('916235064', 'xantia_1027_gao__port_506086', 0.0021955136, 332, '355'), ('916235064', 'terrano_1027_gao__port_506083', 0.0020291298, 332, '355'), ('916235064', 'q3_1027_gao__port_506275', 0.0011265147, 332, '355'), ('916235064', 'hr_v_1027_gao__port_506283', 0.0017807867, 332, '355'), ('916235064', 'expert_1027_gao__port_506142', 0.007368306, 332, '355'), ('916235064', 'multivan_1027_gao__port_506383', 0.006503771, 332, '355'), ('916235064', 'venga_1027_gao__port_506380', 0.0008004101, 332, '355'), ('916235064', 'scudo_1027_gao__port_506129', 0.0055913352, 332, '355'), ('916235064', 'laguna_1027_gao__port_506368', 0.00071344286, 332, '355'), ('916235064', 'vel_satis_1027_gao__port_506130', 0.0027267225, 332, '355'), ('916235064', 'b_max_1027_gao__port_506367', 0.0017248014, 332, '355'), ('916235064', 'ignis_1027_gao__port_506292', 0.0043563773, 332, '355'), ('916235064', '159_1027_gao__port_506064', 0.001078533, 332, '355'), ('916235064', 'grande_punto_1027_gao__port_506138', 0.0023636003, 332, '355'), ('916235064', 'logan_1027_gao__port_506167', 0.0043979906, 332, '355'), ('916235064', 's_max_1027_gao__port_506223', 0.0012523289, 332, '355'), ('916235064', 'caravelle_1027_gao__port_506351', 0.003028958, 332, '355'), ('916235064', 'adam_1027_gao__port_506079', 0.0010539597, 332, '355'), ('916235064', '406_1027_gao__port_506132', 0.0013575398, 332, '355'), ('916235064', 'q30_1027_gao__port_506293', 0.00097158505, 332, '355'), ('916235064', 'almera_1027_gao__port_506089', 0.0010240347, 332, '355'), ('916235064', 'corsa_1027_gao__port_506095', 0.0025205328, 332, '355'), ('916235064', 'corolla_1027_gao__port_506120', 0.0026823368, 332, '355'), ('916235064', 'xc60_1027_gao__port_506388', 0.0018992792, 332, '355'), ('916235064', 'viano_1027_gao__port_506211', 0.0026939136, 332, '355'), ('916235064', 'pro_cee_d_1027_gao__port_506274', 0.0008320473, 332, '355'), ('916235064', 'a3_1027_gao__port_506321', 0.0037388634, 332, '355'), ('916235064', 'v50_1027_gao__port_506150', 0.00079203135, 332, '355'), ('916235064', 'voyager_1027_gao__port_506169', 0.0030527744, 332, '355'), ('916235064', 'corvette_1027_gao__port_506049', 0.0037234158, 332, '355'), ('916235064', 'rio_1027_gao__port_506379', 0.0017740888, 332, '355'), ('916235064', 'jazz_1027_gao__port_506252', 0.0015304439, 332, '355'), ('916235064', '200_1027_gao__port_506112', 0.0040873825, 332, '355'), ('916235064', 'tts_1027_gao__port_506199', 0.0011865238, 332, '355'), ('916235064', 'zafira_1027_gao__port_506287', 0.0026951723, 332, '355'), ('916235064', 'asx_1027_gao__port_506266', 0.0011408638, 332, '355'), ('916235064', '607_1027_gao__port_506118', 0.0012528275, 332, '355'), ('916235064', '207_1027_gao__port_506103', 0.0015146217, 332, '355'), ('916235064', 'classe_s_1027_gao__port_506301', 0.0031658355, 332, '355'), ('916235064', 'c6_1027_gao__port_506105', 0.0017347718, 332, '355'), ('916235064', 'express_1027_gao__port_506137', 0.016715702, 332, '355'), ('916235064', 'classe_gla_1027_gao__port_506352', 0.0018258479, 332, '355'), ('916235064', 'v60_1027_gao__port_506333', 0.0021467013, 332, '355'), ('916235064', 'ka_1027_gao__port_506180', 0.0014153888, 332, '355'), ('916235064', 'range_rover_1027_gao__port_506254', 0.0020547144, 332, '355'), ('916235064', 'discovery_1027_gao__port_506375', 0.0022963895, 332, '355'), ('916235064', 'classe_r_1027_gao__port_506270', 0.0013943058, 332, '355'), ('916235064', 'transporter_1027_gao__port_506319', 0.011967189, 332, '355'), ('916235064', 'cee_d_1027_gao__port_506288', 0.0010549219, 332, '355'), ('916235064', 'zoe_1027_gao__port_506244', 0.0020710444, 332, '355'), ('916235064', 'i20_1027_gao__port_506284', 0.0017868287, 332, '355'), ('916235064', 'gtv_1027_gao__port_506059', 0.005724468, 332, '355'), ('916235064', 's4_avant_1027_gao__port_506261', 0.00276719, 332, '355'), ('916235064', 'x1_1027_gao__port_506372', 0.0017147087, 332, '355'), ('916235064', 'autres_1027_gao__port_506127', 0.004825939, 332, '355'), ('916235064', '208_1027_gao__port_506359', 0.0018692842, 332, '355'), ('916235064', 'c8_1027_gao__port_506135', 0.0012579211, 332, '355'), ('916235064', 'astra_1027_gao__port_506215', 0.0012627457, 332, '355'), ('916235064', '2_1027_gao__port_506151', 0.0009246356, 332, '355'), ('916235064', 'doblo_1027_gao__port_506251', 0.007465212, 332, '355'), ('916235064', '807_1027_gao__port_506152', 0.0007288994, 332, '355'), ('916235064', '206_1027_gao__port_506126', 0.0010386669, 332, '355'), ('916235064', 'a7_1027_gao__port_506373', 0.0006913095, 332, '355'), ('916235064', 'renegade_1027_gao__port_506346', 0.0021420084, 332, '355')]]} begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 0 insert into MTRPhoto.class_photo_score (thcl, photo_id, hashtag_id, score) values (%s,%s,%s,%s) on duplicate key update score = values(score) time used for this insertion : 6.67572021484375e-06 save missing photos in datou_result : time spend for datou_step_exec : 63.496795654296875 time spend to save output : 33.84990072250366 total time spend for step 1 : 97.34669637680054 step2:argmax Mon Apr 14 03:57:21 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec After prepare type args : Here we display some param of map_info ! map_filenames : {'temp/1744595744_648272_916235064_6293d1bb790dc6902450e7c572b7d10b.jpg': 916235064} map_photo_id_path_extension : {916235064: {'path': 'temp/1744595744_648272_916235064_6293d1bb790dc6902450e7c572b7d10b.jpg', 'extension': 'jpg'}} map_subphoto_mainphoto : {} Beginning of datou_step Argmax ! calculate argmax for thcl : 355 After datou_step_exec type output : map_portfolio_photo : len 0 keys : dict_keys([]) Inside saveOutput : final : True verbose : True photo_id : 916235064 output[photo_id] : [('916235064', 'c15_1027_gao__port_506055', 0.017704977, 332, '355'), 'temp/1744595744_648272_916235064_6293d1bb790dc6902450e7c572b7d10b.jpg'] begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 1 insert ignore into MTRBack.photo_hashtag_ids (photo_id, hashtag_id, type) values (%s,%s,%s) insert ignore into MTRBack.photo_hashtag_ids (photo_id, hashtag_id, type) values (%s,%s,%s) first line : ('916235064', '2049863950', '332') ... last line : ('916235064', '2049863950', '332') time used for this insertion : 1.199150562286377 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 1 insert into MTRPhoto.class_photo_score (thcl, photo_id, hashtag_id, score) values (%s,%s,%s,%s) on duplicate key update score = values(score) Catched exception ! Connect or reconnect ! In save_photo_hashtag_id_thcl_score : (1205, 'Lock wait timeout exceeded; try restarting transaction') [('355', '916235064', '2049863950', '0.017704977')] time used for this insertion : 55.134809494018555 len list_finale : 1, len picture : 1 begin to insert list_values into mtr_datou_result : length of list_values in save_final : 1 insert ignore into MTRPhoto.mtr_datou_result (mtd_id, mtr_portfolio_id,mtr_photo_id,result,result_long,result_double,hashtag_id,proba, mtr_current_id) values (%s,%s,%s,%s,%s,%s,%s,%s,%s) on duplicate key update mtr_portfolio_id = mtr_portfolio_id list_values : [('2', None, '916235064', 'c15_1027_gao__port_506055', None, None, '2049863950', '0.017704977', None)] time used for this insertion : 0.7272632122039795 saving photo_ids in datou_result photo id not in port begin to insert list_values into mtr_datou_result : length of list_values in save_final : 0 insert ignore into MTRPhoto.mtr_datou_result (mtd_id, mtr_portfolio_id,mtr_photo_id,result,result_long,result_double,hashtag_id,proba, mtr_current_id) values (%s,%s,%s,%s,%s,%s,%s,%s,%s) on duplicate key update mtr_portfolio_id = mtr_portfolio_id list_values : [] time used for this insertion : 4.5299530029296875e-06 save missing photos in datou_result : time spend for datou_step_exec : 0.00019693374633789062 time spend to save output : 57.06153869628906 total time spend for step 2 : 57.0617356300354 caffe_path_current : About to save ! 2 After save, about to update current ! datou_cur_ids : [] len(datou.list_steps) : 2 output : {'916235064': [('916235064', 'c15_1027_gao__port_506055', 0.017704977, 332, '355'), 'temp/1744595744_648272_916235064_6293d1bb790dc6902450e7c572b7d10b.jpg']} ############################### TEST tfhub2 ################################ TEST TFHUB2 ######################## test with use_multi_inputs=0 ######################## Inside batchDatouExec : verbose : True ##### chargement datou SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4567 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4567 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4567 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4567 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : step 12835 tfhub_classification2 is not linked in the step_by_step architecture ! WARNING : step 12836 argmax is not linked in the step_by_step architecture ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! DataTypes for each output/input checked ! no param json to modify List Step Type Loaded in datou : tfhub_classification2, argmax list_input_json : [] ##### fin chargement datou ##### chargement data ##### Call load_data_input : nb_thread : 5 origin SELECT photo_id, url FROM MTRBack.photos ph WHERE photo_id IN (1171252784,1171252764,1171252487) Found this number of photos: 3 ##### Call download_photos : nb_thread : 5 begin to download photo : 1171252487 begin to download photo : 1171252764 begin to download photo : 1171252784 download finish for photo 1171252784 download finish for photo 1171252764 download finish for photo 1171252487 we have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB ##### After download_photos length of list_filenames : 3 ; length of list_pids : 3 ; length of list_args : 3 ##### After load_data_input time to download the photos : 1.2517194747924805 #### fin chargement data Blocking on flush ? No conitnuing About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : True number of steps : 2 step1:tfhub_classification2 Mon Apr 14 03:58:20 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec After prepare type args : Here we display some param of map_info ! map_filenames : {'temp/1744595899_648272_1171252784_5a3c5d3bb155a7a116f67ded51bffb59.jpg': 1171252784, 'temp/1744595899_648272_1171252764_29d5179a892cc50aadc9d67245534b59.jpg': 1171252764, 'temp/1744595899_648272_1171252487_5ebdd6b0a6bb39942a3808ed114806de.jpg': 1171252487} map_photo_id_path_extension : {1171252784: {'path': 'temp/1744595899_648272_1171252784_5a3c5d3bb155a7a116f67ded51bffb59.jpg', 'extension': 'jpg'}, 1171252764: {'path': 'temp/1744595899_648272_1171252764_29d5179a892cc50aadc9d67245534b59.jpg', 'extension': 'jpg'}, 1171252487: {'path': 'temp/1744595899_648272_1171252487_5ebdd6b0a6bb39942a3808ed114806de.jpg', 'extension': 'jpg'}} map_subphoto_mainphoto : {} Beginning of datou_step TFHub with tf2 ! multi_thcl or not :False multi_thcl_cond or not :False dic_thcl : {'3609': 1} we are using the classfication for only one thcl 3609 begin to check gpu status inside check gpu memory 2025-04-14 03:58:23.106820: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-04-14 03:58:23.107563: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-04-14 03:58:23.107649: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-04-14 03:58:23.107697: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-04-14 03:58:23.113055: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-04-14 03:58:23.113128: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-04-14 03:58:23.116225: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-04-14 03:58:23.117621: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-04-14 03:58:23.123604: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-04-14 03:58:23.125059: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-04-14 03:58:23.125480: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-04-14 03:58:23.159120: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-04-14 03:58:23.161163: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f0e6c000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-04-14 03:58:23.161210: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-04-14 03:58:23.164856: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x24da5270 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-04-14 03:58:23.164888: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-04-14 03:58:23.166089: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-04-14 03:58:23.166213: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-04-14 03:58:23.166244: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-04-14 03:58:23.166332: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-04-14 03:58:23.166371: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-04-14 03:58:23.166419: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-04-14 03:58:23.166470: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-04-14 03:58:23.166522: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-04-14 03:58:23.168258: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-04-14 03:58:23.168334: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-04-14 03:58:23.168396: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-04-14 03:58:23.168412: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-04-14 03:58:23.168424: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-04-14 03:58:23.170205: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 3096 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) l 3637 free memory gpu now : 6717 max_wait_temp : 1 max_wait : 5 1 Physical GPUs, 1 Logical GPUs tagging for thcl : 3609 To do loadFromThcl(), then load ParamDescType : thcl3609 get_desc_type_from_thcl : type of cat SELECT id, mtr_user_id, name, pb_hashtag_id, hashtag_id_list, button_legend_list, portfolio_id_lists, photo_hashtag_type, photo_desc_type, svm_limit, limit_tagging, is_public, live, created_at, updated_at, type_classification FROM MTRDatou.classification_theme WHERE `id` IN (3609) thcls : [{'id': 3609, 'mtr_user_id': 31, 'name': 'tfhub_19_06_2023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'jrm,pcm,pcnc,pehd,tapis_vide', 'svm_portfolios_learning': '9336903,9336904,9336905,9336906,9336909', 'photo_hashtag_type': 4674, 'photo_desc_type': 5832, 'type_classification': 'tf_classification2', 'hashtag_id_list': '495916461,560181804,1284539308,628944319,2107748999'}] thcl {'id': 3609, 'mtr_user_id': 31, 'name': 'tfhub_19_06_2023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'jrm,pcm,pcnc,pehd,tapis_vide', 'svm_portfolios_learning': '9336903,9336904,9336905,9336906,9336909', 'photo_hashtag_type': 4674, 'photo_desc_type': 5832, 'type_classification': 'tf_classification2', 'hashtag_id_list': '495916461,560181804,1284539308,628944319,2107748999'} Update svm_hashtag_type_desc : 5832 SELECT * FROM MTRDatou.photo_desc_type_params WHERE id in (5832) FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5832, 'tfhub_19_06_2023', 1280, 1280, 'tfhub_19_06_2023', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2023, 6, 19, 12, 55, 22), datetime.datetime(2023, 6, 19, 12, 55, 22)) model_name : tfhub_19_06_2023 model_param file didn't exist model_name : tfhub_19_06_2023 model_type : tf_classification2 list file need : ['Confusion_Matrix.png', 'Precision_Recall_jrm.jpg', 'Precision_Recall_pcm.jpg', 'Precision_Recall_pcnc.jpg', 'Precision_Recall_pehd.jpg', 'Precision_Recall_tapis_vide.jpg', 'Result_Summary.txt', 'checkpoint', 'model_checkpoint.ckpt.data-00000-of-00002', 'model_checkpoint.ckpt.data-00001-of-00002', 'model_checkpoint.ckpt.index', 'model_weights.h5'] file exist in s3 : ['Confusion_Matrix.png', 'Precision_Recall_jrm.jpg', 'Precision_Recall_pcm.jpg', 'Precision_Recall_pcnc.jpg', 'Precision_Recall_pehd.jpg', 'Precision_Recall_tapis_vide.jpg', 'Result_Summary.txt', 'checkpoint', 'model_checkpoint.ckpt.data-00000-of-00002', 'model_checkpoint.ckpt.data-00001-of-00002', 'model_checkpoint.ckpt.index', 'model_weights.h5'] file manque in s3 : [] /home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python/../../tools/../lib/rpn/proposal_layer.py:28: YAMLLoadWarning: calling yaml.load() without Loader=... is deprecated, as the default Loader is unsafe. Please read https://msg.pyyaml.org/load for full details. layer_params = yaml.load(self.param_str_) local folder : /data/models_weight/tfhub_19_06_2023 /data/models_weight/tfhub_19_06_2023/Confusion_Matrix.png size_local : 57753 size in s3 : 57753 create time local : 2023-06-22 17:09:38 create time in s3 : 2023-06-19 10:55:15 Confusion_Matrix.png already exist and didn't need to update /data/models_weight/tfhub_19_06_2023/Precision_Recall_jrm.jpg size_local : 79724 size in s3 : 79724 create time local : 2023-06-22 17:09:38 create time in s3 : 2023-06-19 10:55:20 Precision_Recall_jrm.jpg already exist and didn't need to update /data/models_weight/tfhub_19_06_2023/Precision_Recall_pcm.jpg size_local : 83556 size in s3 : 83556 create time local : 2023-06-22 17:09:38 create time in s3 : 2023-06-19 10:55:15 Precision_Recall_pcm.jpg already exist and didn't need to update /data/models_weight/tfhub_19_06_2023/Precision_Recall_pcnc.jpg size_local : 74107 size in s3 : 74107 create time local : 2023-06-22 17:09:38 create time in s3 : 2023-06-19 10:55:20 Precision_Recall_pcnc.jpg already exist and didn't need to update /data/models_weight/tfhub_19_06_2023/Precision_Recall_pehd.jpg size_local : 72705 size in s3 : 72705 create time local : 2023-06-22 17:09:39 create time in s3 : 2023-06-19 10:55:20 Precision_Recall_pehd.jpg already exist and didn't need to update /data/models_weight/tfhub_19_06_2023/Precision_Recall_tapis_vide.jpg size_local : 70874 size in s3 : 70874 create time local : 2023-06-22 17:09:39 create time in s3 : 2023-06-19 10:55:15 Precision_Recall_tapis_vide.jpg already exist and didn't need to update /data/models_weight/tfhub_19_06_2023/Result_Summary.txt size_local : 642 size in s3 : 642 create time local : 2023-06-22 17:09:39 create time in s3 : 2023-06-19 10:55:22 Result_Summary.txt already exist and didn't need to update /data/models_weight/tfhub_19_06_2023/checkpoint size_local : 99 size in s3 : 99 create time local : 2023-06-22 17:09:39 create time in s3 : 2023-06-19 10:55:22 checkpoint already exist and didn't need to update /data/models_weight/tfhub_19_06_2023/model_checkpoint.ckpt.data-00000-of-00002 size_local : 216488 size in s3 : 216488 create time local : 2023-06-22 17:09:39 create time in s3 : 2023-06-19 10:55:22 model_checkpoint.ckpt.data-00000-of-00002 already exist and didn't need to update /data/models_weight/tfhub_19_06_2023/model_checkpoint.ckpt.data-00001-of-00002 size_local : 32279708 size in s3 : 32279708 create time local : 2023-06-22 17:09:40 create time in s3 : 2023-06-19 10:55:21 model_checkpoint.ckpt.data-00001-of-00002 already exist and didn't need to update /data/models_weight/tfhub_19_06_2023/model_checkpoint.ckpt.index size_local : 43546 size in s3 : 43546 create time local : 2023-06-22 17:09:40 create time in s3 : 2023-06-19 10:55:22 model_checkpoint.ckpt.index already exist and didn't need to update /data/models_weight/tfhub_19_06_2023/model_weights.h5 size_local : 16499144 size in s3 : 16499144 create time local : 2023-06-22 17:09:40 create time in s3 : 2023-06-19 10:55:15 model_weights.h5 already exist and didn't need to update desc size : 1280 Model: "sequential" _________________________________________________________________ Layer (type) Output Shape Param # ================================================================= module (KerasLayer) (None, 1280) 4049564 _________________________________________________________________ tfhub_19_06_2023dense (Dense (None, 5) 6405 ================================================================= Total params: 4,055,969 Trainable params: 6,405 Non-trainable params: 4,049,564 _________________________________________________________________ Loading Weights... time used to create the model : 8.449483156204224 time used to load_weights : 0.13631558418273926 0it [00:00, ?it/s] 3it [00:00, 677.56it/s]2025-04-14 03:58:34.639186: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 temp/1744595899_648272_1171252784_5a3c5d3bb155a7a116f67ded51bffb59.jpg temp/1744595899_648272_1171252764_29d5179a892cc50aadc9d67245534b59.jpg temp/1744595899_648272_1171252487_5ebdd6b0a6bb39942a3808ed114806de.jpg Found 3 images belonging to 1 classes. begin to do the prediction : time used to do the prediction : 3.0268633365631104 ['temp/image000000000_1744595899_648272_1171252784_5a3c5d3bb155a7a116f67ded51bffb59.jpg', 'temp/image000000001_1744595899_648272_1171252764_29d5179a892cc50aadc9d67245534b59.jpg', 'temp/image000000002_1744595899_648272_1171252487_5ebdd6b0a6bb39942a3808ed114806de.jpg'] (3,) (3, 5) (3, 1280) shape of features : (3, 1280) shape of new features : (1, 3, 1280) save descriptor for thcl : 3609 (3, 1280) Got the blobs of the net to insert : [0, 6, 0, 0, 1, 0, 0, 1, 0, 0] code_as_byte_string:b'0006000001'| Got the blobs of the net to insert : [0, 6, 0, 1, 0, 0, 0, 1, 0, 0] code_as_byte_string:b'0006000100'| Got the blobs of the net to insert : [0, 9, 0, 0, 0, 0, 1, 0, 0, 0] code_as_byte_string:b'0009000000'| time to traite the descriptors : 0.0314486026763916 Testing : ['1171252784', '1171252764', '1171252487'] In select_photos_meta_from_ids: SELECT photo_id, url, FROM_UNIXTIME(uploaded_at), latitude, longitude, text FROM MTRBack.photos WHERE photo_id IN (1171252784,1171252764,1171252487) result : {1171252487: {'photo_id': 1171252487, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2023/2/22/5ebdd6b0a6bb39942a3808ed114806de.jpg', 'latitude': 0.0, 'longitude': 0.0, 'text': 'image_22022023_21_55_35_005998m0.jpg 0.4259977941513062 for time 6.000020980834961, id_amount 3 this amount prod time diff : 0.006000020980834961'}, 1171252764: {'photo_id': 1171252764, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2023/2/22/29d5179a892cc50aadc9d67245534b59.jpg', 'latitude': 0.0, 'longitude': 0.0, 'text': 'image_22022023_21_55_41_005998m0.jpg 0.4319977941513062 for time 6.0, id_amount 3 this amount prod time diff : 0.006'}, 1171252784: {'photo_id': 1171252784, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2023/2/22/5a3c5d3bb155a7a116f67ded51bffb59.jpg', 'latitude': 0.0, 'longitude': 0.0, 'text': 'image_22022023_21_55_47_006033m0.jpg 0.4379978291988373 for time 6.000035047531128, id_amount 4 this amount prod time diff : 0.006000035047531128'}} list_photo_exists : [1171252487, 1171252764, 1171252784] storage_type for insertDescriptorsMulti : 3 To insert : 1171252784 To insert : 1171252764 To insert : 1171252487 Catched exception ! Connect or reconnect ! Error ! (1205, 'Lock wait timeout exceeded; try restarting transaction') time to insert the descriptors : 52.32743310928345 After datou_step_exec type output : map_portfolio_photo : len 0 keys : dict_keys([]) Inside saveOutput : final : False verbose : True saveOutput not yet implemented for datou_step.type : tfhub_classification2 we use saveGeneral [1171252784, 1171252764, 1171252487] map_info['map_portfolio_photo'] : {} final : False mtd_id 4567 list_pids : [1171252784, 1171252764, 1171252487] Looping around the photos to save general results len do output : 3 /1171252784Didn't retrieve data . /1171252764Didn't retrieve data . /1171252487Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4567', None, None, None, None, None, None, None, None) ('4567', None, '1171252784', None, None, None, None, None, None) ('4567', None, None, None, None, None, None, None, None) ('4567', None, '1171252764', None, None, None, None, None, None) ('4567', None, None, None, None, None, None, None, None) ('4567', None, '1171252487', None, None, None, None, None, None) begin to insert list_values into mtr_datou_result : length of list_values in save_final : 6 insert ignore into MTRPhoto.mtr_datou_result (mtd_id, mtr_portfolio_id,mtr_photo_id,result,result_long,result_double,hashtag_id,proba, mtr_current_id) values (%s,%s,%s,%s,%s,%s,%s,%s,%s) on duplicate key update mtr_portfolio_id = mtr_portfolio_id list_values : [('4567', None, '1171252784', 'None', None, None, None, None, None), ('4567', None, '1171252764', 'None', None, None, None, None, None), ('4567', None, '1171252487', 'None', None, None, None, None, None)] time used for this insertion : 0.12943649291992188 save_final save missing photos in datou_result : time spend for datou_step_exec : 69.85422253608704 time spend to save output : 0.1298673152923584 total time spend for step 1 : 69.9840898513794 step2:argmax Mon Apr 14 03:59:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec After prepare type args : Here we display some param of map_info ! map_filenames : {'temp/1744595899_648272_1171252784_5a3c5d3bb155a7a116f67ded51bffb59.jpg': 1171252784, 'temp/1744595899_648272_1171252764_29d5179a892cc50aadc9d67245534b59.jpg': 1171252764, 'temp/1744595899_648272_1171252487_5ebdd6b0a6bb39942a3808ed114806de.jpg': 1171252487} map_photo_id_path_extension : {1171252784: {'path': 'temp/1744595899_648272_1171252784_5a3c5d3bb155a7a116f67ded51bffb59.jpg', 'extension': 'jpg'}, 1171252764: {'path': 'temp/1744595899_648272_1171252764_29d5179a892cc50aadc9d67245534b59.jpg', 'extension': 'jpg'}, 1171252487: {'path': 'temp/1744595899_648272_1171252487_5ebdd6b0a6bb39942a3808ed114806de.jpg', 'extension': 'jpg'}} map_subphoto_mainphoto : {} Beginning of datou_step Argmax ! calculate argmax for thcl : 3609 After datou_step_exec type output : map_portfolio_photo : len 0 keys : dict_keys([]) Inside saveOutput : final : True verbose : True photo_id : 1171252784 output[photo_id] : [(1171252784, 'jrm', 0.96772, 4674, '3609'), 'temp/1744595899_648272_1171252784_5a3c5d3bb155a7a116f67ded51bffb59.jpg'] photo_id : 1171252764 output[photo_id] : [(1171252764, 'jrm', 0.98535824, 4674, '3609'), 'temp/1744595899_648272_1171252764_29d5179a892cc50aadc9d67245534b59.jpg'] photo_id : 1171252487 output[photo_id] : [(1171252487, 'jrm', 0.92630863, 4674, '3609'), 'temp/1744595899_648272_1171252487_5ebdd6b0a6bb39942a3808ed114806de.jpg'] begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 3 insert ignore into MTRBack.photo_hashtag_ids (photo_id, hashtag_id, type) values (%s,%s,%s) insert ignore into MTRBack.photo_hashtag_ids (photo_id, hashtag_id, type) values (%s,%s,%s) first line : ('1171252784', '495916461', '4674') ... last line : ('1171252487', '495916461', '4674') time used for this insertion : 1.6667628288269043 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 3 insert into MTRPhoto.class_photo_score (thcl, photo_id, hashtag_id, score) values (%s,%s,%s,%s) on duplicate key update score = values(score) Catched exception ! Connect or reconnect ! In save_photo_hashtag_id_thcl_score : (1205, 'Lock wait timeout exceeded; try restarting transaction') [('3609', '1171252784', '495916461', '0.96772'), ('3609', '1171252764', '495916461', '0.98535824'), ('3609', '1171252487', '495916461', '0.92630863')] time used for this insertion : 52.85622310638428 len list_finale : 3, len picture : 3 begin to insert list_values into mtr_datou_result : length of list_values in save_final : 3 insert ignore into MTRPhoto.mtr_datou_result (mtd_id, mtr_portfolio_id,mtr_photo_id,result,result_long,result_double,hashtag_id,proba, mtr_current_id) values (%s,%s,%s,%s,%s,%s,%s,%s,%s) on duplicate key update mtr_portfolio_id = mtr_portfolio_id list_values : [('4567', None, '1171252784', 'jrm', None, None, '495916461', '0.96772', None), ('4567', None, '1171252764', 'jrm', None, None, '495916461', '0.98535824', None), ('4567', None, '1171252487', 'jrm', None, None, '495916461', '0.92630863', None)] time used for this insertion : 0.08517813682556152 saving photo_ids in datou_result photo id not in port photo id not in port photo id not in port begin to insert list_values into mtr_datou_result : length of list_values in save_final : 0 insert ignore into MTRPhoto.mtr_datou_result (mtd_id, mtr_portfolio_id,mtr_photo_id,result,result_long,result_double,hashtag_id,proba, mtr_current_id) values (%s,%s,%s,%s,%s,%s,%s,%s,%s) on duplicate key update mtr_portfolio_id = mtr_portfolio_id list_values : [] time used for this insertion : 3.5762786865234375e-06 save missing photos in datou_result : time spend for datou_step_exec : 0.00018739700317382812 time spend to save output : 54.80655288696289 total time spend for step 2 : 54.806740283966064 caffe_path_current : About to save ! 2 After save, about to update current ! datou_cur_ids : [] len(datou.list_steps) : 2 output : {'1171252784': [(1171252784, 'jrm', 0.96772, 4674, '3609'), 'temp/1744595899_648272_1171252784_5a3c5d3bb155a7a116f67ded51bffb59.jpg'], '1171252764': [(1171252764, 'jrm', 0.98535824, 4674, '3609'), 'temp/1744595899_648272_1171252764_29d5179a892cc50aadc9d67245534b59.jpg'], '1171252487': [(1171252487, 'jrm', 0.92630863, 4674, '3609'), 'temp/1744595899_648272_1171252487_5ebdd6b0a6bb39942a3808ed114806de.jpg']} --------------------- test with use_multi_inputs=0 is succeded ------------------- ######################## test with use_multi_inputs=1 ######################## Inside batchDatouExec : verbose : True ##### chargement datou SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4621 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4621 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4621 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4621 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : step 12927 tfhub_classification2 is not linked in the step_by_step architecture ! WARNING : step 12928 argmax is not linked in the step_by_step architecture ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! DataTypes for each output/input checked ! no param json to modify List Step Type Loaded in datou : tfhub_classification2, argmax list_input_json : [] ##### fin chargement datou ##### chargement data ##### Call load_data_input : nb_thread : 5 origin SELECT photo_id, url FROM MTRBack.photos ph WHERE photo_id IN (1171291875,1171275372,1171275314) Found this number of photos: 3 ##### Call download_photos : nb_thread : 5 begin to download photo : 1171275314 begin to download photo : 1171275372 begin to download photo : 1171291875 download finish for photo 1171291875 download finish for photo 1171275372 download finish for photo 1171275314 we have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB ##### After download_photos length of list_filenames : 3 ; length of list_pids : 3 ; length of list_args : 3 ##### After load_data_input time to download the photos : 0.8517558574676514 #### fin chargement data Blocking on flush ? No conitnuing About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : True number of steps : 2 step1:tfhub_classification2 Mon Apr 14 04:00:25 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec After prepare type args : Here we display some param of map_info ! map_filenames : {'temp/1744596025_648272_1171291875_b62cd9e0d976b143f86fe82d072798c0.jpg': 1171291875, 'temp/1744596025_648272_1171275372_76d81364ff7df843bff095f45c07ba35.jpg': 1171275372, 'temp/1744596025_648272_1171275314_6e0a72c8fa00d5e4b018bd689b547133.jpg': 1171275314} map_photo_id_path_extension : {1171291875: {'path': 'temp/1744596025_648272_1171291875_b62cd9e0d976b143f86fe82d072798c0.jpg', 'extension': 'jpg'}, 1171275372: {'path': 'temp/1744596025_648272_1171275372_76d81364ff7df843bff095f45c07ba35.jpg', 'extension': 'jpg'}, 1171275314: {'path': 'temp/1744596025_648272_1171275314_6e0a72c8fa00d5e4b018bd689b547133.jpg', 'extension': 'jpg'}} map_subphoto_mainphoto : {} Beginning of datou_step TFHub with tf2 ! multi_thcl or not :False multi_thcl_cond or not :False dic_thcl : {'3655': 1} we are using the classfication for only one thcl 3655 begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 3165 max_wait_temp : 1 max_wait : 5 1 Physical GPUs, 1 Logical GPUs tagging for thcl : 3655 To do loadFromThcl(), then load ParamDescType : thcl3655 get_desc_type_from_thcl : type of cat SELECT id, mtr_user_id, name, pb_hashtag_id, hashtag_id_list, button_legend_list, portfolio_id_lists, photo_hashtag_type, photo_desc_type, svm_limit, limit_tagging, is_public, live, created_at, updated_at, type_classification FROM MTRDatou.classification_theme WHERE `id` IN (3655) thcls : [{'id': 3655, 'mtr_user_id': 31, 'name': 'tfhub_18_7_2023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'pcm,pcnc,jrm,pehd,tapis_vide', 'svm_portfolios_learning': '9336904,9336905,9336903,9336906,9336909', 'photo_hashtag_type': 4723, 'photo_desc_type': 5862, 'type_classification': 'tf_classification2', 'hashtag_id_list': '560181804,1284539308,495916461,628944319,2107748999'}] thcl {'id': 3655, 'mtr_user_id': 31, 'name': 'tfhub_18_7_2023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'pcm,pcnc,jrm,pehd,tapis_vide', 'svm_portfolios_learning': '9336904,9336905,9336903,9336906,9336909', 'photo_hashtag_type': 4723, 'photo_desc_type': 5862, 'type_classification': 'tf_classification2', 'hashtag_id_list': '560181804,1284539308,495916461,628944319,2107748999'} Update svm_hashtag_type_desc : 5862 SELECT * FROM MTRDatou.photo_desc_type_params WHERE id in (5862) FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5862, 'tfhub_18_7_2023', 1280, 1280, 'tfhub_18_7_2023', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2023, 7, 18, 22, 46, 29), datetime.datetime(2023, 7, 18, 22, 46, 29)) model_name : tfhub_18_7_2023 model_param file didn't exist model_name : tfhub_18_7_2023 model_type : tf_classification2 list file need : ['Confusion_Matrix.png', 'Precision_Recall_jrm.jpg', 'Precision_Recall_pcm.jpg', 'Precision_Recall_pcnc.jpg', 'Precision_Recall_pehd.jpg', 'Precision_Recall_tapis_vide.jpg', 'Result_Summary.txt', 'checkpoint', 'model_checkpoint.ckpt.data-00000-of-00002', 'model_checkpoint.ckpt.data-00001-of-00002', 'model_checkpoint.ckpt.index', 'model_weights.h5'] file exist in s3 : ['Confusion_Matrix.png', 'Precision_Recall_jrm.jpg', 'Precision_Recall_pcm.jpg', 'Precision_Recall_pcnc.jpg', 'Precision_Recall_pehd.jpg', 'Precision_Recall_tapis_vide.jpg', 'Result_Summary.txt', 'checkpoint', 'model_checkpoint.ckpt.data-00000-of-00002', 'model_checkpoint.ckpt.data-00001-of-00002', 'model_checkpoint.ckpt.index', 'model_weights.h5'] file manque in s3 : [] local folder : /data/models_weight/tfhub_18_7_2023 /data/models_weight/tfhub_18_7_2023/Confusion_Matrix.png size_local : 54360 size in s3 : 54360 create time local : 2023-08-11 11:22:56 create time in s3 : 2023-07-18 20:46:28 Confusion_Matrix.png already exist and didn't need to update /data/models_weight/tfhub_18_7_2023/Precision_Recall_jrm.jpg size_local : 72583 size in s3 : 72583 create time local : 2023-08-11 11:22:56 create time in s3 : 2023-07-18 20:46:23 Precision_Recall_jrm.jpg already exist and didn't need to update /data/models_weight/tfhub_18_7_2023/Precision_Recall_pcm.jpg size_local : 81681 size in s3 : 81681 create time local : 2023-08-11 11:22:56 create time in s3 : 2023-07-18 20:46:17 Precision_Recall_pcm.jpg already exist and didn't need to update /data/models_weight/tfhub_18_7_2023/Precision_Recall_pcnc.jpg size_local : 79510 size in s3 : 79510 create time local : 2023-08-11 11:22:56 create time in s3 : 2023-07-18 20:46:23 Precision_Recall_pcnc.jpg already exist and didn't need to update /data/models_weight/tfhub_18_7_2023/Precision_Recall_pehd.jpg size_local : 59936 size in s3 : 59936 create time local : 2023-08-11 11:22:57 create time in s3 : 2023-07-18 20:46:23 Precision_Recall_pehd.jpg already exist and didn't need to update /data/models_weight/tfhub_18_7_2023/Precision_Recall_tapis_vide.jpg size_local : 78974 size in s3 : 78974 create time local : 2023-08-11 11:22:57 create time in s3 : 2023-07-18 20:46:17 Precision_Recall_tapis_vide.jpg already exist and didn't need to update /data/models_weight/tfhub_18_7_2023/Result_Summary.txt size_local : 642 size in s3 : 642 create time local : 2023-08-11 11:22:57 create time in s3 : 2023-07-18 20:46:23 Result_Summary.txt already exist and didn't need to update /data/models_weight/tfhub_18_7_2023/checkpoint size_local : 99 size in s3 : 99 create time local : 2023-08-11 11:22:57 create time in s3 : 2023-07-18 20:46:23 checkpoint already exist and didn't need to update /data/models_weight/tfhub_18_7_2023/model_checkpoint.ckpt.data-00000-of-00002 size_local : 216529 size in s3 : 216529 create time local : 2023-08-11 11:22:57 create time in s3 : 2023-07-18 20:46:17 model_checkpoint.ckpt.data-00000-of-00002 already exist and didn't need to update /data/models_weight/tfhub_18_7_2023/model_checkpoint.ckpt.data-00001-of-00002 size_local : 32279748 size in s3 : 32279748 create time local : 2023-08-11 11:22:58 create time in s3 : 2023-07-18 20:46:19 model_checkpoint.ckpt.data-00001-of-00002 already exist and didn't need to update /data/models_weight/tfhub_18_7_2023/model_checkpoint.ckpt.index size_local : 43546 size in s3 : 43546 create time local : 2023-08-11 11:22:58 create time in s3 : 2023-07-18 20:46:19 model_checkpoint.ckpt.index already exist and didn't need to update /data/models_weight/tfhub_18_7_2023/model_weights.h5 size_local : 16500868 size in s3 : 16500868 create time local : 2023-08-11 11:22:58 create time in s3 : 2023-07-18 20:46:18 model_weights.h5 already exist and didn't need to update desc size : 1280 Model: "model" __________________________________________________________________________________________________ Layer (type) Output Shape Param # Connected to ================================================================================================== input_1 (InputLayer) [(None, 224, 224, 3) 0 __________________________________________________________________________________________________ input_2 (InputLayer) [(None, 1)] 0 __________________________________________________________________________________________________ module (KerasLayer) (None, 1280) 4049564 input_1[0][0] __________________________________________________________________________________________________ concatenate (Concatenate) (None, 1281) 0 input_2[0][0] module[0][0] __________________________________________________________________________________________________ tfhub_18_7_2023dense (Dense) (None, 5) 6410 concatenate[0][0] ================================================================================================== Total params: 4,055,974 Trainable params: 0 Non-trainable params: 4,055,974 __________________________________________________________________________________________________ Loading Weights... time used to create the model : 7.2696051597595215 time used to load_weights : 0.12855100631713867 found 3 data found 0 labels begin to do the prediction : time used to do the prediction : 1.0886595249176025 ['temp/1744596025_648272_1171291875_b62cd9e0d976b143f86fe82d072798c0.jpg', 'temp/1744596025_648272_1171275372_76d81364ff7df843bff095f45c07ba35.jpg', 'temp/1744596025_648272_1171275314_6e0a72c8fa00d5e4b018bd689b547133.jpg'] (3,) (3, 5) (3, 1280) shape of features : (3, 1280) shape of new features : (1, 3, 1280) save descriptor for thcl : 3655 (3, 1280) Got the blobs of the net to insert : [0, 1, 0, 0, 11, 0, 2, 2, 0, 0] code_as_byte_string:b'000100000b'| Got the blobs of the net to insert : [0, 0, 0, 0, 14, 0, 1, 4, 0, 0] code_as_byte_string:b'000000000e'| Got the blobs of the net to insert : [0, 0, 0, 0, 8, 0, 0, 0, 3, 0] code_as_byte_string:b'0000000008'| time to traite the descriptors : 0.03711271286010742 Testing : ['1171291875', '1171275372', '1171275314'] In select_photos_meta_from_ids: SELECT photo_id, url, FROM_UNIXTIME(uploaded_at), latitude, longitude, text FROM MTRBack.photos WHERE photo_id IN (1171291875,1171275372,1171275314) result : {1171275314: {'photo_id': 1171275314, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2023/2/23/6e0a72c8fa00d5e4b018bd689b547133.jpg', 'latitude': 0.0, 'longitude': 0.0, 'text': 'image_22022023_23_54_22_6187.jpg'}, 1171275372: {'photo_id': 1171275372, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2023/2/23/76d81364ff7df843bff095f45c07ba35.jpg', 'latitude': 0.0, 'longitude': 0.0, 'text': 'image_22022023_23_56_46_6098.jpg'}, 1171291875: {'photo_id': 1171291875, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2023/2/23/b62cd9e0d976b143f86fe82d072798c0.jpg', 'latitude': 0.0, 'longitude': 0.0, 'text': 'image_22022023_23_59_04_5803.jpg'}} list_photo_exists : [1171275314, 1171275372, 1171291875] storage_type for insertDescriptorsMulti : 3 To insert : 1171291875 To insert : 1171275372 To insert : 1171275314 Catched exception ! Connect or reconnect ! Error ! (1205, 'Lock wait timeout exceeded; try restarting transaction') time to insert the descriptors : 58.258647203445435 After datou_step_exec type output : map_portfolio_photo : len 0 keys : dict_keys([]) Inside saveOutput : final : False verbose : True saveOutput not yet implemented for datou_step.type : tfhub_classification2 we use saveGeneral [1171291875, 1171275372, 1171275314] map_info['map_portfolio_photo'] : {} final : False mtd_id 4621 list_pids : [1171291875, 1171275372, 1171275314] Looping around the photos to save general results len do output : 3 /1171291875Didn't retrieve data . /1171275372Didn't retrieve data . /1171275314Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4621', None, None, None, None, None, None, None, None) ('4621', None, '1171291875', None, None, None, None, None, None) ('4621', None, None, None, None, None, None, None, None) ('4621', None, '1171275372', None, None, None, None, None, None) ('4621', None, None, None, None, None, None, None, None) ('4621', None, '1171275314', None, None, None, None, None, None) begin to insert list_values into mtr_datou_result : length of list_values in save_final : 6 insert ignore into MTRPhoto.mtr_datou_result (mtd_id, mtr_portfolio_id,mtr_photo_id,result,result_long,result_double,hashtag_id,proba, mtr_current_id) values (%s,%s,%s,%s,%s,%s,%s,%s,%s) on duplicate key update mtr_portfolio_id = mtr_portfolio_id list_values : [('4621', None, '1171291875', 'None', None, None, None, None, None), ('4621', None, '1171275372', 'None', None, None, None, None, None), ('4621', None, '1171275314', 'None', None, None, None, None, None)] time used for this insertion : 0.013706207275390625 save_final save missing photos in datou_result : time spend for datou_step_exec : 70.3453299999237 time spend to save output : 0.014088630676269531 total time spend for step 1 : 70.35941863059998 step2:argmax Mon Apr 14 04:01:36 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec After prepare type args : Here we display some param of map_info ! map_filenames : {'temp/1744596025_648272_1171291875_b62cd9e0d976b143f86fe82d072798c0.jpg': 1171291875, 'temp/1744596025_648272_1171275372_76d81364ff7df843bff095f45c07ba35.jpg': 1171275372, 'temp/1744596025_648272_1171275314_6e0a72c8fa00d5e4b018bd689b547133.jpg': 1171275314} map_photo_id_path_extension : {1171291875: {'path': 'temp/1744596025_648272_1171291875_b62cd9e0d976b143f86fe82d072798c0.jpg', 'extension': 'jpg'}, 1171275372: {'path': 'temp/1744596025_648272_1171275372_76d81364ff7df843bff095f45c07ba35.jpg', 'extension': 'jpg'}, 1171275314: {'path': 'temp/1744596025_648272_1171275314_6e0a72c8fa00d5e4b018bd689b547133.jpg', 'extension': 'jpg'}} map_subphoto_mainphoto : {} Beginning of datou_step Argmax ! calculate argmax for thcl : 3655 After datou_step_exec type output : map_portfolio_photo : len 0 keys : dict_keys([]) Inside saveOutput : final : True verbose : True photo_id : 1171291875 output[photo_id] : [(1171291875, 'tapis_vide', 0.9707772, 4723, '3655'), 'temp/1744596025_648272_1171291875_b62cd9e0d976b143f86fe82d072798c0.jpg'] photo_id : 1171275372 output[photo_id] : [(1171275372, 'tapis_vide', 0.9673375, 4723, '3655'), 'temp/1744596025_648272_1171275372_76d81364ff7df843bff095f45c07ba35.jpg'] photo_id : 1171275314 output[photo_id] : [(1171275314, 'tapis_vide', 0.9651328, 4723, '3655'), 'temp/1744596025_648272_1171275314_6e0a72c8fa00d5e4b018bd689b547133.jpg'] begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 3 insert ignore into MTRBack.photo_hashtag_ids (photo_id, hashtag_id, type) values (%s,%s,%s) insert ignore into MTRBack.photo_hashtag_ids (photo_id, hashtag_id, type) values (%s,%s,%s) first line : ('1171291875', '2107748999', '4723') ... last line : ('1171275314', '2107748999', '4723') time used for this insertion : 1.2567400932312012 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 3 insert into MTRPhoto.class_photo_score (thcl, photo_id, hashtag_id, score) values (%s,%s,%s,%s) on duplicate key update score = values(score) Catched exception ! Connect or reconnect ! In save_photo_hashtag_id_thcl_score : (1205, 'Lock wait timeout exceeded; try restarting transaction') [('3655', '1171291875', '2107748999', '0.9707772'), ('3655', '1171275372', '2107748999', '0.9673375'), ('3655', '1171275314', '2107748999', '0.9651328')] time used for this insertion : 54.56632208824158 len list_finale : 3, len picture : 3 begin to insert list_values into mtr_datou_result : length of list_values in save_final : 3 insert ignore into MTRPhoto.mtr_datou_result (mtd_id, mtr_portfolio_id,mtr_photo_id,result,result_long,result_double,hashtag_id,proba, mtr_current_id) values (%s,%s,%s,%s,%s,%s,%s,%s,%s) on duplicate key update mtr_portfolio_id = mtr_portfolio_id list_values : [('4621', None, '1171291875', 'tapis_vide', None, None, '2107748999', '0.9707772', None), ('4621', None, '1171275372', 'tapis_vide', None, None, '2107748999', '0.9673375', None), ('4621', None, '1171275314', 'tapis_vide', None, None, '2107748999', '0.9651328', None)] time used for this insertion : 0.23493337631225586 saving photo_ids in datou_result photo id not in port photo id not in port photo id not in port begin to insert list_values into mtr_datou_result : length of list_values in save_final : 0 insert ignore into MTRPhoto.mtr_datou_result (mtd_id, mtr_portfolio_id,mtr_photo_id,result,result_long,result_double,hashtag_id,proba, mtr_current_id) values (%s,%s,%s,%s,%s,%s,%s,%s,%s) on duplicate key update mtr_portfolio_id = mtr_portfolio_id list_values : [] time used for this insertion : 4.0531158447265625e-06 save missing photos in datou_result : time spend for datou_step_exec : 0.00013971328735351562 time spend to save output : 56.06226062774658 total time spend for step 2 : 56.062400341033936 caffe_path_current : About to save ! 2 After save, about to update current ! datou_cur_ids : [] len(datou.list_steps) : 2 output : {'1171291875': [(1171291875, 'tapis_vide', 0.9707772, 4723, '3655'), 'temp/1744596025_648272_1171291875_b62cd9e0d976b143f86fe82d072798c0.jpg'], '1171275372': [(1171275372, 'tapis_vide', 0.9673375, 4723, '3655'), 'temp/1744596025_648272_1171275372_76d81364ff7df843bff095f45c07ba35.jpg'], '1171275314': [(1171275314, 'tapis_vide', 0.9651328, 4723, '3655'), 'temp/1744596025_648272_1171275314_6e0a72c8fa00d5e4b018bd689b547133.jpg']} --------------------- test with use_multi_inputs=1 is succeded ------------------- ############################### TEST ordonner ################################ To do loadFromThcl(), then load ParamDescType : thcl358 get_desc_type_from_thcl : type of cat SELECT id, mtr_user_id, name, pb_hashtag_id, hashtag_id_list, button_legend_list, portfolio_id_lists, photo_hashtag_type, photo_desc_type, svm_limit, limit_tagging, is_public, live, created_at, updated_at, type_classification FROM MTRDatou.classification_theme WHERE `id` IN (358) thcls : [{'id': 358, 'mtr_user_id': 31, 'name': 'car_orientation_0111', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'FirstUploadExperveo_vignette__port_505674,CAR_EXTERIEUR_Roue__port_503398,FirstUploadExperveo_carrosseriegrosplan_VIndanslamoquette__port_506486,FirstUploadExperveo_carrosseriegrosplan_siegegrosplan__port_506485,CAR_EXTERIEUR_Cote_droit_axe_avant__port_504465,CAR_EXTERIEUR_Cote_gauche_axe_arriere__port_504198,CAR_EXTERIEUR_Face_avant_axe_droit__port_504451,CAR_EXTERIEUR_angle_avant_gauche_axe_avant__port_504235,FirstUploadExperveo_vin__port_505675,CAR_EXTERIEUR_cote_droite__port_504108,CAR_INTERIEUR_avant_volant_class_6_levierdevitesse__port_506565,FirstUploadExperveo_carrosseriegrosplan_carrosserie__port_506483,CAR_EXTERIEUR_Angle_arriere_gauche_axe_arriere__port_504201,cartegrise_orientation__port_505064,CAR_EXTERIEUR_Angle_arriere_droit_axe_arriere__port_504217,CAR_INTERIEUR_avant_vue-arriere_class_1__port_506531,CAR_EXTERIEUR_Face_arriere_axe_droit__port_504218,CAR_EXTERIEUR_Cote_droit_axe_arriere__port_504214,CAR_EXTERIEUR_Angle_avant_droit__port_504087,FirstUploadExperveo_carrosseriegrosplan_morceauderoue__port_506484,CAR_INTERIEUR_avant_volant_class_6_class_2__port_506563,CAR_EXTERIEUR_Angle_arriere_droit__port_504160,CAR_EXTERIEUR_arriere__port_504184,CAR_INTERIEUR_avant_volant_class_6_boutonrond__port_506562,INTERIEUR_Compteur_kilometrique__port_503644,CAR_INTERIEUR_avant_vue_gauche_habitacle_class_1__port_506494,CAR_EXTERIEUR_Angle_arriere_gauche__port_504170,CAR_EXTERIEUR_Angle_avant_droit_axe_arriere__port_504226,CAR_EXTERIEUR_Face_arriere_axe_gauche__port_504202,CAR_EXTERIEUR_moteur__port_503704,FirstUploadExperveo_carrosseriegrosplan_class_6__port_506487,CAR_INTERIEUR_siege_arriere_class_1__port_506551,CAR_EXTERIEUR_avant__port_504146,CAR_EXTERIEUR_Angle_arriere_droit_axe_droit__port_504215,CAR_EXTERIEUR_Angle_avant_droit_axe_droit__port_504225,CAR_INTERIEUR_avant_volant_class_6_ecrangrosplan__port_506564,FirstUploadExperveo_carrosseriegrosplan_moteurgrosplanetdegat__port_506482,CAR_INTERIEUR_coffre__port_503412,FirstUploadExperveo_rouetranche__port_505677,UploadPhotoImmatBest_class_1__port_505051,CAR_INTERIEUR_avant_vue-arriere_class_2__port_506532,CAR_EXTERIEUR_angle_avant_gauche__port_504098,CAR_EXTERIEUR_face_avant_axe_gauche__port_504236,CAR_INTERIEUR_avant_vue_droite_habitacle_class_1__port_506540,CAR_EXTERIEUR_cote_gauche_axe_avant__port_504233,CAR_EXTERIEUR_roue_de_secour__port_503763,CAR_EXTERIEUR_Angle_arriere_gauche_axe_gauche__port_504199,CAR_EXTERIEUR_cote_gauche__port_504017,CAR_INTERIEUR_avant_volant_class_1__port_506503,CAR_INTERIEUR_avant_volant_class_2__port_506504,CAR_EXTERIEUR_angle_avant_gauche_axe_gauche__port_504234', 'svm_portfolios_learning': '505674,503398,506486,506485,504465,504198,504451,504235,505675,504108,506565,506483,504201,505064,504217,506531,504218,504214,504087,506484,506563,504160,504184,506562,503644,506494,504170,504226,504202,503704,506487,506551,504146,504215,504225,506564,506482,503412,505677,505051,506532,504098,504236,506540,504233,503763,504199,504017,506503,506504,504234', 'photo_hashtag_type': 337, 'photo_desc_type': 3392, 'type_classification': 'caffe', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0'}] thcl {'id': 358, 'mtr_user_id': 31, 'name': 'car_orientation_0111', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'FirstUploadExperveo_vignette__port_505674,CAR_EXTERIEUR_Roue__port_503398,FirstUploadExperveo_carrosseriegrosplan_VIndanslamoquette__port_506486,FirstUploadExperveo_carrosseriegrosplan_siegegrosplan__port_506485,CAR_EXTERIEUR_Cote_droit_axe_avant__port_504465,CAR_EXTERIEUR_Cote_gauche_axe_arriere__port_504198,CAR_EXTERIEUR_Face_avant_axe_droit__port_504451,CAR_EXTERIEUR_angle_avant_gauche_axe_avant__port_504235,FirstUploadExperveo_vin__port_505675,CAR_EXTERIEUR_cote_droite__port_504108,CAR_INTERIEUR_avant_volant_class_6_levierdevitesse__port_506565,FirstUploadExperveo_carrosseriegrosplan_carrosserie__port_506483,CAR_EXTERIEUR_Angle_arriere_gauche_axe_arriere__port_504201,cartegrise_orientation__port_505064,CAR_EXTERIEUR_Angle_arriere_droit_axe_arriere__port_504217,CAR_INTERIEUR_avant_vue-arriere_class_1__port_506531,CAR_EXTERIEUR_Face_arriere_axe_droit__port_504218,CAR_EXTERIEUR_Cote_droit_axe_arriere__port_504214,CAR_EXTERIEUR_Angle_avant_droit__port_504087,FirstUploadExperveo_carrosseriegrosplan_morceauderoue__port_506484,CAR_INTERIEUR_avant_volant_class_6_class_2__port_506563,CAR_EXTERIEUR_Angle_arriere_droit__port_504160,CAR_EXTERIEUR_arriere__port_504184,CAR_INTERIEUR_avant_volant_class_6_boutonrond__port_506562,INTERIEUR_Compteur_kilometrique__port_503644,CAR_INTERIEUR_avant_vue_gauche_habitacle_class_1__port_506494,CAR_EXTERIEUR_Angle_arriere_gauche__port_504170,CAR_EXTERIEUR_Angle_avant_droit_axe_arriere__port_504226,CAR_EXTERIEUR_Face_arriere_axe_gauche__port_504202,CAR_EXTERIEUR_moteur__port_503704,FirstUploadExperveo_carrosseriegrosplan_class_6__port_506487,CAR_INTERIEUR_siege_arriere_class_1__port_506551,CAR_EXTERIEUR_avant__port_504146,CAR_EXTERIEUR_Angle_arriere_droit_axe_droit__port_504215,CAR_EXTERIEUR_Angle_avant_droit_axe_droit__port_504225,CAR_INTERIEUR_avant_volant_class_6_ecrangrosplan__port_506564,FirstUploadExperveo_carrosseriegrosplan_moteurgrosplanetdegat__port_506482,CAR_INTERIEUR_coffre__port_503412,FirstUploadExperveo_rouetranche__port_505677,UploadPhotoImmatBest_class_1__port_505051,CAR_INTERIEUR_avant_vue-arriere_class_2__port_506532,CAR_EXTERIEUR_angle_avant_gauche__port_504098,CAR_EXTERIEUR_face_avant_axe_gauche__port_504236,CAR_INTERIEUR_avant_vue_droite_habitacle_class_1__port_506540,CAR_EXTERIEUR_cote_gauche_axe_avant__port_504233,CAR_EXTERIEUR_roue_de_secour__port_503763,CAR_EXTERIEUR_Angle_arriere_gauche_axe_gauche__port_504199,CAR_EXTERIEUR_cote_gauche__port_504017,CAR_INTERIEUR_avant_volant_class_1__port_506503,CAR_INTERIEUR_avant_volant_class_2__port_506504,CAR_EXTERIEUR_angle_avant_gauche_axe_gauche__port_504234', 'svm_portfolios_learning': '505674,503398,506486,506485,504465,504198,504451,504235,505675,504108,506565,506483,504201,505064,504217,506531,504218,504214,504087,506484,506563,504160,504184,506562,503644,506494,504170,504226,504202,503704,506487,506551,504146,504215,504225,506564,506482,503412,505677,505051,506532,504098,504236,506540,504233,503763,504199,504017,506503,506504,504234', 'photo_hashtag_type': 337, 'photo_desc_type': 3392, 'type_classification': 'caffe', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 3392 ['FirstUploadExperveo_vignette__port_505674', 'CAR_EXTERIEUR_Roue__port_503398', 'FirstUploadExperveo_carrosseriegrosplan_VIndanslamoquette__port_506486', 'FirstUploadExperveo_carrosseriegrosplan_siegegrosplan__port_506485', 'CAR_EXTERIEUR_Cote_droit_axe_avant__port_504465', 'CAR_EXTERIEUR_Cote_gauche_axe_arriere__port_504198', 'CAR_EXTERIEUR_Face_avant_axe_droit__port_504451', 'CAR_EXTERIEUR_angle_avant_gauche_axe_avant__port_504235', 'FirstUploadExperveo_vin__port_505675', 'CAR_EXTERIEUR_cote_droite__port_504108', 'CAR_INTERIEUR_avant_volant_class_6_levierdevitesse__port_506565', 'FirstUploadExperveo_carrosseriegrosplan_carrosserie__port_506483', 'CAR_EXTERIEUR_Angle_arriere_gauche_axe_arriere__port_504201', 'cartegrise_orientation__port_505064', 'CAR_EXTERIEUR_Angle_arriere_droit_axe_arriere__port_504217', 'CAR_INTERIEUR_avant_vue-arriere_class_1__port_506531', 'CAR_EXTERIEUR_Face_arriere_axe_droit__port_504218', 'CAR_EXTERIEUR_Cote_droit_axe_arriere__port_504214', 'CAR_EXTERIEUR_Angle_avant_droit__port_504087', 'FirstUploadExperveo_carrosseriegrosplan_morceauderoue__port_506484', 'CAR_INTERIEUR_avant_volant_class_6_class_2__port_506563', 'CAR_EXTERIEUR_Angle_arriere_droit__port_504160', 'CAR_EXTERIEUR_arriere__port_504184', 'CAR_INTERIEUR_avant_volant_class_6_boutonrond__port_506562', 'INTERIEUR_Compteur_kilometrique__port_503644', 'CAR_INTERIEUR_avant_vue_gauche_habitacle_class_1__port_506494', 'CAR_EXTERIEUR_Angle_arriere_gauche__port_504170', 'CAR_EXTERIEUR_Angle_avant_droit_axe_arriere__port_504226', 'CAR_EXTERIEUR_Face_arriere_axe_gauche__port_504202', 'CAR_EXTERIEUR_moteur__port_503704', 'FirstUploadExperveo_carrosseriegrosplan_class_6__port_506487', 'CAR_INTERIEUR_siege_arriere_class_1__port_506551', 'CAR_EXTERIEUR_avant__port_504146', 'CAR_EXTERIEUR_Angle_arriere_droit_axe_droit__port_504215', 'CAR_EXTERIEUR_Angle_avant_droit_axe_droit__port_504225', 'CAR_INTERIEUR_avant_volant_class_6_ecrangrosplan__port_506564', 'FirstUploadExperveo_carrosseriegrosplan_moteurgrosplanetdegat__port_506482', 'CAR_INTERIEUR_coffre__port_503412', 'FirstUploadExperveo_rouetranche__port_505677', 'UploadPhotoImmatBest_class_1__port_505051', 'CAR_INTERIEUR_avant_vue-arriere_class_2__port_506532', 'CAR_EXTERIEUR_angle_avant_gauche__port_504098', 'CAR_EXTERIEUR_face_avant_axe_gauche__port_504236', 'CAR_INTERIEUR_avant_vue_droite_habitacle_class_1__port_506540', 'CAR_EXTERIEUR_cote_gauche_axe_avant__port_504233', 'CAR_EXTERIEUR_roue_de_secour__port_503763', 'CAR_EXTERIEUR_Angle_arriere_gauche_axe_gauche__port_504199', 'CAR_EXTERIEUR_cote_gauche__port_504017', 'CAR_INTERIEUR_avant_volant_class_1__port_506503', 'CAR_INTERIEUR_avant_volant_class_2__port_506504', 'CAR_EXTERIEUR_angle_avant_gauche_axe_gauche__port_504234'] 51 SELECT hashtag_id,hashtag FROM MTRBack.hashtags where hashtag in ('FirstUploadExperveo_vignette__port_505674','CAR_EXTERIEUR_Roue__port_503398','FirstUploadExperveo_carrosseriegrosplan_VIndanslamoquette__port_506486','FirstUploadExperveo_carrosseriegrosplan_siegegrosplan__port_506485','CAR_EXTERIEUR_Cote_droit_axe_avant__port_504465','CAR_EXTERIEUR_Cote_gauche_axe_arriere__port_504198','CAR_EXTERIEUR_Face_avant_axe_droit__port_504451','CAR_EXTERIEUR_angle_avant_gauche_axe_avant__port_504235','FirstUploadExperveo_vin__port_505675','CAR_EXTERIEUR_cote_droite__port_504108','CAR_INTERIEUR_avant_volant_class_6_levierdevitesse__port_506565','FirstUploadExperveo_carrosseriegrosplan_carrosserie__port_506483','CAR_EXTERIEUR_Angle_arriere_gauche_axe_arriere__port_504201','cartegrise_orientation__port_505064','CAR_EXTERIEUR_Angle_arriere_droit_axe_arriere__port_504217','CAR_INTERIEUR_avant_vue-arriere_class_1__port_506531','CAR_EXTERIEUR_Face_arriere_axe_droit__port_504218','CAR_EXTERIEUR_Cote_droit_axe_arriere__port_504214','CAR_EXTERIEUR_Angle_avant_droit__port_504087','FirstUploadExperveo_carrosseriegrosplan_morceauderoue__port_506484','CAR_INTERIEUR_avant_volant_class_6_class_2__port_506563','CAR_EXTERIEUR_Angle_arriere_droit__port_504160','CAR_EXTERIEUR_arriere__port_504184','CAR_INTERIEUR_avant_volant_class_6_boutonrond__port_506562','INTERIEUR_Compteur_kilometrique__port_503644','CAR_INTERIEUR_avant_vue_gauche_habitacle_class_1__port_506494','CAR_EXTERIEUR_Angle_arriere_gauche__port_504170','CAR_EXTERIEUR_Angle_avant_droit_axe_arriere__port_504226','CAR_EXTERIEUR_Face_arriere_axe_gauche__port_504202','CAR_EXTERIEUR_moteur__port_503704','FirstUploadExperveo_carrosseriegrosplan_class_6__port_506487','CAR_INTERIEUR_siege_arriere_class_1__port_506551','CAR_EXTERIEUR_avant__port_504146','CAR_EXTERIEUR_Angle_arriere_droit_axe_droit__port_504215','CAR_EXTERIEUR_Angle_avant_droit_axe_droit__port_504225','CAR_INTERIEUR_avant_volant_class_6_ecrangrosplan__port_506564','FirstUploadExperveo_carrosseriegrosplan_moteurgrosplanetdegat__port_506482','CAR_INTERIEUR_coffre__port_503412','FirstUploadExperveo_rouetranche__port_505677','UploadPhotoImmatBest_class_1__port_505051','CAR_INTERIEUR_avant_vue-arriere_class_2__port_506532','CAR_EXTERIEUR_angle_avant_gauche__port_504098','CAR_EXTERIEUR_face_avant_axe_gauche__port_504236','CAR_INTERIEUR_avant_vue_droite_habitacle_class_1__port_506540','CAR_EXTERIEUR_cote_gauche_axe_avant__port_504233','CAR_EXTERIEUR_roue_de_secour__port_503763','CAR_EXTERIEUR_Angle_arriere_gauche_axe_gauche__port_504199','CAR_EXTERIEUR_cote_gauche__port_504017','CAR_INTERIEUR_avant_volant_class_1__port_506503','CAR_INTERIEUR_avant_volant_class_2__port_506504','CAR_EXTERIEUR_angle_avant_gauche_axe_gauche__port_504234'); 51 dict_keys(['cartegrise_orientation__port_505064', 'car_exterieur_angle_arriere_droit_axe_arriere__port_504217', 'car_exterieur_angle_arriere_droit_axe_droit__port_504215', 'car_exterieur_angle_arriere_droit__port_504160', 'car_exterieur_angle_arriere_gauche_axe_arriere__port_504201', 'car_exterieur_angle_arriere_gauche_axe_gauche__port_504199', 'car_exterieur_angle_arriere_gauche__port_504170', 'car_exterieur_angle_avant_droit_axe_arriere__port_504226', 'car_exterieur_angle_avant_droit_axe_droit__port_504225', 'car_exterieur_angle_avant_droit__port_504087', 'car_exterieur_angle_avant_gauche_axe_avant__port_504235', 'car_exterieur_angle_avant_gauche_axe_gauche__port_504234', 'car_exterieur_angle_avant_gauche__port_504098', 'car_exterieur_arriere__port_504184', 'car_exterieur_avant__port_504146', 'car_exterieur_cote_droite__port_504108', 'car_exterieur_cote_droit_axe_arriere__port_504214', 'car_exterieur_cote_droit_axe_avant__port_504465', 'car_exterieur_cote_gauche_axe_arriere__port_504198', 'car_exterieur_cote_gauche_axe_avant__port_504233', 'car_exterieur_cote_gauche__port_504017', 'car_exterieur_face_arriere_axe_droit__port_504218', 'car_exterieur_face_arriere_axe_gauche__port_504202', 'car_exterieur_face_avant_axe_droit__port_504451', 'car_exterieur_face_avant_axe_gauche__port_504236', 'car_exterieur_moteur__port_503704', 'car_exterieur_roue_de_secour__port_503763', 'car_exterieur_roue__port_503398', 'car_interieur_avant_volant_class_1__port_506503', 'car_interieur_avant_volant_class_2__port_506504', 'car_interieur_avant_volant_class_6_boutonrond__port_506562', 'car_interieur_avant_volant_class_6_class_2__port_506563', 'car_interieur_avant_volant_class_6_ecrangrosplan__port_506564', 'car_interieur_avant_volant_class_6_levierdevitesse__port_506565', 'car_interieur_avant_vue-arriere_class_1__port_506531', 'car_interieur_avant_vue-arriere_class_2__port_506532', 'car_interieur_avant_vue_droite_habitacle_class_1__port_506540', 'car_interieur_avant_vue_gauche_habitacle_class_1__port_506494', 'car_interieur_coffre__port_503412', 'car_interieur_siege_arriere_class_1__port_506551', 'firstuploadexperveo_carrosseriegrosplan_carrosserie__port_506483', 'firstuploadexperveo_carrosseriegrosplan_class_6__port_506487', 'firstuploadexperveo_carrosseriegrosplan_morceauderoue__port_506484', 'firstuploadexperveo_carrosseriegrosplan_moteurgrosplanetdegat__port_506482', 'firstuploadexperveo_carrosseriegrosplan_siegegrosplan__port_506485', 'firstuploadexperveo_carrosseriegrosplan_vindanslamoquette__port_506486', 'firstuploadexperveo_rouetranche__port_505677', 'firstuploadexperveo_vignette__port_505674', 'firstuploadexperveo_vin__port_505675', 'interieur_compteur_kilometrique__port_503644', 'uploadphotoimmatbest_class_1__port_505051']) select photo_hashtag_type from MTRDatou.classification_theme where id = 358 thcl : 358 photo_hashtag_type : 337 SELECT phi.hashtag_id , phi.photo_id FROM MTRBack.photo_hashtag_ids phi, MTRUser.mtr_portfolio_photos mp where phi.type = 337 and phi.photo_id = mp.mtr_photo_id and mp.mtr_portfolio_id =510365; {510365: [(917973295, 1), (917973297, 1), (917973302, 1), (917973293, 7), (917973296, 11), (917973300, 11), (917973286, 13), (917973289, 13), (917973301, 24), (917973285, 29), (917973290, 29), (917973299, 29), (917973304, 35), (917973287, 36), (917973298, 36), (917973305, 36), (917973292, 37), (917973291, 41), (917973303, 41), (917973294, 42), (917973288, 46)]} ############################### TEST rotate ################################ test rotate only Inside batchDatouExec : verbose : True ##### chargement datou SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=230 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=230 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 230 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=230 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! no param json to modify List Step Type Loaded in datou : rotate list_input_json : [] ##### fin chargement datou ##### chargement data ##### Call load_data_input : nb_thread : 5 origin SELECT photo_id, url FROM MTRBack.photos ph WHERE photo_id IN (917849322) Found this number of photos: 1 ##### Call download_photos : nb_thread : 5 begin to download photo : 917849322 download finish for photo 917849322 we have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB ##### After download_photos length of list_filenames : 1 ; length of list_pids : 1 ; length of list_args : 1 ##### After load_data_input time to download the photos : 0.6902551651000977 #### fin chargement data Blocking on flush ? No conitnuing About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : True number of steps : 1 step1:rotate Mon Apr 14 04:18:35 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec After prepare type args : Here we display some param of map_info ! map_filenames : {'temp/1744597115_648272_917849322_2bd260e91e91df8378dde8bb8b8c4548.jpg': 917849322} map_photo_id_path_extension : {917849322: {'path': 'temp/1744597115_648272_917849322_2bd260e91e91df8378dde8bb8b8c4548.jpg', 'extension': 'jpg'}} map_subphoto_mainphoto : {} Beginning of datou_step_rotate ! We are in a linear step without datou_depend ! rotate photos of 90,180,270 degres batch 1 select photo_id, hashtag_id, `type`, x0, x1, y0, y1, score, id from MTRPhoto.crop_hashtag_ids where photo_id in ( 917849322) and `type` in (0) Loaded 0 chid ids of type : 0 SELECT crop_hashtag_id, points FROM MTRPhoto.crop_polygon_points WHERE crop_hashtag_id in () map_chi : {} photo_id in download_rotate_and_save : 917849322 list_chi_loc : 0 Use all angle ! Rotation of photo 917849322 of 90 degree temp/1744597115_648272_917849322_2bd260e91e91df8378dde8bb8b8c4548.jpg [] 90 remove_crop_border : False version de PIL : 9.5.0 Needs to change image size ! [[ 6.123234e-17 1.000000e+00] [-1.000000e+00 6.123234e-17]] 90 [[ 6.123234e-17 1.000000e+00] [-1.000000e+00 6.123234e-17]] shrink_image : False image_rotate : image_path : temp/1744597115_648272_917849322_2bd260e91e91df8378dde8bb8b8c4548.jpg path_name_rotate : temp/1744597115_648272_917849322_2bd260e91e91df8378dde8bb8b8c454890.jpg image_rotate.mode : RGB Rotation of photo 917849322 of 180 degree temp/1744597115_648272_917849322_2bd260e91e91df8378dde8bb8b8c4548.jpg [] 180 remove_crop_border : False version de PIL : 9.5.0 Needs to change image size ! [[-1.0000000e+00 1.2246468e-16] [-1.2246468e-16 -1.0000000e+00]] 180 [[-1.0000000e+00 1.2246468e-16] [-1.2246468e-16 -1.0000000e+00]] shrink_image : False image_rotate : image_path : temp/1744597115_648272_917849322_2bd260e91e91df8378dde8bb8b8c4548.jpg path_name_rotate : temp/1744597115_648272_917849322_2bd260e91e91df8378dde8bb8b8c4548180.jpg image_rotate.mode : RGB Rotation of photo 917849322 of 270 degree temp/1744597115_648272_917849322_2bd260e91e91df8378dde8bb8b8c4548.jpg [] 270 remove_crop_border : False version de PIL : 9.5.0 Needs to change image size ! [[-1.8369702e-16 -1.0000000e+00] [ 1.0000000e+00 -1.8369702e-16]] 270 [[-1.8369702e-16 -1.0000000e+00] [ 1.0000000e+00 -1.8369702e-16]] shrink_image : False image_rotate : image_path : temp/1744597115_648272_917849322_2bd260e91e91df8378dde8bb8b8c4548.jpg path_name_rotate : temp/1744597115_648272_917849322_2bd260e91e91df8378dde8bb8b8c4548270.jpg image_rotate.mode : RGB About to upload 3 photos upload in portfolio : 551782 init cache_photo without model_param we have 3 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1744597117_648272 Catched exception ! Connect or reconnect ! error to insert the photos temp/1744597115_648272_917849322_2bd260e91e91df8378dde8bb8b8c454890.jpg in MTRUser.mtr_photo_submit Catched exception ! Connect or reconnect ! error to insert the photos temp/1744597115_648272_917849322_2bd260e91e91df8378dde8bb8b8c4548180.jpg in MTRUser.mtr_photo_submit Catched exception ! Connect or reconnect ! error to insert the photos temp/1744597115_648272_917849322_2bd260e91e91df8378dde8bb8b8c4548270.jpg in MTRUser.mtr_photo_submit we have uploaded 0 photos in the portfolio 551782 time of upload the photos Elapsed time : 6.021358013153076 Len new_chis : 3 Len list_new_chi_with_photo_id : 0 of type : 0 list_new_chi_with_photo_id : [] After datou_step_exec type output : time spend for datou_step_exec : 7.769968748092651 time spend to save output : 0.000179290771484375 total time spend for step 1 : 7.770148038864136 caffe_path_current : About to save ! 1 Inside saveOutput : final : True verbose : True saveOutput not yet implemented for datou_step.type : rotate we use saveGeneral [917849322] map_info['map_portfolio_photo'] : {} final : True mtd_id 230 list_pids : [917849322] Looping around the photos to save general results len do output : 0 before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('230', None, None, None, None, None, None, None, None) ('230', None, '917849322', None, None, None, None, None, None) begin to insert list_values into mtr_datou_result : length of list_values in save_final : 1 insert ignore into MTRPhoto.mtr_datou_result (mtd_id, mtr_portfolio_id,mtr_photo_id,result,result_long,result_double,hashtag_id,proba, mtr_current_id) values (%s,%s,%s,%s,%s,%s,%s,%s,%s) on duplicate key update mtr_portfolio_id = mtr_portfolio_id list_values : [('230', None, '917849322', None, None, None, None, None, None)] time used for this insertion : 0.11843514442443848 save_final save missing photos in datou_result : After save, about to update current ! datou_cur_ids : [] len(datou.list_steps) : 1 output : {} ERROR, got 0 upload, expected 3 test rotate conditionnel Inside batchDatouExec : verbose : True ##### chargement datou SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=233 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=233 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 233 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=233 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! DataTypes for each output/input checked ! no param json to modify List Step Type Loaded in datou : thcl, argmax, rotate list_input_json : [] ##### fin chargement datou ##### chargement data ##### Call load_data_input : nb_thread : 5 origin SELECT photo_id, url FROM MTRBack.photos ph WHERE photo_id IN (917849322) Found this number of photos: 1 ##### Call download_photos : nb_thread : 5 begin to download photo : 917849322 download finish for photo 917849322 we have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB ##### After download_photos length of list_filenames : 1 ; length of list_pids : 1 ; length of list_args : 1 ##### After load_data_input time to download the photos : 0.3498225212097168 #### fin chargement data Blocking on flush ? No conitnuing About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : True number of steps : 3 step1:thcl Mon Apr 14 04:18:44 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec After prepare type args : Here we display some param of map_info ! map_filenames : {'temp/1744597123_648272_917849322_2bd260e91e91df8378dde8bb8b8c4548.jpg': 917849322} map_photo_id_path_extension : {917849322: {'path': 'temp/1744597123_648272_917849322_2bd260e91e91df8378dde8bb8b8c4548.jpg', 'extension': 'jpg'}} map_subphoto_mainphoto : {} Beginning of datou step Thcl ! multi_thcl or not :False multi_thcl_cond or not :False dic_thcl : {'500': 1} we are using the classfication for only one thcl 500 In convert_file_to_np l 337 : 1 l343 1 l357 after caffe.io.load_image dimension du image : (3, (2448, 3264, 3)) dimension displayed ! time to import caffe and check if the image exist : 0.00021767616271972656 time to convert the images to numpy array : 0.843703031539917 total time to convert the images to numpy array : 0.8442120552062988 list photo_ids error: [] list photo_ids correct : [917849322] number of photos to traite : 1 try to delete the photos incorrect in DB tagging for thcl : 500 To do loadFromThcl(), then load ParamDescType : thcl500 get_desc_type_from_thcl : type of cat SELECT id, mtr_user_id, name, pb_hashtag_id, hashtag_id_list, button_legend_list, portfolio_id_lists, photo_hashtag_type, photo_desc_type, svm_limit, limit_tagging, is_public, live, created_at, updated_at, type_classification FROM MTRDatou.classification_theme WHERE `id` IN (500) thcls : [{'id': 500, 'mtr_user_id': 31, 'name': 'orientation_carte_grise_all_2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'carteGrisesVerticales__port_549774,cartegrise_90deg__port_550987,cartesGrisesEnvers__port_549765,portfolio_270deg__port_550988', 'svm_portfolios_learning': '549774,550987,549765,550988', 'photo_hashtag_type': 507, 'photo_desc_type': 3517, 'type_classification': 'caffe', 'hashtag_id_list': '0,0,0,0'}] thcl {'id': 500, 'mtr_user_id': 31, 'name': 'orientation_carte_grise_all_2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'carteGrisesVerticales__port_549774,cartegrise_90deg__port_550987,cartesGrisesEnvers__port_549765,portfolio_270deg__port_550988', 'svm_portfolios_learning': '549774,550987,549765,550988', 'photo_hashtag_type': 507, 'photo_desc_type': 3517, 'type_classification': 'caffe', 'hashtag_id_list': '0,0,0,0'} Update svm_hashtag_type_desc : 3517 SELECT * FROM MTRDatou.photo_desc_type_params WHERE id in (3517) FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (3517, 'orientation_carte_grise_all_2', 16384, 25088, 'orientation_carte_grise_all_2', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2018, 4, 18, 20, 4, 34), datetime.datetime(2018, 4, 18, 20, 4, 34)) To loadFromThcl() : net_3517 begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 3165 max_wait_temp : 1 max_wait : 0 SELECT * FROM MTRDatou.photo_desc_type_params WHERE id in (3517) FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (3517, 'orientation_carte_grise_all_2', 16384, 25088, 'orientation_carte_grise_all_2', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2018, 4, 18, 20, 4, 34), datetime.datetime(2018, 4, 18, 20, 4, 34)) param : , param.caffemodel : orientation_carte_grise_all_2 None mean_file_type : mean_file_path : prototxt_file_path : model : orientation_carte_grise_all_2 Inside get_net Inside get_net before cache_data_model model_param file didn't exist Inside get_net before CDM.load_model_par_type model_name : orientation_carte_grise_all_2 model_type : caffe list file need : ['caffemodel', 'deploy_conv_normal.prototxt', 'deploy_fc.prototxt', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file exist in s3 : ['caffemodel', 'deploy_conv_normal.prototxt', 'deploy_fc.prototxt', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file manque in s3 : [] local folder : /data/models_weight/orientation_carte_grise_all_2 /data/models_weight/orientation_carte_grise_all_2/caffemodel size_local : 537110520 size in s3 : 537110520 create time local : 2021-08-09 05:29:00 create time in s3 : 2021-08-06 20:07:17 caffemodel already exist and didn't need to update /data/models_weight/orientation_carte_grise_all_2/deploy_conv_normal.prototxt size_local : 4626 size in s3 : 4626 create time local : 2021-08-09 05:29:00 create time in s3 : 2021-08-06 20:07:16 deploy_conv_normal.prototxt already exist and didn't need to update /data/models_weight/orientation_carte_grise_all_2/deploy_fc.prototxt size_local : 1130 size in s3 : 1130 create time local : 2021-08-09 05:29:00 create time in s3 : 2021-08-06 20:07:16 deploy_fc.prototxt already exist and didn't need to update /data/models_weight/orientation_carte_grise_all_2/deploy.prototxt size_local : 5653 size in s3 : 5653 create time local : 2021-08-09 05:29:00 create time in s3 : 2021-08-06 20:07:16 deploy.prototxt already exist and didn't need to update /data/models_weight/orientation_carte_grise_all_2/mean.npy size_local : 1572992 size in s3 : 1572992 create time local : 2021-08-09 05:29:00 create time in s3 : 2021-08-06 20:07:31 mean.npy already exist and didn't need to update /data/models_weight/orientation_carte_grise_all_2/synset_words.txt size_local : 159 size in s3 : 159 create time local : 2021-08-09 05:29:00 create time in s3 : 2021-08-06 20:07:16 synset_words.txt already exist and didn't need to update Inside get_net after CDM.load_model_par_type After if not only_with_local_cache: /home/admin/workarea/install/caffe_cuda8_python3/python/:/home/admin/workarea/install/darknet/:/home/admin/workarea/git/Velours/python:/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python:/home/admin/mtr/.credentials:/home/admin/workarea/install/caffe/python:/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools/:/home/admin/workarea/git/fotonowerpip/:/home/admin/workarea/install/segment-anything:/home/admin//workarea/git/pyfvs/ Here before set mode gpu Doing nothing but we could set mode gpu after set mode gpu prototxt_filename : /data/models_weight/orientation_carte_grise_all_2/deploy.prototxt caffemodel_filename : /data/models_weight/orientation_carte_grise_all_2/caffemodel now we set caffe to gpu mode before predict begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 3165 max_wait_temp : 1 max_wait : 0 dict_keys(['prob', 'pool5']) time used to do the prepocess of the images : 2.625783681869507 time used to do the prediction : 0.2102048397064209 save descriptor for thcl : 500 (1, 512, 7, 7) Got the blobs of the net to insert : [0, 0, 0, 0, 0, 0, 0, 0, 0, 0] code_as_byte_string:b'0000000000'| time to traite the descriptors : 0.0448606014251709 Testing : ['917849322'] In select_photos_meta_from_ids: SELECT photo_id, url, FROM_UNIXTIME(uploaded_at), latitude, longitude, text FROM MTRBack.photos WHERE photo_id IN (917849322) result : {917849322: {'photo_id': 917849322, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2022/9/13/2bd260e91e91df8378dde8bb8b8c4548.jpg', 'latitude': 0.0, 'longitude': 0.0, 'text': 'image_13092022_12_32_19_5566.jpg'}} list_photo_exists : [917849322] storage_type for insertDescriptorsMulti : 1 To insert : 917849322 Catched exception ! Connect or reconnect ! Error ! (1205, 'Lock wait timeout exceeded; try restarting transaction') time to insert the descriptors : 55.30960702896118 After datou_step_exec type output : time spend for datou_step_exec : 64.36083030700684 time spend to save output : 0.00017499923706054688 total time spend for step 1 : 64.3610053062439 step2:argmax Mon Apr 14 04:19:48 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 : {'917849322': [[('917849322', 'carteGrisesVerticales__port_549774', 0.99764687, 507, '500'), ('917849322', 'cartegrise_90deg__port_550987', 0.0005042896, 507, '500'), ('917849322', 'cartesGrisesEnvers__port_549765', 0.00036675023, 507, '500'), ('917849322', 'portfolio_270deg__port_550988', 0.0014820651, 507, '500')]]} input_args_next_step : {'917849322': ()} output_args : {'917849322': [[('917849322', 'carteGrisesVerticales__port_549774', 0.99764687, 507, '500'), ('917849322', 'cartegrise_90deg__port_550987', 0.0005042896, 507, '500'), ('917849322', 'cartesGrisesEnvers__port_549765', 0.00036675023, 507, '500'), ('917849322', 'portfolio_270deg__port_550988', 0.0014820651, 507, '500')]]} args : 917849322 depend.output_id : 0 VR 22-3-18 : For now we do not clean correctly the datou structure input_args_next_step, len :1, first value : ([('917849322', 'carteGrisesVerticales__port_549774', 0.99764687, 507, '500'), ('917849322', 'cartegrise_90deg__port_550987', 0.0005042896, 507, '500'), ('917849322', 'cartesGrisesEnvers__port_549765', 0.00036675023, 507, '500'), ('917849322', 'portfolio_270deg__port_550988', 0.0014820651, 507, '500')],) After prepare type args : Here we display some param of map_info ! map_filenames : {'temp/1744597123_648272_917849322_2bd260e91e91df8378dde8bb8b8c4548.jpg': 917849322} map_photo_id_path_extension : {917849322: {'path': 'temp/1744597123_648272_917849322_2bd260e91e91df8378dde8bb8b8c4548.jpg', 'extension': 'jpg'}} map_subphoto_mainphoto : {} Beginning of datou_step Argmax ! calculate argmax for thcl : 500 After datou_step_exec type output : time spend for datou_step_exec : 0.00017213821411132812 time spend to save output : 1.6450881958007812e-05 total time spend for step 2 : 0.00018858909606933594 step3:rotate Mon Apr 14 04:19:48 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 : {'917849322': [('917849322', 'carteGrisesVerticales__port_549774', 0.99764687, 507, '500'), 'temp/1744597123_648272_917849322_2bd260e91e91df8378dde8bb8b8c4548.jpg']} input_args_next_step : {'917849322': ()} output_args : {'917849322': [('917849322', 'carteGrisesVerticales__port_549774', 0.99764687, 507, '500'), 'temp/1744597123_648272_917849322_2bd260e91e91df8378dde8bb8b8c4548.jpg']} args : 917849322 depend.output_id : 1 complete output_args for input 1 : {'917849322': [('917849322', 'carteGrisesVerticales__port_549774', 0.99764687, 507, '500'), 'temp/1744597123_648272_917849322_2bd260e91e91df8378dde8bb8b8c4548.jpg']} input_args_next_step : {'917849322': ('temp/1744597123_648272_917849322_2bd260e91e91df8378dde8bb8b8c4548.jpg',)} output_args : {'917849322': [('917849322', 'carteGrisesVerticales__port_549774', 0.99764687, 507, '500'), 'temp/1744597123_648272_917849322_2bd260e91e91df8378dde8bb8b8c4548.jpg']} args : 917849322 depend.output_id : 0 VR 22-3-18 : For now we do not clean correctly the datou structure input_args_next_step, len :1, first value : ('temp/1744597123_648272_917849322_2bd260e91e91df8378dde8bb8b8c4548.jpg', ('917849322', 'carteGrisesVerticales__port_549774', 0.99764687, 507, '500')) After prepare type args : Here we display some param of map_info ! map_filenames : {'temp/1744597123_648272_917849322_2bd260e91e91df8378dde8bb8b8c4548.jpg': 917849322} map_photo_id_path_extension : {917849322: {'path': 'temp/1744597123_648272_917849322_2bd260e91e91df8378dde8bb8b8c4548.jpg', 'extension': 'jpg'}} map_subphoto_mainphoto : {} Beginning of datou_step_rotate ! We are in a datou with depends ! angle_condi : {'carteGrisesVerticales__port_549774': 0, 'cartegrise_90deg__port_550987': 270, 'portfolio_270deg__port_550988': 90, 'cartesGrisesEnvers__port_549765': 180} rotate photos for hashtag carteGrisesVerticales__port_549774 of 0 degres 1 photos founded : [917849322] batch 1 select photo_id, hashtag_id, `type`, x0, x1, y0, y1, score, id from MTRPhoto.crop_hashtag_ids where photo_id in ( 917849322) and `type` in (0) Loaded 0 chid ids of type : 0 SELECT crop_hashtag_id, points FROM MTRPhoto.crop_polygon_points WHERE crop_hashtag_id in () map_chi : {} photo_id in download_rotate_and_save : 917849322 list_chi_loc : 0 Use all angle ! Rotation of photo 917849322 of 0 degree temp/1744597123_648272_917849322_2bd260e91e91df8378dde8bb8b8c4548.jpg [] 0 remove_crop_border : False version de PIL : 9.5.0 Needs to change image size ! [[ 1. 0.] [-0. 1.]] 0 [[ 1. 0.] [-0. 1.]] shrink_image : False image_rotate : image_path : temp/1744597123_648272_917849322_2bd260e91e91df8378dde8bb8b8c4548.jpg path_name_rotate : temp/1744597123_648272_917849322_2bd260e91e91df8378dde8bb8b8c45480.jpg image_rotate.mode : RGB About to upload 1 photos upload in portfolio : 551782 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1744597189_648272 Catched exception ! Connect or reconnect ! error to insert the photos temp/1744597123_648272_917849322_2bd260e91e91df8378dde8bb8b8c45480.jpg in MTRUser.mtr_photo_submit we have uploaded 0 photos in the portfolio 551782 time of upload the photos Elapsed time : 2.717118501663208 Len new_chis : 1 Len list_new_chi_with_photo_id : 0 of type : 0 list_new_chi_with_photo_id : [] rotate photos for hashtag cartegrise_90deg__port_550987 of 270 degres 0 photos founded : [] rotate photos for hashtag portfolio_270deg__port_550988 of 90 degres 0 photos founded : [] rotate photos for hashtag cartesGrisesEnvers__port_549765 of 180 degres 0 photos founded : [] After datou_step_exec type output : time spend for datou_step_exec : 2.7971720695495605 time spend to save output : 0.00017833709716796875 total time spend for step 3 : 2.7973504066467285 caffe_path_current : About to save ! 1 Inside saveOutput : final : True verbose : True saveOutput not yet implemented for datou_step.type : rotate we use saveGeneral [917849322] map_info['map_portfolio_photo'] : {} final : True mtd_id 233 list_pids : [917849322] Looping around the photos to save general results len do output : 0 before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('233', None, None, None, None, None, None, None, None) ('233', None, '917849322', None, None, None, None, None, None) begin to insert list_values into mtr_datou_result : length of list_values in save_final : 1 insert ignore into MTRPhoto.mtr_datou_result (mtd_id, mtr_portfolio_id,mtr_photo_id,result,result_long,result_double,hashtag_id,proba, mtr_current_id) values (%s,%s,%s,%s,%s,%s,%s,%s,%s) on duplicate key update mtr_portfolio_id = mtr_portfolio_id list_values : [('233', None, '917849322', None, None, None, None, None, None)] time used for this insertion : 0.012953519821166992 save_final save missing photos in datou_result : After save, about to update current ! datou_cur_ids : [] len(datou.list_steps) : 3 output : {} ERROR rotate FAILED ############################### TEST data_augmentation_ellipse_varroa_tile_rotate ################################ SELECT id FROM MTRPhoto.crop_hashtag_ids WHERE photo_id=937852786 AND `type`=520 DELETE FROM MTRPhoto.crop_hashtag_ids WHERE id IN (3766659460,3766659461,3766659462,3766659463) Catched exception ! Connect or reconnect ! (1205, 'Lock wait timeout exceeded; try restarting transaction') ERROR data_augmentation_ellipse_varroa_tile_rotate FAILED ############################### TEST flip ################################ t Inside batchDatouExec : verbose : True ##### chargement datou SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=571 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=571 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 571 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=571 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! no param json to modify List Step Type Loaded in datou : flip list_input_json : [] ##### fin chargement datou ##### chargement data ##### Call load_data_input : nb_thread : 5 origin SELECT photo_id, url FROM MTRBack.photos ph WHERE photo_id IN (911785586) Found this number of photos: 1 ##### Call download_photos : nb_thread : 5 begin to download photo : 911785586 download finish for photo 911785586 we have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB ##### After download_photos length of list_filenames : 1 ; length of list_pids : 1 ; length of list_args : 1 ##### After load_data_input time to download the photos : 0.4130706787109375 #### fin chargement data Blocking on flush ? No conitnuing About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : True number of steps : 1 step1:flip Mon Apr 14 04:27:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec After prepare type args : Here we display some param of map_info ! map_filenames : {'temp/1744597650_648272_911785586_d8582feabcd359151ff718b5832248c7-big.jpg': 911785586} map_photo_id_path_extension : {911785586: {'path': 'temp/1744597650_648272_911785586_d8582feabcd359151ff718b5832248c7-big.jpg', 'extension': 'jpg'}} map_subphoto_mainphoto : {} Beginning of datou_step_flip ! We are in a linear step without datou_depend ! batch 1 select photo_id, hashtag_id, `type`, x0, x1, y0, y1, score, id from MTRPhoto.crop_hashtag_ids where photo_id in ( 911785586) and `type` in (741) Loaded 6 chid ids of type : 741 SELECT crop_hashtag_id, points FROM MTRPhoto.crop_polygon_points WHERE crop_hashtag_id in (18344206,18344211,18344210,18344209,18344208,18344207) +++++WARNING : Unexpected points, we should remove this data for chi_id : 18344210, for now we just ignore these empty polygon points +SELECT * FROM MTRPhoto.crop_segments WHERE crop_hashtag_id in (18344206,18344211,18344210,18344209,18344208,18344207) SELECT * FROM MTRPhoto.crop_sum_segments WHERE crop_hashtag_id in (18344206,18344211,18344210,18344209,18344208,18344207) map_chi_objs : {911785586: [, , , , , ]} photo_id in download_rotate_and_save : 911785586 list_chi_loc : 6 Vertical flip of photo 911785586 version de PIL : 9.5.0 vertically flipped image is saved in temp/1744597650_648272_911785586_d8582feabcd359151ff718b5832248c7-big_flip_vert.jpg Horizontal flip of photo 911785586 version de PIL : 9.5.0 horizontally flipped image is saved in temp/1744597650_648272_911785586_d8582feabcd359151ff718b5832248c7-big_flip_hori.jpg About to upload 2 photos upload in portfolio : 1090565 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1744597652_648272 Catched exception ! Connect or reconnect ! error to insert the photos temp/1744597650_648272_911785586_d8582feabcd359151ff718b5832248c7-big_flip_vert.jpg in MTRUser.mtr_photo_submit Catched exception ! Connect or reconnect ! error to insert the photos temp/1744597650_648272_911785586_d8582feabcd359151ff718b5832248c7-big_flip_hori.jpg in MTRUser.mtr_photo_submit we have uploaded 0 photos in the portfolio 1090565 time of upload the photos Elapsed time : 4.769736051559448 Len new_chis : 12 Len list_new_chi_with_photo_id : 0 of type : 741 list_new_chi_with_photo_id : [] After datou_step_exec type output : time spend for datou_step_exec : 6.169205904006958 time spend to save output : 6.651878356933594e-05 total time spend for step 1 : 6.169272422790527 caffe_path_current : About to save ! 1 Inside saveOutput : final : True verbose : True saveOutput not yet implemented for datou_step.type : flip we use saveGeneral [911785586] map_info['map_portfolio_photo'] : {} final : True mtd_id 571 list_pids : [911785586] Looping around the photos to save general results len do output : 0 before output type Managing all output in save final without adding information in the mtr_datou_result ('571', None, None, None, None, None, None, None, None) ('571', None, '911785586', None, None, None, None, None, None) begin to insert list_values into mtr_datou_result : length of list_values in save_final : 1 insert ignore into MTRPhoto.mtr_datou_result (mtd_id, mtr_portfolio_id,mtr_photo_id,result,result_long,result_double,hashtag_id,proba, mtr_current_id) values (%s,%s,%s,%s,%s,%s,%s,%s,%s) on duplicate key update mtr_portfolio_id = mtr_portfolio_id list_values : [('571', None, '911785586', None, None, None, None, None, None)] time used for this insertion : 0.01216888427734375 save_final save missing photos in datou_result : After save, about to update current ! datou_cur_ids : [] len(datou.list_steps) : 1 output : {} ERROR, got 0 upload, expected 2 ERROR flip FAILED ############################### TEST crop_rles ################################ # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! Unexpected type seems boolean for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : TEST CROP RLES Inside batchDatouExec : verbose : True ##### chargement datou SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=686 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=686 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 686 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=686 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! no param json to modify List Step Type Loaded in datou : crop list_input_json : [] ##### fin chargement datou ##### chargement data ##### Call load_data_input : nb_thread : 5 origin SELECT photo_id, url FROM MTRBack.photos ph WHERE photo_id IN (950103132) Found this number of photos: 1 ##### Call download_photos : nb_thread : 5 begin to download photo : 950103132 download finish for photo 950103132 we have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB ##### After download_photos length of list_filenames : 1 ; length of list_pids : 1 ; length of list_args : 1 ##### After load_data_input time to download the photos : 0.4067857265472412 #### fin chargement data Blocking on flush ? No conitnuing About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : True number of steps : 1 step1:crop Mon Apr 14 04:27:37 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec After prepare type args : Here we display some param of map_info ! map_filenames : {'temp/1744597657_648272_950103132_4f47bd527301396b0a701a1b4183ba00.jpg': 950103132} map_photo_id_path_extension : {950103132: {'path': 'temp/1744597657_648272_950103132_4f47bd527301396b0a701a1b4183ba00.jpg', 'extension': 'jpg'}} map_subphoto_mainphoto : {} Beginning of datou_step Crop ! param_json : {'photo_hashtag_type': 755, 'token': '78d09a0790ec6ecbf119343125a81fdc', 'feed_id_new_photos': 0, 'host': 'www.fotonower.com', 'crop_type': 'rle', 'margin_relative': 0.1, 'min_score': 0.3, 'upload,type': 'python'} margin_type : margin_relative margin_value : [0.1, 0.1, 0.1, 0.1] Loading chi in step crop with photo_hashtag_type : 755 Loading chi in step crop for list_pids : 1 ! batch 1 select photo_id, hashtag_id, `type`, x0, x1, y0, y1, score, id from MTRPhoto.crop_hashtag_ids where photo_id in ( 950103132) and `type` in (755) and score>0.3 Loaded 8 chid ids of type : 755 SELECT crop_hashtag_id, points FROM MTRPhoto.crop_polygon_points WHERE crop_hashtag_id in (1947670931,1947670932,1947670933,1947670934,1947670935,1947670936,1947670937,1947670938) ++++++++SELECT * FROM MTRPhoto.crop_segments WHERE crop_hashtag_id in (1947670931,1947670932,1947670933,1947670934,1947670935,1947670936,1947670937,1947670938) SELECT * FROM MTRPhoto.crop_sum_segments WHERE crop_hashtag_id in (1947670931,1947670932,1947670933,1947670934,1947670935,1947670936,1947670937,1947670938) select photo_id, sub_photo_id, x0, x1, y0, y1, resize_coeff_x, resize_coeff_y, crop_type, id from MTRPhoto.photo_sub_photos where photo_id in ( 950103132) WARNING : margin is only used for type bib ! type of cropped photo chosen : rle we resize croppped photo by 1 on x axis and by 1 on y axis we have both polygon and rles Here we manage rles ! we have both polygon and rles Here we manage rles ! we have both polygon and rles Here we manage rles ! we have both polygon and rles Here we manage rles ! we have both polygon and rles Here we manage rles ! we have both polygon and rles Here we manage rles ! we have both polygon and rles Here we manage rles ! we have both polygon and rles Here we manage rles ! map_result returned by crop_photo_return_map_crop : length : 8 map_result after crop : {1947670931: {'crop': 'temp/1744597657_648272_950103132_4f47bd527301396b0a701a1b4183ba00_rle_crop_1947670931_0.jpg', 'photo_id': 950103132, 'bib_crop': 'temp/1744597657_648272_950103132_4f47bd527301396b0a701a1b4183ba00_bib_crop_1947670931_0.jpg', 'coordonates': (183, 199, 15, 41), 'sub_photo_id': -1, 'same_chi': False}, 1947670932: {'crop': 'temp/1744597657_648272_950103132_4f47bd527301396b0a701a1b4183ba00_rle_crop_1947670932_0.jpg', 'photo_id': 950103132, 'bib_crop': 'temp/1744597657_648272_950103132_4f47bd527301396b0a701a1b4183ba00_bib_crop_1947670932_0.jpg', 'coordonates': (38, 85, 113, 140), 'sub_photo_id': -1, 'same_chi': False}, 1947670933: {'crop': 'temp/1744597657_648272_950103132_4f47bd527301396b0a701a1b4183ba00_rle_crop_1947670933_0.jpg', 'photo_id': 950103132, 'bib_crop': 'temp/1744597657_648272_950103132_4f47bd527301396b0a701a1b4183ba00_bib_crop_1947670933_0.jpg', 'coordonates': (168, 194, 141, 151), 'sub_photo_id': -1, 'same_chi': False}, 1947670934: {'crop': 'temp/1744597657_648272_950103132_4f47bd527301396b0a701a1b4183ba00_rle_crop_1947670934_0.jpg', 'photo_id': 950103132, 'bib_crop': 'temp/1744597657_648272_950103132_4f47bd527301396b0a701a1b4183ba00_bib_crop_1947670934_0.jpg', 'coordonates': (47, 101, 16, 110), 'sub_photo_id': -1, 'same_chi': False}, 1947670935: {'crop': 'temp/1744597657_648272_950103132_4f47bd527301396b0a701a1b4183ba00_rle_crop_1947670935_0.jpg', 'photo_id': 950103132, 'bib_crop': 'temp/1744597657_648272_950103132_4f47bd527301396b0a701a1b4183ba00_bib_crop_1947670935_0.jpg', 'coordonates': (175, 199, 104, 111), 'sub_photo_id': -1, 'same_chi': False}, 1947670936: {'crop': 'temp/1744597657_648272_950103132_4f47bd527301396b0a701a1b4183ba00_rle_crop_1947670936_0.jpg', 'photo_id': 950103132, 'bib_crop': 'temp/1744597657_648272_950103132_4f47bd527301396b0a701a1b4183ba00_bib_crop_1947670936_0.jpg', 'coordonates': (86, 130, 184, 196), 'sub_photo_id': -1, 'same_chi': False}, 1947670937: {'crop': 'temp/1744597657_648272_950103132_4f47bd527301396b0a701a1b4183ba00_rle_crop_1947670937_0.jpg', 'photo_id': 950103132, 'bib_crop': 'temp/1744597657_648272_950103132_4f47bd527301396b0a701a1b4183ba00_bib_crop_1947670937_0.jpg', 'coordonates': (79, 195, 0, 61), 'sub_photo_id': -1, 'same_chi': False}, 1947670938: {'crop': 'temp/1744597657_648272_950103132_4f47bd527301396b0a701a1b4183ba00_rle_crop_1947670938_0.jpg', 'photo_id': 950103132, 'bib_crop': 'temp/1744597657_648272_950103132_4f47bd527301396b0a701a1b4183ba00_bib_crop_1947670938_0.jpg', 'coordonates': (131, 155, 181, 195), 'sub_photo_id': -1, 'same_chi': False}} Here we crop with rles About to insert : list_path_to_insert length 8 new photo from crops ! About to upload 8 photos https://marlene.fotonower.com/api/v1/secured/portfolio/new?access_token=78d09a0790ec6ecbf119343125a81fdc upload in portfolio : 22346564 in upload media Upload medias : ['temp/1744597657_648272_950103132_4f47bd527301396b0a701a1b4183ba00_rle_crop_1947670931_0.jpg', 'temp/1744597657_648272_950103132_4f47bd527301396b0a701a1b4183ba00_rle_crop_1947670932_0.jpg', 'temp/1744597657_648272_950103132_4f47bd527301396b0a701a1b4183ba00_rle_crop_1947670933_0.jpg', 'temp/1744597657_648272_950103132_4f47bd527301396b0a701a1b4183ba00_rle_crop_1947670934_0.jpg', 'temp/1744597657_648272_950103132_4f47bd527301396b0a701a1b4183ba00_rle_crop_1947670935_0.jpg', 'temp/1744597657_648272_950103132_4f47bd527301396b0a701a1b4183ba00_rle_crop_1947670936_0.jpg', 'temp/1744597657_648272_950103132_4f47bd527301396b0a701a1b4183ba00_rle_crop_1947670937_0.jpg', 'temp/1744597657_648272_950103132_4f47bd527301396b0a701a1b4183ba00_rle_crop_1947670938_0.jpg'] : url : https://marlene.fotonower.com/api/v1/secured/photo/upload?token=78d09a0790ec6ecbf119343125a81fdc&datou=0 temp/1744597657_648272_950103132_4f47bd527301396b0a701a1b4183ba00_rle_crop_1947670931_0.jpg temp/1744597657_648272_950103132_4f47bd527301396b0a701a1b4183ba00_rle_crop_1947670932_0.jpg temp/1744597657_648272_950103132_4f47bd527301396b0a701a1b4183ba00_rle_crop_1947670933_0.jpg temp/1744597657_648272_950103132_4f47bd527301396b0a701a1b4183ba00_rle_crop_1947670934_0.jpg temp/1744597657_648272_950103132_4f47bd527301396b0a701a1b4183ba00_rle_crop_1947670935_0.jpg temp/1744597657_648272_950103132_4f47bd527301396b0a701a1b4183ba00_rle_crop_1947670936_0.jpg temp/1744597657_648272_950103132_4f47bd527301396b0a701a1b4183ba00_rle_crop_1947670937_0.jpg temp/1744597657_648272_950103132_4f47bd527301396b0a701a1b4183ba00_rle_crop_1947670938_0.jpg after data_to_send, before sending request after request b'\n\n\n\n\t\n\t\tError\n\t\t\n\t \n\t\n\t\n\t\t

Oops, an error occured

\n\n\t\t

\n\t\t\tThis exception has been logged with id 895cha3b8.\n\t\t

\n\n\t\n\n\n\n\n\n\n\n\n' 500 This exception has been logged with id 895cha3b8. uploaded one batch 0 Elapsed time : 251.00740456581116 map_result_insert : {} Globalization didn't found path temp/1744597657_648272_950103132_4f47bd527301396b0a701a1b4183ba00_rle_crop_1947670931_0.jpg in map_result_insert CONSIDER SERIOUSLY ! Globalization didn't found path temp/1744597657_648272_950103132_4f47bd527301396b0a701a1b4183ba00_rle_crop_1947670932_0.jpg in map_result_insert CONSIDER SERIOUSLY ! Globalization didn't found path temp/1744597657_648272_950103132_4f47bd527301396b0a701a1b4183ba00_rle_crop_1947670933_0.jpg in map_result_insert CONSIDER SERIOUSLY ! Globalization didn't found path temp/1744597657_648272_950103132_4f47bd527301396b0a701a1b4183ba00_rle_crop_1947670934_0.jpg in map_result_insert CONSIDER SERIOUSLY ! Globalization didn't found path temp/1744597657_648272_950103132_4f47bd527301396b0a701a1b4183ba00_rle_crop_1947670935_0.jpg in map_result_insert CONSIDER SERIOUSLY ! Globalization didn't found path temp/1744597657_648272_950103132_4f47bd527301396b0a701a1b4183ba00_rle_crop_1947670936_0.jpg in map_result_insert CONSIDER SERIOUSLY ! Globalization didn't found path temp/1744597657_648272_950103132_4f47bd527301396b0a701a1b4183ba00_rle_crop_1947670937_0.jpg in map_result_insert CONSIDER SERIOUSLY ! Globalization didn't found path temp/1744597657_648272_950103132_4f47bd527301396b0a701a1b4183ba00_rle_crop_1947670938_0.jpg in map_result_insert CONSIDER SERIOUSLY ! Now we prepare data that will be used for ellipse search ! chi_id found to be used 1947670931 path of cropped varroa found to be used to match on an ellipse temp/1744597657_648272_950103132_4f47bd527301396b0a701a1b4183ba00_rle_crop_1947670931_0.jpg chi_id found to be used 1947670932 path of cropped varroa found to be used to match on an ellipse temp/1744597657_648272_950103132_4f47bd527301396b0a701a1b4183ba00_rle_crop_1947670932_0.jpg chi_id found to be used 1947670933 path of cropped varroa found to be used to match on an ellipse temp/1744597657_648272_950103132_4f47bd527301396b0a701a1b4183ba00_rle_crop_1947670933_0.jpg chi_id found to be used 1947670934 path of cropped varroa found to be used to match on an ellipse temp/1744597657_648272_950103132_4f47bd527301396b0a701a1b4183ba00_rle_crop_1947670934_0.jpg chi_id found to be used 1947670935 path of cropped varroa found to be used to match on an ellipse temp/1744597657_648272_950103132_4f47bd527301396b0a701a1b4183ba00_rle_crop_1947670935_0.jpg chi_id found to be used 1947670936 path of cropped varroa found to be used to match on an ellipse temp/1744597657_648272_950103132_4f47bd527301396b0a701a1b4183ba00_rle_crop_1947670936_0.jpg chi_id found to be used 1947670937 path of cropped varroa found to be used to match on an ellipse temp/1744597657_648272_950103132_4f47bd527301396b0a701a1b4183ba00_rle_crop_1947670937_0.jpg chi_id found to be used 1947670938 path of cropped varroa found to be used to match on an ellipse temp/1744597657_648272_950103132_4f47bd527301396b0a701a1b4183ba00_rle_crop_1947670938_0.jpg insert ignore into MTRPhoto.crop_sub_photo_ids (crop_hashtag_id, sub_photo_id, mtr_user_id) VALUES (%s,%s,%s) : [] map of cropped photos with some data : {} After datou_step_exec type output : time spend for datou_step_exec : 252.7927463054657 time spend to save output : 8.153915405273438e-05 total time spend for step 1 : 252.79282784461975 caffe_path_current : About to save ! 1 Inside saveOutput : final : True verbose : True saveOutput not yet implemented for datou_step.type : crop we use saveGeneral [950103132] map_info['map_portfolio_photo'] : {} final : True mtd_id 686 list_pids : [950103132] Looping around the photos to save general results len do output : 0 before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('686', None, None, None, None, None, None, None, None) ('686', None, '950103132', None, None, None, None, None, None) begin to insert list_values into mtr_datou_result : length of list_values in save_final : 1 insert ignore into MTRPhoto.mtr_datou_result (mtd_id, mtr_portfolio_id,mtr_photo_id,result,result_long,result_double,hashtag_id,proba, mtr_current_id) values (%s,%s,%s,%s,%s,%s,%s,%s,%s) on duplicate key update mtr_portfolio_id = mtr_portfolio_id list_values : [('686', None, '950103132', None, None, None, None, None, None)] time used for this insertion : 0.11648702621459961 save_final save missing photos in datou_result : After save, about to update current ! datou_cur_ids : [] len(datou.list_steps) : 1 output : {} ret_da : {} 8 ERROR TEST CROP RLES Difference in size : ret_da_prev_reg : 8 and ret_da : 0 ERROR TEST CROP RLES no filename with crop_id_to_hash 1947670932 FOUND ERROR TEST CROP RLES different hash of same crop : hash_non_reg : f4e274dd08c90f327e74f1b91ebc5e43761642ac4456156033042a4b while hash_to_check : 741e1753b71b2b6b2879a507a69a00f8933bca84317a40e04a011d77 ERROR crop_rles FAILED ############################### TEST angular_coeff ################################ t Inside batchDatouExec : verbose : True ##### chargement datou SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=852 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=852 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 852 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=852 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! no param json to modify List Step Type Loaded in datou : angular_coeff list_input_json : [] ##### fin chargement datou ##### chargement data ##### Call load_data_input : nb_thread : 5 origin SELECT photo_id, url FROM MTRBack.photos ph WHERE photo_id IN (932296368) Found this number of photos: 1 ##### Call download_photos : nb_thread : 5 begin to download photo : 932296368 download finish for photo 932296368 we have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB ##### After download_photos length of list_filenames : 1 ; length of list_pids : 1 ; length of list_args : 1 ##### After load_data_input time to download the photos : 0.4164903163909912 #### fin chargement data Blocking on flush ? No conitnuing About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : True number of steps : 1 step1:angular_coeff Mon Apr 14 04:31:50 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec After prepare type args : Here we display some param of map_info ! map_filenames : {'temp/1744597910_648272_932296368_97c5e7b0f2830e550e2d6eeb248d8006.jpg': 932296368} map_photo_id_path_extension : {932296368: {'path': 'temp/1744597910_648272_932296368_97c5e7b0f2830e550e2d6eeb248d8006.jpg', 'extension': 'jpg'}} map_subphoto_mainphoto : {} beginning of step detection filter param_json : {'input_type': 846, 'output_type': -1, 'orientation_type': 872, 'ref_crop_type': 846, 'condition_crop': 'car', 'criteria_crop': 'center_rect', 'crops_coeffs': {'CAR_EXTERIEUR_angle_avant_droit.*': {'aile-avant': [[15, 0.0], [240, 0.0], [285, 1.0], [345, 1.0]], 'capot': [[45, 1.0], [60, 0.5], [270, 0.0], [315, 1.0], [360, 1.0]]}}} angular_coefficients_to_crops batch 1 select photo_id, hashtag_id, `type`, x0, x1, y0, y1, score, id from MTRPhoto.crop_hashtag_ids where photo_id in ( 932296368) and `type` in (846) Loaded 19 chid ids of type : 846 SELECT crop_hashtag_id, points FROM MTRPhoto.crop_polygon_points WHERE crop_hashtag_id in (769189713,769189714,769189715,769189716,769189717,769189718,769189721,769189723,769189724,769189725,769189727,769189729,769189730,769189732,769189733,769189734,769189737,769189738,769189739) SELECT * FROM MTRPhoto.crop_segments WHERE crop_hashtag_id in (769189713,769189714,769189715,769189716,769189717,769189718,769189721,769189723,769189724,769189725,769189727,769189729,769189730,769189732,769189733,769189734,769189737,769189738,769189739) SELECT * FROM MTRPhoto.crop_sum_segments WHERE crop_hashtag_id in (769189713,769189714,769189715,769189716,769189717,769189718,769189721,769189723,769189724,769189725,769189727,769189729,769189730,769189732,769189733,769189734,769189737,769189738,769189739) select distinct hashtag_id from MTRBack.photo_hashtag_ids where photo_id in (932296368) and type=872 treating photo 932296368 select distinct hashtag_id from MTRBack.photo_hashtag_ids where photo_id in (932296368) and type=872 After datou_step_exec type output : time spend for datou_step_exec : 4.658550500869751 time spend to save output : 5.698204040527344e-05 total time spend for step 1 : 4.658607482910156 caffe_path_current : About to save ! 0 After save, about to update current ! datou_cur_ids : [] len(datou.list_steps) : 1 output : {932296368: ([(932296368, 2106233860, 846, 1066, 1277, 93, 340, 0.31964028378983567, 0, []), (932296368, 2106233860, 846, 434, 690, 218, 498, 0.7170410105787726, 0, []), (932296368, 503548896, 846, 902, 1111, 466, 576, 0.31724966, 769189715, []), (932296368, 599722655, 846, 523, 1100, 152, 337, 0.98039776, 0, []), (932296368, 492601069, 846, 143, 1190, 90, 695, 0.9696157, 769189717, []), (932296368, 492601069, 846, 0, 408, 246, 719, 0.9431181, 769189718, []), (932296368, 2096875722, 846, 567, 964, 162, 215, 0.55490255, 769189721, []), (932296368, 2096875709, 846, 437, 939, 24, 198, 0.9983077, 769189723, []), (932296368, 2096875709, 846, 1004, 1263, 28, 144, 0.9485744, 769189724, []), (932296368, 624624117, 846, 595, 1122, 331, 640, 0.99100167, 769189725, []), (932296368, 492624020, 846, 585, 874, 308, 393, 0.78697366, 769189727, []), (932296368, 2096875719, 846, 943, 1100, 428, 547, 0.96733797, 769189729, []), (932296368, 492654799, 846, 253, 467, 35, 441, 0.99621326, 769189730, []), (932296368, 492689227, 846, 1118, 1264, 270, 438, 0.9901647, 769189732, []), (932296368, 492689227, 846, 486, 671, 378, 690, 0.98789483, 769189733, []), (932296368, 492689227, 846, 161, 255, 229, 409, 0.70801014, 769189734, []), (932296368, 492925064, 846, 261, 421, 27, 193, 0.92215157, 769189737, []), (932296368, 492925064, 846, 873, 1045, 46, 156, 0.7535122, 769189738, []), (932296368, 492925064, 846, 1090, 1279, 20, 107, 0.45259848, 769189739, [])],)} test angular coeff is a success ! ############################### TEST detection_filter_by_crop ################################ t Inside batchDatouExec : verbose : True ##### chargement datou SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=708 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=708 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 708 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=708 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! no param json to modify List Step Type Loaded in datou : detection_filter_by_crop list_input_json : [] ##### fin chargement datou ##### chargement data ##### Call load_data_input : nb_thread : 5 origin SELECT photo_id, url FROM MTRBack.photos ph WHERE photo_id IN (946711423) Found this number of photos: 1 ##### Call download_photos : nb_thread : 5 begin to download photo : 946711423 download finish for photo 946711423 we have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB ##### After download_photos length of list_filenames : 1 ; length of list_pids : 1 ; length of list_args : 1 ##### After load_data_input time to download the photos : 0.8827314376831055 #### fin chargement data Blocking on flush ? No conitnuing About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : True number of steps : 1 step1:detection_filter_by_crop Mon Apr 14 04:31:56 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec After prepare type args : Here we display some param of map_info ! map_filenames : {'temp/1744597915_648272_946711423_b4bef6b5c6c4b6ffae23f8718c42183c.jpg': 946711423} map_photo_id_path_extension : {946711423: {'path': 'temp/1744597915_648272_946711423_b4bef6b5c6c4b6ffae23f8718c42183c.jpg', 'extension': 'jpg'}} map_subphoto_mainphoto : {} beginning of step detection filter param_json : {'input_type': 631, 'output_type': -1, 'condition_type': 445, 'condition_crop': 'car', 'criteria_crop': 'center_rect', 'min_surface_ratio': 0.7} conditional_crop_copy batch 1 select photo_id, hashtag_id, `type`, x0, x1, y0, y1, score, id from MTRPhoto.crop_hashtag_ids where photo_id in ( 946711423) and `type` in (445) Loaded 3 chid ids of type : 445 SELECT crop_hashtag_id, points FROM MTRPhoto.crop_polygon_points WHERE crop_hashtag_id in (1947734477,18345275,18345276) +++SELECT * FROM MTRPhoto.crop_segments WHERE crop_hashtag_id in (1947734477,18345275,18345276) SELECT * FROM MTRPhoto.crop_sum_segments WHERE crop_hashtag_id in (1947734477,18345275,18345276) batch 1 select photo_id, hashtag_id, `type`, x0, x1, y0, y1, score, id from MTRPhoto.crop_hashtag_ids where photo_id in ( 946711423) and `type` in (631) Loaded 35 chid ids of type : 631 SELECT crop_hashtag_id, points FROM MTRPhoto.crop_polygon_points WHERE crop_hashtag_id in (1947740368,1947740369,1947740370,1947740371,1947740372,1947740373,1947740374,1947740375,1947740376,1947740377,1947740378,1947740379,1947740380,1947740381,1947740382,1947740383,1947740384,1947740385,1947740386,1947740387,1947740388,1947740389,1947740390,1947740391,1947740392,1947740393,1947740394,1947740395,1947740396,1947740397,1947740398,1947740399,1947740400,3140491551,3140491552) +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++SELECT * FROM MTRPhoto.crop_segments WHERE crop_hashtag_id in (1947740368,1947740369,1947740370,1947740371,1947740372,1947740373,1947740374,1947740375,1947740376,1947740377,1947740378,1947740379,1947740380,1947740381,1947740382,1947740383,1947740384,1947740385,1947740386,1947740387,1947740388,1947740389,1947740390,1947740391,1947740392,1947740393,1947740394,1947740395,1947740396,1947740397,1947740398,1947740399,1947740400,3140491551,3140491552) SELECT * FROM MTRPhoto.crop_sum_segments WHERE crop_hashtag_id in (1947740368,1947740369,1947740370,1947740371,1947740372,1947740373,1947740374,1947740375,1947740376,1947740377,1947740378,1947740379,1947740380,1947740381,1947740382,1947740383,1947740384,1947740385,1947740386,1947740387,1947740388,1947740389,1947740390,1947740391,1947740392,1947740393,1947740394,1947740395,1947740396,1947740397,1947740398,1947740399,1947740400,3140491551,3140491552) batch 1 select photo_id, hashtag_id, `type`, x0, x1, y0, y1, score, id from MTRPhoto.crop_hashtag_ids where photo_id in ( 946711423) and `type` in (445) Loaded 3 chid ids of type : 445 SELECT crop_hashtag_id, points FROM MTRPhoto.crop_polygon_points WHERE crop_hashtag_id in (1947734477,18345275,18345276) +++SELECT * FROM MTRPhoto.crop_segments WHERE crop_hashtag_id in (1947734477,18345275,18345276) SELECT * FROM MTRPhoto.crop_sum_segments WHERE crop_hashtag_id in (1947734477,18345275,18345276) treating photo 946711423 SELECT * FROM MTRPhoto.crop_segments WHERE crop_hashtag_id in (1947740368,1947740369,1947740370,1947740371,1947740372,1947740373,1947740374,1947740375,1947740376,1947740377,1947740378,1947740379,1947740380,1947740381,1947740382,1947740383,1947740384,1947740385,1947740386,1947740387,1947740388,1947740389,1947740390,1947740391,1947740392,1947740393,1947740394,1947740395,1947740396,1947740397,1947740398,1947740399,1947740400,3140491551,3140491552) crop duplicated : : {'photo_id': 946711423, 'hashtag_id': 624624117, 'type': 631, 'x0': 226, 'x1': 569, 'y0': 252, 'y1': 425, 'score': 0.99812776, 'id': 1947740368, 'points': ['395,419,341,419,340,418,316,418,315,417,306,417, crop duplicated : : {'photo_id': 946711423, 'hashtag_id': 492689227, 'type': 631, 'x0': 162, 'x1': 245, 'y0': 233, 'y1': 396, 'score': 0.99702626, 'id': 1947740369, 'points': ['215,393,206,393,202,390,200,390,192,383,191,380, crop duplicated : : {'photo_id': 946711423, 'hashtag_id': 492654799, 'type': 631, 'x0': 96, 'x1': 172, 'y0': 39, 'y1': 261, 'score': 0.9928518, 'id': 1947740370, 'points': ['143,252,143,249,141,246,140,246,138,248,138,251,137 crop not duplicated : : {'photo_id': 946711423, 'hashtag_id': 492689227, 'type': 631, 'x0': 545, 'x1': 612, 'y0': 186, 'y1': 276, 'score': 0.9876676, 'id': 1947740371, 'points': ['584,267,583,266,578,266,574,262,574,259,573,258,5 surface aoutside conditional crop crop duplicated : : {'photo_id': 946711423, 'hashtag_id': 2096875719, 'type': 631, 'x0': 468, 'x1': 555, 'y0': 292, 'y1': 365, 'score': 0.9830025, 'id': 1947740372, 'points': ['491,350,489,350,488,349,487,350,483,350,480,348, crop duplicated : : {'photo_id': 946711423, 'hashtag_id': 599722655, 'type': 631, 'x0': 176, 'x1': 535, 'y0': 138, 'y1': 264, 'score': 0.9818268, 'id': 1947740373, 'points': ['453,253,413,253,412,252,387,252,386,250,386,248,3 crop not duplicated : : {'photo_id': 946711423, 'hashtag_id': 492689227, 'type': 631, 'x0': 53, 'x1': 87, 'y0': 127, 'y1': 212, 'score': 0.9786105, 'id': 1947740374, 'points': ['74,201,69,201,67,199,66,199,65,198,62,192,62,190,61 surface aoutside conditional crop crop duplicated : : {'photo_id': 946711423, 'hashtag_id': 492844413, 'type': 631, 'x0': 89, 'x1': 163, 'y0': 93, 'y1': 144, 'score': 0.9772748, 'id': 1947740375, 'points': ['159,142,153,141,151,139,148,138,145,135,141,133,139 crop not duplicated : : {'photo_id': 946711423, 'hashtag_id': 492925064, 'type': 631, 'x0': 418, 'x1': 522, 'y0': 69, 'y1': 136, 'score': 0.97407305, 'id': 1947740376, 'points': ['510,121,507,121,505,119,501,120,500,119,500,113,4 surface aoutside conditional crop crop duplicated : : {'photo_id': 946711423, 'hashtag_id': 2096875709, 'type': 631, 'x0': 185, 'x1': 431, 'y0': 39, 'y1': 136, 'score': 0.97171515, 'id': 1947740377, 'points': ['331,134,287,134,286,133,284,133,283,134,272,134, crop duplicated : : {'photo_id': 946711423, 'hashtag_id': 2096875722, 'type': 631, 'x0': 198, 'x1': 395, 'y0': 118, 'y1': 142, 'score': 0.9699756, 'id': 1947740378, 'points': ['328,137,251,137,250,136,249,137,241,137,240,136, crop duplicated : : {'photo_id': 946711423, 'hashtag_id': 499500794, 'type': 631, 'x0': 93, 'x1': 107, 'y0': 127, 'y1': 146, 'score': 0.9574813, 'id': 1947740379, 'points': ['101,143,98,143,95,139,95,131,97,129,100,129,101,13 crop duplicated : : {'photo_id': 946711423, 'hashtag_id': 492925064, 'type': 631, 'x0': 71, 'x1': 125, 'y0': 36, 'y1': 95, 'score': 0.95296955, 'id': 1947740380, 'points': ['104,92,96,92,93,90,91,90,86,86,83,85,83,84,81,82,80 crop duplicated : : {'photo_id': 946711423, 'hashtag_id': 492925064, 'type': 631, 'x0': 101, 'x1': 167, 'y0': 38, 'y1': 127, 'score': 0.9508439, 'id': 1947740381, 'points': ['154,117,152,115,152,112,150,110,148,106,148,104,14 crop duplicated : : {'photo_id': 946711423, 'hashtag_id': 492624020, 'type': 631, 'x0': 249, 'x1': 400, 'y0': 219, 'y1': 316, 'score': 0.8792459, 'id': 1947740382, 'points': ['395,313,390,313,386,311,384,312,381,312,376,309,3 crop not duplicated : : {'photo_id': 946711423, 'hashtag_id': 492654799, 'type': 631, 'x0': 540, 'x1': 625, 'y0': 78, 'y1': 221, 'score': 0.87864035, 'id': 1947740383, 'points': ['567,127,566,127,565,126,564,109,562,106,560,106,5 surface aoutside conditional crop crop not duplicated : : {'photo_id': 946711423, 'hashtag_id': 492925064, 'type': 631, 'x0': 547, 'x1': 640, 'y0': 79, 'y1': 129, 'score': 0.8165246, 'id': 1947740384, 'points': ['630,96,627,96,627,94,628,92,629,92,631,94,631,95', surface aoutside conditional crop crop not duplicated : : {'photo_id': 946711423, 'hashtag_id': 492925064, 'type': 631, 'x0': 360, 'x1': 434, 'y0': 62, 'y1': 116, 'score': 0.74684095, 'id': 1947740385, 'points': ['415,103,413,103,411,101,408,101,405,99,403,99,401 surface aoutside conditional crop crop duplicated : : {'photo_id': 946711423, 'hashtag_id': 503548896, 'type': 631, 'x0': 302, 'x1': 540, 'y0': 339, 'y1': 403, 'score': 0.7406652, 'id': 1947740386, 'points': ['442,401,372,401,372,397,370,395,369,392,366,390,3 crop duplicated : : {'photo_id': 946711423, 'hashtag_id': 2106233860, 'type': 631, 'x0': 53, 'x1': 85, 'y0': 75, 'y1': 182, 'score': 0.73015845, 'id': 1947740387, 'points': ['70,147,68,145,65,139,65,137,62,132,61,128,57,126,5 crop duplicated : : {'photo_id': 946711423, 'hashtag_id': 2096875717, 'type': 631, 'x0': 477, 'x1': 510, 'y0': 220, 'y1': 243, 'score': 0.69028217, 'id': 1947740388, 'points': ['501,241,493,241,489,239,488,237,487,237,480,232 crop not duplicated : : {'photo_id': 946711423, 'hashtag_id': 492654799, 'type': 631, 'x0': 61, 'x1': 115, 'y0': 42, 'y1': 188, 'score': 0.6900027, 'id': 1947740389, 'points': ['92,47,91,45,92,44,96,45,94,45', '73,141,73,136,72,1 surface aoutside conditional crop crop duplicated : : {'photo_id': 946711423, 'hashtag_id': 2096875712, 'type': 631, 'x0': 309, 'x1': 326, 'y0': 382, 'y1': 404, 'score': 0.6633776, 'id': 1947740390, 'points': ['309,383,309,382,311,382', '325,385,324,383,319,3 crop duplicated : : {'photo_id': 946711423, 'hashtag_id': 2096875719, 'type': 631, 'x0': 427, 'x1': 553, 'y0': 258, 'y1': 315, 'score': 0.6446218, 'id': 1947740391, 'points': ['531,284,526,284,525,283,525,281,523,279,522,280, crop duplicated : : {'photo_id': 946711423, 'hashtag_id': 2106233861, 'type': 631, 'x0': 144, 'x1': 267, 'y0': 181, 'y1': 307, 'score': 0.63958377, 'id': 1947740392, 'points': ['212,251,209,251,208,250,203,251,201,250,201,249 crop duplicated : : {'photo_id': 946711423, 'hashtag_id': 2096875712, 'type': 631, 'x0': 285, 'x1': 433, 'y0': 343, 'y1': 377, 'score': 0.61493844, 'id': 1947740393, 'points': ['431,376,286,376,285,375,285,368,286,367,286,362 crop duplicated : : {'photo_id': 946711423, 'hashtag_id': 2106233860, 'type': 631, 'x0': 146, 'x1': 287, 'y0': 140, 'y1': 311, 'score': 0.54784286, 'id': 1947740394, 'points': ['234,254,227,254,221,251,219,248,215,253,212,253 crop not duplicated : : {'photo_id': 946711423, 'hashtag_id': 2106233860, 'type': 631, 'x0': 496, 'x1': 624, 'y0': 141, 'y1': 245, 'score': 0.46262404, 'id': 1947740395, 'points': ['603,176,599,173,595,176,593,176,590,174,589,174 surface aoutside conditional crop crop duplicated : : {'photo_id': 946711423, 'hashtag_id': 495920967, 'type': 631, 'x0': 202, 'x1': 524, 'y0': 112, 'y1': 333, 'score': 0.45109355, 'id': 1947740396, 'points': ['483,289,483,286,482,285,482,283,480,279,480,274, crop duplicated : : {'photo_id': 946711423, 'hashtag_id': 2096875722, 'type': 631, 'x0': 433, 'x1': 558, 'y0': 248, 'y1': 286, 'score': 0.44133398, 'id': 1947740397, 'points': ['492,272,474,272,473,271,468,271,465,269,460,269 crop not duplicated : : {'photo_id': 946711423, 'hashtag_id': 2106233861, 'type': 631, 'x0': 535, 'x1': 630, 'y0': 138, 'y1': 231, 'score': 0.42747068, 'id': 1947740398, 'points': ['590,171,589,170,585,170,584,171,581,169,579,169 surface aoutside conditional crop crop duplicated : : {'photo_id': 946711423, 'hashtag_id': 492654799, 'type': 631, 'x0': 399, 'x1': 569, 'y0': 68, 'y1': 251, 'score': 0.41876298, 'id': 1947740399, 'points': [], 'sub_photo_id': 0, 'rles': [], 'hashtag': '', ' crop duplicated : : {'photo_id': 946711423, 'hashtag_id': 492624020, 'type': 631, 'x0': 420, 'x1': 552, 'y0': 244, 'y1': 293, 'score': 0.35962066, 'id': 1947740400, 'points': ['474,289,453,289,452,288,439,288,437,286,431,286, crop duplicated : : {'photo_id': 946711423, 'hashtag_id': 503548896, 'type': 631, 'x0': 301, 'x1': 540, 'y0': 339, 'y1': 403, 'score': 0.740756, 'id': 3140491551, 'points': ['442,401,371,401,371,397,366,390,365,386,356,386,35 crop not duplicated : : {'photo_id': 946711423, 'hashtag_id': 2106233860, 'type': 631, 'x0': 496, 'x1': 624, 'y0': 140, 'y1': 245, 'score': 0.4627206, 'id': 3140491552, 'points': ['595,176,593,176,589,173,586,176,583,176,580,174, surface aoutside conditional crop After datou_step_exec type output : time spend for datou_step_exec : 4.378717422485352 time spend to save output : 4.673004150390625e-05 total time spend for step 1 : 4.3787641525268555 caffe_path_current : About to save ! 0 After save, about to update current ! datou_cur_ids : [] len(datou.list_steps) : 1 output : {946711423: ([(946711423, 624624117, 631, 226, 569, 252, 425, 0.99812776, 1947740368, ['395,419,341,419,340,418,316,418,315,417,306,417,305,416,293,415,290,413,284,412,283,411,280,411,272,407,264,405,258,400,254,398,250,394,244,391,242,389,242,386,239,380,240,368,239,367,239,347,238,346,238,331,237,330,237,327,238,326,237,314,239,311,239,308,237,304,238,302,243,298,244,296,244,292,246,291,250,291,251,290,259,290,260,289,264,289,265,288,269,288,271,290,273,294,278,299,280,300,285,300,286,301,293,301,294,302,302,304,305,307,309,308,312,310,314,310,317,312,335,312,336,313,343,313,344,314,370,314,371,315,381,315,382,314,389,313,393,311,405,309,406,308,408,308,412,306,414,304,417,304,421,307,426,308,427,309,433,309,434,310,464,309,467,306,471,304,476,304,477,303,489,303,490,302,494,302,495,301,500,301,501,300,515,300,516,299,519,298,522,292,525,290,533,290,534,291,540,291,541,290,543,290,547,288,550,285,550,285,552,289,552,291,553,292,553,313,552,314,552,324,550,328,550,333,549,334,549,336,544,346,543,353,539,361,532,368,531,368,527,372,519,374,509,379,503,384,499,385,498,386,496,386,492,388,490,390,486,392,484,392,479,396,475,397,474,398,472,398,471,399,469,399,462,403,460,403,459,404,457,404,456,405,454,405,450,407,448,407,443,410,425,413,424,414,422,414,416,417,404,417,403,418,396,418']), (946711423, 492689227, 631, 162, 245, 233, 396, 0.99702626, 1947740369, ['215,393,206,393,202,390,200,390,192,383,191,380,187,375,184,369,184,367,180,360,180,358,179,357,177,349,175,347,174,339,172,336,171,330,170,329,169,324,168,323,168,313,167,312,167,304,166,303,166,298,165,297,165,288,164,287,165,286,165,272,166,271,166,268,167,267,167,263,168,262,169,254,173,249,177,247,178,247,181,251,184,251,184,252,187,255,189,255,193,259,193,261,195,263,195,264,201,270,203,278,207,282,208,289,211,293,211,296,213,299,214,304,215,305,216,312,219,316,219,319,220,320,220,325,222,329,222,335,223,336,223,338,225,342,225,349,226,350,226,359,227,360,227,366,228,367,228,371,231,375,231,382,227,385,226,388,225,389,223,388,219,392,216,392']), (946711423, 492654799, 631, 96, 172, 39, 261, 0.9928518, 1947740370, ['143,252,143,249,141,246,140,246,138,248,138,251,137,250,137,248,135,246,134,246,132,248,127,244,124,244,122,241,122,236,121,235,121,232,118,229,117,225,116,224,116,212,113,209,115,207,116,201,111,194,110,184,106,178,107,154,108,152,112,148,113,144,112,143,112,138,110,136,108,136,107,135,103,128,103,124,102,123,102,121,103,120,103,118,106,115,106,106,107,105,110,104,113,101,117,93,117,71,114,65,116,61,116,59,117,58,117,55,118,54,119,49,122,45,122,44,124,42,150,42,151,43,153,43,153,47,152,48,152,50,154,52,155,56,156,57,156,85,155,86,155,95,154,96,154,98,155,99,155,105,156,106,155,107,155,116,157,120,159,121,159,123,156,127,156,134,157,135,157,138,156,139,156,141,154,145,152,147,150,151,149,159,148,160,148,164,149,165,149,174,148,175,148,197,149,198,149,215,150,216,150,241,149,242,149,245,148,247,146,245,144,247', '122,147,121,138,120,141,119,142,119,144,118,145,121,148']), (946711423, 2096875719, 631, 468, 555, 292, 365, 0.9830025, 1947740372, ['491,350,489,350,488,349,487,350,483,350,480,348,480,341,482,339,482,337,485,334,487,334,491,330,494,330,495,328,498,326,501,326,503,324,507,325,509,323,514,321,516,319,518,321,520,321,521,319,522,319,524,321,527,321,530,317,530,315,531,314,535,313,540,309,543,310,544,311,542,313,542,314,544,316,541,318,541,322,536,322,535,323,533,323,532,322,528,322,527,321,524,321,522,323,518,322,516,324,517,327,516,328,512,327,510,329,512,332,513,332,515,330,516,331,516,333,514,332,511,333,511,336,514,337,516,336,516,339,515,339,513,338,511,340,512,341,512,342,510,343,507,343,502,347,500,347,497,349,492,349', '514,325,515,324,513,322,512,322,511,325,512,326', '522,327,521,327,521,326,522,325']), (946711423, 599722655, 631, 176, 535, 138, 264, 0.9818268, 1947740373, ['453,253,413,253,412,252,387,252,386,250,386,248,383,246,379,245,376,243,361,243,361,240,362,239,359,238,358,237,356,237,355,236,352,236,351,235,333,235,332,234,329,234,329,233,331,231,331,229,329,228,328,224,330,222,330,221,324,218,308,219,307,218,302,218,298,216,288,217,287,218,285,218,283,220,283,221,287,224,295,225,295,225,294,226,289,226,288,227,283,227,282,228,273,228,272,229,271,228,259,228,258,227,254,227,253,226,247,225,247,225,251,221,248,218,243,216,247,213,248,213,249,212,248,211,246,211,245,210,241,210,240,209,237,209,236,208,231,207,230,206,228,202,224,201,223,200,221,200,220,199,214,198,213,195,211,193,208,193,203,189,203,184,201,181,201,176,198,171,199,170,199,158,203,154,205,153,205,151,206,149,209,149,210,148,225,148,226,147,283,147,284,148,287,148,288,147,305,147,306,148,312,148,313,147,354,147,355,146,428,146,429,147,433,147,434,148,437,148,438,149,451,149,457,156,459,162,462,165,464,166,471,166,472,165,477,165,480,167,480,171,486,175,488,175,489,176,502,176,503,178,503,180,509,185,509,189,512,193,512,199,513,200,513,203,514,204,514,210,513,211,514,217,512,221,513,222,513,225,510,229,510,235,507,237,504,238,502,243,490,243,489,244,485,244,484,245,480,245,479,246,463,246,462,247,460,247,458,249,457,252,454,252', '528,212,528,207,526,206,524,203,526,203,527,202,528,202', '299,215,302,212,299,211,298,210,291,210,290,211,281,212,286,215,290,215,291,216', '375,242,376,240,375,238,363,239,368,242,371,242,372,243']), (946711423, 492844413, 631, 89, 163, 93, 144, 0.9772748, 1947740375, ['159,142,153,141,151,139,148,138,145,135,141,133,139,133,138,132,131,132,130,131,125,131,124,130,121,130,120,129,116,129,115,128,112,128,108,126,106,126,100,123,98,121,94,113,94,104,97,101,103,98,105,98,106,97,110,97,111,96,116,96,117,95,132,95,133,96,139,97,141,99,144,100,149,105,150,107,154,108,155,113,157,115,158,115,160,118,160,120,161,121,161,133,160,134,160,140']), (946711423, 2096875709, 631, 185, 431, 39, 136, 0.97171515, 1947740377, ['331,134,287,134,286,133,284,133,283,134,272,134,271,133,264,133,263,134,258,134,257,133,254,133,253,132,236,132,235,131,225,131,224,132,223,131,213,131,212,130,208,130,207,129,204,129,203,128,199,127,193,121,192,117,189,113,189,110,188,109,187,93,186,92,187,91,187,89,186,88,186,65,185,64,186,63,186,61,185,60,185,48,186,47,186,42,187,40,232,40,233,41,248,41,249,42,281,43,282,44,290,44,291,45,300,45,301,46,308,46,309,47,314,47,315,48,322,49,328,53,334,54,336,56,339,57,344,62,349,64,351,66,353,67,356,67,358,69,359,72,363,76,367,78,369,80,379,91,380,93,383,94,390,100,393,101,395,103,396,106,399,109,402,110,406,115,408,115,410,117,410,120,412,123,411,127,409,129,399,129,398,130,395,130,394,131,378,131,377,132,368,132,367,131,346,131,345,132,342,132,341,133,332,133']), (946711423, 2096875722, 631, 198, 395, 118, 142, 0.9699756, 1947740378, ['328,137,251,137,250,136,249,137,241,137,240,136,219,136,218,135,213,135,212,134,206,133,205,132,201,131,200,130,200,122,201,121,205,121,206,122,222,122,226,124,239,124,240,125,369,125,370,124,371,125,389,125,391,127,391,133,390,134,386,134,385,135,380,135,379,134,375,134,374,135,341,135,340,136,329,136']), (946711423, 499500794, 631, 93, 107, 127, 146, 0.9574813, 1947740379, ['101,143,98,143,95,139,95,131,97,129,100,129,101,133,102,134,102,136,103,137,103,140']), (946711423, 492925064, 631, 71, 125, 36, 95, 0.95296955, 1947740380, ['104,92,96,92,93,90,91,90,86,86,83,85,83,84,81,82,80,82,75,77,75,75,74,74,74,66,75,65,75,62,77,60,77,58,80,55,80,54,83,51,83,50,88,45,94,44,95,43,99,43,100,42,113,42,117,45,117,47,116,48,116,51,115,52,114,59,113,60,112,65,111,66,111,69,110,70,110,75,109,76,109,83,108,84,108,86,109,87,108,89']), (946711423, 492925064, 631, 101, 167, 38, 127, 0.9508439, 1947740381, ['154,117,152,115,152,112,150,110,148,106,148,104,145,101,143,100,138,100,137,99,135,99,133,95,131,95,126,93,126,91,128,88,128,83,129,82,129,70,127,68,127,66,128,65,125,61,127,59,127,56,129,52,129,49,130,47,135,42,144,42,148,45,151,49,151,60,152,61,152,75,153,76,153,80,155,83,155,87,156,88,156,105,155,106,156,107,156,110,154,112,156,116', '109,100,108,100,107,99,109,97']), (946711423, 492624020, 631, 249, 400, 219, 316, 0.8792459, 1947740382, ['395,313,390,313,386,311,384,312,381,312,376,309,358,308,357,307,354,307,353,306,350,306,349,307,345,305,343,303,341,304,337,304,334,302,325,302,324,301,315,300,313,298,313,297,310,295,304,295,300,293,295,293,291,288,289,287,283,287,281,285,281,283,278,280,274,280,272,279,272,276,270,273,270,270,269,268,266,265,265,265,264,264,264,262,261,260,260,258,260,256,261,255,259,252,259,248,258,246,255,244,256,241,252,239,251,238,251,226,265,226,266,227,268,227,272,232,276,232,277,233,279,233,281,234,283,237,285,238,290,239,293,241,296,241,304,246,312,247,316,251,318,252,320,252,326,255,328,255,337,260,342,260,343,261,345,261,349,264,351,264,355,266,357,268,364,271,366,273,370,275,374,275,376,276,377,279,379,281,383,282,384,283,386,283,387,286,390,289,390,290,394,294,396,294,398,296,398,308,397,309,397,311']), (946711423, 503548896, 631, 302, 540, 339, 403, 0.7406652, 1947740386, ['442,401,372,401,372,397,370,395,369,392,366,390,367,389,366,386,357,386,354,384,350,384,349,383,320,383,319,382,320,378,318,376,318,374,314,370,309,370,308,369,306,369,305,363,305,357,306,356,306,353,307,353,308,354,313,354,314,355,315,354,320,354,321,353,331,353,332,354,335,354,336,355,339,355,340,356,379,356,380,357,406,357,407,356,409,356,410,357,474,357,475,356,482,356,484,357,485,356,488,356,493,353,501,354,502,353,506,353,507,352,517,352,518,351,522,351,525,347,527,346,530,347,530,349,533,351,530,355,528,355,527,356,515,356,509,359,508,361,505,362,503,365,497,368,494,372,490,373,489,374,492,376,495,376,493,377,488,378,490,380,495,380,497,381,497,381,487,382,485,385,476,387,469,392,466,392,465,393,460,393,456,396,453,397,451,399,443,400', '519,353,518,352,517,353,518,354']), (946711423, 2106233860, 631, 53, 85, 75, 182, 0.73015845, 1947740387, ['70,147,68,145,65,139,65,137,62,132,61,128,57,126,56,124,56,121,54,119,54,110,56,108,56,103,59,100,60,101,61,100,61,96,63,93,63,89,66,84,65,83,65,80,66,78,68,78,68,79,70,80,70,83,74,87,74,90,75,91,75,100,77,102,77,105,75,106,75,125,76,126,77,125,77,125,77,128,76,129,77,131,77,136,75,139,75,143,78,145,76,146,71,146', '61,107,60,106,59,107,60,108', '77,134,76,131,75,134,76,135']), (946711423, 2096875717, 631, 477, 510, 220, 243, 0.69028217, 1947740388, ['501,241,493,241,489,239,488,237,487,237,480,232,479,230,479,226,484,222,487,222,488,223,492,224,496,228,497,228,497,229,502,234,502,235,504,236,504,240,502,240']), (946711423, 2096875712, 631, 309, 326, 382, 404, 0.6633776, 1947740390, ['309,383,309,382,311,382', '325,385,324,383,319,383,318,382,325,382', '320,400,311,400,309,398,309,385,310,386,311,385,315,385,316,384,318,384,319,385,322,385,325,387,325,398,323,398']), (946711423, 2096875719, 631, 427, 553, 258, 315, 0.6446218, 1947740391, ['531,284,526,284,525,283,525,281,523,279,522,280,519,281,521,282,521,283,519,284,518,283,519,281,515,279,516,277,515,276,513,276,512,277,513,279,511,280,507,279,505,276,504,279,497,279,496,278,495,279,485,279,484,280,480,280,479,281,481,283,482,283,482,283,469,283,468,284,438,284,436,283,440,279,446,279,447,278,456,278,458,276,457,275,457,275,467,275,468,274,490,274,491,273,494,273,496,271,496,269,499,268,501,266,503,265,506,265,510,263,514,263,516,261,520,259,544,259,544,259,543,260,545,262,548,262,550,263,550,276,549,277,547,277,540,282,538,282,537,283,532,283']), (946711423, 2106233861, 631, 144, 267, 181, 307, 0.63958377, 1947740392, ['212,251,209,251,208,250,203,251,201,250,201,249,195,243,189,242,188,241,185,241,184,240,182,236,180,236,179,235,173,235,172,234,170,235,164,235,163,234,163,232,162,231,163,217,166,217,168,218,170,215,171,210,172,209,173,209,176,212,178,210,178,208,181,203,186,203,188,201,193,201,194,202,195,201,201,201,202,202,204,202,205,201,209,201,210,202,212,202,215,200,217,200,220,202,221,201,227,201,231,205,231,206,234,209,235,209,235,210,238,213,238,224,234,228,235,232,234,233,228,234,225,237,224,241,222,242,216,242,209,246,211,248,212,248,213,250', '221,228,220,227,219,228,220,229', '224,238,224,237,221,235,217,237,219,239']), (946711423, 2096875712, 631, 285, 433, 343, 377, 0.61493844, 1947740393, ['431,376,286,376,285,375,285,368,286,367,286,362,287,361,287,359,291,359,297,362,306,363,307,364,312,364,313,365,322,366,323,367,331,366,332,368,334,368,335,369,338,368,337,366,336,366,337,365,336,364,327,364,325,361,319,361,317,357,317,356,318,355,325,355,326,353,331,353,333,351,332,350,330,350,328,348,326,348,325,347,319,347,315,345,306,345,305,344,297,344,299,344,300,343,431,343,432,344,432,353,431,354,431,358,430,359,430,365,427,365,425,363,424,363,422,364,421,366,418,366,413,369,404,370,409,371,409,371,399,371,398,372,395,373,419,374,420,373,426,372,428,370,428,367,429,367,430,368,429,369,430,370,430,373,431,374', '381,373,378,372,377,371,356,371,356,371,359,370,347,369,345,367,343,367,342,368,343,369,341,370,354,371,354,371,352,372,353,373,359,373,360,374']), (946711423, 2106233860, 631, 146, 287, 140, 311, 0.54784286, 1947740394, ['234,254,227,254,221,251,219,248,215,253,212,253,210,252,206,247,203,247,198,243,197,243,194,239,189,238,186,236,182,236,181,235,167,235,164,233,164,228,159,227,158,226,158,219,159,218,159,213,162,207,162,205,169,192,169,186,170,185,172,185,177,179,175,175,173,173,177,171,181,171,182,170,184,170,187,167,187,164,188,163,188,161,199,161,202,164,205,165,207,167,209,167,212,165,215,165,216,168,218,170,219,170,221,168,221,164,220,163,220,161,222,161,223,160,230,160,231,159,242,159,244,158,247,161,248,161,247,162,246,168,248,172,248,174,253,176,254,180,253,182,249,182,247,185,249,188,253,188,254,189,254,194,249,194,247,196,247,198,249,200,252,200,253,199,255,202,255,205,254,206,254,208,250,207,249,206,246,209,246,210,249,214,252,212,254,212,254,214,255,215,255,217,254,218,254,221,252,221,249,219,247,221,247,225,249,228,250,228,252,226,253,224,253,224,253,229,252,229,251,228,249,228,247,230,247,233,246,234,246,237,245,238,245,240,243,244,243,247,239,251,237,251', '230,167,229,166,227,167,228,168']), (946711423, 495920967, 631, 202, 524, 112, 333, 0.45109355, 1947740396, ['483,289,483,286,482,285,482,283,480,279,480,274,476,270,472,268,465,268,464,269,459,269,458,268,454,268,453,267,437,267,436,268,428,268,427,269,418,269,417,270,414,270,410,266,410,265,416,262,418,262,421,260,423,260,425,259,426,257,424,255,422,255,419,253,417,253,416,252,412,251,410,250,410,249,412,249,413,248,415,248,416,247,422,246,428,243,429,242,428,241,424,240,423,239,420,239,419,238,390,238,389,237,386,237,385,236,369,236,368,235,363,234,363,233,364,232,364,230,366,226,365,225,357,220,344,220,341,218,339,218,339,218,342,212,342,210,336,207,327,207,326,206,319,206,318,205,314,205,313,204,297,204,291,207,288,210,288,212,291,217,290,220,288,222,284,224,282,224,278,227,273,228,271,230,270,235,265,239,262,236,261,232,263,228,266,226,261,224,256,219,256,210,249,206,242,205,237,202,234,195,226,186,227,184,227,180,228,179,225,175,225,174,222,171,225,165,227,163,229,158,230,157,232,156,235,156,236,155,239,155,240,154,245,154,246,155,254,155,255,156,258,156,259,157,268,157,269,156,272,156,273,155,280,155,281,156,298,156,300,155,301,156,307,156,308,157,311,157,318,152,322,151,323,150,333,150,338,146,339,146,342,143,343,143,346,140,357,140,362,136,366,134,368,134,369,133,373,133,374,132,377,132,378,131,388,131,389,130,410,130,411,131,417,131,428,140,432,142,434,142,435,143,443,145,446,147,448,147,451,154,453,156,457,158,462,159,463,160,466,160,467,161,472,162,474,163,474,164,481,171,489,175,491,175,492,176,494,176,495,177,499,178,500,179,502,184,507,189,517,194,518,195,514,201,514,203,518,207,519,209,518,214,515,218,517,227,515,229,515,231,514,232,515,236,518,239,518,252,519,253,519,263,518,264,518,267,517,269,514,272,512,273,512,274,506,280,500,277,498,273,496,272,493,272,491,274,491,278,490,279,490,281', '312,179,311,178,308,179,309,180', '268,269,264,269,259,266,259,262,261,258,261,250,265,245,269,250,270,257,274,260,278,265,275,267,269,268', '414,281,401,281,414,281']), (946711423, 2096875722, 631, 433, 558, 248, 286, 0.44133398, 1947740397, ['492,272,474,272,473,271,468,271,465,269,460,269,460,268,465,266,467,266,468,265,470,265,471,264,475,264,476,263,479,263,480,262,486,262,487,261,491,261,492,260,495,260,496,259,502,259,506,257,510,257,514,255,517,255,518,254,530,253,531,252,535,252,536,251,538,251,539,252,543,252,544,253,547,253,549,251,553,251,555,253,555,267,552,270,550,270,550,269,548,267,547,267,547,267,548,266,547,265,545,266,540,266,539,264,530,264,529,263,524,263,519,266,513,266,510,268,507,268,506,269,499,270,498,271,493,271', '438,279,435,279,435,273,436,272,448,271,449,272,448,274,443,274,440,277,440,278']), (946711423, 492654799, 631, 399, 569, 68, 251, 0.41876298, 1947740399, []), (946711423, 492624020, 631, 420, 552, 244, 293, 0.35962066, 1947740400, ['474,289,453,289,452,288,439,288,437,286,431,286,427,284,423,284,422,283,422,275,427,275,428,273,430,272,435,272,436,271,438,271,442,269,447,269,450,267,454,267,460,264,464,264,467,262,483,261,484,260,488,260,489,259,494,259,495,258,502,258,503,257,505,257,509,255,512,255,516,252,520,252,521,251,526,250,530,248,534,248,535,247,546,247,547,248,549,248,549,250,550,251,550,266,551,267,551,275,550,276,550,278,549,279,549,281,537,282,535,284,528,284,527,285,504,285,503,286,495,286,492,288,488,287,487,288,475,288']), (946711423, 503548896, 631, 301, 540, 339, 403, 0.740756, 3140491551, ['442,401,371,401,371,397,366,390,365,386,356,386,353,384,348,383,319,383,319,378,314,370,310,370,305,368,304,357,305,353,330,353,339,356,378,356,379,357,474,357,475,356,488,356,493,353,501,354,507,352,517,352,522,351,527,346,530,347,533,351,530,355,527,356,515,356,505,362,503,365,497,368,494,372,489,374,492,376,488,378,490,380,495,380,487,382,485,385,476,387,469,392,461,393,456,395,451,399,447,399', '519,353,518,352,517,353,518,354'])],)} test detection filter by crop is a success ! ############################### TEST detection_filter_by_classif ################################ t SELECT id FROM MTRPhoto.crop_hashtag_ids WHERE photo_id=946711423 AND `type`=816 DELETE FROM MTRPhoto.crop_hashtag_ids WHERE id IN (3766703366,3766703365,3766703364,3766703373,3766703372,3766703371,3766703370,3766703369,3766703378,3766703381,3766703367,3766703368,3766703377,3766703376,3766703382,3766703383,3766703384,3766703386,3766703374,3766703380,3766703379,3766703385,3766703375) Catched exception ! Connect or reconnect ! (1205, 'Lock wait timeout exceeded; try restarting transaction') ERROR detection_filter_by_classif FAILED ############################### TEST blur_detection ################################ t Inside batchDatouExec : verbose : True ##### chargement datou SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=1243 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=1243 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 1243 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=1243 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! no param json to modify List Step Type Loaded in datou : blur_detection list_input_json : [] ##### fin chargement datou ##### chargement data ##### Call load_data_input : nb_thread : 5 origin SELECT photo_id, url FROM MTRBack.photos ph WHERE photo_id IN (930729675) Found this number of photos: 1 ##### Call download_photos : nb_thread : 5 begin to download photo : 930729675 download finish for photo 930729675 we have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB ##### After download_photos length of list_filenames : 1 ; length of list_pids : 1 ; length of list_args : 1 ##### After load_data_input time to download the photos : 0.5177311897277832 #### fin chargement data Blocking on flush ? No conitnuing About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : True number of steps : 1 step1:blur_detection Mon Apr 14 04:32:54 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec After prepare type args : Here we display some param of map_info ! map_filenames : {'temp/1744597974_648272_930729675_b2d2beaaee733d521cbb0c9800a29073.jpg': 930729675} map_photo_id_path_extension : {930729675: {'path': 'temp/1744597974_648272_930729675_b2d2beaaee733d521cbb0c9800a29073.jpg', 'extension': 'jpg'}} map_subphoto_mainphoto : {} inside step blur_detection methode: ratio et variance treat image : temp/1744597974_648272_930729675_b2d2beaaee733d521cbb0c9800a29073.jpg resize: (600, 800) 930729675 12.961859636534896 score_blur_detection : {930729675: [(930729675, 12.961859636534896, 492688767)]} After datou_step_exec type output : time spend for datou_step_exec : 0.31903791427612305 time spend to save output : 4.172325134277344e-05 total time spend for step 1 : 0.3190796375274658 caffe_path_current : About to save ! 0 After save, about to update current ! datou_cur_ids : [] len(datou.list_steps) : 1 output : {930729675: [(930729675, 12.961859636534896, 492688767)]} {930729675: [(930729675, 12.961859636534896, 492688767)]} ############################### TEST detect_point_224x224 ################################ test_detect_point_224x224 Inside batchDatouExec : verbose : True ##### chargement datou SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=1908 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=1908 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 1908 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=1908 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : step 4589 thcl is not linked in the step_by_step architecture ! WARNING : step 4590 argmax is not linked in the step_by_step architecture ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! DataTypes for each output/input checked ! no param json to modify List Step Type Loaded in datou : thcl, argmax list_input_json : [] ##### fin chargement datou ##### chargement data ##### Call load_data_input : nb_thread : 5 origin SELECT photo_id, url FROM MTRBack.photos ph WHERE photo_id IN (987515175,987515176,987515177,987515178,987515179,987515180,987515181,987515182,987515183,987515184,987515185,987515186,987515187,987515188,987515189,987515190,987515192,987515193,987515195,987515196,987515198,987515200,987515201,987515202,987515204,987515205,987515207,987515208,987515209,987515211,987515212,987515213,987515215,987515216,987515217,987515219,987515220,987515222,987515223,987515224,987515226,987515227,987515228,987515230,987515231,987515232,987515233,987515234,987515235,987515236,987515237,987515238,987515239,987515240,987515241,987515242,987515243,987515244,987515245,987515246,987515247,987515248,987515249,987515250) Found this number of photos: 64 ##### Call download_photos : nb_thread : 5 begin to download photo : 987515175 begin to download photo : 987515188 begin to download photo : 987515207 begin to download photo : 987515239 begin to download photo : 987515224 download finish for photo 987515224 begin to download photo : 987515226 download finish for photo 987515207 begin to download photo : 987515208 download finish for photo 987515239 begin to download photo : 987515240 download finish for photo 987515188 begin to download photo : 987515189 download finish for photo 987515175 begin to download photo : 987515176 download finish for photo 987515176 begin to download photo : 987515177 download finish for photo 987515208 begin to download photo : 987515209 download finish for photo 987515189 begin to download photo : 987515190 download finish for photo 987515226 begin to download photo : 987515227 download finish for photo 987515240 begin to download photo : 987515241 download finish for photo 987515190 begin to download photo : 987515192 download finish for photo 987515177 begin to download photo : 987515178 download finish for photo 987515241 begin to download photo : 987515242 download finish for photo 987515227 begin to download photo : 987515228 download finish for photo 987515209 begin to download photo : 987515211 download finish for photo 987515242 begin to download photo : 987515243 download finish for photo 987515228 begin to download photo : 987515230 download finish for photo 987515211 begin to download photo : 987515212 download finish for photo 987515178 begin to download photo : 987515179 download finish for photo 987515243 begin to download photo : 987515244 download finish for photo 987515179 begin to download photo : 987515180 download finish for photo 987515192 begin to download photo : 987515193 download finish for photo 987515230 begin to download photo : 987515231 download finish for photo 987515212 begin to download photo : 987515213 download finish for photo 987515244 begin to download photo : 987515245 download finish for photo 987515180 begin to download photo : 987515181 download finish for photo 987515213 begin to download photo : 987515215 download finish for photo 987515231 begin to download photo : 987515232 download finish for photo 987515193 begin to download photo : 987515195 download finish for photo 987515181 begin to download photo : 987515182 download finish for photo 987515232 begin to download photo : 987515233 download finish for photo 987515195 begin to download photo : 987515196 download finish for photo 987515245 begin to download photo : 987515246 download finish for photo 987515215 begin to download photo : 987515216 download finish for photo 987515182 begin to download photo : 987515183 download finish for photo 987515216 begin to download photo : 987515217 download finish for photo 987515196 begin to download photo : 987515198 download finish for photo 987515246 begin to download photo : 987515247 download finish for photo 987515233 begin to download photo : 987515234 download finish for photo 987515217 begin to download photo : 987515219 download finish for photo 987515183 begin to download photo : 987515184 download finish for photo 987515198 begin to download photo : 987515200 download finish for photo 987515234 begin to download photo : 987515235 download finish for photo 987515247 begin to download photo : 987515248 download finish for photo 987515219 begin to download photo : 987515220 download finish for photo 987515200 begin to download photo : 987515201 download finish for photo 987515235 begin to download photo : 987515236 download finish for photo 987515220 begin to download photo : 987515222 download finish for photo 987515248 begin to download photo : 987515249 download finish for photo 987515184 begin to download photo : 987515185 download finish for photo 987515201 begin to download photo : 987515202 download finish for photo 987515236 begin to download photo : 987515237 download finish for photo 987515185 begin to download photo : 987515186 download finish for photo 987515222 begin to download photo : 987515223 download finish for photo 987515249 begin to download photo : 987515250 download finish for photo 987515237 begin to download photo : 987515238 download finish for photo 987515202 begin to download photo : 987515204 download finish for photo 987515186 begin to download photo : 987515187 download finish for photo 987515238 download finish for photo 987515250 download finish for photo 987515223 download finish for photo 987515204 begin to download photo : 987515205 download finish for photo 987515187 download finish for photo 987515205 we have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB ##### After download_photos length of list_filenames : 64 ; length of list_pids : 64 ; length of list_args : 64 ##### After load_data_input time to download the photos : 2.721752166748047 #### fin chargement data Blocking on flush ? No conitnuing About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : True number of steps : 2 step1:thcl Mon Apr 14 04:32:57 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec After prepare type args : Here we display some param of map_info ! map_filenames : {'temp/1744597975_648272_987515224_e8747b400e713ecbd08d5b75db4d7568.jpg': 987515224, 'temp/1744597975_648272_987515226_a18048dca1a77ae086b62cf07759f704.jpg': 987515226, 'temp/1744597975_648272_987515227_e9c45a0e576ec9e44c1379c3fc5fec7c.jpg': 987515227, 'temp/1744597975_648272_987515228_9f1759f20c9e603bccb9f9879d2f0d54.jpg': 987515228, 'temp/1744597975_648272_987515230_846ad925884264181565c81d152a2e94.jpg': 987515230, 'temp/1744597975_648272_987515231_dbf4cafa71b6db4771c5c8f0c25e9cda.jpg': 987515231, 'temp/1744597975_648272_987515232_38db7950cdb3c674ee0ad65915b021f3.jpg': 987515232, 'temp/1744597975_648272_987515233_a92514bed0e8c5724f2d032d3ab1e2ad.jpg': 987515233, 'temp/1744597975_648272_987515234_2eca3480aed0f8b876242675ad99b666.jpg': 987515234, 'temp/1744597975_648272_987515235_87075955a2f76b3948b47ffe1825ecd9.jpg': 987515235, 'temp/1744597975_648272_987515236_8b44a98b1aceadad73ed000d65836a9a.jpg': 987515236, 'temp/1744597975_648272_987515237_1183dfa371a457f11ce2b622c7cf9467.jpg': 987515237, 'temp/1744597975_648272_987515238_e6292cb81e05894cfeb4b99f21a1d3f8.jpg': 987515238, 'temp/1744597975_648272_987515239_b3fa6f29636080b5138c8d8c33fea309.jpg': 987515239, 'temp/1744597975_648272_987515240_7829b9b15f1bf128ea4e2c1a39b9f0dd.jpg': 987515240, 'temp/1744597975_648272_987515241_073420d938f5f010ffd5b4353c064e09.jpg': 987515241, 'temp/1744597975_648272_987515242_327abb5215d6fd1f0aad51f53ed8c324.jpg': 987515242, 'temp/1744597975_648272_987515243_4375283f3bc5cdaa431c2fc6f17f53a4.jpg': 987515243, 'temp/1744597975_648272_987515244_419530eaef5ef868f75c758b94eea4b4.jpg': 987515244, 'temp/1744597975_648272_987515245_757d9d208d5bd4375c5f21f68b699148.jpg': 987515245, 'temp/1744597975_648272_987515246_671a708f67f2efa19004b8257fc7b9c8.jpg': 987515246, 'temp/1744597975_648272_987515247_e47b65403df916ba909bc9c439b0af73.jpg': 987515247, 'temp/1744597975_648272_987515248_a70ad88462a22fb62a120721a42b2d42.jpg': 987515248, 'temp/1744597975_648272_987515249_a70ad88462a22fb62a120721a42b2d42.jpg': 987515249, 'temp/1744597975_648272_987515250_b2827c9639df69656f23abcc7f2f82d9.jpg': 987515250, 'temp/1744597975_648272_987515207_de216ddb041e249524b0fb2b949064a5.jpg': 987515207, 'temp/1744597975_648272_987515208_a2b90cb74908aa64bbc4aae58f0c5ae8.jpg': 987515208, 'temp/1744597975_648272_987515209_02dfe1ae39f51994652f4a8538844aea.jpg': 987515209, 'temp/1744597975_648272_987515211_72cc7664d45bd40477351b9b764f1500.jpg': 987515211, 'temp/1744597975_648272_987515212_b0a038fcb9678ebfd60d9b1f6ec1fc17.jpg': 987515212, 'temp/1744597975_648272_987515213_b0a038fcb9678ebfd60d9b1f6ec1fc17.jpg': 987515213, 'temp/1744597975_648272_987515215_902ef348a7eebb9a8b87f42927347936.jpg': 987515215, 'temp/1744597975_648272_987515216_4f7dc21f1d2cd3fcabadc4a6755921e1.jpg': 987515216, 'temp/1744597975_648272_987515217_78877bb2c5760be28518d17f77d1c609.jpg': 987515217, 'temp/1744597975_648272_987515219_c2d417a5ba6ccf7c84527636f8d5eef9.jpg': 987515219, 'temp/1744597975_648272_987515220_e729f316c4c3b32049adfbaaa336d95c.jpg': 987515220, 'temp/1744597975_648272_987515222_067a027bc7402f969b6277d0dcb47eaa.jpg': 987515222, 'temp/1744597975_648272_987515223_ebb57f09941cd11d7ee45a9368a883c1.jpg': 987515223, 'temp/1744597975_648272_987515175_8b398cba2f448622cd9657f5eb3f9796.jpg': 987515175, 'temp/1744597975_648272_987515176_8b398cba2f448622cd9657f5eb3f9796.jpg': 987515176, 'temp/1744597975_648272_987515177_4a54e9967227806219ddf45d256539d8.jpg': 987515177, 'temp/1744597975_648272_987515178_298b3d2bfe0fda6787b59a78e2e68867.jpg': 987515178, 'temp/1744597975_648272_987515179_f7d4d1757a470f4c96dc3541eac88b9e.jpg': 987515179, 'temp/1744597975_648272_987515180_776a5d7d8486ee2961bbe3a0d90f95b5.jpg': 987515180, 'temp/1744597975_648272_987515181_1738c2798fb31152809ecb443ac286d6.jpg': 987515181, 'temp/1744597975_648272_987515182_fe7f29bf6d13e08c3e985f91b5232178.jpg': 987515182, 'temp/1744597975_648272_987515183_6aab9ca0421398b4899892c10c2594c6.jpg': 987515183, 'temp/1744597975_648272_987515184_19c8c2177209a285df6014d95fe53f2c.jpg': 987515184, 'temp/1744597975_648272_987515185_e172d54457cabee9d7f02ee1300f3ae9.jpg': 987515185, 'temp/1744597975_648272_987515186_797def426440b544aa80dbd63a19234a.jpg': 987515186, 'temp/1744597975_648272_987515187_9f62f98efd3caca0b9c17d27f5c70440.jpg': 987515187, 'temp/1744597975_648272_987515188_4116f9906657a69bb76c2fda982037b9.jpg': 987515188, 'temp/1744597975_648272_987515189_8e8590a26f72249d4c2116dffd0cf668.jpg': 987515189, 'temp/1744597975_648272_987515190_d56932bfc6ba2a8c974c691108755017.jpg': 987515190, 'temp/1744597975_648272_987515192_b661073b218f5f056833d6af1c617153.jpg': 987515192, 'temp/1744597975_648272_987515193_1a97fceb4dcbf5821d783b2e00b52fe6.jpg': 987515193, 'temp/1744597975_648272_987515195_30ccb89dfe410c445878a7f2819ddc36.jpg': 987515195, 'temp/1744597975_648272_987515196_30ccb89dfe410c445878a7f2819ddc36.jpg': 987515196, 'temp/1744597975_648272_987515198_599e80f444c876f407e94b533c89360b.jpg': 987515198, 'temp/1744597975_648272_987515200_978964436b5d5fb0eeda17e3bfafe889.jpg': 987515200, 'temp/1744597975_648272_987515201_b224d2acdc7fa2bbb134c09db6bca7ce.jpg': 987515201, 'temp/1744597975_648272_987515202_3314bd90d1404f31b827d8925abf2d62.jpg': 987515202, 'temp/1744597975_648272_987515204_9779c4f9d44360a9c80499e3b01e8a09.jpg': 987515204, 'temp/1744597975_648272_987515205_fd4b136d0b3a9a1a347942d7191f6fea.jpg': 987515205} map_photo_id_path_extension : {987515224: {'path': 'temp/1744597975_648272_987515224_e8747b400e713ecbd08d5b75db4d7568.jpg', 'extension': 'jpg'}, 987515226: {'path': 'temp/1744597975_648272_987515226_a18048dca1a77ae086b62cf07759f704.jpg', 'extension': 'jpg'}, 987515227: {'path': 'temp/1744597975_648272_987515227_e9c45a0e576ec9e44c1379c3fc5fec7c.jpg', 'extension': 'jpg'}, 987515228: {'path': 'temp/1744597975_648272_987515228_9f1759f20c9e603bccb9f9879d2f0d54.jpg', 'extension': 'jpg'}, 987515230: {'path': 'temp/1744597975_648272_987515230_846ad925884264181565c81d152a2e94.jpg', 'extension': 'jpg'}, 987515231: {'path': 'temp/1744597975_648272_987515231_dbf4cafa71b6db4771c5c8f0c25e9cda.jpg', 'extension': 'jpg'}, 987515232: {'path': 'temp/1744597975_648272_987515232_38db7950cdb3c674ee0ad65915b021f3.jpg', 'extension': 'jpg'}, 987515233: {'path': 'temp/1744597975_648272_987515233_a92514bed0e8c5724f2d032d3ab1e2ad.jpg', 'extension': 'jpg'}, 987515234: {'path': 'temp/1744597975_648272_987515234_2eca3480aed0f8b876242675ad99b666.jpg', 'extension': 'jpg'}, 987515235: {'path': 'temp/1744597975_648272_987515235_87075955a2f76b3948b47ffe1825ecd9.jpg', 'extension': 'jpg'}, 987515236: {'path': 'temp/1744597975_648272_987515236_8b44a98b1aceadad73ed000d65836a9a.jpg', 'extension': 'jpg'}, 987515237: {'path': 'temp/1744597975_648272_987515237_1183dfa371a457f11ce2b622c7cf9467.jpg', 'extension': 'jpg'}, 987515238: {'path': 'temp/1744597975_648272_987515238_e6292cb81e05894cfeb4b99f21a1d3f8.jpg', 'extension': 'jpg'}, 987515239: {'path': 'temp/1744597975_648272_987515239_b3fa6f29636080b5138c8d8c33fea309.jpg', 'extension': 'jpg'}, 987515240: {'path': 'temp/1744597975_648272_987515240_7829b9b15f1bf128ea4e2c1a39b9f0dd.jpg', 'extension': 'jpg'}, 987515241: {'path': 'temp/1744597975_648272_987515241_073420d938f5f010ffd5b4353c064e09.jpg', 'extension': 'jpg'}, 987515242: {'path': 'temp/1744597975_648272_987515242_327abb5215d6fd1f0aad51f53ed8c324.jpg', 'extension': 'jpg'}, 987515243: {'path': 'temp/1744597975_648272_987515243_4375283f3bc5cdaa431c2fc6f17f53a4.jpg', 'extension': 'jpg'}, 987515244: {'path': 'temp/1744597975_648272_987515244_419530eaef5ef868f75c758b94eea4b4.jpg', 'extension': 'jpg'}, 987515245: {'path': 'temp/1744597975_648272_987515245_757d9d208d5bd4375c5f21f68b699148.jpg', 'extension': 'jpg'}, 987515246: {'path': 'temp/1744597975_648272_987515246_671a708f67f2efa19004b8257fc7b9c8.jpg', 'extension': 'jpg'}, 987515247: {'path': 'temp/1744597975_648272_987515247_e47b65403df916ba909bc9c439b0af73.jpg', 'extension': 'jpg'}, 987515248: {'path': 'temp/1744597975_648272_987515248_a70ad88462a22fb62a120721a42b2d42.jpg', 'extension': 'jpg'}, 987515249: {'path': 'temp/1744597975_648272_987515249_a70ad88462a22fb62a120721a42b2d42.jpg', 'extension': 'jpg'}, 987515250: {'path': 'temp/1744597975_648272_987515250_b2827c9639df69656f23abcc7f2f82d9.jpg', 'extension': 'jpg'}, 987515207: {'path': 'temp/1744597975_648272_987515207_de216ddb041e249524b0fb2b949064a5.jpg', 'extension': 'jpg'}, 987515208: {'path': 'temp/1744597975_648272_987515208_a2b90cb74908aa64bbc4aae58f0c5ae8.jpg', 'extension': 'jpg'}, 987515209: {'path': 'temp/1744597975_648272_987515209_02dfe1ae39f51994652f4a8538844aea.jpg', 'extension': 'jpg'}, 987515211: {'path': 'temp/1744597975_648272_987515211_72cc7664d45bd40477351b9b764f1500.jpg', 'extension': 'jpg'}, 987515212: {'path': 'temp/1744597975_648272_987515212_b0a038fcb9678ebfd60d9b1f6ec1fc17.jpg', 'extension': 'jpg'}, 987515213: {'path': 'temp/1744597975_648272_987515213_b0a038fcb9678ebfd60d9b1f6ec1fc17.jpg', 'extension': 'jpg'}, 987515215: {'path': 'temp/1744597975_648272_987515215_902ef348a7eebb9a8b87f42927347936.jpg', 'extension': 'jpg'}, 987515216: {'path': 'temp/1744597975_648272_987515216_4f7dc21f1d2cd3fcabadc4a6755921e1.jpg', 'extension': 'jpg'}, 987515217: {'path': 'temp/1744597975_648272_987515217_78877bb2c5760be28518d17f77d1c609.jpg', 'extension': 'jpg'}, 987515219: {'path': 'temp/1744597975_648272_987515219_c2d417a5ba6ccf7c84527636f8d5eef9.jpg', 'extension': 'jpg'}, 987515220: {'path': 'temp/1744597975_648272_987515220_e729f316c4c3b32049adfbaaa336d95c.jpg', 'extension': 'jpg'}, 987515222: {'path': 'temp/1744597975_648272_987515222_067a027bc7402f969b6277d0dcb47eaa.jpg', 'extension': 'jpg'}, 987515223: {'path': 'temp/1744597975_648272_987515223_ebb57f09941cd11d7ee45a9368a883c1.jpg', 'extension': 'jpg'}, 987515175: {'path': 'temp/1744597975_648272_987515175_8b398cba2f448622cd9657f5eb3f9796.jpg', 'extension': 'jpg'}, 987515176: {'path': 'temp/1744597975_648272_987515176_8b398cba2f448622cd9657f5eb3f9796.jpg', 'extension': 'jpg'}, 987515177: {'path': 'temp/1744597975_648272_987515177_4a54e9967227806219ddf45d256539d8.jpg', 'extension': 'jpg'}, 987515178: {'path': 'temp/1744597975_648272_987515178_298b3d2bfe0fda6787b59a78e2e68867.jpg', 'extension': 'jpg'}, 987515179: {'path': 'temp/1744597975_648272_987515179_f7d4d1757a470f4c96dc3541eac88b9e.jpg', 'extension': 'jpg'}, 987515180: {'path': 'temp/1744597975_648272_987515180_776a5d7d8486ee2961bbe3a0d90f95b5.jpg', 'extension': 'jpg'}, 987515181: {'path': 'temp/1744597975_648272_987515181_1738c2798fb31152809ecb443ac286d6.jpg', 'extension': 'jpg'}, 987515182: {'path': 'temp/1744597975_648272_987515182_fe7f29bf6d13e08c3e985f91b5232178.jpg', 'extension': 'jpg'}, 987515183: {'path': 'temp/1744597975_648272_987515183_6aab9ca0421398b4899892c10c2594c6.jpg', 'extension': 'jpg'}, 987515184: {'path': 'temp/1744597975_648272_987515184_19c8c2177209a285df6014d95fe53f2c.jpg', 'extension': 'jpg'}, 987515185: {'path': 'temp/1744597975_648272_987515185_e172d54457cabee9d7f02ee1300f3ae9.jpg', 'extension': 'jpg'}, 987515186: {'path': 'temp/1744597975_648272_987515186_797def426440b544aa80dbd63a19234a.jpg', 'extension': 'jpg'}, 987515187: {'path': 'temp/1744597975_648272_987515187_9f62f98efd3caca0b9c17d27f5c70440.jpg', 'extension': 'jpg'}, 987515188: {'path': 'temp/1744597975_648272_987515188_4116f9906657a69bb76c2fda982037b9.jpg', 'extension': 'jpg'}, 987515189: {'path': 'temp/1744597975_648272_987515189_8e8590a26f72249d4c2116dffd0cf668.jpg', 'extension': 'jpg'}, 987515190: {'path': 'temp/1744597975_648272_987515190_d56932bfc6ba2a8c974c691108755017.jpg', 'extension': 'jpg'}, 987515192: {'path': 'temp/1744597975_648272_987515192_b661073b218f5f056833d6af1c617153.jpg', 'extension': 'jpg'}, 987515193: {'path': 'temp/1744597975_648272_987515193_1a97fceb4dcbf5821d783b2e00b52fe6.jpg', 'extension': 'jpg'}, 987515195: {'path': 'temp/1744597975_648272_987515195_30ccb89dfe410c445878a7f2819ddc36.jpg', 'extension': 'jpg'}, 987515196: {'path': 'temp/1744597975_648272_987515196_30ccb89dfe410c445878a7f2819ddc36.jpg', 'extension': 'jpg'}, 987515198: {'path': 'temp/1744597975_648272_987515198_599e80f444c876f407e94b533c89360b.jpg', 'extension': 'jpg'}, 987515200: {'path': 'temp/1744597975_648272_987515200_978964436b5d5fb0eeda17e3bfafe889.jpg', 'extension': 'jpg'}, 987515201: {'path': 'temp/1744597975_648272_987515201_b224d2acdc7fa2bbb134c09db6bca7ce.jpg', 'extension': 'jpg'}, 987515202: {'path': 'temp/1744597975_648272_987515202_3314bd90d1404f31b827d8925abf2d62.jpg', 'extension': 'jpg'}, 987515204: {'path': 'temp/1744597975_648272_987515204_9779c4f9d44360a9c80499e3b01e8a09.jpg', 'extension': 'jpg'}, 987515205: {'path': 'temp/1744597975_648272_987515205_fd4b136d0b3a9a1a347942d7191f6fea.jpg', 'extension': 'jpg'}} map_subphoto_mainphoto : {} Beginning of datou step Thcl ! multi_thcl or not :False multi_thcl_cond or not :False dic_thcl : {'1528': 1} we are using the classfication for only one thcl 1528 In convert_file_to_np l 337 : 7 l343 7 In convert_file_to_np l 337 : 7 l343 7 In convert_file_to_np l 337 : 7 l343 7 In convert_file_to_np l 337 : 1 l343 1 In convert_file_to_np l 337 : 7 l343 7 In convert_file_to_np l 337 : 7 l343 7 l357 after caffe.io.load_image dimension du image : (3, (224, 224, 3)) dimension displayed ! l357 after caffe.io.load_image dimension du image : (3, (224, 224, 3)) dimension displayed ! time to import caffe and check if the image exist : 0.0025634765625 time to convert the images to numpy array : 0.005578041076660156 In convert_file_to_np l 337 : 7 l343 7 l357 after caffe.io.load_image dimension du image : (3, (224, 224, 3)) dimension displayed ! l357 after caffe.io.load_image dimension du image : (3, (224, 224, 3)) dimension displayed ! l357 after caffe.io.load_image dimension du image : (3, (224, 224, 3)) dimension displayed ! l357 after caffe.io.load_image dimension du image : (3, (224, 224, 3)) dimension displayed ! In convert_file_to_np l 337 : 7 l343 7 l357 after caffe.io.load_image dimension du image : (3, (224, 224, 3)) dimension displayed ! In convert_file_to_np l 337 : 7 l343 7 l357 after caffe.io.load_image dimension du image : (3, (224, 224, 3)) dimension displayed ! l357 after caffe.io.load_image dimension du image : (3, (224, 224, 3)) dimension displayed ! l357 after caffe.io.load_image dimension du image : (3, (224, 224, 3)) dimension displayed ! l357 after caffe.io.load_image dimension du image : (3, (224, 224, 3)) dimension displayed ! l357 after caffe.io.load_image dimension du image : (3, (224, 224, 3)) dimension displayed ! l357 after caffe.io.load_image dimension du image : (3, (224, 224, 3)) dimension displayed ! l357 after caffe.io.load_image dimension du image : (3, (224, 224, 3)) dimension displayed ! l357 after caffe.io.load_image dimension du image : (3, (224, 224, 3)) dimension displayed ! l357 after caffe.io.load_image dimension du image : (3, (224, 224, 3)) dimension displayed ! l357 after caffe.io.load_image dimension du image : (3, (224, 224, 3)) dimension displayed ! l357 after caffe.io.load_image dimension du image : (3, (224, 224, 3)) dimension displayed ! l357 after caffe.io.load_image dimension du image : (3, (224, 224, 3)) dimension displayed ! l357 after caffe.io.load_image dimension du image : (3, (224, 224, 3)) dimension displayed ! l357 after caffe.io.load_image dimension du image : (3, (224, 224, 3)) dimension displayed ! l357 after caffe.io.load_image dimension du image : (3, (224, 224, 3)) dimension displayed ! l357 after caffe.io.load_image dimension du image : (3, (224, 224, 3)) dimension displayed ! l357 after caffe.io.load_image dimension du image : (3, (224, 224, 3)) dimension displayed ! l357 after caffe.io.load_image dimension du image : (3, (224, 224, 3)) dimension displayed ! l357 after caffe.io.load_image dimension du image : (3, (224, 224, 3)) dimension displayed ! l357 after caffe.io.load_image dimension du image : (3, (224, 224, 3)) dimension displayed ! l357 after caffe.io.load_image dimension du image : (3, (224, 224, 3)) dimension displayed ! l357 after caffe.io.load_image dimension du image : (3, (224, 224, 3)) dimension displayed ! l357 after caffe.io.load_image dimension du image : (3, (224, 224, 3)) dimension displayed ! l357 after caffe.io.load_image dimension du image : (3, (224, 224, 3)) dimension displayed ! l357 after caffe.io.load_image dimension du image : (3, (224, 224, 3)) dimension displayed ! l357 after caffe.io.load_image dimension du image : (3, (224, 224, 3)) dimension displayed ! l357 after caffe.io.load_image dimension du image : (3, (224, 224, 3)) dimension displayed ! l357 after caffe.io.load_image dimension du image : (3, (224, 224, 3)) dimension displayed ! l357 after caffe.io.load_image dimension du image : (3, (224, 224, 3)) dimension displayed ! l357 after caffe.io.load_image dimension du image : (3, (224, 224, 3)) dimension displayed ! l357 after caffe.io.load_image dimension du image : (3, (224, 224, 3)) dimension displayed ! l357 after caffe.io.load_image dimension du image : (3, (224, 224, 3)) dimension displayed ! l357 after caffe.io.load_image dimension du image : (3, (224, 224, 3)) dimension displayed ! l357 after caffe.io.load_image dimension du image : (3, (224, 224, 3)) dimension displayed ! time to import caffe and check if the image exist : 0.004791736602783203 time to convert the images to numpy array : 0.03534507751464844 l357 after caffe.io.load_image dimension du image : (3, (224, 224, 3)) dimension displayed ! l357 after caffe.io.load_image dimension du image : (3, (224, 224, 3)) dimension displayed ! l357 after caffe.io.load_image dimension du image : (3, (224, 224, 3)) dimension displayed ! l357 after caffe.io.load_image dimension du image : (3, (224, 224, 3)) dimension displayed ! l357 after caffe.io.load_image dimension du image : (3, (224, 224, 3)) dimension displayed ! l357 after caffe.io.load_image dimension du image : (3, (224, 224, 3)) dimension displayed ! l357 after caffe.io.load_image dimension du image : (3, (224, 224, 3)) dimension displayed ! time to import caffe and check if the image exist : 0.004683732986450195 time to convert the images to numpy array : 0.040231943130493164 l357 after caffe.io.load_image dimension du image : (3, (224, 224, 3)) dimension displayed ! time to import caffe and check if the image exist : 0.007311820983886719 time to convert the images to numpy array : 0.036812543869018555 l357 after caffe.io.load_image dimension du image : (3, (224, 224, 3)) dimension displayed ! l357 after caffe.io.load_image dimension du image : (3, (224, 224, 3)) dimension displayed ! time to import caffe and check if the image exist : 0.011325836181640625 time to convert the images to numpy array : 0.03255033493041992 l357 after caffe.io.load_image dimension du image : (3, (224, 224, 3)) dimension displayed ! l357 after caffe.io.load_image dimension du image : (3, (224, 224, 3)) dimension displayed ! l357 after caffe.io.load_image dimension du image : (3, (224, 224, 3)) dimension displayed ! l357 after caffe.io.load_image dimension du image : (3, (224, 224, 3)) dimension displayed ! time to import caffe and check if the image exist : 0.004998207092285156 time to convert the images to numpy array : 0.04324197769165039 l357 after caffe.io.load_image dimension du image : (3, (224, 224, 3)) dimension displayed ! l357 after caffe.io.load_image dimension du image : (3, (224, 224, 3)) dimension displayed ! l357 after caffe.io.load_image dimension du image : (3, (224, 224, 3)) dimension displayed ! time to import caffe and check if the image exist : 0.017739057540893555 time to convert the images to numpy array : 0.031461238861083984 l357 after caffe.io.load_image dimension du image : (3, (224, 224, 3)) dimension displayed ! time to import caffe and check if the image exist : 0.0048062801361083984 time to convert the images to numpy array : 0.0429377555847168 l357 after caffe.io.load_image dimension du image : (3, (224, 224, 3)) dimension displayed ! l357 after caffe.io.load_image dimension du image : (3, (224, 224, 3)) dimension displayed ! time to import caffe and check if the image exist : 0.011844635009765625 time to convert the images to numpy array : 0.03938102722167969 l357 after caffe.io.load_image dimension du image : (3, (224, 224, 3)) dimension displayed ! time to import caffe and check if the image exist : 0.016292095184326172 time to convert the images to numpy array : 0.03430747985839844 P•è!°P Y#ApQê! y"À>"ðtotal time to convert the images to numpy array : 0.05340576171875 list photo_ids error: [] list photo_ids correct : [987515205, 987515240, 987515241, 987515242, 987515243, 987515244, 987515245, 987515246, 987515224, 987515226, 987515227, 987515228, 987515230, 987515231, 987515232, 987515220, 987515222, 987515223, 987515175, 987515176, 987515177, 987515178, 987515186, 987515187, 987515188, 987515189, 987515190, 987515192, 987515193, 987515233, 987515234, 987515235, 987515236, 987515237, 987515238, 987515239, 987515211, 987515212, 987515213, 987515215, 987515216, 987515217, 987515219, 987515195, 987515196, 987515198, 987515200, 987515201, 987515202, 987515204, 987515247, 987515248, 987515249, 987515250, 987515207, 987515208, 987515209, 987515179, 987515180, 987515181, 987515182, 987515183, 987515184, 987515185] number of photos to traite : 64 try to delete the photos incorrect in DB tagging for thcl : 1528 To do loadFromThcl(), then load ParamDescType : thcl1528 get_desc_type_from_thcl : type of cat SELECT id, mtr_user_id, name, pb_hashtag_id, hashtag_id_list, button_legend_list, portfolio_id_lists, photo_hashtag_type, photo_desc_type, svm_limit, limit_tagging, is_public, live, created_at, updated_at, type_classification FROM MTRDatou.classification_theme WHERE `id` IN (1528) thcls : [{'id': 1528, 'mtr_user_id': 31, 'name': 'learn_refus_upm_blanches_1924', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Autre_Environement,Carton,Kraft,Lointain_Papier_Magazine,Metal,Papier_Magazine,Plastique,Sol_Environement,Teint_Dans_La_Masse,autre_refus', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 1927, 'photo_desc_type': 4421, 'type_classification': 'caffe', 'hashtag_id_list': '2107752388,492774966,493202403,2107752389,492628673,2107752386,492725882,2107752387,2107752385,2107752406'}] thcl {'id': 1528, 'mtr_user_id': 31, 'name': 'learn_refus_upm_blanches_1924', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Autre_Environement,Carton,Kraft,Lointain_Papier_Magazine,Metal,Papier_Magazine,Plastique,Sol_Environement,Teint_Dans_La_Masse,autre_refus', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 1927, 'photo_desc_type': 4421, 'type_classification': 'caffe', 'hashtag_id_list': '2107752388,492774966,493202403,2107752389,492628673,2107752386,492725882,2107752387,2107752385,2107752406'} Update svm_hashtag_type_desc : 4421 SELECT * FROM MTRDatou.photo_desc_type_params WHERE id in (4421) FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (4421, 'learn_refus_upm_blanches_1924', 16384, 25088, 'learn_refus_upm_blanches_1924', 'res5b', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2019, 10, 22, 17, 39, 25), datetime.datetime(2019, 10, 22, 17, 39, 25)) To loadFromThcl() : net_4421 begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 3165 max_wait_temp : 1 max_wait : 0 SELECT * FROM MTRDatou.photo_desc_type_params WHERE id in (4421) FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (4421, 'learn_refus_upm_blanches_1924', 16384, 25088, 'learn_refus_upm_blanches_1924', 'res5b', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2019, 10, 22, 17, 39, 25), datetime.datetime(2019, 10, 22, 17, 39, 25)) param : , param.caffemodel : learn_refus_upm_blanches_1924 None mean_file_type : mean_file_path : prototxt_file_path : model : learn_refus_upm_blanches_1924 Inside get_net Inside get_net before cache_data_model model_param file didn't exist Inside get_net before CDM.load_model_par_type model_name : learn_refus_upm_blanches_1924 model_type : caffe list file need : ['caffemodel', 'deploy_conv_normal.prototxt', 'deploy_fc.prototxt', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file exist in s3 : ['caffemodel', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file manque in s3 : ['deploy_conv_normal.prototxt', 'deploy_fc.prototxt'] local folder : /data/models_weight/learn_refus_upm_blanches_1924 /data/models_weight/learn_refus_upm_blanches_1924/caffemodel size_local : 45774543 size in s3 : 45774543 create time local : 2021-08-09 05:29:53 create time in s3 : 2021-08-06 19:36:04 caffemodel already exist and didn't need to update /data/models_weight/learn_refus_upm_blanches_1924/deploy.prototxt size_local : 17312 size in s3 : 17312 create time local : 2021-08-09 05:29:53 create time in s3 : 2021-08-06 19:36:03 deploy.prototxt already exist and didn't need to update /data/models_weight/learn_refus_upm_blanches_1924/mean.npy size_local : 1572992 size in s3 : 1572992 create time local : 2021-08-09 05:29:53 create time in s3 : 2021-08-06 19:36:05 mean.npy already exist and didn't need to update /data/models_weight/learn_refus_upm_blanches_1924/synset_words.txt size_local : 218 size in s3 : 218 create time local : 2021-08-09 05:29:53 create time in s3 : 2021-08-06 19:36:04 synset_words.txt already exist and didn't need to update Inside get_net after CDM.load_model_par_type After if not only_with_local_cache: /home/admin/workarea/install/caffe_cuda8_python3/python/:/home/admin/workarea/install/darknet/:/home/admin/workarea/git/Velours/python:/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python:/home/admin/mtr/.credentials:/home/admin/workarea/install/caffe/python:/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools/:/home/admin/workarea/git/fotonowerpip/:/home/admin/workarea/install/segment-anything:/home/admin//workarea/git/pyfvs/ Here before set mode gpu Doing nothing but we could set mode gpu after set mode gpu prototxt_filename : /data/models_weight/learn_refus_upm_blanches_1924/deploy.prototxt caffemodel_filename : /data/models_weight/learn_refus_upm_blanches_1924/caffemodel now we set caffe to gpu mode before predict begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 3165 max_wait_temp : 1 max_wait : 0 dict_keys(['prob', 'res5b']) time used to do the prepocess of the images : 0.061979055404663086 time used to do the prediction : 0.26659369468688965 save descriptor for thcl : 1528 (64, 512, 7, 7) Got the blobs of the net to insert : [5, 7, 3, 2, 1, 2, 2, 2, 0, 0] code_as_byte_string:b'0507030201'| Got the blobs of the net to insert : [0, 3, 0, 1, 1, 6, 7, 5, 5, 3] code_as_byte_string:b'0003000101'| Got the blobs of the net to insert : [6, 6, 3, 3, 8, 8, 6, 6, 2, 0] code_as_byte_string:b'0606030308'| Got the blobs of the net to insert : [5, 5, 2, 4, 6, 5, 9, 9, 4, 2] code_as_byte_string:b'0505020406'| Got the blobs of the net to insert : [2, 1, 3, 5, 7, 5, 3, 4, 1, 3] code_as_byte_string:b'0201030507'| Got the blobs of the net to insert : [0, 0, 0, 1, 1, 3, 2, 1, 0, 2] code_as_byte_string:b'0000000101'| Got the blobs of the net to insert : [0, 0, 0, 0, 0, 0, 1, 3, 1, 0] code_as_byte_string:b'0000000000'| Got the blobs of the net to insert : [0, 0, 0, 1, 0, 0, 0, 0, 1, 3] code_as_byte_string:b'0000000100'| Got the blobs of the net to insert : [7, 7, 3, 8, 9, 6, 7, 10, 11, 6] code_as_byte_string:b'0707030809'| Got the blobs of the net to insert : [3, 3, 3, 1, 6, 7, 10, 5, 3, 5] code_as_byte_string:b'0303030106'| Got the blobs of the net to insert : [3, 2, 2, 1, 1, 2, 2, 3, 2, 5] code_as_byte_string:b'0302020101'| Got the blobs of the net to insert : [1, 0, 3, 1, 0, 0, 0, 0, 0, 5] code_as_byte_string:b'0100030100'| Got the blobs of the net to insert : [0, 0, 2, 2, 0, 0, 0, 0, 0, 3] code_as_byte_string:b'0000020200'| Got the blobs of the net to insert : [1, 1, 2, 1, 0, 0, 0, 3, 6, 7] code_as_byte_string:b'0101020100'| Got the blobs of the net to insert : [1, 3, 3, 3, 0, 1, 5, 6, 7, 4] code_as_byte_string:b'0103030300'| Got the blobs of the net to insert : [1, 0, 0, 1, 0, 0, 0, 3, 4, 5] code_as_byte_string:b'0100000100'| Got the blobs of the net to insert : [0, 1, 1, 4, 2, 1, 3, 7, 9, 9] code_as_byte_string:b'0001010402'| Got the blobs of the net to insert : [7, 10, 10, 2, 4, 7, 8, 5, 5, 2] code_as_byte_string:b'070a0a0204'| Got the blobs of the net to insert : [13, 9, 9, 8, 11, 13, 6, 14, 9, 18] code_as_byte_string:b'0d0909080b'| Got the blobs of the net to insert : [13, 9, 9, 8, 11, 13, 6, 14, 9, 18] code_as_byte_string:b'0d0909080b'| Got the blobs of the net to insert : [2, 2, 6, 7, 8, 6, 4, 3, 1, 8] code_as_byte_string:b'0202060708'| Got the blobs of the net to insert : [1, 2, 2, 1, 0, 1, 1, 2, 1, 1] code_as_byte_string:b'0102020100'| Got the blobs of the net to insert : [0, 0, 0, 1, 1, 1, 3, 3, 0, 0] code_as_byte_string:b'0000000101'| Got the blobs of the net to insert : [3, 1, 1, 1, 1, 1, 2, 1, 1, 2] code_as_byte_string:b'0301010101'| Got the blobs of the net to insert : [1, 1, 1, 2, 0, 3, 4, 3, 4, 5] code_as_byte_string:b'0101010200'| Got the blobs of the net to insert : [3, 2, 1, 4, 5, 7, 6, 5, 6, 5] code_as_byte_string:b'0302010405'| Got the blobs of the net to insert : [3, 4, 5, 5, 9, 9, 9, 9, 11, 7] code_as_byte_string:b'0304050509'| Got the blobs of the net to insert : [5, 3, 3, 6, 8, 12, 9, 9, 3, 5] code_as_byte_string:b'0503030608'| Got the blobs of the net to insert : [6, 3, 3, 0, 1, 2, 2, 5, 2, 4] code_as_byte_string:b'0603030001'| Got the blobs of the net to insert : [5, 7, 3, 2, 5, 9, 10, 3, 5, 0] code_as_byte_string:b'0507030205'| Got the blobs of the net to insert : [6, 8, 3, 6, 6, 6, 5, 10, 10, 3] code_as_byte_string:b'0608030606'| Got the blobs of the net to insert : [1, 2, 1, 5, 7, 10, 8, 2, 2, 1] code_as_byte_string:b'0102010507'| Got the blobs of the net to insert : [0, 0, 0, 1, 5, 4, 6, 3, 1, 3] code_as_byte_string:b'0000000105'| Got the blobs of the net to insert : [0, 2, 1, 0, 0, 0, 0, 0, 4, 2] code_as_byte_string:b'0002010000'| Got the blobs of the net to insert : [0, 2, 0, 1, 1, 0, 0, 0, 1, 3] code_as_byte_string:b'0002000101'| Got the blobs of the net to insert : [1, 1, 0, 0, 0, 0, 0, 3, 5, 1] code_as_byte_string:b'0101000000'| Got the blobs of the net to insert : [1, 1, 2, 3, 4, 4, 1, 2, 8, 7] code_as_byte_string:b'0101020304'| Got the blobs of the net to insert : [6, 8, 5, 7, 7, 8, 10, 12, 12, 6] code_as_byte_string:b'0608050707'| Got the blobs of the net to insert : [6, 8, 5, 7, 7, 8, 10, 12, 12, 6] code_as_byte_string:b'0608050707'| Got the blobs of the net to insert : [5, 5, 4, 3, 5, 6, 3, 4, 3, 3] code_as_byte_string:b'0505040305'| Got the blobs of the net to insert : [5, 3, 3, 1, 1, 1, 2, 2, 2, 4] code_as_byte_string:b'0503030101'| Got the blobs of the net to insert : [2, 1, 2, 2, 2, 0, 0, 1, 0, 3] code_as_byte_string:b'0201020202'| Got the blobs of the net to insert : [0, 0, 2, 3, 3, 1, 0, 0, 0, 0] code_as_byte_string:b'0000020303'| Got the blobs of the net to insert : [0, 0, 0, 0, 0, 2, 5, 1, 0, 0] code_as_byte_string:b'0000000000'| Got the blobs of the net to insert : [0, 0, 0, 0, 0, 2, 5, 1, 0, 0] code_as_byte_string:b'0000000000'| Got the blobs of the net to insert : [1, 1, 0, 0, 1, 2, 0, 0, 0, 1] code_as_byte_string:b'0101000001'| Got the blobs of the net to insert : [0, 1, 0, 1, 3, 4, 2, 1, 3, 5] code_as_byte_string:b'0001000103'| Got the blobs of the net to insert : [3, 3, 3, 8, 7, 5, 5, 4, 5, 3] code_as_byte_string:b'0303030807'| Got the blobs of the net to insert : [2, 5, 4, 6, 9, 9, 10, 9, 11, 5] code_as_byte_string:b'0205040609'| Got the blobs of the net to insert : [5, 2, 3, 7, 5, 7, 6, 2, 4, 3] code_as_byte_string:b'0502030705'| Got the blobs of the net to insert : [0, 0, 0, 1, 2, 0, 1, 4, 0, 2] code_as_byte_string:b'0000000102'| Got the blobs of the net to insert : [4, 1, 3, 4, 7, 3, 4, 2, 1, 0] code_as_byte_string:b'0401030407'| Got the blobs of the net to insert : [4, 1, 3, 4, 7, 3, 4, 2, 1, 0] code_as_byte_string:b'0401030407'| Got the blobs of the net to insert : [3, 3, 1, 4, 7, 7, 9, 6, 2, 1] code_as_byte_string:b'0303010407'| Got the blobs of the net to insert : [4, 2, 1, 2, 3, 1, 0, 1, 0, 1] code_as_byte_string:b'0402010203'| Got the blobs of the net to insert : [0, 0, 0, 1, 2, 2, 0, 1, 0, 0] code_as_byte_string:b'0000000102'| Got the blobs of the net to insert : [1, 0, 0, 1, 1, 1, 0, 1, 1, 3] code_as_byte_string:b'0100000101'| Got the blobs of the net to insert : [2, 2, 1, 3, 2, 3, 2, 0, 0, 1] code_as_byte_string:b'0202010302'| Got the blobs of the net to insert : [1, 0, 1, 2, 1, 0, 3, 3, 3, 8] code_as_byte_string:b'0100010201'| Got the blobs of the net to insert : [5, 5, 6, 4, 3, 6, 9, 7, 7, 7] code_as_byte_string:b'0505060403'| Got the blobs of the net to insert : [4, 6, 6, 4, 7, 8, 8, 8, 12, 8] code_as_byte_string:b'0406060407'| Got the blobs of the net to insert : [11, 8, 5, 9, 12, 14, 13, 14, 12, 6] code_as_byte_string:b'0b0805090c'| Got the blobs of the net to insert : [8, 7, 6, 4, 2, 1, 2, 4, 4, 4] code_as_byte_string:b'0807060402'| Got the blobs of the net to insert : [2, 3, 5, 5, 2, 2, 3, 0, 1, 4] code_as_byte_string:b'0203050502'| time to traite the descriptors : 3.002953052520752 Testing : ['987515205', '987515240', '987515241', '987515242', '987515243', '987515244', '987515245', '987515246', '987515224', '987515226', '987515227', '987515228', '987515230', '987515231', '987515232', '987515220', '987515222', '987515223', '987515175', '987515176', '987515177', '987515178', '987515186', '987515187', '987515188', '987515189', '987515190', '987515192', '987515193', '987515233', '987515234', '987515235', '987515236', '987515237', '987515238', '987515239', '987515211', '987515212', '987515213', '987515215', '987515216', '987515217', '987515219', '987515195', '987515196', '987515198', '987515200', '987515201', '987515202', '987515204', '987515247', '987515248', '987515249', '987515250', '987515207', '987515208', '987515209', '987515179', '987515180', '987515181', '987515182', '987515183', '987515184', '987515185'] In select_photos_meta_from_ids: SELECT photo_id, url, FROM_UNIXTIME(uploaded_at), latitude, longitude, text FROM MTRBack.photos WHERE photo_id IN (987515205,987515240,987515241,987515242,987515243,987515244,987515245,987515246,987515224,987515226,987515227,987515228,987515230,987515231,987515232,987515220,987515222,987515223,987515175,987515176,987515177,987515178,987515186,987515187,987515188,987515189,987515190,987515192,987515193,987515233,987515234,987515235,987515236,987515237,987515238,987515239,987515211,987515212,987515213,987515215,987515216,987515217,987515219,987515195,987515196,987515198,987515200,987515201,987515202,987515204,987515247,987515248,987515249,987515250,987515207,987515208,987515209,987515179,987515180,987515181,987515182,987515183,987515184,987515185) result : {987515175: {'photo_id': 987515175, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2019/11/22/8b398cba2f448622cd9657f5eb3f9796.jpg', 'latitude': 0.0, 'longitude': 0.0, 'text': 'image_22062023_14_16_02_694514_0001.jpg'}, 987515176: {'photo_id': 987515176, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2019/11/22/8b398cba2f448622cd9657f5eb3f9796.jpg', 'latitude': 0.0, 'longitude': 0.0, 'text': 'photo_origin_x_112_y_144.jpg'}, 987515177: {'photo_id': 987515177, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2019/11/22/4a54e9967227806219ddf45d256539d8.jpg', 'latitude': 0.0, 'longitude': 0.0, 'text': 'photo_origin_x_112_y_176.jpg'}, 987515178: {'photo_id': 987515178, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2019/11/22/298b3d2bfe0fda6787b59a78e2e68867.jpg', 'latitude': 0.0, 'longitude': 0.0, 'text': 'photo_origin_x_112_y_208.jpg'}, 987515179: {'photo_id': 987515179, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2019/11/22/f7d4d1757a470f4c96dc3541eac88b9e.jpg', 'latitude': 0.0, 'longitude': 0.0, 'text': 'photo_origin_x_112_y_240.jpg'}, 987515180: {'photo_id': 987515180, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2019/11/22/776a5d7d8486ee2961bbe3a0d90f95b5.jpg', 'latitude': 0.0, 'longitude': 0.0, 'text': 'photo_origin_x_112_y_272.jpg'}, 987515181: {'photo_id': 987515181, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2019/11/22/1738c2798fb31152809ecb443ac286d6.jpg', 'latitude': 0.0, 'longitude': 0.0, 'text': 'photo_origin_x_112_y_304.jpg'}, 987515182: {'photo_id': 987515182, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2019/11/22/fe7f29bf6d13e08c3e985f91b5232178.jpg', 'latitude': 0.0, 'longitude': 0.0, 'text': 'photo_origin_x_112_y_336.jpg'}, 987515183: {'photo_id': 987515183, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2019/11/22/6aab9ca0421398b4899892c10c2594c6.jpg', 'latitude': 0.0, 'longitude': 0.0, 'text': 'photo_origin_x_144_y_112.jpg'}, 987515184: {'photo_id': 987515184, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2019/11/22/19c8c2177209a285df6014d95fe53f2c.jpg', 'latitude': 0.0, 'longitude': 0.0, 'text': 'photo_origin_x_144_y_144.jpg'}, 987515185: {'photo_id': 987515185, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2019/11/22/e172d54457cabee9d7f02ee1300f3ae9.jpg', 'latitude': 0.0, 'longitude': 0.0, 'text': 'photo_origin_x_144_y_176.jpg'}, 987515186: {'photo_id': 987515186, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2019/11/22/797def426440b544aa80dbd63a19234a.jpg', 'latitude': 0.0, 'longitude': 0.0, 'text': 'photo_origin_x_144_y_208.jpg'}, 987515187: {'photo_id': 987515187, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2019/11/22/9f62f98efd3caca0b9c17d27f5c70440.jpg', 'latitude': 0.0, 'longitude': 0.0, 'text': 'photo_origin_x_144_y_240.jpg'}, 987515188: {'photo_id': 987515188, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2019/11/22/4116f9906657a69bb76c2fda982037b9.jpg', 'latitude': 0.0, 'longitude': 0.0, 'text': 'photo_origin_x_144_y_272.jpg'}, 987515189: {'photo_id': 987515189, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2019/11/22/8e8590a26f72249d4c2116dffd0cf668.jpg', 'latitude': 0.0, 'longitude': 0.0, 'text': 'photo_origin_x_144_y_304.jpg'}, 987515190: {'photo_id': 987515190, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2019/11/22/d56932bfc6ba2a8c974c691108755017.jpg', 'latitude': 0.0, 'longitude': 0.0, 'text': 'photo_origin_x_144_y_336.jpg'}, 987515192: {'photo_id': 987515192, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2019/11/22/b661073b218f5f056833d6af1c617153.jpg', 'latitude': 0.0, 'longitude': 0.0, 'text': 'photo_origin_x_176_y_112.jpg'}, 987515193: {'photo_id': 987515193, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2019/11/22/1a97fceb4dcbf5821d783b2e00b52fe6.jpg', 'latitude': 0.0, 'longitude': 0.0, 'text': 'photo_origin_x_176_y_144.jpg'}, 987515195: {'photo_id': 987515195, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2019/11/22/30ccb89dfe410c445878a7f2819ddc36.jpg', 'latitude': 0.0, 'longitude': 0.0, 'text': 'image_22062023_17_37_58_622227.jpg'}, 987515196: {'photo_id': 987515196, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2019/11/22/30ccb89dfe410c445878a7f2819ddc36.jpg', 'latitude': 0.0, 'longitude': 0.0, 'text': 'photo_origin_x_176_y_208.jpg'}, 987515198: {'photo_id': 987515198, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2019/11/22/599e80f444c876f407e94b533c89360b.jpg', 'latitude': 0.0, 'longitude': 0.0, 'text': 'photo_origin_x_176_y_240.jpg'}, 987515200: {'photo_id': 987515200, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2019/11/22/978964436b5d5fb0eeda17e3bfafe889.jpg', 'latitude': 0.0, 'longitude': 0.0, 'text': 'photo_origin_x_176_y_272.jpg'}, 987515201: {'photo_id': 987515201, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2019/11/22/b224d2acdc7fa2bbb134c09db6bca7ce.jpg', 'latitude': 0.0, 'longitude': 0.0, 'text': 'photo_origin_x_176_y_304.jpg'}, 987515202: {'photo_id': 987515202, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2019/11/22/3314bd90d1404f31b827d8925abf2d62.jpg', 'latitude': 0.0, 'longitude': 0.0, 'text': 'photo_origin_x_176_y_336.jpg'}, 987515204: {'photo_id': 987515204, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2019/11/22/9779c4f9d44360a9c80499e3b01e8a09.jpg', 'latitude': 0.0, 'longitude': 0.0, 'text': 'photo_origin_x_208_y_112.jpg'}, 987515205: {'photo_id': 987515205, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2019/11/22/fd4b136d0b3a9a1a347942d7191f6fea.jpg', 'latitude': 0.0, 'longitude': 0.0, 'text': 'photo_origin_x_208_y_144.jpg'}, 987515207: {'photo_id': 987515207, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2019/11/22/de216ddb041e249524b0fb2b949064a5.jpg', 'latitude': 0.0, 'longitude': 0.0, 'text': 'photo_origin_x_208_y_176.jpg'}, 987515208: {'photo_id': 987515208, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2019/11/22/a2b90cb74908aa64bbc4aae58f0c5ae8.jpg', 'latitude': 0.0, 'longitude': 0.0, 'text': 'photo_origin_x_208_y_208.jpg'}, 987515209: {'photo_id': 987515209, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2019/11/22/02dfe1ae39f51994652f4a8538844aea.jpg', 'latitude': 0.0, 'longitude': 0.0, 'text': 'photo_origin_x_208_y_240.jpg'}, 987515211: {'photo_id': 987515211, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2019/11/22/72cc7664d45bd40477351b9b764f1500.jpg', 'latitude': 0.0, 'longitude': 0.0, 'text': 'photo_origin_x_208_y_272.jpg'}, 987515212: {'photo_id': 987515212, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2019/11/22/b0a038fcb9678ebfd60d9b1f6ec1fc17.jpg', 'latitude': 0.0, 'longitude': 0.0, 'text': 'image_22062023_09_32_14_525625.jpg'}, 987515213: {'photo_id': 987515213, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2019/11/22/b0a038fcb9678ebfd60d9b1f6ec1fc17.jpg', 'latitude': 0.0, 'longitude': 0.0, 'text': 'photo_origin_x_208_y_336.jpg'}, 987515215: {'photo_id': 987515215, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2019/11/22/902ef348a7eebb9a8b87f42927347936.jpg', 'latitude': 0.0, 'longitude': 0.0, 'text': 'photo_origin_x_240_y_112.jpg'}, 987515216: {'photo_id': 987515216, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2019/11/22/4f7dc21f1d2cd3fcabadc4a6755921e1.jpg', 'latitude': 0.0, 'longitude': 0.0, 'text': 'photo_origin_x_240_y_144.jpg'}, 987515217: {'photo_id': 987515217, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2019/11/22/78877bb2c5760be28518d17f77d1c609.jpg', 'latitude': 0.0, 'longitude': 0.0, 'text': 'photo_origin_x_240_y_176.jpg'}, 987515219: {'photo_id': 987515219, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2019/11/22/c2d417a5ba6ccf7c84527636f8d5eef9.jpg', 'latitude': 0.0, 'longitude': 0.0, 'text': 'photo_origin_x_240_y_208.jpg'}, 987515220: {'photo_id': 987515220, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2019/11/22/e729f316c4c3b32049adfbaaa336d95c.jpg', 'latitude': 0.0, 'longitude': 0.0, 'text': 'photo_origin_x_240_y_240.jpg'}, 987515222: {'photo_id': 987515222, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2019/11/22/067a027bc7402f969b6277d0dcb47eaa.jpg', 'latitude': 0.0, 'longitude': 0.0, 'text': 'photo_origin_x_240_y_272.jpg'}, 987515223: {'photo_id': 987515223, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2019/11/22/ebb57f09941cd11d7ee45a9368a883c1.jpg', 'latitude': 0.0, 'longitude': 0.0, 'text': 'photo_origin_x_240_y_304.jpg'}, 987515224: {'photo_id': 987515224, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2019/11/22/e8747b400e713ecbd08d5b75db4d7568.jpg', 'latitude': 0.0, 'longitude': 0.0, 'text': 'photo_origin_x_240_y_336.jpg'}, 987515226: {'photo_id': 987515226, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2019/11/22/a18048dca1a77ae086b62cf07759f704.jpg', 'latitude': 0.0, 'longitude': 0.0, 'text': 'photo_origin_x_272_y_112.jpg'}, 987515227: {'photo_id': 987515227, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2019/11/22/e9c45a0e576ec9e44c1379c3fc5fec7c.jpg', 'latitude': 0.0, 'longitude': 0.0, 'text': 'photo_origin_x_272_y_144.jpg'}, 987515228: {'photo_id': 987515228, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2019/11/22/9f1759f20c9e603bccb9f9879d2f0d54.jpg', 'latitude': 0.0, 'longitude': 0.0, 'text': 'photo_origin_x_272_y_176.jpg'}, 987515230: {'photo_id': 987515230, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2019/11/22/846ad925884264181565c81d152a2e94.jpg', 'latitude': 0.0, 'longitude': 0.0, 'text': 'photo_origin_x_272_y_208.jpg'}, 987515231: {'photo_id': 987515231, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2019/11/22/dbf4cafa71b6db4771c5c8f0c25e9cda.jpg', 'latitude': 0.0, 'longitude': 0.0, 'text': 'photo_origin_x_272_y_240.jpg'}, 987515232: {'photo_id': 987515232, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2019/11/22/38db7950cdb3c674ee0ad65915b021f3.jpg', 'latitude': 0.0, 'longitude': 0.0, 'text': 'photo_origin_x_272_y_272.jpg'}, 987515233: {'photo_id': 987515233, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2019/11/22/a92514bed0e8c5724f2d032d3ab1e2ad.jpg', 'latitude': 0.0, 'longitude': 0.0, 'text': 'photo_origin_x_272_y_304.jpg'}, 987515234: {'photo_id': 987515234, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2019/11/22/2eca3480aed0f8b876242675ad99b666.jpg', 'latitude': 0.0, 'longitude': 0.0, 'text': 'photo_origin_x_272_y_336.jpg'}, 987515235: {'photo_id': 987515235, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2019/11/22/87075955a2f76b3948b47ffe1825ecd9.jpg', 'latitude': 0.0, 'longitude': 0.0, 'text': 'photo_origin_x_304_y_112.jpg'}, 987515236: {'photo_id': 987515236, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2019/11/22/8b44a98b1aceadad73ed000d65836a9a.jpg', 'latitude': 0.0, 'longitude': 0.0, 'text': 'photo_origin_x_304_y_144.jpg'}, 987515237: {'photo_id': 987515237, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2019/11/22/1183dfa371a457f11ce2b622c7cf9467.jpg', 'latitude': 0.0, 'longitude': 0.0, 'text': 'photo_origin_x_304_y_176.jpg'}, 987515238: {'photo_id': 987515238, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2019/11/22/e6292cb81e05894cfeb4b99f21a1d3f8.jpg', 'latitude': 0.0, 'longitude': 0.0, 'text': 'photo_origin_x_304_y_208.jpg'}, 987515239: {'photo_id': 987515239, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2019/11/22/b3fa6f29636080b5138c8d8c33fea309.jpg', 'latitude': 0.0, 'longitude': 0.0, 'text': 'photo_origin_x_304_y_240.jpg'}, 987515240: {'photo_id': 987515240, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2019/11/22/7829b9b15f1bf128ea4e2c1a39b9f0dd.jpg', 'latitude': 0.0, 'longitude': 0.0, 'text': 'photo_origin_x_304_y_272.jpg'}, 987515241: {'photo_id': 987515241, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2019/11/22/073420d938f5f010ffd5b4353c064e09.jpg', 'latitude': 0.0, 'longitude': 0.0, 'text': 'photo_origin_x_304_y_304.jpg'}, 987515242: {'photo_id': 987515242, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2019/11/22/327abb5215d6fd1f0aad51f53ed8c324.jpg', 'latitude': 0.0, 'longitude': 0.0, 'text': 'photo_origin_x_304_y_336.jpg'}, 987515243: {'photo_id': 987515243, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2019/11/22/4375283f3bc5cdaa431c2fc6f17f53a4.jpg', 'latitude': 0.0, 'longitude': 0.0, 'text': 'photo_origin_x_336_y_112.jpg'}, 987515244: {'photo_id': 987515244, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2019/11/22/419530eaef5ef868f75c758b94eea4b4.jpg', 'latitude': 0.0, 'longitude': 0.0, 'text': 'photo_origin_x_336_y_144.jpg'}, 987515245: {'photo_id': 987515245, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2019/11/22/757d9d208d5bd4375c5f21f68b699148.jpg', 'latitude': 0.0, 'longitude': 0.0, 'text': 'photo_origin_x_336_y_176.jpg'}, 987515246: {'photo_id': 987515246, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2019/11/22/671a708f67f2efa19004b8257fc7b9c8.jpg', 'latitude': 0.0, 'longitude': 0.0, 'text': 'photo_origin_x_336_y_208.jpg'}, 987515247: {'photo_id': 987515247, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2019/11/22/e47b65403df916ba909bc9c439b0af73.jpg', 'latitude': 0.0, 'longitude': 0.0, 'text': 'photo_origin_x_336_y_240.jpg'}, 987515248: {'photo_id': 987515248, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2019/11/22/a70ad88462a22fb62a120721a42b2d42.jpg', 'latitude': 0.0, 'longitude': 0.0, 'text': 'image_22062023_14_16_02_694514_0002.jpg'}, 987515249: {'photo_id': 987515249, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2019/11/22/a70ad88462a22fb62a120721a42b2d42.jpg', 'latitude': 0.0, 'longitude': 0.0, 'text': 'photo_origin_x_336_y_304.jpg'}, 987515250: {'photo_id': 987515250, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2019/11/22/b2827c9639df69656f23abcc7f2f82d9.jpg', 'latitude': 0.0, 'longitude': 0.0, 'text': 'photo_origin_x_336_y_336.jpg'}} list_photo_exists : [987515175, 987515176, 987515177, 987515178, 987515179, 987515180, 987515181, 987515182, 987515183, 987515184, 987515185, 987515186, 987515187, 987515188, 987515189, 987515190, 987515192, 987515193, 987515195, 987515196, 987515198, 987515200, 987515201, 987515202, 987515204, 987515205, 987515207, 987515208, 987515209, 987515211, 987515212, 987515213, 987515215, 987515216, 987515217, 987515219, 987515220, 987515222, 987515223, 987515224, 987515226, 987515227, 987515228, 987515230, 987515231, 987515232, 987515233, 987515234, 987515235, 987515236, 987515237, 987515238, 987515239, 987515240, 987515241, 987515242, 987515243, 987515244, 987515245, 987515246, 987515247, 987515248, 987515249, 987515250] storage_type for insertDescriptorsMulti : 1 To insert : 987515205 To insert : 987515240 To insert : 987515241 To insert : 987515242 To insert : 987515243 To insert : 987515244 To insert : 987515245 To insert : 987515246 To insert : 987515224 To insert : 987515226 To insert : 987515227 To insert : 987515228 To insert : 987515230 To insert : 987515231 To insert : 987515232 To insert : 987515220 To insert : 987515222 To insert : 987515223 To insert : 987515175 To insert : 987515176 To insert : 987515177 To insert : 987515178 To insert : 987515186 To insert : 987515187 To insert : 987515188 To insert : 987515189 To insert : 987515190 To insert : 987515192 To insert : 987515193 To insert : 987515233 To insert : 987515234 To insert : 987515235 To insert : 987515236 To insert : 987515237 To insert : 987515238 To insert : 987515239 To insert : 987515211 To insert : 987515212 To insert : 987515213 To insert : 987515215 To insert : 987515216 To insert : 987515217 To insert : 987515219 To insert : 987515195 To insert : 987515196 To insert : 987515198 To insert : 987515200 To insert : 987515201 To insert : 987515202 To insert : 987515204 To insert : 987515247 To insert : 987515248 To insert : 987515249 To insert : 987515250 To insert : 987515207 To insert : 987515208 To insert : 987515209 To insert : 987515179 To insert : 987515180 To insert : 987515181 To insert : 987515182 To insert : 987515183 To insert : 987515184 To insert : 987515185 Catched exception ! Connect or reconnect ! Error ! (1205, 'Lock wait timeout exceeded; try restarting transaction') time to insert the descriptors : 69.39918851852417 After datou_step_exec type output : time spend for datou_step_exec : 81.77814817428589 time spend to save output : 0.00010371208190917969 total time spend for step 1 : 81.7782518863678 step2:argmax Mon Apr 14 04:34:19 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec After prepare type args : Here we display some param of map_info ! map_filenames : {'temp/1744597975_648272_987515224_e8747b400e713ecbd08d5b75db4d7568.jpg': 987515224, 'temp/1744597975_648272_987515226_a18048dca1a77ae086b62cf07759f704.jpg': 987515226, 'temp/1744597975_648272_987515227_e9c45a0e576ec9e44c1379c3fc5fec7c.jpg': 987515227, 'temp/1744597975_648272_987515228_9f1759f20c9e603bccb9f9879d2f0d54.jpg': 987515228, 'temp/1744597975_648272_987515230_846ad925884264181565c81d152a2e94.jpg': 987515230, 'temp/1744597975_648272_987515231_dbf4cafa71b6db4771c5c8f0c25e9cda.jpg': 987515231, 'temp/1744597975_648272_987515232_38db7950cdb3c674ee0ad65915b021f3.jpg': 987515232, 'temp/1744597975_648272_987515233_a92514bed0e8c5724f2d032d3ab1e2ad.jpg': 987515233, 'temp/1744597975_648272_987515234_2eca3480aed0f8b876242675ad99b666.jpg': 987515234, 'temp/1744597975_648272_987515235_87075955a2f76b3948b47ffe1825ecd9.jpg': 987515235, 'temp/1744597975_648272_987515236_8b44a98b1aceadad73ed000d65836a9a.jpg': 987515236, 'temp/1744597975_648272_987515237_1183dfa371a457f11ce2b622c7cf9467.jpg': 987515237, 'temp/1744597975_648272_987515238_e6292cb81e05894cfeb4b99f21a1d3f8.jpg': 987515238, 'temp/1744597975_648272_987515239_b3fa6f29636080b5138c8d8c33fea309.jpg': 987515239, 'temp/1744597975_648272_987515240_7829b9b15f1bf128ea4e2c1a39b9f0dd.jpg': 987515240, 'temp/1744597975_648272_987515241_073420d938f5f010ffd5b4353c064e09.jpg': 987515241, 'temp/1744597975_648272_987515242_327abb5215d6fd1f0aad51f53ed8c324.jpg': 987515242, 'temp/1744597975_648272_987515243_4375283f3bc5cdaa431c2fc6f17f53a4.jpg': 987515243, 'temp/1744597975_648272_987515244_419530eaef5ef868f75c758b94eea4b4.jpg': 987515244, 'temp/1744597975_648272_987515245_757d9d208d5bd4375c5f21f68b699148.jpg': 987515245, 'temp/1744597975_648272_987515246_671a708f67f2efa19004b8257fc7b9c8.jpg': 987515246, 'temp/1744597975_648272_987515247_e47b65403df916ba909bc9c439b0af73.jpg': 987515247, 'temp/1744597975_648272_987515248_a70ad88462a22fb62a120721a42b2d42.jpg': 987515248, 'temp/1744597975_648272_987515249_a70ad88462a22fb62a120721a42b2d42.jpg': 987515249, 'temp/1744597975_648272_987515250_b2827c9639df69656f23abcc7f2f82d9.jpg': 987515250, 'temp/1744597975_648272_987515207_de216ddb041e249524b0fb2b949064a5.jpg': 987515207, 'temp/1744597975_648272_987515208_a2b90cb74908aa64bbc4aae58f0c5ae8.jpg': 987515208, 'temp/1744597975_648272_987515209_02dfe1ae39f51994652f4a8538844aea.jpg': 987515209, 'temp/1744597975_648272_987515211_72cc7664d45bd40477351b9b764f1500.jpg': 987515211, 'temp/1744597975_648272_987515212_b0a038fcb9678ebfd60d9b1f6ec1fc17.jpg': 987515212, 'temp/1744597975_648272_987515213_b0a038fcb9678ebfd60d9b1f6ec1fc17.jpg': 987515213, 'temp/1744597975_648272_987515215_902ef348a7eebb9a8b87f42927347936.jpg': 987515215, 'temp/1744597975_648272_987515216_4f7dc21f1d2cd3fcabadc4a6755921e1.jpg': 987515216, 'temp/1744597975_648272_987515217_78877bb2c5760be28518d17f77d1c609.jpg': 987515217, 'temp/1744597975_648272_987515219_c2d417a5ba6ccf7c84527636f8d5eef9.jpg': 987515219, 'temp/1744597975_648272_987515220_e729f316c4c3b32049adfbaaa336d95c.jpg': 987515220, 'temp/1744597975_648272_987515222_067a027bc7402f969b6277d0dcb47eaa.jpg': 987515222, 'temp/1744597975_648272_987515223_ebb57f09941cd11d7ee45a9368a883c1.jpg': 987515223, 'temp/1744597975_648272_987515175_8b398cba2f448622cd9657f5eb3f9796.jpg': 987515175, 'temp/1744597975_648272_987515176_8b398cba2f448622cd9657f5eb3f9796.jpg': 987515176, 'temp/1744597975_648272_987515177_4a54e9967227806219ddf45d256539d8.jpg': 987515177, 'temp/1744597975_648272_987515178_298b3d2bfe0fda6787b59a78e2e68867.jpg': 987515178, 'temp/1744597975_648272_987515179_f7d4d1757a470f4c96dc3541eac88b9e.jpg': 987515179, 'temp/1744597975_648272_987515180_776a5d7d8486ee2961bbe3a0d90f95b5.jpg': 987515180, 'temp/1744597975_648272_987515181_1738c2798fb31152809ecb443ac286d6.jpg': 987515181, 'temp/1744597975_648272_987515182_fe7f29bf6d13e08c3e985f91b5232178.jpg': 987515182, 'temp/1744597975_648272_987515183_6aab9ca0421398b4899892c10c2594c6.jpg': 987515183, 'temp/1744597975_648272_987515184_19c8c2177209a285df6014d95fe53f2c.jpg': 987515184, 'temp/1744597975_648272_987515185_e172d54457cabee9d7f02ee1300f3ae9.jpg': 987515185, 'temp/1744597975_648272_987515186_797def426440b544aa80dbd63a19234a.jpg': 987515186, 'temp/1744597975_648272_987515187_9f62f98efd3caca0b9c17d27f5c70440.jpg': 987515187, 'temp/1744597975_648272_987515188_4116f9906657a69bb76c2fda982037b9.jpg': 987515188, 'temp/1744597975_648272_987515189_8e8590a26f72249d4c2116dffd0cf668.jpg': 987515189, 'temp/1744597975_648272_987515190_d56932bfc6ba2a8c974c691108755017.jpg': 987515190, 'temp/1744597975_648272_987515192_b661073b218f5f056833d6af1c617153.jpg': 987515192, 'temp/1744597975_648272_987515193_1a97fceb4dcbf5821d783b2e00b52fe6.jpg': 987515193, 'temp/1744597975_648272_987515195_30ccb89dfe410c445878a7f2819ddc36.jpg': 987515195, 'temp/1744597975_648272_987515196_30ccb89dfe410c445878a7f2819ddc36.jpg': 987515196, 'temp/1744597975_648272_987515198_599e80f444c876f407e94b533c89360b.jpg': 987515198, 'temp/1744597975_648272_987515200_978964436b5d5fb0eeda17e3bfafe889.jpg': 987515200, 'temp/1744597975_648272_987515201_b224d2acdc7fa2bbb134c09db6bca7ce.jpg': 987515201, 'temp/1744597975_648272_987515202_3314bd90d1404f31b827d8925abf2d62.jpg': 987515202, 'temp/1744597975_648272_987515204_9779c4f9d44360a9c80499e3b01e8a09.jpg': 987515204, 'temp/1744597975_648272_987515205_fd4b136d0b3a9a1a347942d7191f6fea.jpg': 987515205} map_photo_id_path_extension : {987515224: {'path': 'temp/1744597975_648272_987515224_e8747b400e713ecbd08d5b75db4d7568.jpg', 'extension': 'jpg'}, 987515226: {'path': 'temp/1744597975_648272_987515226_a18048dca1a77ae086b62cf07759f704.jpg', 'extension': 'jpg'}, 987515227: {'path': 'temp/1744597975_648272_987515227_e9c45a0e576ec9e44c1379c3fc5fec7c.jpg', 'extension': 'jpg'}, 987515228: {'path': 'temp/1744597975_648272_987515228_9f1759f20c9e603bccb9f9879d2f0d54.jpg', 'extension': 'jpg'}, 987515230: {'path': 'temp/1744597975_648272_987515230_846ad925884264181565c81d152a2e94.jpg', 'extension': 'jpg'}, 987515231: {'path': 'temp/1744597975_648272_987515231_dbf4cafa71b6db4771c5c8f0c25e9cda.jpg', 'extension': 'jpg'}, 987515232: {'path': 'temp/1744597975_648272_987515232_38db7950cdb3c674ee0ad65915b021f3.jpg', 'extension': 'jpg'}, 987515233: {'path': 'temp/1744597975_648272_987515233_a92514bed0e8c5724f2d032d3ab1e2ad.jpg', 'extension': 'jpg'}, 987515234: {'path': 'temp/1744597975_648272_987515234_2eca3480aed0f8b876242675ad99b666.jpg', 'extension': 'jpg'}, 987515235: {'path': 'temp/1744597975_648272_987515235_87075955a2f76b3948b47ffe1825ecd9.jpg', 'extension': 'jpg'}, 987515236: {'path': 'temp/1744597975_648272_987515236_8b44a98b1aceadad73ed000d65836a9a.jpg', 'extension': 'jpg'}, 987515237: {'path': 'temp/1744597975_648272_987515237_1183dfa371a457f11ce2b622c7cf9467.jpg', 'extension': 'jpg'}, 987515238: {'path': 'temp/1744597975_648272_987515238_e6292cb81e05894cfeb4b99f21a1d3f8.jpg', 'extension': 'jpg'}, 987515239: {'path': 'temp/1744597975_648272_987515239_b3fa6f29636080b5138c8d8c33fea309.jpg', 'extension': 'jpg'}, 987515240: {'path': 'temp/1744597975_648272_987515240_7829b9b15f1bf128ea4e2c1a39b9f0dd.jpg', 'extension': 'jpg'}, 987515241: {'path': 'temp/1744597975_648272_987515241_073420d938f5f010ffd5b4353c064e09.jpg', 'extension': 'jpg'}, 987515242: {'path': 'temp/1744597975_648272_987515242_327abb5215d6fd1f0aad51f53ed8c324.jpg', 'extension': 'jpg'}, 987515243: {'path': 'temp/1744597975_648272_987515243_4375283f3bc5cdaa431c2fc6f17f53a4.jpg', 'extension': 'jpg'}, 987515244: {'path': 'temp/1744597975_648272_987515244_419530eaef5ef868f75c758b94eea4b4.jpg', 'extension': 'jpg'}, 987515245: {'path': 'temp/1744597975_648272_987515245_757d9d208d5bd4375c5f21f68b699148.jpg', 'extension': 'jpg'}, 987515246: {'path': 'temp/1744597975_648272_987515246_671a708f67f2efa19004b8257fc7b9c8.jpg', 'extension': 'jpg'}, 987515247: {'path': 'temp/1744597975_648272_987515247_e47b65403df916ba909bc9c439b0af73.jpg', 'extension': 'jpg'}, 987515248: {'path': 'temp/1744597975_648272_987515248_a70ad88462a22fb62a120721a42b2d42.jpg', 'extension': 'jpg'}, 987515249: {'path': 'temp/1744597975_648272_987515249_a70ad88462a22fb62a120721a42b2d42.jpg', 'extension': 'jpg'}, 987515250: {'path': 'temp/1744597975_648272_987515250_b2827c9639df69656f23abcc7f2f82d9.jpg', 'extension': 'jpg'}, 987515207: {'path': 'temp/1744597975_648272_987515207_de216ddb041e249524b0fb2b949064a5.jpg', 'extension': 'jpg'}, 987515208: {'path': 'temp/1744597975_648272_987515208_a2b90cb74908aa64bbc4aae58f0c5ae8.jpg', 'extension': 'jpg'}, 987515209: {'path': 'temp/1744597975_648272_987515209_02dfe1ae39f51994652f4a8538844aea.jpg', 'extension': 'jpg'}, 987515211: {'path': 'temp/1744597975_648272_987515211_72cc7664d45bd40477351b9b764f1500.jpg', 'extension': 'jpg'}, 987515212: {'path': 'temp/1744597975_648272_987515212_b0a038fcb9678ebfd60d9b1f6ec1fc17.jpg', 'extension': 'jpg'}, 987515213: {'path': 'temp/1744597975_648272_987515213_b0a038fcb9678ebfd60d9b1f6ec1fc17.jpg', 'extension': 'jpg'}, 987515215: {'path': 'temp/1744597975_648272_987515215_902ef348a7eebb9a8b87f42927347936.jpg', 'extension': 'jpg'}, 987515216: {'path': 'temp/1744597975_648272_987515216_4f7dc21f1d2cd3fcabadc4a6755921e1.jpg', 'extension': 'jpg'}, 987515217: {'path': 'temp/1744597975_648272_987515217_78877bb2c5760be28518d17f77d1c609.jpg', 'extension': 'jpg'}, 987515219: {'path': 'temp/1744597975_648272_987515219_c2d417a5ba6ccf7c84527636f8d5eef9.jpg', 'extension': 'jpg'}, 987515220: {'path': 'temp/1744597975_648272_987515220_e729f316c4c3b32049adfbaaa336d95c.jpg', 'extension': 'jpg'}, 987515222: {'path': 'temp/1744597975_648272_987515222_067a027bc7402f969b6277d0dcb47eaa.jpg', 'extension': 'jpg'}, 987515223: {'path': 'temp/1744597975_648272_987515223_ebb57f09941cd11d7ee45a9368a883c1.jpg', 'extension': 'jpg'}, 987515175: {'path': 'temp/1744597975_648272_987515175_8b398cba2f448622cd9657f5eb3f9796.jpg', 'extension': 'jpg'}, 987515176: {'path': 'temp/1744597975_648272_987515176_8b398cba2f448622cd9657f5eb3f9796.jpg', 'extension': 'jpg'}, 987515177: {'path': 'temp/1744597975_648272_987515177_4a54e9967227806219ddf45d256539d8.jpg', 'extension': 'jpg'}, 987515178: {'path': 'temp/1744597975_648272_987515178_298b3d2bfe0fda6787b59a78e2e68867.jpg', 'extension': 'jpg'}, 987515179: {'path': 'temp/1744597975_648272_987515179_f7d4d1757a470f4c96dc3541eac88b9e.jpg', 'extension': 'jpg'}, 987515180: {'path': 'temp/1744597975_648272_987515180_776a5d7d8486ee2961bbe3a0d90f95b5.jpg', 'extension': 'jpg'}, 987515181: {'path': 'temp/1744597975_648272_987515181_1738c2798fb31152809ecb443ac286d6.jpg', 'extension': 'jpg'}, 987515182: {'path': 'temp/1744597975_648272_987515182_fe7f29bf6d13e08c3e985f91b5232178.jpg', 'extension': 'jpg'}, 987515183: {'path': 'temp/1744597975_648272_987515183_6aab9ca0421398b4899892c10c2594c6.jpg', 'extension': 'jpg'}, 987515184: {'path': 'temp/1744597975_648272_987515184_19c8c2177209a285df6014d95fe53f2c.jpg', 'extension': 'jpg'}, 987515185: {'path': 'temp/1744597975_648272_987515185_e172d54457cabee9d7f02ee1300f3ae9.jpg', 'extension': 'jpg'}, 987515186: {'path': 'temp/1744597975_648272_987515186_797def426440b544aa80dbd63a19234a.jpg', 'extension': 'jpg'}, 987515187: {'path': 'temp/1744597975_648272_987515187_9f62f98efd3caca0b9c17d27f5c70440.jpg', 'extension': 'jpg'}, 987515188: {'path': 'temp/1744597975_648272_987515188_4116f9906657a69bb76c2fda982037b9.jpg', 'extension': 'jpg'}, 987515189: {'path': 'temp/1744597975_648272_987515189_8e8590a26f72249d4c2116dffd0cf668.jpg', 'extension': 'jpg'}, 987515190: {'path': 'temp/1744597975_648272_987515190_d56932bfc6ba2a8c974c691108755017.jpg', 'extension': 'jpg'}, 987515192: {'path': 'temp/1744597975_648272_987515192_b661073b218f5f056833d6af1c617153.jpg', 'extension': 'jpg'}, 987515193: {'path': 'temp/1744597975_648272_987515193_1a97fceb4dcbf5821d783b2e00b52fe6.jpg', 'extension': 'jpg'}, 987515195: {'path': 'temp/1744597975_648272_987515195_30ccb89dfe410c445878a7f2819ddc36.jpg', 'extension': 'jpg'}, 987515196: {'path': 'temp/1744597975_648272_987515196_30ccb89dfe410c445878a7f2819ddc36.jpg', 'extension': 'jpg'}, 987515198: {'path': 'temp/1744597975_648272_987515198_599e80f444c876f407e94b533c89360b.jpg', 'extension': 'jpg'}, 987515200: {'path': 'temp/1744597975_648272_987515200_978964436b5d5fb0eeda17e3bfafe889.jpg', 'extension': 'jpg'}, 987515201: {'path': 'temp/1744597975_648272_987515201_b224d2acdc7fa2bbb134c09db6bca7ce.jpg', 'extension': 'jpg'}, 987515202: {'path': 'temp/1744597975_648272_987515202_3314bd90d1404f31b827d8925abf2d62.jpg', 'extension': 'jpg'}, 987515204: {'path': 'temp/1744597975_648272_987515204_9779c4f9d44360a9c80499e3b01e8a09.jpg', 'extension': 'jpg'}, 987515205: {'path': 'temp/1744597975_648272_987515205_fd4b136d0b3a9a1a347942d7191f6fea.jpg', 'extension': 'jpg'}} map_subphoto_mainphoto : {} Beginning of datou_step Argmax ! calculate argmax for thcl : 1528 After datou_step_exec type output : time spend for datou_step_exec : 0.0009796619415283203 time spend to save output : 6.866455078125e-05 total time spend for step 2 : 0.0010483264923095703 caffe_path_current : About to save ! 0 After save, about to update current ! datou_cur_ids : [] len(datou.list_steps) : 2 output : {'987515205': [('987515205', 'Papier_Magazine', 0.9908626, 1927, '1528'), 'temp/1744597975_648272_987515205_fd4b136d0b3a9a1a347942d7191f6fea.jpg'], '987515240': [('987515240', 'Carton', 0.99951947, 1927, '1528'), 'temp/1744597975_648272_987515240_7829b9b15f1bf128ea4e2c1a39b9f0dd.jpg'], '987515241': [('987515241', 'Carton', 0.98209697, 1927, '1528'), 'temp/1744597975_648272_987515241_073420d938f5f010ffd5b4353c064e09.jpg'], '987515242': [('987515242', 'Carton', 0.93579596, 1927, '1528'), 'temp/1744597975_648272_987515242_327abb5215d6fd1f0aad51f53ed8c324.jpg'], '987515243': [('987515243', 'Papier_Magazine', 0.8744101, 1927, '1528'), 'temp/1744597975_648272_987515243_4375283f3bc5cdaa431c2fc6f17f53a4.jpg'], '987515244': [('987515244', 'Papier_Magazine', 0.8171105, 1927, '1528'), 'temp/1744597975_648272_987515244_419530eaef5ef868f75c758b94eea4b4.jpg'], '987515245': [('987515245', 'Carton', 0.8659946, 1927, '1528'), 'temp/1744597975_648272_987515245_757d9d208d5bd4375c5f21f68b699148.jpg'], '987515246': [('987515246', 'Carton', 0.99923265, 1927, '1528'), 'temp/1744597975_648272_987515246_671a708f67f2efa19004b8257fc7b9c8.jpg'], '987515224': [('987515224', 'Carton', 0.9081279, 1927, '1528'), 'temp/1744597975_648272_987515224_e8747b400e713ecbd08d5b75db4d7568.jpg'], '987515226': [('987515226', 'Papier_Magazine', 0.98696065, 1927, '1528'), 'temp/1744597975_648272_987515226_a18048dca1a77ae086b62cf07759f704.jpg'], '987515227': [('987515227', 'Papier_Magazine', 0.9010772, 1927, '1528'), 'temp/1744597975_648272_987515227_e9c45a0e576ec9e44c1379c3fc5fec7c.jpg'], '987515228': [('987515228', 'Papier_Magazine', 0.52274555, 1927, '1528'), 'temp/1744597975_648272_987515228_9f1759f20c9e603bccb9f9879d2f0d54.jpg'], '987515230': [('987515230', 'Carton', 0.9994054, 1927, '1528'), 'temp/1744597975_648272_987515230_846ad925884264181565c81d152a2e94.jpg'], '987515231': [('987515231', 'Carton', 0.9994228, 1927, '1528'), 'temp/1744597975_648272_987515231_dbf4cafa71b6db4771c5c8f0c25e9cda.jpg'], '987515232': [('987515232', 'Carton', 0.99924505, 1927, '1528'), 'temp/1744597975_648272_987515232_38db7950cdb3c674ee0ad65915b021f3.jpg'], '987515220': [('987515220', 'Carton', 0.9963793, 1927, '1528'), 'temp/1744597975_648272_987515220_e729f316c4c3b32049adfbaaa336d95c.jpg'], '987515222': [('987515222', 'Carton', 0.9974693, 1927, '1528'), 'temp/1744597975_648272_987515222_067a027bc7402f969b6277d0dcb47eaa.jpg'], '987515223': [('987515223', 'Carton', 0.9921038, 1927, '1528'), 'temp/1744597975_648272_987515223_ebb57f09941cd11d7ee45a9368a883c1.jpg'], '987515175': [('987515175', 'Papier_Magazine', 0.9998135, 1927, '1528'), 'temp/1744597975_648272_987515175_8b398cba2f448622cd9657f5eb3f9796.jpg'], '987515176': [('987515176', 'Papier_Magazine', 0.99981457, 1927, '1528'), 'temp/1744597975_648272_987515176_8b398cba2f448622cd9657f5eb3f9796.jpg'], '987515177': [('987515177', 'Papier_Magazine', 0.9771006, 1927, '1528'), 'temp/1744597975_648272_987515177_4a54e9967227806219ddf45d256539d8.jpg'], '987515178': [('987515178', 'Carton', 0.8572866, 1927, '1528'), 'temp/1744597975_648272_987515178_298b3d2bfe0fda6787b59a78e2e68867.jpg'], '987515186': [('987515186', 'Carton', 0.98475295, 1927, '1528'), 'temp/1744597975_648272_987515186_797def426440b544aa80dbd63a19234a.jpg'], '987515187': [('987515187', 'Carton', 0.9811897, 1927, '1528'), 'temp/1744597975_648272_987515187_9f62f98efd3caca0b9c17d27f5c70440.jpg'], '987515188': [('987515188', 'Carton', 0.9956463, 1927, '1528'), 'temp/1744597975_648272_987515188_4116f9906657a69bb76c2fda982037b9.jpg'], '987515189': [('987515189', 'Carton', 0.99778914, 1927, '1528'), 'temp/1744597975_648272_987515189_8e8590a26f72249d4c2116dffd0cf668.jpg'], '987515190': [('987515190', 'Carton', 0.9763238, 1927, '1528'), 'temp/1744597975_648272_987515190_d56932bfc6ba2a8c974c691108755017.jpg'], '987515192': [('987515192', 'Papier_Magazine', 0.9999113, 1927, '1528'), 'temp/1744597975_648272_987515192_b661073b218f5f056833d6af1c617153.jpg'], '987515193': [('987515193', 'Papier_Magazine', 0.99939513, 1927, '1528'), 'temp/1744597975_648272_987515193_1a97fceb4dcbf5821d783b2e00b52fe6.jpg'], '987515233': [('987515233', 'Carton', 0.98355603, 1927, '1528'), 'temp/1744597975_648272_987515233_a92514bed0e8c5724f2d032d3ab1e2ad.jpg'], '987515234': [('987515234', 'Carton', 0.944692, 1927, '1528'), 'temp/1744597975_648272_987515234_2eca3480aed0f8b876242675ad99b666.jpg'], '987515235': [('987515235', 'Papier_Magazine', 0.8919306, 1927, '1528'), 'temp/1744597975_648272_987515235_87075955a2f76b3948b47ffe1825ecd9.jpg'], '987515236': [('987515236', 'Papier_Magazine', 0.5373591, 1927, '1528'), 'temp/1744597975_648272_987515236_8b44a98b1aceadad73ed000d65836a9a.jpg'], '987515237': [('987515237', 'Carton', 0.7695443, 1927, '1528'), 'temp/1744597975_648272_987515237_1183dfa371a457f11ce2b622c7cf9467.jpg'], '987515238': [('987515238', 'Carton', 0.9995728, 1927, '1528'), 'temp/1744597975_648272_987515238_e6292cb81e05894cfeb4b99f21a1d3f8.jpg'], '987515239': [('987515239', 'Carton', 0.9997836, 1927, '1528'), 'temp/1744597975_648272_987515239_b3fa6f29636080b5138c8d8c33fea309.jpg'], '987515211': [('987515211', 'Carton', 0.97331965, 1927, '1528'), 'temp/1744597975_648272_987515211_72cc7664d45bd40477351b9b764f1500.jpg'], '987515212': [('987515212', 'Carton', 0.9869164, 1927, '1528'), 'temp/1744597975_648272_987515212_b0a038fcb9678ebfd60d9b1f6ec1fc17.jpg'], '987515213': [('987515213', 'Carton', 0.98690784, 1927, '1528'), 'temp/1744597975_648272_987515213_b0a038fcb9678ebfd60d9b1f6ec1fc17.jpg'], '987515215': [('987515215', 'Papier_Magazine', 0.9939022, 1927, '1528'), 'temp/1744597975_648272_987515215_902ef348a7eebb9a8b87f42927347936.jpg'], '987515216': [('987515216', 'Papier_Magazine', 0.97736585, 1927, '1528'), 'temp/1744597975_648272_987515216_4f7dc21f1d2cd3fcabadc4a6755921e1.jpg'], '987515217': [('987515217', 'Carton', 0.52921593, 1927, '1528'), 'temp/1744597975_648272_987515217_78877bb2c5760be28518d17f77d1c609.jpg'], '987515219': [('987515219', 'Carton', 0.9993685, 1927, '1528'), 'temp/1744597975_648272_987515219_c2d417a5ba6ccf7c84527636f8d5eef9.jpg'], '987515195': [('987515195', 'Carton', 0.98466706, 1927, '1528'), 'temp/1744597975_648272_987515195_30ccb89dfe410c445878a7f2819ddc36.jpg'], '987515196': [('987515196', 'Carton', 0.98468876, 1927, '1528'), 'temp/1744597975_648272_987515196_30ccb89dfe410c445878a7f2819ddc36.jpg'], '987515198': [('987515198', 'Carton', 0.96602005, 1927, '1528'), 'temp/1744597975_648272_987515198_599e80f444c876f407e94b533c89360b.jpg'], '987515200': [('987515200', 'Carton', 0.98594636, 1927, '1528'), 'temp/1744597975_648272_987515200_978964436b5d5fb0eeda17e3bfafe889.jpg'], '987515201': [('987515201', 'Carton', 0.9954596, 1927, '1528'), 'temp/1744597975_648272_987515201_b224d2acdc7fa2bbb134c09db6bca7ce.jpg'], '987515202': [('987515202', 'Carton', 0.99111664, 1927, '1528'), 'temp/1744597975_648272_987515202_3314bd90d1404f31b827d8925abf2d62.jpg'], '987515204': [('987515204', 'Papier_Magazine', 0.99508345, 1927, '1528'), 'temp/1744597975_648272_987515204_9779c4f9d44360a9c80499e3b01e8a09.jpg'], '987515247': [('987515247', 'Carton', 0.99966943, 1927, '1528'), 'temp/1744597975_648272_987515247_e47b65403df916ba909bc9c439b0af73.jpg'], '987515248': [('987515248', 'Carton', 0.9812247, 1927, '1528'), 'temp/1744597975_648272_987515248_a70ad88462a22fb62a120721a42b2d42.jpg'], '987515249': [('987515249', 'Carton', 0.98130167, 1927, '1528'), 'temp/1744597975_648272_987515249_a70ad88462a22fb62a120721a42b2d42.jpg'], '987515250': [('987515250', 'Carton', 0.98080826, 1927, '1528'), 'temp/1744597975_648272_987515250_b2827c9639df69656f23abcc7f2f82d9.jpg'], '987515207': [('987515207', 'Papier_Magazine', 0.8737082, 1927, '1528'), 'temp/1744597975_648272_987515207_de216ddb041e249524b0fb2b949064a5.jpg'], '987515208': [('987515208', 'Carton', 0.99170697, 1927, '1528'), 'temp/1744597975_648272_987515208_a2b90cb74908aa64bbc4aae58f0c5ae8.jpg'], '987515209': [('987515209', 'Carton', 0.9677449, 1927, '1528'), 'temp/1744597975_648272_987515209_02dfe1ae39f51994652f4a8538844aea.jpg'], '987515179': [('987515179', 'Carton', 0.92677104, 1927, '1528'), 'temp/1744597975_648272_987515179_f7d4d1757a470f4c96dc3541eac88b9e.jpg'], '987515180': [('987515180', 'Carton', 0.9899963, 1927, '1528'), 'temp/1744597975_648272_987515180_776a5d7d8486ee2961bbe3a0d90f95b5.jpg'], '987515181': [('987515181', 'Carton', 0.9977798, 1927, '1528'), 'temp/1744597975_648272_987515181_1738c2798fb31152809ecb443ac286d6.jpg'], '987515182': [('987515182', 'Carton', 0.99244046, 1927, '1528'), 'temp/1744597975_648272_987515182_fe7f29bf6d13e08c3e985f91b5232178.jpg'], '987515183': [('987515183', 'Papier_Magazine', 0.99999213, 1927, '1528'), 'temp/1744597975_648272_987515183_6aab9ca0421398b4899892c10c2594c6.jpg'], '987515184': [('987515184', 'Papier_Magazine', 0.99973136, 1927, '1528'), 'temp/1744597975_648272_987515184_19c8c2177209a285df6014d95fe53f2c.jpg'], '987515185': [('987515185', 'Papier_Magazine', 0.79828423, 1927, '1528'), 'temp/1744597975_648272_987515185_e172d54457cabee9d7f02ee1300f3ae9.jpg']} Inside batchDatouExec : verbose : True ##### chargement datou SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=1879 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=1879 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 1879 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=1879 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! no param json to modify List Step Type Loaded in datou : detect_points list_input_json : [] ##### fin chargement datou ##### chargement data ##### Call load_data_input : nb_thread : 5 origin SELECT photo_id, url FROM MTRBack.photos ph WHERE photo_id IN (987515173) Found this number of photos: 1 ##### Call download_photos : nb_thread : 5 begin to download photo : 987515173 download finish for photo 987515173 we have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB ##### After download_photos length of list_filenames : 1 ; length of list_pids : 1 ; length of list_args : 1 ##### After load_data_input time to download the photos : 0.13971757888793945 #### fin chargement data Blocking on flush ? No conitnuing About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : True number of steps : 1 step1:detect_points Mon Apr 14 04:34:19 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec After prepare type args : Here we display some param of map_info ! map_filenames : {'temp/1744598059_648272_987515173_91fa471b1a04f95b356afdbaf021f623.jpg': 987515173} map_photo_id_path_extension : {987515173: {'path': 'temp/1744598059_648272_987515173_91fa471b1a04f95b356afdbaf021f623.jpg', 'extension': 'jpg'}} map_subphoto_mainphoto : {} Beginning of datou step predict points ! Inside try reload ! classes : ['Autre_Environement', 'Carton', 'Kraft', 'Lointain_Papier_Magazine', 'Metal', 'Papier_Magazine', 'Plastique', 'Sol_Environement', 'Teint_Dans_La_Masse', 'autre_refus'] pht : 1927 model_name : learn_refus_upm_blanches_1924 {'id': 1528, 'mtr_user_id': 31, 'name': 'learn_refus_upm_blanches_1924', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Autre_Environement,Carton,Kraft,Lointain_Papier_Magazine,Metal,Papier_Magazine,Plastique,Sol_Environement,Teint_Dans_La_Masse,autre_refus', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 1927, 'photo_desc_type': 4421, 'type_classification': 'caffe', 'hashtag_id_list': '2107752388,492774966,493202403,2107752389,492628673,2107752386,492725882,2107752387,2107752385,2107752406'} gpu_mode in detect_points : 1 To load net FromThcl() model_param file didn't exist model_name : learn_refus_upm_blanches_1924 model_type : caffe list file need : ['caffemodel', 'deploy_conv_normal.prototxt', 'deploy_fc.prototxt', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file exist in s3 : ['caffemodel', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file manque in s3 : ['deploy_conv_normal.prototxt', 'deploy_fc.prototxt'] local folder : /data/models_weight/learn_refus_upm_blanches_1924 /data/models_weight/learn_refus_upm_blanches_1924/caffemodel size_local : 45774543 size in s3 : 45774543 create time local : 2021-08-09 05:29:53 create time in s3 : 2021-08-06 19:36:04 caffemodel already exist and didn't need to update /data/models_weight/learn_refus_upm_blanches_1924/deploy.prototxt size_local : 17312 size in s3 : 17312 create time local : 2021-08-09 05:29:53 create time in s3 : 2021-08-06 19:36:03 deploy.prototxt already exist and didn't need to update /data/models_weight/learn_refus_upm_blanches_1924/mean.npy size_local : 1572992 size in s3 : 1572992 create time local : 2021-08-09 05:29:53 create time in s3 : 2021-08-06 19:36:05 mean.npy already exist and didn't need to update /data/models_weight/learn_refus_upm_blanches_1924/synset_words.txt size_local : 218 size in s3 : 218 create time local : 2021-08-09 05:29:53 create time in s3 : 2021-08-06 19:36:04 synset_words.txt already exist and didn't need to update reshape net's input to : (224, 224) origin shape : (10, 3, 224, 224) after reshape : (1, 3, 224, 224) [('data', (1, 3, 224, 224)), ('conv1', (1, 64, 112, 112)), ('pool1', (1, 64, 56, 56)), ('pool1_pool1_0_split_0', (1, 64, 56, 56)), ('pool1_pool1_0_split_1', (1, 64, 56, 56)), ('res2a_branch1', (1, 64, 56, 56)), ('res2a_branch2a', (1, 64, 56, 56)), ('res2a_branch2b', (1, 64, 56, 56)), ('res2a', (1, 64, 56, 56)), ('res2a_res2a_relu_0_split_0', (1, 64, 56, 56)), ('res2a_res2a_relu_0_split_1', (1, 64, 56, 56)), ('res2b_branch2a', (1, 64, 56, 56)), ('res2b_branch2b', (1, 64, 56, 56)), ('res2b', (1, 64, 56, 56)), ('res2b_res2b_relu_0_split_0', (1, 64, 56, 56)), ('res2b_res2b_relu_0_split_1', (1, 64, 56, 56)), ('res3a_branch1', (1, 128, 28, 28)), ('res3a_branch2a', (1, 128, 28, 28)), ('res3a_branch2b', (1, 128, 28, 28)), ('res3a', (1, 128, 28, 28)), ('res3a_res3a_relu_0_split_0', (1, 128, 28, 28)), ('res3a_res3a_relu_0_split_1', (1, 128, 28, 28)), ('res3b_branch2a', (1, 128, 28, 28)), ('res3b_branch2b', (1, 128, 28, 28)), ('res3b', (1, 128, 28, 28)), ('res3b_res3b_relu_0_split_0', (1, 128, 28, 28)), ('res3b_res3b_relu_0_split_1', (1, 128, 28, 28)), ('res4a_branch1', (1, 256, 14, 14)), ('res4a_branch2a', (1, 256, 14, 14)), ('res4a_branch2b', (1, 256, 14, 14)), ('res4a', (1, 256, 14, 14)), ('res4a_res4a_relu_0_split_0', (1, 256, 14, 14)), ('res4a_res4a_relu_0_split_1', (1, 256, 14, 14)), ('res4b_branch2a', (1, 256, 14, 14)), ('res4b_branch2b', (1, 256, 14, 14)), ('res4b', (1, 256, 14, 14)), ('res4b_res4b_relu_0_split_0', (1, 256, 14, 14)), ('res4b_res4b_relu_0_split_1', (1, 256, 14, 14)), ('res5a_branch1', (1, 512, 7, 7)), ('res5a_branch2a', (1, 512, 7, 7)), ('res5a_branch2b', (1, 512, 7, 7)), ('res5a', (1, 512, 7, 7)), ('res5a_res5a_relu_0_split_0', (1, 512, 7, 7)), ('res5a_res5a_relu_0_split_1', (1, 512, 7, 7)), ('res5b_branch2a', (1, 512, 7, 7)), ('res5b_branch2b', (1, 512, 7, 7)), ('res5b', (1, 512, 7, 7)), ('fc2019-10-22_15-02-46', (1, 10, 1, 1)), ('prob', (1, 10, 1, 1))] set image transformer : About to compute detect the points : len(args) : 1 Inside predict_points step exec : nb paths : 1 treate image : temp/1744598059_648272_987515173_91fa471b1a04f95b356afdbaf021f623.jpg size of numpy array img : 2408584 scale method : caffe/skimage size of numpy array img_scale : 2408584 (448, 448, 3) nb_h 8 nb_w 8 size of sub images : (224, 224, 3) size of caffe_input : 38535320 (64, 3, 224, 224) time to do the preprocess : 0.023270845413208008 time to do a prediction : 0.33385562896728516 dict_keys(['prob']) shape of output (64, 10, 1, 1) shape of the out_put heatmap (10, 8, 8) number of sub_photos vertical and horizon 8 8 size of heatmap : (8,8) size of heatmap : (8,8) size of heatmap : (8,8) size of heatmap : (8,8) size of heatmap : (8,8) size of heatmap : (8,8) size of heatmap : (8,8) size of heatmap : (8,8) size of heatmap : (8,8) size of heatmap : (8,8) After datou_step_exec type output : time spend for datou_step_exec : 1.6955723762512207 time spend to save output : 6.079673767089844e-05 total time spend for step 1 : 1.6956331729888916 caffe_path_current : About to save ! 0 After save, about to update current ! datou_cur_ids : [] len(datou.list_steps) : 1 output : {987515173: [(987515173, 1982, 'Autre_Environement', 112, -1, 112, -1, 6.271397463841755e-12), (987515173, 1982, 'Autre_Environement', 144, -1, 112, -1, 2.451621891608191e-11), (987515173, 1982, 'Autre_Environement', 176, -1, 112, -1, 1.0498378166801103e-08), (987515173, 1982, 'Autre_Environement', 208, -1, 112, -1, 4.447592516498844e-07), (987515173, 1982, 'Autre_Environement', 240, -1, 112, -1, 1.921495822898578e-06), (987515173, 1982, 'Autre_Environement', 272, -1, 112, -1, 3.768848910112865e-05), (987515173, 1982, 'Autre_Environement', 304, -1, 112, -1, 0.00012225352111272514), (987515173, 1982, 'Autre_Environement', 336, -1, 112, -1, 2.9528571758419275e-05), (987515173, 1982, 'Autre_Environement', 112, -1, 144, -1, 2.350749106483363e-08), (987515173, 1982, 'Autre_Environement', 144, -1, 144, -1, 2.205972116087196e-08), (987515173, 1982, 'Autre_Environement', 176, -1, 144, -1, 1.3810169718908583e-07), (987515173, 1982, 'Autre_Environement', 208, -1, 144, -1, 1.4717463727720315e-06), (987515173, 1982, 'Autre_Environement', 240, -1, 144, -1, 1.1271431503701024e-05), (987515173, 1982, 'Autre_Environement', 272, -1, 144, -1, 0.00015789814642630517), (987515173, 1982, 'Autre_Environement', 304, -1, 144, -1, 0.00044295270345173776), (987515173, 1982, 'Autre_Environement', 336, -1, 144, -1, 6.552588456543162e-05), (987515173, 1982, 'Autre_Environement', 112, -1, 176, -1, 1.3336054962564958e-06), (987515173, 1982, 'Autre_Environement', 144, -1, 176, -1, 1.6210512967518298e-06), (987515173, 1982, 'Autre_Environement', 176, -1, 176, -1, 2.524664978409419e-06), (987515173, 1982, 'Autre_Environement', 208, -1, 176, -1, 1.6130259155033855e-06), (987515173, 1982, 'Autre_Environement', 240, -1, 176, -1, 6.276387466641609e-06), (987515173, 1982, 'Autre_Environement', 272, -1, 176, -1, 8.610051736468449e-05), (987515173, 1982, 'Autre_Environement', 304, -1, 176, -1, 0.00032730188104324043), (987515173, 1982, 'Autre_Environement', 336, -1, 176, -1, 0.0003038864815607667), (987515173, 1982, 'Autre_Environement', 112, -1, 208, -1, 1.854014590207953e-05), (987515173, 1982, 'Autre_Environement', 144, -1, 208, -1, 7.929676939966157e-06), (987515173, 1982, 'Autre_Environement', 176, -1, 208, -1, 2.6948040613206103e-05), (987515173, 1982, 'Autre_Environement', 208, -1, 208, -1, 1.8061984519590624e-05), (987515173, 1982, 'Autre_Environement', 240, -1, 208, -1, 2.297614082635846e-05), (987515173, 1982, 'Autre_Environement', 272, -1, 208, -1, 1.701935070741456e-05), (987515173, 1982, 'Autre_Environement', 304, -1, 208, -1, 4.559010449156631e-06), (987515173, 1982, 'Autre_Environement', 336, -1, 208, -1, 8.78635182743892e-06), (987515173, 1982, 'Autre_Environement', 112, -1, 240, -1, 6.226186087587848e-06), (987515173, 1982, 'Autre_Environement', 144, -1, 240, -1, 1.643238533688418e-06), (987515173, 1982, 'Autre_Environement', 176, -1, 240, -1, 1.9630781480373116e-06), (987515173, 1982, 'Autre_Environement', 208, -1, 240, -1, 1.4375708587976987e-06), (987515173, 1982, 'Autre_Environement', 240, -1, 240, -1, 7.879094482632354e-06), (987515173, 1982, 'Autre_Environement', 272, -1, 240, -1, 1.286372025788296e-05), (987515173, 1982, 'Autre_Environement', 304, -1, 240, -1, 9.307515028922353e-06), (987515173, 1982, 'Autre_Environement', 336, -1, 240, -1, 2.1793444830109365e-05), (987515173, 1982, 'Autre_Environement', 112, -1, 272, -1, 3.8258981476246845e-06), (987515173, 1982, 'Autre_Environement', 144, -1, 272, -1, 2.547542862885166e-06), (987515173, 1982, 'Autre_Environement', 176, -1, 272, -1, 2.960170604637824e-06), (987515173, 1982, 'Autre_Environement', 208, -1, 272, -1, 2.76046148428577e-06), (987515173, 1982, 'Autre_Environement', 240, -1, 272, -1, 4.330826413934119e-06), (987515173, 1982, 'Autre_Environement', 272, -1, 272, -1, 8.172176421794575e-06), (987515173, 1982, 'Autre_Environement', 304, -1, 272, -1, 1.1552077012311202e-05), (987515173, 1982, 'Autre_Environement', 336, -1, 272, -1, 3.9282433135667816e-05), (987515173, 1982, 'Autre_Environement', 112, -1, 304, -1, 1.2083461115253158e-05), (987515173, 1982, 'Autre_Environement', 144, -1, 304, -1, 1.5569297829642892e-05), (987515173, 1982, 'Autre_Environement', 176, -1, 304, -1, 3.345852383063175e-05), (987515173, 1982, 'Autre_Environement', 208, -1, 304, -1, 0.00015421949501615018), (987515173, 1982, 'Autre_Environement', 240, -1, 304, -1, 0.0002589003706816584), (987515173, 1982, 'Autre_Environement', 272, -1, 304, -1, 0.00018797280790749937), (987515173, 1982, 'Autre_Environement', 304, -1, 304, -1, 0.0002131713117705658), (987515173, 1982, 'Autre_Environement', 336, -1, 304, -1, 0.00016473198775202036), (987515173, 1982, 'Autre_Environement', 112, -1, 336, -1, 4.548686320049455e-06), (987515173, 1982, 'Autre_Environement', 144, -1, 336, -1, 1.7321308405371383e-05), (987515173, 1982, 'Autre_Environement', 176, -1, 336, -1, 4.923374217469245e-05), (987515173, 1982, 'Autre_Environement', 208, -1, 336, -1, 0.00012132490519434214), (987515173, 1982, 'Autre_Environement', 240, -1, 336, -1, 0.00019545952090993524), (987515173, 1982, 'Autre_Environement', 272, -1, 336, -1, 0.00018809996254276484), (987515173, 1982, 'Autre_Environement', 304, -1, 336, -1, 0.00012375719961710274), (987515173, 1982, 'Autre_Environement', 336, -1, 336, -1, 0.0002720215416047722), (987515173, 1982, 'Carton', 112, -1, 112, -1, 1.5825072807729157e-07), (987515173, 1982, 'Carton', 144, -1, 112, -1, 4.051383257319685e-06), (987515173, 1982, 'Carton', 176, -1, 112, -1, 6.961710369068896e-06), (987515173, 1982, 'Carton', 208, -1, 112, -1, 0.0008730586268939078), (987515173, 1982, 'Carton', 240, -1, 112, -1, 0.00264487462118268), (987515173, 1982, 'Carton', 272, -1, 112, -1, 0.003375138621777296), (987515173, 1982, 'Carton', 304, -1, 112, -1, 0.03124803863465786), (987515173, 1982, 'Carton', 336, -1, 112, -1, 0.05582995340228081), (987515173, 1982, 'Carton', 112, -1, 144, -1, 0.00012355086801107973), (987515173, 1982, 'Carton', 144, -1, 144, -1, 0.00020865698752459139), (987515173, 1982, 'Carton', 176, -1, 144, -1, 0.00036844637361355126), (987515173, 1982, 'Carton', 208, -1, 144, -1, 0.0068449354730546474), (987515173, 1982, 'Carton', 240, -1, 144, -1, 0.01588798686861992), (987515173, 1982, 'Carton', 272, -1, 144, -1, 0.009420260787010193), (987515173, 1982, 'Carton', 304, -1, 144, -1, 0.009784248657524586), (987515173, 1982, 'Carton', 336, -1, 144, -1, 0.02217702567577362), (987515173, 1982, 'Carton', 112, -1, 176, -1, 0.021903619170188904), (987515173, 1982, 'Carton', 144, -1, 176, -1, 0.19304311275482178), (987515173, 1982, 'Carton', 176, -1, 176, -1, 0.09658566862344742), (987515173, 1982, 'Carton', 208, -1, 176, -1, 0.12337026745080948), (987515173, 1982, 'Carton', 240, -1, 176, -1, 0.5333078503608704), (987515173, 1982, 'Carton', 272, -1, 176, -1, 0.4592636823654175), (987515173, 1982, 'Carton', 304, -1, 176, -1, 0.7708209753036499), (987515173, 1982, 'Carton', 336, -1, 176, -1, 0.8663483262062073), (987515173, 1982, 'Carton', 112, -1, 208, -1, 0.8500397801399231), (987515173, 1982, 'Carton', 144, -1, 208, -1, 0.9842839241027832), (987515173, 1982, 'Carton', 176, -1, 208, -1, 0.9847639203071594), (987515173, 1982, 'Carton', 208, -1, 208, -1, 0.9919419288635254), (987515173, 1982, 'Carton', 240, -1, 208, -1, 0.9993878602981567), (987515173, 1982, 'Carton', 272, -1, 208, -1, 0.9994122982025146), (987515173, 1982, 'Carton', 304, -1, 208, -1, 0.9995859265327454), (987515173, 1982, 'Carton', 336, -1, 208, -1, 0.9992280006408691), (987515173, 1982, 'Carton', 112, -1, 240, -1, 0.9295159578323364), (987515173, 1982, 'Carton', 144, -1, 240, -1, 0.9809831976890564), (987515173, 1982, 'Carton', 176, -1, 240, -1, 0.9662431478500366), (987515173, 1982, 'Carton', 208, -1, 240, -1, 0.9674913883209229), (987515173, 1982, 'Carton', 240, -1, 240, -1, 0.9964020252227783), (987515173, 1982, 'Carton', 272, -1, 240, -1, 0.9994215965270996), (987515173, 1982, 'Carton', 304, -1, 240, -1, 0.9997861981391907), (987515173, 1982, 'Carton', 336, -1, 240, -1, 0.9996650218963623), (987515173, 1982, 'Carton', 112, -1, 272, -1, 0.989547848701477), (987515173, 1982, 'Carton', 144, -1, 272, -1, 0.9954788088798523), (987515173, 1982, 'Carton', 176, -1, 272, -1, 0.9854978322982788), (987515173, 1982, 'Carton', 208, -1, 272, -1, 0.9731882214546204), (987515173, 1982, 'Carton', 240, -1, 272, -1, 0.9974695444107056), (987515173, 1982, 'Carton', 272, -1, 272, -1, 0.9992057681083679), (987515173, 1982, 'Carton', 304, -1, 272, -1, 0.9995170831680298), (987515173, 1982, 'Carton', 336, -1, 272, -1, 0.9991299510002136), (987515173, 1982, 'Carton', 112, -1, 304, -1, 0.9977769255638123), (987515173, 1982, 'Carton', 144, -1, 304, -1, 0.997759222984314), (987515173, 1982, 'Carton', 176, -1, 304, -1, 0.9955556988716125), (987515173, 1982, 'Carton', 208, -1, 304, -1, 0.9927322268486023), (987515173, 1982, 'Carton', 240, -1, 304, -1, 0.9920433163642883), (987515173, 1982, 'Carton', 272, -1, 304, -1, 0.9835757613182068), (987515173, 1982, 'Carton', 304, -1, 304, -1, 0.9820222854614258), (987515173, 1982, 'Carton', 336, -1, 304, -1, 0.9809085130691528), (987515173, 1982, 'Carton', 112, -1, 336, -1, 0.9924331903457642), (987515173, 1982, 'Carton', 144, -1, 336, -1, 0.9761760830879211), (987515173, 1982, 'Carton', 176, -1, 336, -1, 0.9911621809005737), (987515173, 1982, 'Carton', 208, -1, 336, -1, 0.9869205951690674), (987515173, 1982, 'Carton', 240, -1, 336, -1, 0.9087321162223816), (987515173, 1982, 'Carton', 272, -1, 336, -1, 0.9451696872711182), (987515173, 1982, 'Carton', 304, -1, 336, -1, 0.9365019202232361), (987515173, 1982, 'Carton', 336, -1, 336, -1, 0.980847954750061), (987515173, 1982, 'Kraft', 112, -1, 112, -1, 1.959683970653714e-09), (987515173, 1982, 'Kraft', 144, -1, 112, -1, 1.714873221203561e-08), (987515173, 1982, 'Kraft', 176, -1, 112, -1, 9.55324139795266e-07), (987515173, 1982, 'Kraft', 208, -1, 112, -1, 3.143177309539169e-05), (987515173, 1982, 'Kraft', 240, -1, 112, -1, 4.4369498937157914e-05), (987515173, 1982, 'Kraft', 272, -1, 112, -1, 0.00020552732166834176), (987515173, 1982, 'Kraft', 304, -1, 112, -1, 0.0010803882032632828), (987515173, 1982, 'Kraft', 336, -1, 112, -1, 0.000830929959192872), (987515173, 1982, 'Kraft', 112, -1, 144, -1, 2.6106312361662276e-05), (987515173, 1982, 'Kraft', 144, -1, 144, -1, 6.978860255912878e-06), (987515173, 1982, 'Kraft', 176, -1, 144, -1, 3.6201220154907787e-06), (987515173, 1982, 'Kraft', 208, -1, 144, -1, 3.5640423448057845e-05), (987515173, 1982, 'Kraft', 240, -1, 144, -1, 6.705272971885279e-05), (987515173, 1982, 'Kraft', 272, -1, 144, -1, 8.692406845511869e-05), (987515173, 1982, 'Kraft', 304, -1, 144, -1, 0.00012203908408991992), (987515173, 1982, 'Kraft', 336, -1, 144, -1, 0.00011321275815134868), (987515173, 1982, 'Kraft', 112, -1, 176, -1, 0.0004972309106960893), (987515173, 1982, 'Kraft', 144, -1, 176, -1, 0.00012299961235839874), (987515173, 1982, 'Kraft', 176, -1, 176, -1, 9.062672324944288e-05), (987515173, 1982, 'Kraft', 208, -1, 176, -1, 5.164916001376696e-05), (987515173, 1982, 'Kraft', 240, -1, 176, -1, 0.00011583475134102628), (987515173, 1982, 'Kraft', 272, -1, 176, -1, 0.00043470572563819587), (987515173, 1982, 'Kraft', 304, -1, 176, -1, 0.0009228104609064758), (987515173, 1982, 'Kraft', 336, -1, 176, -1, 0.0014166416367515922), (987515173, 1982, 'Kraft', 112, -1, 208, -1, 6.874173413962126e-05), (987515173, 1982, 'Kraft', 144, -1, 208, -1, 1.848871397669427e-05), (987515173, 1982, 'Kraft', 176, -1, 208, -1, 2.5827497665886767e-05), (987515173, 1982, 'Kraft', 208, -1, 208, -1, 3.5433324228506535e-05), (987515173, 1982, 'Kraft', 240, -1, 208, -1, 3.6650839319918305e-05), (987515173, 1982, 'Kraft', 272, -1, 208, -1, 8.675114077050239e-05), (987515173, 1982, 'Kraft', 304, -1, 208, -1, 0.0001242355356225744), (987515173, 1982, 'Kraft', 336, -1, 208, -1, 0.0003906067868229002), (987515173, 1982, 'Kraft', 112, -1, 240, -1, 0.0003084047057200223), (987515173, 1982, 'Kraft', 144, -1, 240, -1, 4.1625782614573836e-05), (987515173, 1982, 'Kraft', 176, -1, 240, -1, 1.2235901522217318e-05), (987515173, 1982, 'Kraft', 208, -1, 240, -1, 7.3616929512354545e-06), (987515173, 1982, 'Kraft', 240, -1, 240, -1, 2.2985597752267495e-05), (987515173, 1982, 'Kraft', 272, -1, 240, -1, 5.8279227232560515e-05), (987515173, 1982, 'Kraft', 304, -1, 240, -1, 6.569155812030658e-05), (987515173, 1982, 'Kraft', 336, -1, 240, -1, 0.00018918130081146955), (987515173, 1982, 'Kraft', 112, -1, 272, -1, 0.001457546604797244), (987515173, 1982, 'Kraft', 144, -1, 272, -1, 0.0006897087441757321), (987515173, 1982, 'Kraft', 176, -1, 272, -1, 0.00027349754236638546), (987515173, 1982, 'Kraft', 208, -1, 272, -1, 4.359403465059586e-05), (987515173, 1982, 'Kraft', 240, -1, 272, -1, 3.355489388923161e-05), (987515173, 1982, 'Kraft', 272, -1, 272, -1, 8.330883429152891e-05), (987515173, 1982, 'Kraft', 304, -1, 272, -1, 0.00011177566921105608), (987515173, 1982, 'Kraft', 336, -1, 272, -1, 0.00042294766171835363), (987515173, 1982, 'Kraft', 112, -1, 304, -1, 0.0009915876435115933), (987515173, 1982, 'Kraft', 144, -1, 304, -1, 0.000894882483407855), (987515173, 1982, 'Kraft', 176, -1, 304, -1, 0.0006185802631080151), (987515173, 1982, 'Kraft', 208, -1, 304, -1, 0.0010835569119080901), (987515173, 1982, 'Kraft', 240, -1, 304, -1, 0.0017841329099610448), (987515173, 1982, 'Kraft', 272, -1, 304, -1, 0.004681267309933901), (987515173, 1982, 'Kraft', 304, -1, 304, -1, 0.004695300478488207), (987515173, 1982, 'Kraft', 336, -1, 304, -1, 0.012496287003159523), (987515173, 1982, 'Kraft', 112, -1, 336, -1, 0.0021780256647616625), (987515173, 1982, 'Kraft', 144, -1, 336, -1, 0.005715335253626108), (987515173, 1982, 'Kraft', 176, -1, 336, -1, 0.0008306269883178174), (987515173, 1982, 'Kraft', 208, -1, 336, -1, 0.0012675191974267364), (987515173, 1982, 'Kraft', 240, -1, 336, -1, 0.007761738263070583), (987515173, 1982, 'Kraft', 272, -1, 336, -1, 0.012569199316203594), (987515173, 1982, 'Kraft', 304, -1, 336, -1, 0.017978103831410408), (987515173, 1982, 'Kraft', 336, -1, 336, -1, 0.007746298797428608), (987515173, 1982, 'Lointain_Papier_Magazine', 112, -1, 112, -1, 1.4940078341130203e-10), (987515173, 1982, 'Lointain_Papier_Magazine', 144, -1, 112, -1, 8.33071123196305e-09), (987515173, 1982, 'Lointain_Papier_Magazine', 176, -1, 112, -1, 5.462326271299389e-07), (987515173, 1982, 'Lointain_Papier_Magazine', 208, -1, 112, -1, 5.510708433575928e-06), (987515173, 1982, 'Lointain_Papier_Magazine', 240, -1, 112, -1, 8.230662388086785e-06), (987515173, 1982, 'Lointain_Papier_Magazine', 272, -1, 112, -1, 3.555577131919563e-05), (987515173, 1982, 'Lointain_Papier_Magazine', 304, -1, 112, -1, 8.13369479146786e-05), (987515173, 1982, 'Lointain_Papier_Magazine', 336, -1, 112, -1, 4.2267522076144814e-05), (987515173, 1982, 'Lointain_Papier_Magazine', 112, -1, 144, -1, 3.609803798099165e-07), (987515173, 1982, 'Lointain_Papier_Magazine', 144, -1, 144, -1, 1.306211629525933e-06), (987515173, 1982, 'Lointain_Papier_Magazine', 176, -1, 144, -1, 2.474431539667421e-06), (987515173, 1982, 'Lointain_Papier_Magazine', 208, -1, 144, -1, 3.460275365796406e-06), (987515173, 1982, 'Lointain_Papier_Magazine', 240, -1, 144, -1, 5.711162884836085e-06), (987515173, 1982, 'Lointain_Papier_Magazine', 272, -1, 144, -1, 2.058469908661209e-05), (987515173, 1982, 'Lointain_Papier_Magazine', 304, -1, 144, -1, 3.9017530070850626e-05), (987515173, 1982, 'Lointain_Papier_Magazine', 336, -1, 144, -1, 1.3692897482542321e-05), (987515173, 1982, 'Lointain_Papier_Magazine', 112, -1, 176, -1, 3.8840900629111275e-07), (987515173, 1982, 'Lointain_Papier_Magazine', 144, -1, 176, -1, 2.5529288905090652e-06), (987515173, 1982, 'Lointain_Papier_Magazine', 176, -1, 176, -1, 1.2019247151329182e-05), (987515173, 1982, 'Lointain_Papier_Magazine', 208, -1, 176, -1, 7.813697266101371e-06), (987515173, 1982, 'Lointain_Papier_Magazine', 240, -1, 176, -1, 6.3746665546204895e-06), (987515173, 1982, 'Lointain_Papier_Magazine', 272, -1, 176, -1, 2.6441966838319786e-05), (987515173, 1982, 'Lointain_Papier_Magazine', 304, -1, 176, -1, 3.923190161003731e-05), (987515173, 1982, 'Lointain_Papier_Magazine', 336, -1, 176, -1, 1.8379327229922637e-05), (987515173, 1982, 'Lointain_Papier_Magazine', 112, -1, 208, -1, 1.7972835166801815e-06), (987515173, 1982, 'Lointain_Papier_Magazine', 144, -1, 208, -1, 5.707428840651119e-07), (987515173, 1982, 'Lointain_Papier_Magazine', 176, -1, 208, -1, 2.1920441213296726e-06), (987515173, 1982, 'Lointain_Papier_Magazine', 208, -1, 208, -1, 1.7368854514643317e-06), (987515173, 1982, 'Lointain_Papier_Magazine', 240, -1, 208, -1, 3.942007253954216e-07), (987515173, 1982, 'Lointain_Papier_Magazine', 272, -1, 208, -1, 2.0314573134783132e-07), (987515173, 1982, 'Lointain_Papier_Magazine', 304, -1, 208, -1, 9.911964582443034e-08), (987515173, 1982, 'Lointain_Papier_Magazine', 336, -1, 208, -1, 8.657914918330789e-08), (987515173, 1982, 'Lointain_Papier_Magazine', 112, -1, 240, -1, 1.8172463569499087e-06), (987515173, 1982, 'Lointain_Papier_Magazine', 144, -1, 240, -1, 6.324177661554131e-07), (987515173, 1982, 'Lointain_Papier_Magazine', 176, -1, 240, -1, 7.812197964085499e-07), (987515173, 1982, 'Lointain_Papier_Magazine', 208, -1, 240, -1, 6.423416607503896e-07), (987515173, 1982, 'Lointain_Papier_Magazine', 240, -1, 240, -1, 7.706531164330954e-07), (987515173, 1982, 'Lointain_Papier_Magazine', 272, -1, 240, -1, 5.175296564630116e-07), (987515173, 1982, 'Lointain_Papier_Magazine', 304, -1, 240, -1, 1.7716223510433338e-07), (987515173, 1982, 'Lointain_Papier_Magazine', 336, -1, 240, -1, 1.4615179111387988e-07), (987515173, 1982, 'Lointain_Papier_Magazine', 112, -1, 272, -1, 4.1788069893300417e-07), (987515173, 1982, 'Lointain_Papier_Magazine', 144, -1, 272, -1, 3.1647965670345e-07), (987515173, 1982, 'Lointain_Papier_Magazine', 176, -1, 272, -1, 5.092023798169976e-07), (987515173, 1982, 'Lointain_Papier_Magazine', 208, -1, 272, -1, 7.379881594715698e-07), (987515173, 1982, 'Lointain_Papier_Magazine', 240, -1, 272, -1, 4.032547167298617e-07), (987515173, 1982, 'Lointain_Papier_Magazine', 272, -1, 272, -1, 3.2165866059585824e-07), (987515173, 1982, 'Lointain_Papier_Magazine', 304, -1, 272, -1, 2.1000541039484233e-07), (987515173, 1982, 'Lointain_Papier_Magazine', 336, -1, 272, -1, 3.479018744201312e-07), (987515173, 1982, 'Lointain_Papier_Magazine', 112, -1, 304, -1, 3.2972729968605563e-07), (987515173, 1982, 'Lointain_Papier_Magazine', 144, -1, 304, -1, 3.254387763718114e-07), (987515173, 1982, 'Lointain_Papier_Magazine', 176, -1, 304, -1, 8.377591029784526e-07), (987515173, 1982, 'Lointain_Papier_Magazine', 208, -1, 304, -1, 3.301834340163623e-06), (987515173, 1982, 'Lointain_Papier_Magazine', 240, -1, 304, -1, 4.4132220864412375e-06), (987515173, 1982, 'Lointain_Papier_Magazine', 272, -1, 304, -1, 5.029261956224218e-06), (987515173, 1982, 'Lointain_Papier_Magazine', 304, -1, 304, -1, 8.185589649656322e-06), (987515173, 1982, 'Lointain_Papier_Magazine', 336, -1, 304, -1, 5.578862783295335e-06), (987515173, 1982, 'Lointain_Papier_Magazine', 112, -1, 336, -1, 4.1916669601960166e-07), (987515173, 1982, 'Lointain_Papier_Magazine', 144, -1, 336, -1, 8.219464575631719e-07), (987515173, 1982, 'Lointain_Papier_Magazine', 176, -1, 336, -1, 7.145447398215765e-07), (987515173, 1982, 'Lointain_Papier_Magazine', 208, -1, 336, -1, 1.950574187503662e-06), (987515173, 1982, 'Lointain_Papier_Magazine', 240, -1, 336, -1, 3.904702225554502e-06), (987515173, 1982, 'Lointain_Papier_Magazine', 272, -1, 336, -1, 2.4593293801444815e-06), (987515173, 1982, 'Lointain_Papier_Magazine', 304, -1, 336, -1, 3.440815589783597e-06), (987515173, 1982, 'Lointain_Papier_Magazine', 336, -1, 336, -1, 4.847029231314082e-06), (987515173, 1982, 'Metal', 112, -1, 112, -1, 7.429567377981172e-11), (987515173, 1982, 'Metal', 144, -1, 112, -1, 1.927237036625229e-09), (987515173, 1982, 'Metal', 176, -1, 112, -1, 7.238608645820932e-07), (987515173, 1982, 'Metal', 208, -1, 112, -1, 9.461645277042408e-06), (987515173, 1982, 'Metal', 240, -1, 112, -1, 2.6466661438462324e-05), (987515173, 1982, 'Metal', 272, -1, 112, -1, 0.00016887523815967143), (987515173, 1982, 'Metal', 304, -1, 112, -1, 0.0007536012562923133), (987515173, 1982, 'Metal', 336, -1, 112, -1, 0.00030341820092871785), (987515173, 1982, 'Metal', 112, -1, 144, -1, 5.301479859554092e-07), (987515173, 1982, 'Metal', 144, -1, 144, -1, 4.372370199234865e-07), (987515173, 1982, 'Metal', 176, -1, 144, -1, 3.182121417921735e-06), (987515173, 1982, 'Metal', 208, -1, 144, -1, 9.581408448866569e-06), (987515173, 1982, 'Metal', 240, -1, 144, -1, 1.657801476540044e-05), (987515173, 1982, 'Metal', 272, -1, 144, -1, 7.649704639334232e-05), (987515173, 1982, 'Metal', 304, -1, 144, -1, 0.00013103988021612167), (987515173, 1982, 'Metal', 336, -1, 144, -1, 4.679865742218681e-05), (987515173, 1982, 'Metal', 112, -1, 176, -1, 5.895034519198816e-06), (987515173, 1982, 'Metal', 144, -1, 176, -1, 4.025052021461306e-06), (987515173, 1982, 'Metal', 176, -1, 176, -1, 1.013188375509344e-05), (987515173, 1982, 'Metal', 208, -1, 176, -1, 4.155038368480746e-06), (987515173, 1982, 'Metal', 240, -1, 176, -1, 6.681396371277515e-06), (987515173, 1982, 'Metal', 272, -1, 176, -1, 5.4504220315720886e-05), (987515173, 1982, 'Metal', 304, -1, 176, -1, 0.00012920470908284187), (987515173, 1982, 'Metal', 336, -1, 176, -1, 6.520314491353929e-05), (987515173, 1982, 'Metal', 112, -1, 208, -1, 8.130266905936878e-06), (987515173, 1982, 'Metal', 144, -1, 208, -1, 2.2603026081924327e-06), (987515173, 1982, 'Metal', 176, -1, 208, -1, 6.603681413253071e-06), (987515173, 1982, 'Metal', 208, -1, 208, -1, 4.597570296027698e-06), (987515173, 1982, 'Metal', 240, -1, 208, -1, 1.6922837176025496e-06), (987515173, 1982, 'Metal', 272, -1, 208, -1, 1.37054678361892e-06), (987515173, 1982, 'Metal', 304, -1, 208, -1, 5.808111041005759e-07), (987515173, 1982, 'Metal', 336, -1, 208, -1, 8.317612127939356e-07), (987515173, 1982, 'Metal', 112, -1, 240, -1, 2.9390259896899806e-06), (987515173, 1982, 'Metal', 144, -1, 240, -1, 7.395906322926749e-07), (987515173, 1982, 'Metal', 176, -1, 240, -1, 6.079575882722565e-07), (987515173, 1982, 'Metal', 208, -1, 240, -1, 6.252850539567589e-07), (987515173, 1982, 'Metal', 240, -1, 240, -1, 1.1991652399956365e-06), (987515173, 1982, 'Metal', 272, -1, 240, -1, 6.958346716601227e-07), (987515173, 1982, 'Metal', 304, -1, 240, -1, 3.145828202377743e-07), (987515173, 1982, 'Metal', 336, -1, 240, -1, 4.16455719687292e-07), (987515173, 1982, 'Metal', 112, -1, 272, -1, 2.6158625132666202e-06), (987515173, 1982, 'Metal', 144, -1, 272, -1, 8.040984198487422e-07), (987515173, 1982, 'Metal', 176, -1, 272, -1, 8.207837822737929e-07), (987515173, 1982, 'Metal', 208, -1, 272, -1, 4.0223488895207993e-07), (987515173, 1982, 'Metal', 240, -1, 272, -1, 2.7486524345476937e-07), (987515173, 1982, 'Metal', 272, -1, 272, -1, 3.314421803679579e-07), (987515173, 1982, 'Metal', 304, -1, 272, -1, 3.4366294698884303e-07), (987515173, 1982, 'Metal', 336, -1, 272, -1, 1.474345481256023e-06), (987515173, 1982, 'Metal', 112, -1, 304, -1, 2.3098004930943716e-06), (987515173, 1982, 'Metal', 144, -1, 304, -1, 1.9551482637325535e-06), (987515173, 1982, 'Metal', 176, -1, 304, -1, 4.532780167210149e-06), (987515173, 1982, 'Metal', 208, -1, 304, -1, 1.3328808563528582e-05), (987515173, 1982, 'Metal', 240, -1, 304, -1, 5.640958988806233e-06), (987515173, 1982, 'Metal', 272, -1, 304, -1, 5.689619229087839e-06), (987515173, 1982, 'Metal', 304, -1, 304, -1, 6.3661709646112286e-06), (987515173, 1982, 'Metal', 336, -1, 304, -1, 7.386000561382389e-06), (987515173, 1982, 'Metal', 112, -1, 336, -1, 7.140306479413994e-06), (987515173, 1982, 'Metal', 144, -1, 336, -1, 3.309083331259899e-05), (987515173, 1982, 'Metal', 176, -1, 336, -1, 4.025809175800532e-05), (987515173, 1982, 'Metal', 208, -1, 336, -1, 7.588235166622326e-05), (987515173, 1982, 'Metal', 240, -1, 336, -1, 0.0001211166090797633), (987515173, 1982, 'Metal', 272, -1, 336, -1, 3.7181634979788214e-05), (987515173, 1982, 'Metal', 304, -1, 336, -1, 2.9152195565984584e-05), (987515173, 1982, 'Metal', 336, -1, 336, -1, 2.807711462082807e-05), (987515173, 1982, 'Papier_Magazine', 112, -1, 112, -1, 0.9999953508377075), (987515173, 1982, 'Papier_Magazine', 144, -1, 112, -1, 0.9999926090240479), (987515173, 1982, 'Papier_Magazine', 176, -1, 112, -1, 0.9999089241027832), (987515173, 1982, 'Papier_Magazine', 208, -1, 112, -1, 0.9949466586112976), (987515173, 1982, 'Papier_Magazine', 240, -1, 112, -1, 0.9937742948532104), (987515173, 1982, 'Papier_Magazine', 272, -1, 112, -1, 0.9867067933082581), (987515173, 1982, 'Papier_Magazine', 304, -1, 112, -1, 0.8925614953041077), (987515173, 1982, 'Papier_Magazine', 336, -1, 112, -1, 0.8720738291740417), (987515173, 1982, 'Papier_Magazine', 112, -1, 144, -1, 0.9998149275779724), (987515173, 1982, 'Papier_Magazine', 144, -1, 144, -1, 0.9997429251670837), (987515173, 1982, 'Papier_Magazine', 176, -1, 144, -1, 0.999413013458252), (987515173, 1982, 'Papier_Magazine', 208, -1, 144, -1, 0.9911862015724182), (987515173, 1982, 'Papier_Magazine', 240, -1, 144, -1, 0.9781213402748108), (987515173, 1982, 'Papier_Magazine', 272, -1, 144, -1, 0.9001358151435852), (987515173, 1982, 'Papier_Magazine', 304, -1, 144, -1, 0.5367849469184875), (987515173, 1982, 'Papier_Magazine', 336, -1, 144, -1, 0.8109948039054871), (987515173, 1982, 'Papier_Magazine', 112, -1, 176, -1, 0.9775570034980774), (987515173, 1982, 'Papier_Magazine', 144, -1, 176, -1, 0.8065951466560364), (987515173, 1982, 'Papier_Magazine', 176, -1, 176, -1, 0.902694582939148), (987515173, 1982, 'Papier_Magazine', 208, -1, 176, -1, 0.8753410577774048), (987515173, 1982, 'Papier_Magazine', 240, -1, 176, -1, 0.4652388095855713), (987515173, 1982, 'Papier_Magazine', 272, -1, 176, -1, 0.5267437696456909), (987515173, 1982, 'Papier_Magazine', 304, -1, 176, -1, 0.16677312552928925), (987515173, 1982, 'Papier_Magazine', 336, -1, 176, -1, 0.11064697057008743), (987515173, 1982, 'Papier_Magazine', 112, -1, 208, -1, 0.14967940747737885), (987515173, 1982, 'Papier_Magazine', 144, -1, 208, -1, 0.015457632951438427), (987515173, 1982, 'Papier_Magazine', 176, -1, 208, -1, 0.014767689630389214), (987515173, 1982, 'Papier_Magazine', 208, -1, 208, -1, 0.007597489282488823), (987515173, 1982, 'Papier_Magazine', 240, -1, 208, -1, 0.000341917562764138), (987515173, 1982, 'Papier_Magazine', 272, -1, 208, -1, 0.0001709045172901824), (987515173, 1982, 'Papier_Magazine', 304, -1, 208, -1, 5.406516356742941e-05), (987515173, 1982, 'Papier_Magazine', 336, -1, 208, -1, 6.242784002097324e-05), (987515173, 1982, 'Papier_Magazine', 112, -1, 240, -1, 0.06973759829998016), (987515173, 1982, 'Papier_Magazine', 144, -1, 240, -1, 0.018822692334651947), (987515173, 1982, 'Papier_Magazine', 176, -1, 240, -1, 0.03365115821361542), (987515173, 1982, 'Papier_Magazine', 208, -1, 240, -1, 0.03246324509382248), (987515173, 1982, 'Papier_Magazine', 240, -1, 240, -1, 0.0034809978678822517), (987515173, 1982, 'Papier_Magazine', 272, -1, 240, -1, 0.00034122721990570426), (987515173, 1982, 'Papier_Magazine', 304, -1, 240, -1, 2.9580574846477248e-05), (987515173, 1982, 'Papier_Magazine', 336, -1, 240, -1, 1.6584102922934107e-05), (987515173, 1982, 'Papier_Magazine', 112, -1, 272, -1, 0.00848313421010971), (987515173, 1982, 'Papier_Magazine', 144, -1, 272, -1, 0.003637234913185239), (987515173, 1982, 'Papier_Magazine', 176, -1, 272, -1, 0.014042586088180542), (987515173, 1982, 'Papier_Magazine', 208, -1, 272, -1, 0.026692884042859077), (987515173, 1982, 'Papier_Magazine', 240, -1, 272, -1, 0.002454567700624466), (987515173, 1982, 'Papier_Magazine', 272, -1, 272, -1, 0.0006429362110793591), (987515173, 1982, 'Papier_Magazine', 304, -1, 272, -1, 0.0002746349200606346), (987515173, 1982, 'Papier_Magazine', 336, -1, 272, -1, 0.00015863798034843057), (987515173, 1982, 'Papier_Magazine', 112, -1, 304, -1, 0.0010022649075835943), (987515173, 1982, 'Papier_Magazine', 144, -1, 304, -1, 0.0009964967612177134), (987515173, 1982, 'Papier_Magazine', 176, -1, 304, -1, 0.0031952999997884035), (987515173, 1982, 'Papier_Magazine', 208, -1, 304, -1, 0.005031617358326912), (987515173, 1982, 'Papier_Magazine', 240, -1, 304, -1, 0.003491390962153673), (987515173, 1982, 'Papier_Magazine', 272, -1, 304, -1, 0.004061806946992874), (987515173, 1982, 'Papier_Magazine', 304, -1, 304, -1, 0.007191794924438), (987515173, 1982, 'Papier_Magazine', 336, -1, 304, -1, 0.0019518923945724964), (987515173, 1982, 'Papier_Magazine', 112, -1, 336, -1, 0.004871977027505636), (987515173, 1982, 'Papier_Magazine', 144, -1, 336, -1, 0.015524879097938538), (987515173, 1982, 'Papier_Magazine', 176, -1, 336, -1, 0.006796706467866898), (987515173, 1982, 'Papier_Magazine', 208, -1, 336, -1, 0.00799369066953659), (987515173, 1982, 'Papier_Magazine', 240, -1, 336, -1, 0.01902930438518524), (987515173, 1982, 'Papier_Magazine', 272, -1, 336, -1, 0.003651471110060811), (987515173, 1982, 'Papier_Magazine', 304, -1, 336, -1, 0.006298679392784834), (987515173, 1982, 'Papier_Magazine', 336, -1, 336, -1, 0.0044465335085988045), (987515173, 1982, 'Plastique', 112, -1, 112, -1, 5.622127474680383e-08), (987515173, 1982, 'Plastique', 144, -1, 112, -1, 8.177399308806343e-07), (987515173, 1982, 'Plastique', 176, -1, 112, -1, 6.249731086427346e-05), (987515173, 1982, 'Plastique', 208, -1, 112, -1, 0.003556065959855914), (987515173, 1982, 'Plastique', 240, -1, 112, -1, 0.003158387029543519), (987515173, 1982, 'Plastique', 272, -1, 112, -1, 0.007464884780347347), (987515173, 1982, 'Plastique', 304, -1, 112, -1, 0.05466088280081749), (987515173, 1982, 'Plastique', 336, -1, 112, -1, 0.0596756711602211), (987515173, 1982, 'Plastique', 112, -1, 144, -1, 2.778921498247655e-06), (987515173, 1982, 'Plastique', 144, -1, 144, -1, 1.900940878840629e-05), (987515173, 1982, 'Plastique', 176, -1, 144, -1, 0.00017660776211414486), (987515173, 1982, 'Plastique', 208, -1, 144, -1, 0.00150451494846493), (987515173, 1982, 'Plastique', 240, -1, 144, -1, 0.005060078576207161), (987515173, 1982, 'Plastique', 272, -1, 144, -1, 0.0845026895403862), (987515173, 1982, 'Plastique', 304, -1, 144, -1, 0.4088384807109833), (987515173, 1982, 'Plastique', 336, -1, 144, -1, 0.07086360454559326), (987515173, 1982, 'Plastique', 112, -1, 176, -1, 3.92720130548696e-06), (987515173, 1982, 'Plastique', 144, -1, 176, -1, 9.539171878714114e-05), (987515173, 1982, 'Plastique', 176, -1, 176, -1, 0.00033992071985267103), (987515173, 1982, 'Plastique', 208, -1, 176, -1, 0.00038902502274140716), (987515173, 1982, 'Plastique', 240, -1, 176, -1, 0.0006224163807928562), (987515173, 1982, 'Plastique', 272, -1, 176, -1, 0.008974647149443626), (987515173, 1982, 'Plastique', 304, -1, 176, -1, 0.03738725930452347), (987515173, 1982, 'Plastique', 336, -1, 176, -1, 0.0020566813182085752), (987515173, 1982, 'Plastique', 112, -1, 208, -1, 7.615958020323887e-05), (987515173, 1982, 'Plastique', 144, -1, 208, -1, 4.1350296669406816e-05), (987515173, 1982, 'Plastique', 176, -1, 208, -1, 8.221130701713264e-05), (987515173, 1982, 'Plastique', 208, -1, 208, -1, 3.836985706584528e-05), (987515173, 1982, 'Plastique', 240, -1, 208, -1, 8.264566531579476e-06), (987515173, 1982, 'Plastique', 272, -1, 208, -1, 1.200982205773471e-05), (987515173, 1982, 'Plastique', 304, -1, 208, -1, 1.2179839359305333e-05), (987515173, 1982, 'Plastique', 336, -1, 208, -1, 4.096551947441185e-06), (987515173, 1982, 'Plastique', 112, -1, 240, -1, 0.00014472127077169716), (987515173, 1982, 'Plastique', 144, -1, 240, -1, 3.536904841894284e-05), (987515173, 1982, 'Plastique', 176, -1, 240, -1, 2.1146281142137013e-05), (987515173, 1982, 'Plastique', 208, -1, 240, -1, 7.377555448329076e-06), (987515173, 1982, 'Plastique', 240, -1, 240, -1, 4.8655388127372134e-06), (987515173, 1982, 'Plastique', 272, -1, 240, -1, 2.768247213680297e-06), (987515173, 1982, 'Plastique', 304, -1, 240, -1, 7.970205047058698e-07), (987515173, 1982, 'Plastique', 336, -1, 240, -1, 3.5654480257107934e-07), (987515173, 1982, 'Plastique', 112, -1, 272, -1, 3.357404420967214e-05), (987515173, 1982, 'Plastique', 144, -1, 272, -1, 1.1636775525403209e-05), (987515173, 1982, 'Plastique', 176, -1, 272, -1, 1.3384699741436634e-05), (987515173, 1982, 'Plastique', 208, -1, 272, -1, 5.4405018090619706e-06), (987515173, 1982, 'Plastique', 240, -1, 272, -1, 9.57501242737635e-07), (987515173, 1982, 'Plastique', 272, -1, 272, -1, 6.871134132779844e-07), (987515173, 1982, 'Plastique', 304, -1, 272, -1, 5.68629445751867e-07), (987515173, 1982, 'Plastique', 336, -1, 272, -1, 7.439693945343606e-07), (987515173, 1982, 'Plastique', 112, -1, 304, -1, 3.353062993483036e-06), (987515173, 1982, 'Plastique', 144, -1, 304, -1, 3.3659280234132893e-06), (987515173, 1982, 'Plastique', 176, -1, 304, -1, 6.495131856354419e-06), (987515173, 1982, 'Plastique', 208, -1, 304, -1, 8.748752406972926e-06), (987515173, 1982, 'Plastique', 240, -1, 304, -1, 3.3829505809990223e-06), (987515173, 1982, 'Plastique', 272, -1, 304, -1, 4.756150246976176e-06), (987515173, 1982, 'Plastique', 304, -1, 304, -1, 4.501874627749203e-06), (987515173, 1982, 'Plastique', 336, -1, 304, -1, 2.419771362838219e-06), (987515173, 1982, 'Plastique', 112, -1, 336, -1, 1.5507144780713134e-05), (987515173, 1982, 'Plastique', 144, -1, 336, -1, 5.3460193157661706e-05), (987515173, 1982, 'Plastique', 176, -1, 336, -1, 3.4315962693654e-05), (987515173, 1982, 'Plastique', 208, -1, 336, -1, 2.379975740041118e-05), (987515173, 1982, 'Plastique', 240, -1, 336, -1, 3.8546666473848745e-05), (987515173, 1982, 'Plastique', 272, -1, 336, -1, 2.5773197194212116e-05), (987515173, 1982, 'Plastique', 304, -1, 336, -1, 3.327463491586968e-05), (987515173, 1982, 'Plastique', 336, -1, 336, -1, 4.185928264632821e-05), (987515173, 1982, 'Sol_Environement', 112, -1, 112, -1, 2.9164426949834787e-12), (987515173, 1982, 'Sol_Environement', 144, -1, 112, -1, 5.566790917121978e-10), (987515173, 1982, 'Sol_Environement', 176, -1, 112, -1, 4.842164571527974e-07), (987515173, 1982, 'Sol_Environement', 208, -1, 112, -1, 1.0150369234906975e-05), (987515173, 1982, 'Sol_Environement', 240, -1, 112, -1, 9.192692232318223e-06), (987515173, 1982, 'Sol_Environement', 272, -1, 112, -1, 5.604355101240799e-05), (987515173, 1982, 'Sol_Environement', 304, -1, 112, -1, 0.00037779175909236073), (987515173, 1982, 'Sol_Environement', 336, -1, 112, -1, 0.00016540467913728207), (987515173, 1982, 'Sol_Environement', 112, -1, 144, -1, 1.023474354155951e-07), (987515173, 1982, 'Sol_Environement', 144, -1, 144, -1, 5.775520435236103e-07), (987515173, 1982, 'Sol_Environement', 176, -1, 144, -1, 1.4353344113260391e-06), (987515173, 1982, 'Sol_Environement', 208, -1, 144, -1, 5.889411568205105e-06), (987515173, 1982, 'Sol_Environement', 240, -1, 144, -1, 1.8204920706921257e-05), (987515173, 1982, 'Sol_Environement', 272, -1, 144, -1, 0.0001262298901565373), (987515173, 1982, 'Sol_Environement', 304, -1, 144, -1, 0.0003236296179238707), (987515173, 1982, 'Sol_Environement', 336, -1, 144, -1, 9.675041656009853e-05), (987515173, 1982, 'Sol_Environement', 112, -1, 176, -1, 4.183500834642473e-07), (987515173, 1982, 'Sol_Environement', 144, -1, 176, -1, 1.0190278771915473e-06), (987515173, 1982, 'Sol_Environement', 176, -1, 176, -1, 6.56763313600095e-06), (987515173, 1982, 'Sol_Environement', 208, -1, 176, -1, 1.7184872831421671e-06), (987515173, 1982, 'Sol_Environement', 240, -1, 176, -1, 3.7357981454988476e-06), (987515173, 1982, 'Sol_Environement', 272, -1, 176, -1, 2.8030666726408526e-05), (987515173, 1982, 'Sol_Environement', 304, -1, 176, -1, 0.00015384185826405883), (987515173, 1982, 'Sol_Environement', 336, -1, 176, -1, 0.00024026268511079252), (987515173, 1982, 'Sol_Environement', 112, -1, 208, -1, 3.998693046014523e-06), (987515173, 1982, 'Sol_Environement', 144, -1, 208, -1, 7.504650056944229e-07), (987515173, 1982, 'Sol_Environement', 176, -1, 208, -1, 1.3276603567646816e-06), (987515173, 1982, 'Sol_Environement', 208, -1, 208, -1, 9.065654467121931e-07), (987515173, 1982, 'Sol_Environement', 240, -1, 208, -1, 6.81384790368611e-07), (987515173, 1982, 'Sol_Environement', 272, -1, 208, -1, 1.083008328350843e-06), (987515173, 1982, 'Sol_Environement', 304, -1, 208, -1, 1.453265667805681e-06), (987515173, 1982, 'Sol_Environement', 336, -1, 208, -1, 2.314477114850888e-06), (987515173, 1982, 'Sol_Environement', 112, -1, 240, -1, 4.6900381676096e-06), (987515173, 1982, 'Sol_Environement', 144, -1, 240, -1, 3.765826761537028e-07), (987515173, 1982, 'Sol_Environement', 176, -1, 240, -1, 2.490155850409792e-07), (987515173, 1982, 'Sol_Environement', 208, -1, 240, -1, 2.1702769004150468e-07), (987515173, 1982, 'Sol_Environement', 240, -1, 240, -1, 5.590806040345342e-07), (987515173, 1982, 'Sol_Environement', 272, -1, 240, -1, 8.637705377623206e-07), (987515173, 1982, 'Sol_Environement', 304, -1, 240, -1, 6.652900310655241e-07), (987515173, 1982, 'Sol_Environement', 336, -1, 240, -1, 7.912277055766026e-07), (987515173, 1982, 'Sol_Environement', 112, -1, 272, -1, 2.9859702408430167e-06), (987515173, 1982, 'Sol_Environement', 144, -1, 272, -1, 6.873660822748207e-07), (987515173, 1982, 'Sol_Environement', 176, -1, 272, -1, 5.011965527046414e-07), (987515173, 1982, 'Sol_Environement', 208, -1, 272, -1, 2.0163645331194857e-07), (987515173, 1982, 'Sol_Environement', 240, -1, 272, -1, 1.3206189919401368e-07), (987515173, 1982, 'Sol_Environement', 272, -1, 272, -1, 2.6999873625754844e-07), (987515173, 1982, 'Sol_Environement', 304, -1, 272, -1, 1.6096453236968955e-07), (987515173, 1982, 'Sol_Environement', 336, -1, 272, -1, 4.855953648075229e-07), (987515173, 1982, 'Sol_Environement', 112, -1, 304, -1, 6.985521849856013e-07), (987515173, 1982, 'Sol_Environement', 144, -1, 304, -1, 4.0420090385850926e-07), (987515173, 1982, 'Sol_Environement', 176, -1, 304, -1, 8.927498242883303e-07), (987515173, 1982, 'Sol_Environement', 208, -1, 304, -1, 2.333048314540065e-06), (987515173, 1982, 'Sol_Environement', 240, -1, 304, -1, 3.059052005482954e-06), (987515173, 1982, 'Sol_Environement', 272, -1, 304, -1, 2.6725676889327588e-06), (987515173, 1982, 'Sol_Environement', 304, -1, 304, -1, 1.500109078733658e-06), (987515173, 1982, 'Sol_Environement', 336, -1, 304, -1, 1.6174526535905898e-06), (987515173, 1982, 'Sol_Environement', 112, -1, 336, -1, 4.631622232409427e-07), (987515173, 1982, 'Sol_Environement', 144, -1, 336, -1, 1.1254171567998128e-06), (987515173, 1982, 'Sol_Environement', 176, -1, 336, -1, 6.791749456169782e-07), (987515173, 1982, 'Sol_Environement', 208, -1, 336, -1, 1.435619878975558e-06), (987515173, 1982, 'Sol_Environement', 240, -1, 336, -1, 3.327920467199874e-06), (987515173, 1982, 'Sol_Environement', 272, -1, 336, -1, 2.1234357063804055e-06), (987515173, 1982, 'Sol_Environement', 304, -1, 336, -1, 2.3018735646473942e-06), (987515173, 1982, 'Sol_Environement', 336, -1, 336, -1, 3.383832790859742e-06), (987515173, 1982, 'Teint_Dans_La_Masse', 112, -1, 112, -1, 4.587334387906594e-06), (987515173, 1982, 'Teint_Dans_La_Masse', 144, -1, 112, -1, 2.4690571081009693e-06), (987515173, 1982, 'Teint_Dans_La_Masse', 176, -1, 112, -1, 1.7566268070368096e-05), (987515173, 1982, 'Teint_Dans_La_Masse', 208, -1, 112, -1, 0.00047449066187255085), (987515173, 1982, 'Teint_Dans_La_Masse', 240, -1, 112, -1, 0.0001157822334789671), (987515173, 1982, 'Teint_Dans_La_Masse', 272, -1, 112, -1, 0.00020899179799016565), (987515173, 1982, 'Teint_Dans_La_Masse', 304, -1, 112, -1, 0.00144397490657866), (987515173, 1982, 'Teint_Dans_La_Masse', 336, -1, 112, -1, 0.002027868991717696), (987515173, 1982, 'Teint_Dans_La_Masse', 112, -1, 144, -1, 3.069341619266197e-05), (987515173, 1982, 'Teint_Dans_La_Masse', 144, -1, 144, -1, 1.7209589714184403e-05), (987515173, 1982, 'Teint_Dans_La_Masse', 176, -1, 144, -1, 2.077752105833497e-05), (987515173, 1982, 'Teint_Dans_La_Masse', 208, -1, 144, -1, 0.0002737499016802758), (987515173, 1982, 'Teint_Dans_La_Masse', 240, -1, 144, -1, 0.00046442897291854024), (987515173, 1982, 'Teint_Dans_La_Masse', 272, -1, 144, -1, 0.0005287824315018952), (987515173, 1982, 'Teint_Dans_La_Masse', 304, -1, 144, -1, 0.00018989521777257323), (987515173, 1982, 'Teint_Dans_La_Masse', 336, -1, 144, -1, 0.00020626770856324583), (987515173, 1982, 'Teint_Dans_La_Masse', 112, -1, 176, -1, 1.5043824532767758e-05), (987515173, 1982, 'Teint_Dans_La_Masse', 144, -1, 176, -1, 6.765830221411306e-06), (987515173, 1982, 'Teint_Dans_La_Masse', 176, -1, 176, -1, 2.1044705135864206e-05), (987515173, 1982, 'Teint_Dans_La_Masse', 208, -1, 176, -1, 2.4098864741972648e-05), (987515173, 1982, 'Teint_Dans_La_Masse', 240, -1, 176, -1, 3.5458331694826484e-05), (987515173, 1982, 'Teint_Dans_La_Masse', 272, -1, 176, -1, 7.947169797262177e-05), (987515173, 1982, 'Teint_Dans_La_Masse', 304, -1, 176, -1, 0.00010088772978633642), (987515173, 1982, 'Teint_Dans_La_Masse', 336, -1, 176, -1, 0.0003758094971999526), (987515173, 1982, 'Teint_Dans_La_Masse', 112, -1, 208, -1, 1.505455747974338e-05), (987515173, 1982, 'Teint_Dans_La_Masse', 144, -1, 208, -1, 1.4635437537435791e-06), (987515173, 1982, 'Teint_Dans_La_Masse', 176, -1, 208, -1, 4.7228372750396375e-06), (987515173, 1982, 'Teint_Dans_La_Masse', 208, -1, 208, -1, 3.8325911191350315e-06), (987515173, 1982, 'Teint_Dans_La_Masse', 240, -1, 208, -1, 3.5922296319768066e-06), (987515173, 1982, 'Teint_Dans_La_Masse', 272, -1, 208, -1, 1.1672076652757823e-05), (987515173, 1982, 'Teint_Dans_La_Masse', 304, -1, 208, -1, 1.3421738003671635e-05), (987515173, 1982, 'Teint_Dans_La_Masse', 336, -1, 208, -1, 5.938324102316983e-05), (987515173, 1982, 'Teint_Dans_La_Masse', 112, -1, 240, -1, 4.1709306970005855e-05), (987515173, 1982, 'Teint_Dans_La_Masse', 144, -1, 240, -1, 5.331648935680278e-06), (987515173, 1982, 'Teint_Dans_La_Masse', 176, -1, 240, -1, 3.8959392441029195e-06), (987515173, 1982, 'Teint_Dans_La_Masse', 208, -1, 240, -1, 2.4257865334220696e-06), (987515173, 1982, 'Teint_Dans_La_Masse', 240, -1, 240, -1, 5.766920821770327e-06), (987515173, 1982, 'Teint_Dans_La_Masse', 272, -1, 240, -1, 2.105739440594334e-05), (987515173, 1982, 'Teint_Dans_La_Masse', 304, -1, 240, -1, 1.7739739632816054e-05), (987515173, 1982, 'Teint_Dans_La_Masse', 336, -1, 240, -1, 2.287948882440105e-05), (987515173, 1982, 'Teint_Dans_La_Masse', 112, -1, 272, -1, 0.00020044486154802144), (987515173, 1982, 'Teint_Dans_La_Masse', 144, -1, 272, -1, 6.678612407995388e-05), (987515173, 1982, 'Teint_Dans_La_Masse', 176, -1, 272, -1, 4.345419438323006e-05), (987515173, 1982, 'Teint_Dans_La_Masse', 208, -1, 272, -1, 1.4597423614759464e-05), (987515173, 1982, 'Teint_Dans_La_Masse', 240, -1, 272, -1, 7.097452453308506e-06), (987515173, 1982, 'Teint_Dans_La_Masse', 272, -1, 272, -1, 1.5360610632342286e-05), (987515173, 1982, 'Teint_Dans_La_Masse', 304, -1, 272, -1, 1.5401941709569655e-05), (987515173, 1982, 'Teint_Dans_La_Masse', 336, -1, 272, -1, 0.00010421417391626164), (987515173, 1982, 'Teint_Dans_La_Masse', 112, -1, 304, -1, 9.493271500105038e-05), (987515173, 1982, 'Teint_Dans_La_Masse', 144, -1, 304, -1, 0.00010995937191182747), (987515173, 1982, 'Teint_Dans_La_Masse', 176, -1, 304, -1, 0.00015807031013537198), (987515173, 1982, 'Teint_Dans_La_Masse', 208, -1, 304, -1, 0.0005429694429039955), (987515173, 1982, 'Teint_Dans_La_Masse', 240, -1, 304, -1, 0.002339977538213134), (987515173, 1982, 'Teint_Dans_La_Masse', 272, -1, 304, -1, 0.007443092297762632), (987515173, 1982, 'Teint_Dans_La_Masse', 304, -1, 304, -1, 0.005845243111252785), (987515173, 1982, 'Teint_Dans_La_Masse', 336, -1, 304, -1, 0.004442479927092791), (987515173, 1982, 'Teint_Dans_La_Masse', 112, -1, 336, -1, 0.00024110640515573323), (987515173, 1982, 'Teint_Dans_La_Masse', 144, -1, 336, -1, 0.0020081577822566032), (987515173, 1982, 'Teint_Dans_La_Masse', 176, -1, 336, -1, 0.0007497547776438296), (987515173, 1982, 'Teint_Dans_La_Masse', 208, -1, 336, -1, 0.003356361761689186), (987515173, 1982, 'Teint_Dans_La_Masse', 240, -1, 336, -1, 0.06400793790817261), (987515173, 1982, 'Teint_Dans_La_Masse', 272, -1, 336, -1, 0.03825811296701431), (987515173, 1982, 'Teint_Dans_La_Masse', 304, -1, 336, -1, 0.03889764845371246), (987515173, 1982, 'Teint_Dans_La_Masse', 336, -1, 336, -1, 0.005877725780010223), (987515173, 1982, 'autre_refus', 112, -1, 112, -1, 5.834029370710425e-10), (987515173, 1982, 'autre_refus', 144, -1, 112, -1, 2.0602117345447368e-08), (987515173, 1982, 'autre_refus', 176, -1, 112, -1, 1.433396278116561e-06), (987515173, 1982, 'autre_refus', 208, -1, 112, -1, 9.267325367545709e-05), (987515173, 1982, 'autre_refus', 240, -1, 112, -1, 0.00021654520242009312), (987515173, 1982, 'autre_refus', 272, -1, 112, -1, 0.0017405332764610648), (987515173, 1982, 'autre_refus', 304, -1, 112, -1, 0.017670197412371635), (987515173, 1982, 'autre_refus', 336, -1, 112, -1, 0.0090212132781744), (987515173, 1982, 'autre_refus', 112, -1, 144, -1, 9.155830298368528e-07), (987515173, 1982, 'autre_refus', 144, -1, 144, -1, 2.9137170258763945e-06), (987515173, 1982, 'autre_refus', 176, -1, 144, -1, 1.0336477316741366e-05), (987515173, 1982, 'autre_refus', 208, -1, 144, -1, 0.0001345006749033928), (987515173, 1982, 'autre_refus', 240, -1, 144, -1, 0.00034747060271911323), (987515173, 1982, 'autre_refus', 272, -1, 144, -1, 0.004944386426359415), (987515173, 1982, 'autre_refus', 304, -1, 144, -1, 0.04334375262260437), (987515173, 1982, 'autre_refus', 336, -1, 144, -1, 0.09542225301265717), (987515173, 1982, 'autre_refus', 112, -1, 176, -1, 1.5147723388508894e-05), (987515173, 1982, 'autre_refus', 144, -1, 176, -1, 0.00012741713726427406), (987515173, 1982, 'autre_refus', 176, -1, 176, -1, 0.00023687219072598964), (987515173, 1982, 'autre_refus', 208, -1, 176, -1, 0.0008085939916782081), (987515173, 1982, 'autre_refus', 240, -1, 176, -1, 0.0006565107614733279), (987515173, 1982, 'autre_refus', 272, -1, 176, -1, 0.004308648407459259), (987515173, 1982, 'autre_refus', 304, -1, 176, -1, 0.02334536425769329), (987515173, 1982, 'autre_refus', 336, -1, 176, -1, 0.018527962267398834), (987515173, 1982, 'autre_refus', 112, -1, 208, -1, 8.839317160891369e-05), (987515173, 1982, 'autre_refus', 144, -1, 208, -1, 0.00018574082059785724), (987515173, 1982, 'autre_refus', 176, -1, 208, -1, 0.0003185727109666914), (987515173, 1982, 'autre_refus', 208, -1, 208, -1, 0.0003576175950001925), (987515173, 1982, 'autre_refus', 240, -1, 208, -1, 0.0001959709043148905), (987515173, 1982, 'autre_refus', 272, -1, 208, -1, 0.0002866119029931724), (987515173, 1982, 'autre_refus', 304, -1, 208, -1, 0.00020335461886133999), (987515173, 1982, 'autre_refus', 336, -1, 208, -1, 0.00024350958119612187), (987515173, 1982, 'autre_refus', 112, -1, 240, -1, 0.0002360981743549928), (987515173, 1982, 'autre_refus', 144, -1, 240, -1, 0.00010847541852854192), (987515173, 1982, 'autre_refus', 176, -1, 240, -1, 6.490483065135777e-05), (987515173, 1982, 'autre_refus', 208, -1, 240, -1, 2.529977609810885e-05), (987515173, 1982, 'autre_refus', 240, -1, 240, -1, 7.294115494005382e-05), (987515173, 1982, 'autre_refus', 272, -1, 240, -1, 0.00014021786046214402), (987515173, 1982, 'autre_refus', 304, -1, 240, -1, 8.945826266426593e-05), (987515173, 1982, 'autre_refus', 336, -1, 240, -1, 8.289203833555803e-05), (987515173, 1982, 'autre_refus', 112, -1, 272, -1, 0.0002676252042874694), (987515173, 1982, 'autre_refus', 144, -1, 272, -1, 0.00011144334712298587), (987515173, 1982, 'autre_refus', 176, -1, 272, -1, 0.00012453059025574476), (987515173, 1982, 'autre_refus', 208, -1, 272, -1, 5.121962385601364e-05), (987515173, 1982, 'autre_refus', 240, -1, 272, -1, 2.922762905654963e-05), (987515173, 1982, 'autre_refus', 272, -1, 272, -1, 4.27944069087971e-05), (987515173, 1982, 'autre_refus', 304, -1, 272, -1, 6.831809878349304e-05), (987515173, 1982, 'autre_refus', 336, -1, 272, -1, 0.00014196991105563939), (987515173, 1982, 'autre_refus', 112, -1, 304, -1, 0.00011545980669325218), (987515173, 1982, 'autre_refus', 144, -1, 304, -1, 0.000217922730371356), (987515173, 1982, 'autre_refus', 176, -1, 304, -1, 0.00042608188232406974), (987515173, 1982, 'autre_refus', 208, -1, 304, -1, 0.00042769924039021134), (987515173, 1982, 'autre_refus', 240, -1, 304, -1, 6.571278208866715e-05), (987515173, 1982, 'autre_refus', 272, -1, 304, -1, 3.172958531649783e-05), (987515173, 1982, 'autre_refus', 304, -1, 304, -1, 1.1687313417496625e-05), (987515173, 1982, 'autre_refus', 336, -1, 304, -1, 1.8889093553298153e-05), (987515173, 1982, 'autre_refus', 112, -1, 336, -1, 0.0002475624205544591), (987515173, 1982, 'autre_refus', 144, -1, 336, -1, 0.00046979915350675583), (987515173, 1982, 'autre_refus', 176, -1, 336, -1, 0.0003355757798999548), (987515173, 1982, 'autre_refus', 208, -1, 336, -1, 0.00023737932497169822), (987515173, 1982, 'autre_refus', 240, -1, 336, -1, 0.00010660426778485999), (987515173, 1982, 'autre_refus', 272, -1, 336, -1, 9.579621837474406e-05), (987515173, 1982, 'autre_refus', 304, -1, 336, -1, 0.00013162456161808223), (987515173, 1982, 'autre_refus', 336, -1, 336, -1, 0.0007313883397728205)]} result thcl : {'987515205': [('987515205', 'Papier_Magazine', 0.9908626, 1927, '1528'), 'temp/1744597975_648272_987515205_fd4b136d0b3a9a1a347942d7191f6fea.jpg'], '987515240': [('987515240', 'Carton', 0.99951947, 1927, '1528'), 'temp/1744597975_648272_987515240_7829b9b15f1bf128ea4e2c1a39b9f0dd.jpg'], '987515241': [('987515241', 'Carton', 0.98209697, 1927, '1528'), 'temp/1744597975_648272_987515241_073420d938f5f010ffd5b4353c064e09.jpg'], '987515242': [('987515242', 'Carton', 0.93579596, 1927, '1528'), 'temp/1744597975_648272_987515242_327abb5215d6fd1f0aad51f53ed8c324.jpg'], '987515243': [('987515243', 'Papier_Magazine', 0.8744101, 1927, '1528'), 'temp/1744597975_648272_987515243_4375283f3bc5cdaa431c2fc6f17f53a4.jpg'], '987515244': [('987515244', 'Papier_Magazine', 0.8171105, 1927, '1528'), 'temp/1744597975_648272_987515244_419530eaef5ef868f75c758b94eea4b4.jpg'], '987515245': [('987515245', 'Carton', 0.8659946, 1927, '1528'), 'temp/1744597975_648272_987515245_757d9d208d5bd4375c5f21f68b699148.jpg'], '987515246': [('987515246', 'Carton', 0.99923265, 1927, '1528'), 'temp/1744597975_648272_987515246_671a708f67f2efa19004b8257fc7b9c8.jpg'], '987515224': [('987515224', 'Carton', 0.9081279, 1927, '1528'), 'temp/1744597975_648272_987515224_e8747b400e713ecbd08d5b75db4d7568.jpg'], '987515226': [('987515226', 'Papier_Magazine', 0.98696065, 1927, '1528'), 'temp/1744597975_648272_987515226_a18048dca1a77ae086b62cf07759f704.jpg'], '987515227': [('987515227', 'Papier_Magazine', 0.9010772, 1927, '1528'), 'temp/1744597975_648272_987515227_e9c45a0e576ec9e44c1379c3fc5fec7c.jpg'], '987515228': [('987515228', 'Papier_Magazine', 0.52274555, 1927, '1528'), 'temp/1744597975_648272_987515228_9f1759f20c9e603bccb9f9879d2f0d54.jpg'], '987515230': [('987515230', 'Carton', 0.9994054, 1927, '1528'), 'temp/1744597975_648272_987515230_846ad925884264181565c81d152a2e94.jpg'], '987515231': [('987515231', 'Carton', 0.9994228, 1927, '1528'), 'temp/1744597975_648272_987515231_dbf4cafa71b6db4771c5c8f0c25e9cda.jpg'], '987515232': [('987515232', 'Carton', 0.99924505, 1927, '1528'), 'temp/1744597975_648272_987515232_38db7950cdb3c674ee0ad65915b021f3.jpg'], '987515220': [('987515220', 'Carton', 0.9963793, 1927, '1528'), 'temp/1744597975_648272_987515220_e729f316c4c3b32049adfbaaa336d95c.jpg'], '987515222': [('987515222', 'Carton', 0.9974693, 1927, '1528'), 'temp/1744597975_648272_987515222_067a027bc7402f969b6277d0dcb47eaa.jpg'], '987515223': [('987515223', 'Carton', 0.9921038, 1927, '1528'), 'temp/1744597975_648272_987515223_ebb57f09941cd11d7ee45a9368a883c1.jpg'], '987515175': [('987515175', 'Papier_Magazine', 0.9998135, 1927, '1528'), 'temp/1744597975_648272_987515175_8b398cba2f448622cd9657f5eb3f9796.jpg'], '987515176': [('987515176', 'Papier_Magazine', 0.99981457, 1927, '1528'), 'temp/1744597975_648272_987515176_8b398cba2f448622cd9657f5eb3f9796.jpg'], '987515177': [('987515177', 'Papier_Magazine', 0.9771006, 1927, '1528'), 'temp/1744597975_648272_987515177_4a54e9967227806219ddf45d256539d8.jpg'], '987515178': [('987515178', 'Carton', 0.8572866, 1927, '1528'), 'temp/1744597975_648272_987515178_298b3d2bfe0fda6787b59a78e2e68867.jpg'], '987515186': [('987515186', 'Carton', 0.98475295, 1927, '1528'), 'temp/1744597975_648272_987515186_797def426440b544aa80dbd63a19234a.jpg'], '987515187': [('987515187', 'Carton', 0.9811897, 1927, '1528'), 'temp/1744597975_648272_987515187_9f62f98efd3caca0b9c17d27f5c70440.jpg'], '987515188': [('987515188', 'Carton', 0.9956463, 1927, '1528'), 'temp/1744597975_648272_987515188_4116f9906657a69bb76c2fda982037b9.jpg'], '987515189': [('987515189', 'Carton', 0.99778914, 1927, '1528'), 'temp/1744597975_648272_987515189_8e8590a26f72249d4c2116dffd0cf668.jpg'], '987515190': [('987515190', 'Carton', 0.9763238, 1927, '1528'), 'temp/1744597975_648272_987515190_d56932bfc6ba2a8c974c691108755017.jpg'], '987515192': [('987515192', 'Papier_Magazine', 0.9999113, 1927, '1528'), 'temp/1744597975_648272_987515192_b661073b218f5f056833d6af1c617153.jpg'], '987515193': [('987515193', 'Papier_Magazine', 0.99939513, 1927, '1528'), 'temp/1744597975_648272_987515193_1a97fceb4dcbf5821d783b2e00b52fe6.jpg'], '987515233': [('987515233', 'Carton', 0.98355603, 1927, '1528'), 'temp/1744597975_648272_987515233_a92514bed0e8c5724f2d032d3ab1e2ad.jpg'], '987515234': [('987515234', 'Carton', 0.944692, 1927, '1528'), 'temp/1744597975_648272_987515234_2eca3480aed0f8b876242675ad99b666.jpg'], '987515235': [('987515235', 'Papier_Magazine', 0.8919306, 1927, '1528'), 'temp/1744597975_648272_987515235_87075955a2f76b3948b47ffe1825ecd9.jpg'], '987515236': [('987515236', 'Papier_Magazine', 0.5373591, 1927, '1528'), 'temp/1744597975_648272_987515236_8b44a98b1aceadad73ed000d65836a9a.jpg'], '987515237': [('987515237', 'Carton', 0.7695443, 1927, '1528'), 'temp/1744597975_648272_987515237_1183dfa371a457f11ce2b622c7cf9467.jpg'], '987515238': [('987515238', 'Carton', 0.9995728, 1927, '1528'), 'temp/1744597975_648272_987515238_e6292cb81e05894cfeb4b99f21a1d3f8.jpg'], '987515239': [('987515239', 'Carton', 0.9997836, 1927, '1528'), 'temp/1744597975_648272_987515239_b3fa6f29636080b5138c8d8c33fea309.jpg'], '987515211': [('987515211', 'Carton', 0.97331965, 1927, '1528'), 'temp/1744597975_648272_987515211_72cc7664d45bd40477351b9b764f1500.jpg'], '987515212': [('987515212', 'Carton', 0.9869164, 1927, '1528'), 'temp/1744597975_648272_987515212_b0a038fcb9678ebfd60d9b1f6ec1fc17.jpg'], '987515213': [('987515213', 'Carton', 0.98690784, 1927, '1528'), 'temp/1744597975_648272_987515213_b0a038fcb9678ebfd60d9b1f6ec1fc17.jpg'], '987515215': [('987515215', 'Papier_Magazine', 0.9939022, 1927, '1528'), 'temp/1744597975_648272_987515215_902ef348a7eebb9a8b87f42927347936.jpg'], '987515216': [('987515216', 'Papier_Magazine', 0.97736585, 1927, '1528'), 'temp/1744597975_648272_987515216_4f7dc21f1d2cd3fcabadc4a6755921e1.jpg'], '987515217': [('987515217', 'Carton', 0.52921593, 1927, '1528'), 'temp/1744597975_648272_987515217_78877bb2c5760be28518d17f77d1c609.jpg'], '987515219': [('987515219', 'Carton', 0.9993685, 1927, '1528'), 'temp/1744597975_648272_987515219_c2d417a5ba6ccf7c84527636f8d5eef9.jpg'], '987515195': [('987515195', 'Carton', 0.98466706, 1927, '1528'), 'temp/1744597975_648272_987515195_30ccb89dfe410c445878a7f2819ddc36.jpg'], '987515196': [('987515196', 'Carton', 0.98468876, 1927, '1528'), 'temp/1744597975_648272_987515196_30ccb89dfe410c445878a7f2819ddc36.jpg'], '987515198': [('987515198', 'Carton', 0.96602005, 1927, '1528'), 'temp/1744597975_648272_987515198_599e80f444c876f407e94b533c89360b.jpg'], '987515200': [('987515200', 'Carton', 0.98594636, 1927, '1528'), 'temp/1744597975_648272_987515200_978964436b5d5fb0eeda17e3bfafe889.jpg'], '987515201': [('987515201', 'Carton', 0.9954596, 1927, '1528'), 'temp/1744597975_648272_987515201_b224d2acdc7fa2bbb134c09db6bca7ce.jpg'], '987515202': [('987515202', 'Carton', 0.99111664, 1927, '1528'), 'temp/1744597975_648272_987515202_3314bd90d1404f31b827d8925abf2d62.jpg'], '987515204': [('987515204', 'Papier_Magazine', 0.99508345, 1927, '1528'), 'temp/1744597975_648272_987515204_9779c4f9d44360a9c80499e3b01e8a09.jpg'], '987515247': [('987515247', 'Carton', 0.99966943, 1927, '1528'), 'temp/1744597975_648272_987515247_e47b65403df916ba909bc9c439b0af73.jpg'], '987515248': [('987515248', 'Carton', 0.9812247, 1927, '1528'), 'temp/1744597975_648272_987515248_a70ad88462a22fb62a120721a42b2d42.jpg'], '987515249': [('987515249', 'Carton', 0.98130167, 1927, '1528'), 'temp/1744597975_648272_987515249_a70ad88462a22fb62a120721a42b2d42.jpg'], '987515250': [('987515250', 'Carton', 0.98080826, 1927, '1528'), 'temp/1744597975_648272_987515250_b2827c9639df69656f23abcc7f2f82d9.jpg'], '987515207': [('987515207', 'Papier_Magazine', 0.8737082, 1927, '1528'), 'temp/1744597975_648272_987515207_de216ddb041e249524b0fb2b949064a5.jpg'], '987515208': [('987515208', 'Carton', 0.99170697, 1927, '1528'), 'temp/1744597975_648272_987515208_a2b90cb74908aa64bbc4aae58f0c5ae8.jpg'], '987515209': [('987515209', 'Carton', 0.9677449, 1927, '1528'), 'temp/1744597975_648272_987515209_02dfe1ae39f51994652f4a8538844aea.jpg'], '987515179': [('987515179', 'Carton', 0.92677104, 1927, '1528'), 'temp/1744597975_648272_987515179_f7d4d1757a470f4c96dc3541eac88b9e.jpg'], '987515180': [('987515180', 'Carton', 0.9899963, 1927, '1528'), 'temp/1744597975_648272_987515180_776a5d7d8486ee2961bbe3a0d90f95b5.jpg'], '987515181': [('987515181', 'Carton', 0.9977798, 1927, '1528'), 'temp/1744597975_648272_987515181_1738c2798fb31152809ecb443ac286d6.jpg'], '987515182': [('987515182', 'Carton', 0.99244046, 1927, '1528'), 'temp/1744597975_648272_987515182_fe7f29bf6d13e08c3e985f91b5232178.jpg'], '987515183': [('987515183', 'Papier_Magazine', 0.99999213, 1927, '1528'), 'temp/1744597975_648272_987515183_6aab9ca0421398b4899892c10c2594c6.jpg'], '987515184': [('987515184', 'Papier_Magazine', 0.99973136, 1927, '1528'), 'temp/1744597975_648272_987515184_19c8c2177209a285df6014d95fe53f2c.jpg'], '987515185': [('987515185', 'Papier_Magazine', 0.79828423, 1927, '1528'), 'temp/1744597975_648272_987515185_e172d54457cabee9d7f02ee1300f3ae9.jpg']} result detect_point : {987515173: [(987515173, 1982, 'Autre_Environement', 112, -1, 112, -1, 6.271397463841755e-12), (987515173, 1982, 'Autre_Environement', 144, -1, 112, -1, 2.451621891608191e-11), (987515173, 1982, 'Autre_Environement', 176, -1, 112, -1, 1.0498378166801103e-08), (987515173, 1982, 'Autre_Environement', 208, -1, 112, -1, 4.447592516498844e-07), (987515173, 1982, 'Autre_Environement', 240, -1, 112, -1, 1.921495822898578e-06), (987515173, 1982, 'Autre_Environement', 272, -1, 112, -1, 3.768848910112865e-05), (987515173, 1982, 'Autre_Environement', 304, -1, 112, -1, 0.00012225352111272514), (987515173, 1982, 'Autre_Environement', 336, -1, 112, -1, 2.9528571758419275e-05), (987515173, 1982, 'Autre_Environement', 112, -1, 144, -1, 2.350749106483363e-08), (987515173, 1982, 'Autre_Environement', 144, -1, 144, -1, 2.205972116087196e-08), (987515173, 1982, 'Autre_Environement', 176, -1, 144, -1, 1.3810169718908583e-07), (987515173, 1982, 'Autre_Environement', 208, -1, 144, -1, 1.4717463727720315e-06), (987515173, 1982, 'Autre_Environement', 240, -1, 144, -1, 1.1271431503701024e-05), (987515173, 1982, 'Autre_Environement', 272, -1, 144, -1, 0.00015789814642630517), (987515173, 1982, 'Autre_Environement', 304, -1, 144, -1, 0.00044295270345173776), (987515173, 1982, 'Autre_Environement', 336, -1, 144, -1, 6.552588456543162e-05), (987515173, 1982, 'Autre_Environement', 112, -1, 176, -1, 1.3336054962564958e-06), (987515173, 1982, 'Autre_Environement', 144, -1, 176, -1, 1.6210512967518298e-06), (987515173, 1982, 'Autre_Environement', 176, -1, 176, -1, 2.524664978409419e-06), (987515173, 1982, 'Autre_Environement', 208, -1, 176, -1, 1.6130259155033855e-06), (987515173, 1982, 'Autre_Environement', 240, -1, 176, -1, 6.276387466641609e-06), (987515173, 1982, 'Autre_Environement', 272, -1, 176, -1, 8.610051736468449e-05), (987515173, 1982, 'Autre_Environement', 304, -1, 176, -1, 0.00032730188104324043), (987515173, 1982, 'Autre_Environement', 336, -1, 176, -1, 0.0003038864815607667), (987515173, 1982, 'Autre_Environement', 112, -1, 208, -1, 1.854014590207953e-05), (987515173, 1982, 'Autre_Environement', 144, -1, 208, -1, 7.929676939966157e-06), (987515173, 1982, 'Autre_Environement', 176, -1, 208, -1, 2.6948040613206103e-05), (987515173, 1982, 'Autre_Environement', 208, -1, 208, -1, 1.8061984519590624e-05), (987515173, 1982, 'Autre_Environement', 240, -1, 208, -1, 2.297614082635846e-05), (987515173, 1982, 'Autre_Environement', 272, -1, 208, -1, 1.701935070741456e-05), (987515173, 1982, 'Autre_Environement', 304, -1, 208, -1, 4.559010449156631e-06), (987515173, 1982, 'Autre_Environement', 336, -1, 208, -1, 8.78635182743892e-06), (987515173, 1982, 'Autre_Environement', 112, -1, 240, -1, 6.226186087587848e-06), (987515173, 1982, 'Autre_Environement', 144, -1, 240, -1, 1.643238533688418e-06), (987515173, 1982, 'Autre_Environement', 176, -1, 240, -1, 1.9630781480373116e-06), (987515173, 1982, 'Autre_Environement', 208, -1, 240, -1, 1.4375708587976987e-06), (987515173, 1982, 'Autre_Environement', 240, -1, 240, -1, 7.879094482632354e-06), (987515173, 1982, 'Autre_Environement', 272, -1, 240, -1, 1.286372025788296e-05), (987515173, 1982, 'Autre_Environement', 304, -1, 240, -1, 9.307515028922353e-06), (987515173, 1982, 'Autre_Environement', 336, -1, 240, -1, 2.1793444830109365e-05), (987515173, 1982, 'Autre_Environement', 112, -1, 272, -1, 3.8258981476246845e-06), (987515173, 1982, 'Autre_Environement', 144, -1, 272, -1, 2.547542862885166e-06), (987515173, 1982, 'Autre_Environement', 176, -1, 272, -1, 2.960170604637824e-06), (987515173, 1982, 'Autre_Environement', 208, -1, 272, -1, 2.76046148428577e-06), (987515173, 1982, 'Autre_Environement', 240, -1, 272, -1, 4.330826413934119e-06), (987515173, 1982, 'Autre_Environement', 272, -1, 272, -1, 8.172176421794575e-06), (987515173, 1982, 'Autre_Environement', 304, -1, 272, -1, 1.1552077012311202e-05), (987515173, 1982, 'Autre_Environement', 336, -1, 272, -1, 3.9282433135667816e-05), (987515173, 1982, 'Autre_Environement', 112, -1, 304, -1, 1.2083461115253158e-05), (987515173, 1982, 'Autre_Environement', 144, -1, 304, -1, 1.5569297829642892e-05), (987515173, 1982, 'Autre_Environement', 176, -1, 304, -1, 3.345852383063175e-05), (987515173, 1982, 'Autre_Environement', 208, -1, 304, -1, 0.00015421949501615018), (987515173, 1982, 'Autre_Environement', 240, -1, 304, -1, 0.0002589003706816584), (987515173, 1982, 'Autre_Environement', 272, -1, 304, -1, 0.00018797280790749937), (987515173, 1982, 'Autre_Environement', 304, -1, 304, -1, 0.0002131713117705658), (987515173, 1982, 'Autre_Environement', 336, -1, 304, -1, 0.00016473198775202036), (987515173, 1982, 'Autre_Environement', 112, -1, 336, -1, 4.548686320049455e-06), (987515173, 1982, 'Autre_Environement', 144, -1, 336, -1, 1.7321308405371383e-05), (987515173, 1982, 'Autre_Environement', 176, -1, 336, -1, 4.923374217469245e-05), (987515173, 1982, 'Autre_Environement', 208, -1, 336, -1, 0.00012132490519434214), (987515173, 1982, 'Autre_Environement', 240, -1, 336, -1, 0.00019545952090993524), (987515173, 1982, 'Autre_Environement', 272, -1, 336, -1, 0.00018809996254276484), (987515173, 1982, 'Autre_Environement', 304, -1, 336, -1, 0.00012375719961710274), (987515173, 1982, 'Autre_Environement', 336, -1, 336, -1, 0.0002720215416047722), (987515173, 1982, 'Carton', 112, -1, 112, -1, 1.5825072807729157e-07), (987515173, 1982, 'Carton', 144, -1, 112, -1, 4.051383257319685e-06), (987515173, 1982, 'Carton', 176, -1, 112, -1, 6.961710369068896e-06), (987515173, 1982, 'Carton', 208, -1, 112, -1, 0.0008730586268939078), (987515173, 1982, 'Carton', 240, -1, 112, -1, 0.00264487462118268), (987515173, 1982, 'Carton', 272, -1, 112, -1, 0.003375138621777296), (987515173, 1982, 'Carton', 304, -1, 112, -1, 0.03124803863465786), (987515173, 1982, 'Carton', 336, -1, 112, -1, 0.05582995340228081), (987515173, 1982, 'Carton', 112, -1, 144, -1, 0.00012355086801107973), (987515173, 1982, 'Carton', 144, -1, 144, -1, 0.00020865698752459139), (987515173, 1982, 'Carton', 176, -1, 144, -1, 0.00036844637361355126), (987515173, 1982, 'Carton', 208, -1, 144, -1, 0.0068449354730546474), (987515173, 1982, 'Carton', 240, -1, 144, -1, 0.01588798686861992), (987515173, 1982, 'Carton', 272, -1, 144, -1, 0.009420260787010193), (987515173, 1982, 'Carton', 304, -1, 144, -1, 0.009784248657524586), (987515173, 1982, 'Carton', 336, -1, 144, -1, 0.02217702567577362), (987515173, 1982, 'Carton', 112, -1, 176, -1, 0.021903619170188904), (987515173, 1982, 'Carton', 144, -1, 176, -1, 0.19304311275482178), (987515173, 1982, 'Carton', 176, -1, 176, -1, 0.09658566862344742), (987515173, 1982, 'Carton', 208, -1, 176, -1, 0.12337026745080948), (987515173, 1982, 'Carton', 240, -1, 176, -1, 0.5333078503608704), (987515173, 1982, 'Carton', 272, -1, 176, -1, 0.4592636823654175), (987515173, 1982, 'Carton', 304, -1, 176, -1, 0.7708209753036499), (987515173, 1982, 'Carton', 336, -1, 176, -1, 0.8663483262062073), (987515173, 1982, 'Carton', 112, -1, 208, -1, 0.8500397801399231), (987515173, 1982, 'Carton', 144, -1, 208, -1, 0.9842839241027832), (987515173, 1982, 'Carton', 176, -1, 208, -1, 0.9847639203071594), (987515173, 1982, 'Carton', 208, -1, 208, -1, 0.9919419288635254), (987515173, 1982, 'Carton', 240, -1, 208, -1, 0.9993878602981567), (987515173, 1982, 'Carton', 272, -1, 208, -1, 0.9994122982025146), (987515173, 1982, 'Carton', 304, -1, 208, -1, 0.9995859265327454), (987515173, 1982, 'Carton', 336, -1, 208, -1, 0.9992280006408691), (987515173, 1982, 'Carton', 112, -1, 240, -1, 0.9295159578323364), (987515173, 1982, 'Carton', 144, -1, 240, -1, 0.9809831976890564), (987515173, 1982, 'Carton', 176, -1, 240, -1, 0.9662431478500366), (987515173, 1982, 'Carton', 208, -1, 240, -1, 0.9674913883209229), (987515173, 1982, 'Carton', 240, -1, 240, -1, 0.9964020252227783), (987515173, 1982, 'Carton', 272, -1, 240, -1, 0.9994215965270996), (987515173, 1982, 'Carton', 304, -1, 240, -1, 0.9997861981391907), (987515173, 1982, 'Carton', 336, -1, 240, -1, 0.9996650218963623), (987515173, 1982, 'Carton', 112, -1, 272, -1, 0.989547848701477), (987515173, 1982, 'Carton', 144, -1, 272, -1, 0.9954788088798523), (987515173, 1982, 'Carton', 176, -1, 272, -1, 0.9854978322982788), (987515173, 1982, 'Carton', 208, -1, 272, -1, 0.9731882214546204), (987515173, 1982, 'Carton', 240, -1, 272, -1, 0.9974695444107056), (987515173, 1982, 'Carton', 272, -1, 272, -1, 0.9992057681083679), (987515173, 1982, 'Carton', 304, -1, 272, -1, 0.9995170831680298), (987515173, 1982, 'Carton', 336, -1, 272, -1, 0.9991299510002136), (987515173, 1982, 'Carton', 112, -1, 304, -1, 0.9977769255638123), (987515173, 1982, 'Carton', 144, -1, 304, -1, 0.997759222984314), (987515173, 1982, 'Carton', 176, -1, 304, -1, 0.9955556988716125), (987515173, 1982, 'Carton', 208, -1, 304, -1, 0.9927322268486023), (987515173, 1982, 'Carton', 240, -1, 304, -1, 0.9920433163642883), (987515173, 1982, 'Carton', 272, -1, 304, -1, 0.9835757613182068), (987515173, 1982, 'Carton', 304, -1, 304, -1, 0.9820222854614258), (987515173, 1982, 'Carton', 336, -1, 304, -1, 0.9809085130691528), (987515173, 1982, 'Carton', 112, -1, 336, -1, 0.9924331903457642), (987515173, 1982, 'Carton', 144, -1, 336, -1, 0.9761760830879211), (987515173, 1982, 'Carton', 176, -1, 336, -1, 0.9911621809005737), (987515173, 1982, 'Carton', 208, -1, 336, -1, 0.9869205951690674), (987515173, 1982, 'Carton', 240, -1, 336, -1, 0.9087321162223816), (987515173, 1982, 'Carton', 272, -1, 336, -1, 0.9451696872711182), (987515173, 1982, 'Carton', 304, -1, 336, -1, 0.9365019202232361), (987515173, 1982, 'Carton', 336, -1, 336, -1, 0.980847954750061), (987515173, 1982, 'Kraft', 112, -1, 112, -1, 1.959683970653714e-09), (987515173, 1982, 'Kraft', 144, -1, 112, -1, 1.714873221203561e-08), (987515173, 1982, 'Kraft', 176, -1, 112, -1, 9.55324139795266e-07), (987515173, 1982, 'Kraft', 208, -1, 112, -1, 3.143177309539169e-05), (987515173, 1982, 'Kraft', 240, -1, 112, -1, 4.4369498937157914e-05), (987515173, 1982, 'Kraft', 272, -1, 112, -1, 0.00020552732166834176), (987515173, 1982, 'Kraft', 304, -1, 112, -1, 0.0010803882032632828), (987515173, 1982, 'Kraft', 336, -1, 112, -1, 0.000830929959192872), (987515173, 1982, 'Kraft', 112, -1, 144, -1, 2.6106312361662276e-05), (987515173, 1982, 'Kraft', 144, -1, 144, -1, 6.978860255912878e-06), (987515173, 1982, 'Kraft', 176, -1, 144, -1, 3.6201220154907787e-06), (987515173, 1982, 'Kraft', 208, -1, 144, -1, 3.5640423448057845e-05), (987515173, 1982, 'Kraft', 240, -1, 144, -1, 6.705272971885279e-05), (987515173, 1982, 'Kraft', 272, -1, 144, -1, 8.692406845511869e-05), (987515173, 1982, 'Kraft', 304, -1, 144, -1, 0.00012203908408991992), (987515173, 1982, 'Kraft', 336, -1, 144, -1, 0.00011321275815134868), (987515173, 1982, 'Kraft', 112, -1, 176, -1, 0.0004972309106960893), (987515173, 1982, 'Kraft', 144, -1, 176, -1, 0.00012299961235839874), (987515173, 1982, 'Kraft', 176, -1, 176, -1, 9.062672324944288e-05), (987515173, 1982, 'Kraft', 208, -1, 176, -1, 5.164916001376696e-05), (987515173, 1982, 'Kraft', 240, -1, 176, -1, 0.00011583475134102628), (987515173, 1982, 'Kraft', 272, -1, 176, -1, 0.00043470572563819587), (987515173, 1982, 'Kraft', 304, -1, 176, -1, 0.0009228104609064758), (987515173, 1982, 'Kraft', 336, -1, 176, -1, 0.0014166416367515922), (987515173, 1982, 'Kraft', 112, -1, 208, -1, 6.874173413962126e-05), (987515173, 1982, 'Kraft', 144, -1, 208, -1, 1.848871397669427e-05), (987515173, 1982, 'Kraft', 176, -1, 208, -1, 2.5827497665886767e-05), (987515173, 1982, 'Kraft', 208, -1, 208, -1, 3.5433324228506535e-05), (987515173, 1982, 'Kraft', 240, -1, 208, -1, 3.6650839319918305e-05), (987515173, 1982, 'Kraft', 272, -1, 208, -1, 8.675114077050239e-05), (987515173, 1982, 'Kraft', 304, -1, 208, -1, 0.0001242355356225744), (987515173, 1982, 'Kraft', 336, -1, 208, -1, 0.0003906067868229002), (987515173, 1982, 'Kraft', 112, -1, 240, -1, 0.0003084047057200223), (987515173, 1982, 'Kraft', 144, -1, 240, -1, 4.1625782614573836e-05), (987515173, 1982, 'Kraft', 176, -1, 240, -1, 1.2235901522217318e-05), (987515173, 1982, 'Kraft', 208, -1, 240, -1, 7.3616929512354545e-06), (987515173, 1982, 'Kraft', 240, -1, 240, -1, 2.2985597752267495e-05), (987515173, 1982, 'Kraft', 272, -1, 240, -1, 5.8279227232560515e-05), (987515173, 1982, 'Kraft', 304, -1, 240, -1, 6.569155812030658e-05), (987515173, 1982, 'Kraft', 336, -1, 240, -1, 0.00018918130081146955), (987515173, 1982, 'Kraft', 112, -1, 272, -1, 0.001457546604797244), (987515173, 1982, 'Kraft', 144, -1, 272, -1, 0.0006897087441757321), (987515173, 1982, 'Kraft', 176, -1, 272, -1, 0.00027349754236638546), (987515173, 1982, 'Kraft', 208, -1, 272, -1, 4.359403465059586e-05), (987515173, 1982, 'Kraft', 240, -1, 272, -1, 3.355489388923161e-05), (987515173, 1982, 'Kraft', 272, -1, 272, -1, 8.330883429152891e-05), (987515173, 1982, 'Kraft', 304, -1, 272, -1, 0.00011177566921105608), (987515173, 1982, 'Kraft', 336, -1, 272, -1, 0.00042294766171835363), (987515173, 1982, 'Kraft', 112, -1, 304, -1, 0.0009915876435115933), (987515173, 1982, 'Kraft', 144, -1, 304, -1, 0.000894882483407855), (987515173, 1982, 'Kraft', 176, -1, 304, -1, 0.0006185802631080151), (987515173, 1982, 'Kraft', 208, -1, 304, -1, 0.0010835569119080901), (987515173, 1982, 'Kraft', 240, -1, 304, -1, 0.0017841329099610448), (987515173, 1982, 'Kraft', 272, -1, 304, -1, 0.004681267309933901), (987515173, 1982, 'Kraft', 304, -1, 304, -1, 0.004695300478488207), (987515173, 1982, 'Kraft', 336, -1, 304, -1, 0.012496287003159523), (987515173, 1982, 'Kraft', 112, -1, 336, -1, 0.0021780256647616625), (987515173, 1982, 'Kraft', 144, -1, 336, -1, 0.005715335253626108), (987515173, 1982, 'Kraft', 176, -1, 336, -1, 0.0008306269883178174), (987515173, 1982, 'Kraft', 208, -1, 336, -1, 0.0012675191974267364), (987515173, 1982, 'Kraft', 240, -1, 336, -1, 0.007761738263070583), (987515173, 1982, 'Kraft', 272, -1, 336, -1, 0.012569199316203594), (987515173, 1982, 'Kraft', 304, -1, 336, -1, 0.017978103831410408), (987515173, 1982, 'Kraft', 336, -1, 336, -1, 0.007746298797428608), (987515173, 1982, 'Lointain_Papier_Magazine', 112, -1, 112, -1, 1.4940078341130203e-10), (987515173, 1982, 'Lointain_Papier_Magazine', 144, -1, 112, -1, 8.33071123196305e-09), (987515173, 1982, 'Lointain_Papier_Magazine', 176, -1, 112, -1, 5.462326271299389e-07), (987515173, 1982, 'Lointain_Papier_Magazine', 208, -1, 112, -1, 5.510708433575928e-06), (987515173, 1982, 'Lointain_Papier_Magazine', 240, -1, 112, -1, 8.230662388086785e-06), (987515173, 1982, 'Lointain_Papier_Magazine', 272, -1, 112, -1, 3.555577131919563e-05), (987515173, 1982, 'Lointain_Papier_Magazine', 304, -1, 112, -1, 8.13369479146786e-05), (987515173, 1982, 'Lointain_Papier_Magazine', 336, -1, 112, -1, 4.2267522076144814e-05), (987515173, 1982, 'Lointain_Papier_Magazine', 112, -1, 144, -1, 3.609803798099165e-07), (987515173, 1982, 'Lointain_Papier_Magazine', 144, -1, 144, -1, 1.306211629525933e-06), (987515173, 1982, 'Lointain_Papier_Magazine', 176, -1, 144, -1, 2.474431539667421e-06), (987515173, 1982, 'Lointain_Papier_Magazine', 208, -1, 144, -1, 3.460275365796406e-06), (987515173, 1982, 'Lointain_Papier_Magazine', 240, -1, 144, -1, 5.711162884836085e-06), (987515173, 1982, 'Lointain_Papier_Magazine', 272, -1, 144, -1, 2.058469908661209e-05), (987515173, 1982, 'Lointain_Papier_Magazine', 304, -1, 144, -1, 3.9017530070850626e-05), (987515173, 1982, 'Lointain_Papier_Magazine', 336, -1, 144, -1, 1.3692897482542321e-05), (987515173, 1982, 'Lointain_Papier_Magazine', 112, -1, 176, -1, 3.8840900629111275e-07), (987515173, 1982, 'Lointain_Papier_Magazine', 144, -1, 176, -1, 2.5529288905090652e-06), (987515173, 1982, 'Lointain_Papier_Magazine', 176, -1, 176, -1, 1.2019247151329182e-05), (987515173, 1982, 'Lointain_Papier_Magazine', 208, -1, 176, -1, 7.813697266101371e-06), (987515173, 1982, 'Lointain_Papier_Magazine', 240, -1, 176, -1, 6.3746665546204895e-06), (987515173, 1982, 'Lointain_Papier_Magazine', 272, -1, 176, -1, 2.6441966838319786e-05), (987515173, 1982, 'Lointain_Papier_Magazine', 304, -1, 176, -1, 3.923190161003731e-05), (987515173, 1982, 'Lointain_Papier_Magazine', 336, -1, 176, -1, 1.8379327229922637e-05), (987515173, 1982, 'Lointain_Papier_Magazine', 112, -1, 208, -1, 1.7972835166801815e-06), (987515173, 1982, 'Lointain_Papier_Magazine', 144, -1, 208, -1, 5.707428840651119e-07), (987515173, 1982, 'Lointain_Papier_Magazine', 176, -1, 208, -1, 2.1920441213296726e-06), (987515173, 1982, 'Lointain_Papier_Magazine', 208, -1, 208, -1, 1.7368854514643317e-06), (987515173, 1982, 'Lointain_Papier_Magazine', 240, -1, 208, -1, 3.942007253954216e-07), (987515173, 1982, 'Lointain_Papier_Magazine', 272, -1, 208, -1, 2.0314573134783132e-07), (987515173, 1982, 'Lointain_Papier_Magazine', 304, -1, 208, -1, 9.911964582443034e-08), (987515173, 1982, 'Lointain_Papier_Magazine', 336, -1, 208, -1, 8.657914918330789e-08), (987515173, 1982, 'Lointain_Papier_Magazine', 112, -1, 240, -1, 1.8172463569499087e-06), (987515173, 1982, 'Lointain_Papier_Magazine', 144, -1, 240, -1, 6.324177661554131e-07), (987515173, 1982, 'Lointain_Papier_Magazine', 176, -1, 240, -1, 7.812197964085499e-07), (987515173, 1982, 'Lointain_Papier_Magazine', 208, -1, 240, -1, 6.423416607503896e-07), (987515173, 1982, 'Lointain_Papier_Magazine', 240, -1, 240, -1, 7.706531164330954e-07), (987515173, 1982, 'Lointain_Papier_Magazine', 272, -1, 240, -1, 5.175296564630116e-07), (987515173, 1982, 'Lointain_Papier_Magazine', 304, -1, 240, -1, 1.7716223510433338e-07), (987515173, 1982, 'Lointain_Papier_Magazine', 336, -1, 240, -1, 1.4615179111387988e-07), (987515173, 1982, 'Lointain_Papier_Magazine', 112, -1, 272, -1, 4.1788069893300417e-07), (987515173, 1982, 'Lointain_Papier_Magazine', 144, -1, 272, -1, 3.1647965670345e-07), (987515173, 1982, 'Lointain_Papier_Magazine', 176, -1, 272, -1, 5.092023798169976e-07), (987515173, 1982, 'Lointain_Papier_Magazine', 208, -1, 272, -1, 7.379881594715698e-07), (987515173, 1982, 'Lointain_Papier_Magazine', 240, -1, 272, -1, 4.032547167298617e-07), (987515173, 1982, 'Lointain_Papier_Magazine', 272, -1, 272, -1, 3.2165866059585824e-07), (987515173, 1982, 'Lointain_Papier_Magazine', 304, -1, 272, -1, 2.1000541039484233e-07), (987515173, 1982, 'Lointain_Papier_Magazine', 336, -1, 272, -1, 3.479018744201312e-07), (987515173, 1982, 'Lointain_Papier_Magazine', 112, -1, 304, -1, 3.2972729968605563e-07), (987515173, 1982, 'Lointain_Papier_Magazine', 144, -1, 304, -1, 3.254387763718114e-07), (987515173, 1982, 'Lointain_Papier_Magazine', 176, -1, 304, -1, 8.377591029784526e-07), (987515173, 1982, 'Lointain_Papier_Magazine', 208, -1, 304, -1, 3.301834340163623e-06), (987515173, 1982, 'Lointain_Papier_Magazine', 240, -1, 304, -1, 4.4132220864412375e-06), (987515173, 1982, 'Lointain_Papier_Magazine', 272, -1, 304, -1, 5.029261956224218e-06), (987515173, 1982, 'Lointain_Papier_Magazine', 304, -1, 304, -1, 8.185589649656322e-06), (987515173, 1982, 'Lointain_Papier_Magazine', 336, -1, 304, -1, 5.578862783295335e-06), (987515173, 1982, 'Lointain_Papier_Magazine', 112, -1, 336, -1, 4.1916669601960166e-07), (987515173, 1982, 'Lointain_Papier_Magazine', 144, -1, 336, -1, 8.219464575631719e-07), (987515173, 1982, 'Lointain_Papier_Magazine', 176, -1, 336, -1, 7.145447398215765e-07), (987515173, 1982, 'Lointain_Papier_Magazine', 208, -1, 336, -1, 1.950574187503662e-06), (987515173, 1982, 'Lointain_Papier_Magazine', 240, -1, 336, -1, 3.904702225554502e-06), (987515173, 1982, 'Lointain_Papier_Magazine', 272, -1, 336, -1, 2.4593293801444815e-06), (987515173, 1982, 'Lointain_Papier_Magazine', 304, -1, 336, -1, 3.440815589783597e-06), (987515173, 1982, 'Lointain_Papier_Magazine', 336, -1, 336, -1, 4.847029231314082e-06), (987515173, 1982, 'Metal', 112, -1, 112, -1, 7.429567377981172e-11), (987515173, 1982, 'Metal', 144, -1, 112, -1, 1.927237036625229e-09), (987515173, 1982, 'Metal', 176, -1, 112, -1, 7.238608645820932e-07), (987515173, 1982, 'Metal', 208, -1, 112, -1, 9.461645277042408e-06), (987515173, 1982, 'Metal', 240, -1, 112, -1, 2.6466661438462324e-05), (987515173, 1982, 'Metal', 272, -1, 112, -1, 0.00016887523815967143), (987515173, 1982, 'Metal', 304, -1, 112, -1, 0.0007536012562923133), (987515173, 1982, 'Metal', 336, -1, 112, -1, 0.00030341820092871785), (987515173, 1982, 'Metal', 112, -1, 144, -1, 5.301479859554092e-07), (987515173, 1982, 'Metal', 144, -1, 144, -1, 4.372370199234865e-07), (987515173, 1982, 'Metal', 176, -1, 144, -1, 3.182121417921735e-06), (987515173, 1982, 'Metal', 208, -1, 144, -1, 9.581408448866569e-06), (987515173, 1982, 'Metal', 240, -1, 144, -1, 1.657801476540044e-05), (987515173, 1982, 'Metal', 272, -1, 144, -1, 7.649704639334232e-05), (987515173, 1982, 'Metal', 304, -1, 144, -1, 0.00013103988021612167), (987515173, 1982, 'Metal', 336, -1, 144, -1, 4.679865742218681e-05), (987515173, 1982, 'Metal', 112, -1, 176, -1, 5.895034519198816e-06), (987515173, 1982, 'Metal', 144, -1, 176, -1, 4.025052021461306e-06), (987515173, 1982, 'Metal', 176, -1, 176, -1, 1.013188375509344e-05), (987515173, 1982, 'Metal', 208, -1, 176, -1, 4.155038368480746e-06), (987515173, 1982, 'Metal', 240, -1, 176, -1, 6.681396371277515e-06), (987515173, 1982, 'Metal', 272, -1, 176, -1, 5.4504220315720886e-05), (987515173, 1982, 'Metal', 304, -1, 176, -1, 0.00012920470908284187), (987515173, 1982, 'Metal', 336, -1, 176, -1, 6.520314491353929e-05), (987515173, 1982, 'Metal', 112, -1, 208, -1, 8.130266905936878e-06), (987515173, 1982, 'Metal', 144, -1, 208, -1, 2.2603026081924327e-06), (987515173, 1982, 'Metal', 176, -1, 208, -1, 6.603681413253071e-06), (987515173, 1982, 'Metal', 208, -1, 208, -1, 4.597570296027698e-06), (987515173, 1982, 'Metal', 240, -1, 208, -1, 1.6922837176025496e-06), (987515173, 1982, 'Metal', 272, -1, 208, -1, 1.37054678361892e-06), (987515173, 1982, 'Metal', 304, -1, 208, -1, 5.808111041005759e-07), (987515173, 1982, 'Metal', 336, -1, 208, -1, 8.317612127939356e-07), (987515173, 1982, 'Metal', 112, -1, 240, -1, 2.9390259896899806e-06), (987515173, 1982, 'Metal', 144, -1, 240, -1, 7.395906322926749e-07), (987515173, 1982, 'Metal', 176, -1, 240, -1, 6.079575882722565e-07), (987515173, 1982, 'Metal', 208, -1, 240, -1, 6.252850539567589e-07), (987515173, 1982, 'Metal', 240, -1, 240, -1, 1.1991652399956365e-06), (987515173, 1982, 'Metal', 272, -1, 240, -1, 6.958346716601227e-07), (987515173, 1982, 'Metal', 304, -1, 240, -1, 3.145828202377743e-07), (987515173, 1982, 'Metal', 336, -1, 240, -1, 4.16455719687292e-07), (987515173, 1982, 'Metal', 112, -1, 272, -1, 2.6158625132666202e-06), (987515173, 1982, 'Metal', 144, -1, 272, -1, 8.040984198487422e-07), (987515173, 1982, 'Metal', 176, -1, 272, -1, 8.207837822737929e-07), (987515173, 1982, 'Metal', 208, -1, 272, -1, 4.0223488895207993e-07), (987515173, 1982, 'Metal', 240, -1, 272, -1, 2.7486524345476937e-07), (987515173, 1982, 'Metal', 272, -1, 272, -1, 3.314421803679579e-07), (987515173, 1982, 'Metal', 304, -1, 272, -1, 3.4366294698884303e-07), (987515173, 1982, 'Metal', 336, -1, 272, -1, 1.474345481256023e-06), (987515173, 1982, 'Metal', 112, -1, 304, -1, 2.3098004930943716e-06), (987515173, 1982, 'Metal', 144, -1, 304, -1, 1.9551482637325535e-06), (987515173, 1982, 'Metal', 176, -1, 304, -1, 4.532780167210149e-06), (987515173, 1982, 'Metal', 208, -1, 304, -1, 1.3328808563528582e-05), (987515173, 1982, 'Metal', 240, -1, 304, -1, 5.640958988806233e-06), (987515173, 1982, 'Metal', 272, -1, 304, -1, 5.689619229087839e-06), (987515173, 1982, 'Metal', 304, -1, 304, -1, 6.3661709646112286e-06), (987515173, 1982, 'Metal', 336, -1, 304, -1, 7.386000561382389e-06), (987515173, 1982, 'Metal', 112, -1, 336, -1, 7.140306479413994e-06), (987515173, 1982, 'Metal', 144, -1, 336, -1, 3.309083331259899e-05), (987515173, 1982, 'Metal', 176, -1, 336, -1, 4.025809175800532e-05), (987515173, 1982, 'Metal', 208, -1, 336, -1, 7.588235166622326e-05), (987515173, 1982, 'Metal', 240, -1, 336, -1, 0.0001211166090797633), (987515173, 1982, 'Metal', 272, -1, 336, -1, 3.7181634979788214e-05), (987515173, 1982, 'Metal', 304, -1, 336, -1, 2.9152195565984584e-05), (987515173, 1982, 'Metal', 336, -1, 336, -1, 2.807711462082807e-05), (987515173, 1982, 'Papier_Magazine', 112, -1, 112, -1, 0.9999953508377075), (987515173, 1982, 'Papier_Magazine', 144, -1, 112, -1, 0.9999926090240479), (987515173, 1982, 'Papier_Magazine', 176, -1, 112, -1, 0.9999089241027832), (987515173, 1982, 'Papier_Magazine', 208, -1, 112, -1, 0.9949466586112976), (987515173, 1982, 'Papier_Magazine', 240, -1, 112, -1, 0.9937742948532104), (987515173, 1982, 'Papier_Magazine', 272, -1, 112, -1, 0.9867067933082581), (987515173, 1982, 'Papier_Magazine', 304, -1, 112, -1, 0.8925614953041077), (987515173, 1982, 'Papier_Magazine', 336, -1, 112, -1, 0.8720738291740417), (987515173, 1982, 'Papier_Magazine', 112, -1, 144, -1, 0.9998149275779724), (987515173, 1982, 'Papier_Magazine', 144, -1, 144, -1, 0.9997429251670837), (987515173, 1982, 'Papier_Magazine', 176, -1, 144, -1, 0.999413013458252), (987515173, 1982, 'Papier_Magazine', 208, -1, 144, -1, 0.9911862015724182), (987515173, 1982, 'Papier_Magazine', 240, -1, 144, -1, 0.9781213402748108), (987515173, 1982, 'Papier_Magazine', 272, -1, 144, -1, 0.9001358151435852), (987515173, 1982, 'Papier_Magazine', 304, -1, 144, -1, 0.5367849469184875), (987515173, 1982, 'Papier_Magazine', 336, -1, 144, -1, 0.8109948039054871), (987515173, 1982, 'Papier_Magazine', 112, -1, 176, -1, 0.9775570034980774), (987515173, 1982, 'Papier_Magazine', 144, -1, 176, -1, 0.8065951466560364), (987515173, 1982, 'Papier_Magazine', 176, -1, 176, -1, 0.902694582939148), (987515173, 1982, 'Papier_Magazine', 208, -1, 176, -1, 0.8753410577774048), (987515173, 1982, 'Papier_Magazine', 240, -1, 176, -1, 0.4652388095855713), (987515173, 1982, 'Papier_Magazine', 272, -1, 176, -1, 0.5267437696456909), (987515173, 1982, 'Papier_Magazine', 304, -1, 176, -1, 0.16677312552928925), (987515173, 1982, 'Papier_Magazine', 336, -1, 176, -1, 0.11064697057008743), (987515173, 1982, 'Papier_Magazine', 112, -1, 208, -1, 0.14967940747737885), (987515173, 1982, 'Papier_Magazine', 144, -1, 208, -1, 0.015457632951438427), (987515173, 1982, 'Papier_Magazine', 176, -1, 208, -1, 0.014767689630389214), (987515173, 1982, 'Papier_Magazine', 208, -1, 208, -1, 0.007597489282488823), (987515173, 1982, 'Papier_Magazine', 240, -1, 208, -1, 0.000341917562764138), (987515173, 1982, 'Papier_Magazine', 272, -1, 208, -1, 0.0001709045172901824), (987515173, 1982, 'Papier_Magazine', 304, -1, 208, -1, 5.406516356742941e-05), (987515173, 1982, 'Papier_Magazine', 336, -1, 208, -1, 6.242784002097324e-05), (987515173, 1982, 'Papier_Magazine', 112, -1, 240, -1, 0.06973759829998016), (987515173, 1982, 'Papier_Magazine', 144, -1, 240, -1, 0.018822692334651947), (987515173, 1982, 'Papier_Magazine', 176, -1, 240, -1, 0.03365115821361542), (987515173, 1982, 'Papier_Magazine', 208, -1, 240, -1, 0.03246324509382248), (987515173, 1982, 'Papier_Magazine', 240, -1, 240, -1, 0.0034809978678822517), (987515173, 1982, 'Papier_Magazine', 272, -1, 240, -1, 0.00034122721990570426), (987515173, 1982, 'Papier_Magazine', 304, -1, 240, -1, 2.9580574846477248e-05), (987515173, 1982, 'Papier_Magazine', 336, -1, 240, -1, 1.6584102922934107e-05), (987515173, 1982, 'Papier_Magazine', 112, -1, 272, -1, 0.00848313421010971), (987515173, 1982, 'Papier_Magazine', 144, -1, 272, -1, 0.003637234913185239), (987515173, 1982, 'Papier_Magazine', 176, -1, 272, -1, 0.014042586088180542), (987515173, 1982, 'Papier_Magazine', 208, -1, 272, -1, 0.026692884042859077), (987515173, 1982, 'Papier_Magazine', 240, -1, 272, -1, 0.002454567700624466), (987515173, 1982, 'Papier_Magazine', 272, -1, 272, -1, 0.0006429362110793591), (987515173, 1982, 'Papier_Magazine', 304, -1, 272, -1, 0.0002746349200606346), (987515173, 1982, 'Papier_Magazine', 336, -1, 272, -1, 0.00015863798034843057), (987515173, 1982, 'Papier_Magazine', 112, -1, 304, -1, 0.0010022649075835943), (987515173, 1982, 'Papier_Magazine', 144, -1, 304, -1, 0.0009964967612177134), (987515173, 1982, 'Papier_Magazine', 176, -1, 304, -1, 0.0031952999997884035), (987515173, 1982, 'Papier_Magazine', 208, -1, 304, -1, 0.005031617358326912), (987515173, 1982, 'Papier_Magazine', 240, -1, 304, -1, 0.003491390962153673), (987515173, 1982, 'Papier_Magazine', 272, -1, 304, -1, 0.004061806946992874), (987515173, 1982, 'Papier_Magazine', 304, -1, 304, -1, 0.007191794924438), (987515173, 1982, 'Papier_Magazine', 336, -1, 304, -1, 0.0019518923945724964), (987515173, 1982, 'Papier_Magazine', 112, -1, 336, -1, 0.004871977027505636), (987515173, 1982, 'Papier_Magazine', 144, -1, 336, -1, 0.015524879097938538), (987515173, 1982, 'Papier_Magazine', 176, -1, 336, -1, 0.006796706467866898), (987515173, 1982, 'Papier_Magazine', 208, -1, 336, -1, 0.00799369066953659), (987515173, 1982, 'Papier_Magazine', 240, -1, 336, -1, 0.01902930438518524), (987515173, 1982, 'Papier_Magazine', 272, -1, 336, -1, 0.003651471110060811), (987515173, 1982, 'Papier_Magazine', 304, -1, 336, -1, 0.006298679392784834), (987515173, 1982, 'Papier_Magazine', 336, -1, 336, -1, 0.0044465335085988045), (987515173, 1982, 'Plastique', 112, -1, 112, -1, 5.622127474680383e-08), (987515173, 1982, 'Plastique', 144, -1, 112, -1, 8.177399308806343e-07), (987515173, 1982, 'Plastique', 176, -1, 112, -1, 6.249731086427346e-05), (987515173, 1982, 'Plastique', 208, -1, 112, -1, 0.003556065959855914), (987515173, 1982, 'Plastique', 240, -1, 112, -1, 0.003158387029543519), (987515173, 1982, 'Plastique', 272, -1, 112, -1, 0.007464884780347347), (987515173, 1982, 'Plastique', 304, -1, 112, -1, 0.05466088280081749), (987515173, 1982, 'Plastique', 336, -1, 112, -1, 0.0596756711602211), (987515173, 1982, 'Plastique', 112, -1, 144, -1, 2.778921498247655e-06), (987515173, 1982, 'Plastique', 144, -1, 144, -1, 1.900940878840629e-05), (987515173, 1982, 'Plastique', 176, -1, 144, -1, 0.00017660776211414486), (987515173, 1982, 'Plastique', 208, -1, 144, -1, 0.00150451494846493), (987515173, 1982, 'Plastique', 240, -1, 144, -1, 0.005060078576207161), (987515173, 1982, 'Plastique', 272, -1, 144, -1, 0.0845026895403862), (987515173, 1982, 'Plastique', 304, -1, 144, -1, 0.4088384807109833), (987515173, 1982, 'Plastique', 336, -1, 144, -1, 0.07086360454559326), (987515173, 1982, 'Plastique', 112, -1, 176, -1, 3.92720130548696e-06), (987515173, 1982, 'Plastique', 144, -1, 176, -1, 9.539171878714114e-05), (987515173, 1982, 'Plastique', 176, -1, 176, -1, 0.00033992071985267103), (987515173, 1982, 'Plastique', 208, -1, 176, -1, 0.00038902502274140716), (987515173, 1982, 'Plastique', 240, -1, 176, -1, 0.0006224163807928562), (987515173, 1982, 'Plastique', 272, -1, 176, -1, 0.008974647149443626), (987515173, 1982, 'Plastique', 304, -1, 176, -1, 0.03738725930452347), (987515173, 1982, 'Plastique', 336, -1, 176, -1, 0.0020566813182085752), (987515173, 1982, 'Plastique', 112, -1, 208, -1, 7.615958020323887e-05), (987515173, 1982, 'Plastique', 144, -1, 208, -1, 4.1350296669406816e-05), (987515173, 1982, 'Plastique', 176, -1, 208, -1, 8.221130701713264e-05), (987515173, 1982, 'Plastique', 208, -1, 208, -1, 3.836985706584528e-05), (987515173, 1982, 'Plastique', 240, -1, 208, -1, 8.264566531579476e-06), (987515173, 1982, 'Plastique', 272, -1, 208, -1, 1.200982205773471e-05), (987515173, 1982, 'Plastique', 304, -1, 208, -1, 1.2179839359305333e-05), (987515173, 1982, 'Plastique', 336, -1, 208, -1, 4.096551947441185e-06), (987515173, 1982, 'Plastique', 112, -1, 240, -1, 0.00014472127077169716), (987515173, 1982, 'Plastique', 144, -1, 240, -1, 3.536904841894284e-05), (987515173, 1982, 'Plastique', 176, -1, 240, -1, 2.1146281142137013e-05), (987515173, 1982, 'Plastique', 208, -1, 240, -1, 7.377555448329076e-06), (987515173, 1982, 'Plastique', 240, -1, 240, -1, 4.8655388127372134e-06), (987515173, 1982, 'Plastique', 272, -1, 240, -1, 2.768247213680297e-06), (987515173, 1982, 'Plastique', 304, -1, 240, -1, 7.970205047058698e-07), (987515173, 1982, 'Plastique', 336, -1, 240, -1, 3.5654480257107934e-07), (987515173, 1982, 'Plastique', 112, -1, 272, -1, 3.357404420967214e-05), (987515173, 1982, 'Plastique', 144, -1, 272, -1, 1.1636775525403209e-05), (987515173, 1982, 'Plastique', 176, -1, 272, -1, 1.3384699741436634e-05), (987515173, 1982, 'Plastique', 208, -1, 272, -1, 5.4405018090619706e-06), (987515173, 1982, 'Plastique', 240, -1, 272, -1, 9.57501242737635e-07), (987515173, 1982, 'Plastique', 272, -1, 272, -1, 6.871134132779844e-07), (987515173, 1982, 'Plastique', 304, -1, 272, -1, 5.68629445751867e-07), (987515173, 1982, 'Plastique', 336, -1, 272, -1, 7.439693945343606e-07), (987515173, 1982, 'Plastique', 112, -1, 304, -1, 3.353062993483036e-06), (987515173, 1982, 'Plastique', 144, -1, 304, -1, 3.3659280234132893e-06), (987515173, 1982, 'Plastique', 176, -1, 304, -1, 6.495131856354419e-06), (987515173, 1982, 'Plastique', 208, -1, 304, -1, 8.748752406972926e-06), (987515173, 1982, 'Plastique', 240, -1, 304, -1, 3.3829505809990223e-06), (987515173, 1982, 'Plastique', 272, -1, 304, -1, 4.756150246976176e-06), (987515173, 1982, 'Plastique', 304, -1, 304, -1, 4.501874627749203e-06), (987515173, 1982, 'Plastique', 336, -1, 304, -1, 2.419771362838219e-06), (987515173, 1982, 'Plastique', 112, -1, 336, -1, 1.5507144780713134e-05), (987515173, 1982, 'Plastique', 144, -1, 336, -1, 5.3460193157661706e-05), (987515173, 1982, 'Plastique', 176, -1, 336, -1, 3.4315962693654e-05), (987515173, 1982, 'Plastique', 208, -1, 336, -1, 2.379975740041118e-05), (987515173, 1982, 'Plastique', 240, -1, 336, -1, 3.8546666473848745e-05), (987515173, 1982, 'Plastique', 272, -1, 336, -1, 2.5773197194212116e-05), (987515173, 1982, 'Plastique', 304, -1, 336, -1, 3.327463491586968e-05), (987515173, 1982, 'Plastique', 336, -1, 336, -1, 4.185928264632821e-05), (987515173, 1982, 'Sol_Environement', 112, -1, 112, -1, 2.9164426949834787e-12), (987515173, 1982, 'Sol_Environement', 144, -1, 112, -1, 5.566790917121978e-10), (987515173, 1982, 'Sol_Environement', 176, -1, 112, -1, 4.842164571527974e-07), (987515173, 1982, 'Sol_Environement', 208, -1, 112, -1, 1.0150369234906975e-05), (987515173, 1982, 'Sol_Environement', 240, -1, 112, -1, 9.192692232318223e-06), (987515173, 1982, 'Sol_Environement', 272, -1, 112, -1, 5.604355101240799e-05), (987515173, 1982, 'Sol_Environement', 304, -1, 112, -1, 0.00037779175909236073), (987515173, 1982, 'Sol_Environement', 336, -1, 112, -1, 0.00016540467913728207), (987515173, 1982, 'Sol_Environement', 112, -1, 144, -1, 1.023474354155951e-07), (987515173, 1982, 'Sol_Environement', 144, -1, 144, -1, 5.775520435236103e-07), (987515173, 1982, 'Sol_Environement', 176, -1, 144, -1, 1.4353344113260391e-06), (987515173, 1982, 'Sol_Environement', 208, -1, 144, -1, 5.889411568205105e-06), (987515173, 1982, 'Sol_Environement', 240, -1, 144, -1, 1.8204920706921257e-05), (987515173, 1982, 'Sol_Environement', 272, -1, 144, -1, 0.0001262298901565373), (987515173, 1982, 'Sol_Environement', 304, -1, 144, -1, 0.0003236296179238707), (987515173, 1982, 'Sol_Environement', 336, -1, 144, -1, 9.675041656009853e-05), (987515173, 1982, 'Sol_Environement', 112, -1, 176, -1, 4.183500834642473e-07), (987515173, 1982, 'Sol_Environement', 144, -1, 176, -1, 1.0190278771915473e-06), (987515173, 1982, 'Sol_Environement', 176, -1, 176, -1, 6.56763313600095e-06), (987515173, 1982, 'Sol_Environement', 208, -1, 176, -1, 1.7184872831421671e-06), (987515173, 1982, 'Sol_Environement', 240, -1, 176, -1, 3.7357981454988476e-06), (987515173, 1982, 'Sol_Environement', 272, -1, 176, -1, 2.8030666726408526e-05), (987515173, 1982, 'Sol_Environement', 304, -1, 176, -1, 0.00015384185826405883), (987515173, 1982, 'Sol_Environement', 336, -1, 176, -1, 0.00024026268511079252), (987515173, 1982, 'Sol_Environement', 112, -1, 208, -1, 3.998693046014523e-06), (987515173, 1982, 'Sol_Environement', 144, -1, 208, -1, 7.504650056944229e-07), (987515173, 1982, 'Sol_Environement', 176, -1, 208, -1, 1.3276603567646816e-06), (987515173, 1982, 'Sol_Environement', 208, -1, 208, -1, 9.065654467121931e-07), (987515173, 1982, 'Sol_Environement', 240, -1, 208, -1, 6.81384790368611e-07), (987515173, 1982, 'Sol_Environement', 272, -1, 208, -1, 1.083008328350843e-06), (987515173, 1982, 'Sol_Environement', 304, -1, 208, -1, 1.453265667805681e-06), (987515173, 1982, 'Sol_Environement', 336, -1, 208, -1, 2.314477114850888e-06), (987515173, 1982, 'Sol_Environement', 112, -1, 240, -1, 4.6900381676096e-06), (987515173, 1982, 'Sol_Environement', 144, -1, 240, -1, 3.765826761537028e-07), (987515173, 1982, 'Sol_Environement', 176, -1, 240, -1, 2.490155850409792e-07), (987515173, 1982, 'Sol_Environement', 208, -1, 240, -1, 2.1702769004150468e-07), (987515173, 1982, 'Sol_Environement', 240, -1, 240, -1, 5.590806040345342e-07), (987515173, 1982, 'Sol_Environement', 272, -1, 240, -1, 8.637705377623206e-07), (987515173, 1982, 'Sol_Environement', 304, -1, 240, -1, 6.652900310655241e-07), (987515173, 1982, 'Sol_Environement', 336, -1, 240, -1, 7.912277055766026e-07), (987515173, 1982, 'Sol_Environement', 112, -1, 272, -1, 2.9859702408430167e-06), (987515173, 1982, 'Sol_Environement', 144, -1, 272, -1, 6.873660822748207e-07), (987515173, 1982, 'Sol_Environement', 176, -1, 272, -1, 5.011965527046414e-07), (987515173, 1982, 'Sol_Environement', 208, -1, 272, -1, 2.0163645331194857e-07), (987515173, 1982, 'Sol_Environement', 240, -1, 272, -1, 1.3206189919401368e-07), (987515173, 1982, 'Sol_Environement', 272, -1, 272, -1, 2.6999873625754844e-07), (987515173, 1982, 'Sol_Environement', 304, -1, 272, -1, 1.6096453236968955e-07), (987515173, 1982, 'Sol_Environement', 336, -1, 272, -1, 4.855953648075229e-07), (987515173, 1982, 'Sol_Environement', 112, -1, 304, -1, 6.985521849856013e-07), (987515173, 1982, 'Sol_Environement', 144, -1, 304, -1, 4.0420090385850926e-07), (987515173, 1982, 'Sol_Environement', 176, -1, 304, -1, 8.927498242883303e-07), (987515173, 1982, 'Sol_Environement', 208, -1, 304, -1, 2.333048314540065e-06), (987515173, 1982, 'Sol_Environement', 240, -1, 304, -1, 3.059052005482954e-06), (987515173, 1982, 'Sol_Environement', 272, -1, 304, -1, 2.6725676889327588e-06), (987515173, 1982, 'Sol_Environement', 304, -1, 304, -1, 1.500109078733658e-06), (987515173, 1982, 'Sol_Environement', 336, -1, 304, -1, 1.6174526535905898e-06), (987515173, 1982, 'Sol_Environement', 112, -1, 336, -1, 4.631622232409427e-07), (987515173, 1982, 'Sol_Environement', 144, -1, 336, -1, 1.1254171567998128e-06), (987515173, 1982, 'Sol_Environement', 176, -1, 336, -1, 6.791749456169782e-07), (987515173, 1982, 'Sol_Environement', 208, -1, 336, -1, 1.435619878975558e-06), (987515173, 1982, 'Sol_Environement', 240, -1, 336, -1, 3.327920467199874e-06), (987515173, 1982, 'Sol_Environement', 272, -1, 336, -1, 2.1234357063804055e-06), (987515173, 1982, 'Sol_Environement', 304, -1, 336, -1, 2.3018735646473942e-06), (987515173, 1982, 'Sol_Environement', 336, -1, 336, -1, 3.383832790859742e-06), (987515173, 1982, 'Teint_Dans_La_Masse', 112, -1, 112, -1, 4.587334387906594e-06), (987515173, 1982, 'Teint_Dans_La_Masse', 144, -1, 112, -1, 2.4690571081009693e-06), (987515173, 1982, 'Teint_Dans_La_Masse', 176, -1, 112, -1, 1.7566268070368096e-05), (987515173, 1982, 'Teint_Dans_La_Masse', 208, -1, 112, -1, 0.00047449066187255085), (987515173, 1982, 'Teint_Dans_La_Masse', 240, -1, 112, -1, 0.0001157822334789671), (987515173, 1982, 'Teint_Dans_La_Masse', 272, -1, 112, -1, 0.00020899179799016565), (987515173, 1982, 'Teint_Dans_La_Masse', 304, -1, 112, -1, 0.00144397490657866), (987515173, 1982, 'Teint_Dans_La_Masse', 336, -1, 112, -1, 0.002027868991717696), (987515173, 1982, 'Teint_Dans_La_Masse', 112, -1, 144, -1, 3.069341619266197e-05), (987515173, 1982, 'Teint_Dans_La_Masse', 144, -1, 144, -1, 1.7209589714184403e-05), (987515173, 1982, 'Teint_Dans_La_Masse', 176, -1, 144, -1, 2.077752105833497e-05), (987515173, 1982, 'Teint_Dans_La_Masse', 208, -1, 144, -1, 0.0002737499016802758), (987515173, 1982, 'Teint_Dans_La_Masse', 240, -1, 144, -1, 0.00046442897291854024), (987515173, 1982, 'Teint_Dans_La_Masse', 272, -1, 144, -1, 0.0005287824315018952), (987515173, 1982, 'Teint_Dans_La_Masse', 304, -1, 144, -1, 0.00018989521777257323), (987515173, 1982, 'Teint_Dans_La_Masse', 336, -1, 144, -1, 0.00020626770856324583), (987515173, 1982, 'Teint_Dans_La_Masse', 112, -1, 176, -1, 1.5043824532767758e-05), (987515173, 1982, 'Teint_Dans_La_Masse', 144, -1, 176, -1, 6.765830221411306e-06), (987515173, 1982, 'Teint_Dans_La_Masse', 176, -1, 176, -1, 2.1044705135864206e-05), (987515173, 1982, 'Teint_Dans_La_Masse', 208, -1, 176, -1, 2.4098864741972648e-05), (987515173, 1982, 'Teint_Dans_La_Masse', 240, -1, 176, -1, 3.5458331694826484e-05), (987515173, 1982, 'Teint_Dans_La_Masse', 272, -1, 176, -1, 7.947169797262177e-05), (987515173, 1982, 'Teint_Dans_La_Masse', 304, -1, 176, -1, 0.00010088772978633642), (987515173, 1982, 'Teint_Dans_La_Masse', 336, -1, 176, -1, 0.0003758094971999526), (987515173, 1982, 'Teint_Dans_La_Masse', 112, -1, 208, -1, 1.505455747974338e-05), (987515173, 1982, 'Teint_Dans_La_Masse', 144, -1, 208, -1, 1.4635437537435791e-06), (987515173, 1982, 'Teint_Dans_La_Masse', 176, -1, 208, -1, 4.7228372750396375e-06), (987515173, 1982, 'Teint_Dans_La_Masse', 208, -1, 208, -1, 3.8325911191350315e-06), (987515173, 1982, 'Teint_Dans_La_Masse', 240, -1, 208, -1, 3.5922296319768066e-06), (987515173, 1982, 'Teint_Dans_La_Masse', 272, -1, 208, -1, 1.1672076652757823e-05), (987515173, 1982, 'Teint_Dans_La_Masse', 304, -1, 208, -1, 1.3421738003671635e-05), (987515173, 1982, 'Teint_Dans_La_Masse', 336, -1, 208, -1, 5.938324102316983e-05), (987515173, 1982, 'Teint_Dans_La_Masse', 112, -1, 240, -1, 4.1709306970005855e-05), (987515173, 1982, 'Teint_Dans_La_Masse', 144, -1, 240, -1, 5.331648935680278e-06), (987515173, 1982, 'Teint_Dans_La_Masse', 176, -1, 240, -1, 3.8959392441029195e-06), (987515173, 1982, 'Teint_Dans_La_Masse', 208, -1, 240, -1, 2.4257865334220696e-06), (987515173, 1982, 'Teint_Dans_La_Masse', 240, -1, 240, -1, 5.766920821770327e-06), (987515173, 1982, 'Teint_Dans_La_Masse', 272, -1, 240, -1, 2.105739440594334e-05), (987515173, 1982, 'Teint_Dans_La_Masse', 304, -1, 240, -1, 1.7739739632816054e-05), (987515173, 1982, 'Teint_Dans_La_Masse', 336, -1, 240, -1, 2.287948882440105e-05), (987515173, 1982, 'Teint_Dans_La_Masse', 112, -1, 272, -1, 0.00020044486154802144), (987515173, 1982, 'Teint_Dans_La_Masse', 144, -1, 272, -1, 6.678612407995388e-05), (987515173, 1982, 'Teint_Dans_La_Masse', 176, -1, 272, -1, 4.345419438323006e-05), (987515173, 1982, 'Teint_Dans_La_Masse', 208, -1, 272, -1, 1.4597423614759464e-05), (987515173, 1982, 'Teint_Dans_La_Masse', 240, -1, 272, -1, 7.097452453308506e-06), (987515173, 1982, 'Teint_Dans_La_Masse', 272, -1, 272, -1, 1.5360610632342286e-05), (987515173, 1982, 'Teint_Dans_La_Masse', 304, -1, 272, -1, 1.5401941709569655e-05), (987515173, 1982, 'Teint_Dans_La_Masse', 336, -1, 272, -1, 0.00010421417391626164), (987515173, 1982, 'Teint_Dans_La_Masse', 112, -1, 304, -1, 9.493271500105038e-05), (987515173, 1982, 'Teint_Dans_La_Masse', 144, -1, 304, -1, 0.00010995937191182747), (987515173, 1982, 'Teint_Dans_La_Masse', 176, -1, 304, -1, 0.00015807031013537198), (987515173, 1982, 'Teint_Dans_La_Masse', 208, -1, 304, -1, 0.0005429694429039955), (987515173, 1982, 'Teint_Dans_La_Masse', 240, -1, 304, -1, 0.002339977538213134), (987515173, 1982, 'Teint_Dans_La_Masse', 272, -1, 304, -1, 0.007443092297762632), (987515173, 1982, 'Teint_Dans_La_Masse', 304, -1, 304, -1, 0.005845243111252785), (987515173, 1982, 'Teint_Dans_La_Masse', 336, -1, 304, -1, 0.004442479927092791), (987515173, 1982, 'Teint_Dans_La_Masse', 112, -1, 336, -1, 0.00024110640515573323), (987515173, 1982, 'Teint_Dans_La_Masse', 144, -1, 336, -1, 0.0020081577822566032), (987515173, 1982, 'Teint_Dans_La_Masse', 176, -1, 336, -1, 0.0007497547776438296), (987515173, 1982, 'Teint_Dans_La_Masse', 208, -1, 336, -1, 0.003356361761689186), (987515173, 1982, 'Teint_Dans_La_Masse', 240, -1, 336, -1, 0.06400793790817261), (987515173, 1982, 'Teint_Dans_La_Masse', 272, -1, 336, -1, 0.03825811296701431), (987515173, 1982, 'Teint_Dans_La_Masse', 304, -1, 336, -1, 0.03889764845371246), (987515173, 1982, 'Teint_Dans_La_Masse', 336, -1, 336, -1, 0.005877725780010223), (987515173, 1982, 'autre_refus', 112, -1, 112, -1, 5.834029370710425e-10), (987515173, 1982, 'autre_refus', 144, -1, 112, -1, 2.0602117345447368e-08), (987515173, 1982, 'autre_refus', 176, -1, 112, -1, 1.433396278116561e-06), (987515173, 1982, 'autre_refus', 208, -1, 112, -1, 9.267325367545709e-05), (987515173, 1982, 'autre_refus', 240, -1, 112, -1, 0.00021654520242009312), (987515173, 1982, 'autre_refus', 272, -1, 112, -1, 0.0017405332764610648), (987515173, 1982, 'autre_refus', 304, -1, 112, -1, 0.017670197412371635), (987515173, 1982, 'autre_refus', 336, -1, 112, -1, 0.0090212132781744), (987515173, 1982, 'autre_refus', 112, -1, 144, -1, 9.155830298368528e-07), (987515173, 1982, 'autre_refus', 144, -1, 144, -1, 2.9137170258763945e-06), (987515173, 1982, 'autre_refus', 176, -1, 144, -1, 1.0336477316741366e-05), (987515173, 1982, 'autre_refus', 208, -1, 144, -1, 0.0001345006749033928), (987515173, 1982, 'autre_refus', 240, -1, 144, -1, 0.00034747060271911323), (987515173, 1982, 'autre_refus', 272, -1, 144, -1, 0.004944386426359415), (987515173, 1982, 'autre_refus', 304, -1, 144, -1, 0.04334375262260437), (987515173, 1982, 'autre_refus', 336, -1, 144, -1, 0.09542225301265717), (987515173, 1982, 'autre_refus', 112, -1, 176, -1, 1.5147723388508894e-05), (987515173, 1982, 'autre_refus', 144, -1, 176, -1, 0.00012741713726427406), (987515173, 1982, 'autre_refus', 176, -1, 176, -1, 0.00023687219072598964), (987515173, 1982, 'autre_refus', 208, -1, 176, -1, 0.0008085939916782081), (987515173, 1982, 'autre_refus', 240, -1, 176, -1, 0.0006565107614733279), (987515173, 1982, 'autre_refus', 272, -1, 176, -1, 0.004308648407459259), (987515173, 1982, 'autre_refus', 304, -1, 176, -1, 0.02334536425769329), (987515173, 1982, 'autre_refus', 336, -1, 176, -1, 0.018527962267398834), (987515173, 1982, 'autre_refus', 112, -1, 208, -1, 8.839317160891369e-05), (987515173, 1982, 'autre_refus', 144, -1, 208, -1, 0.00018574082059785724), (987515173, 1982, 'autre_refus', 176, -1, 208, -1, 0.0003185727109666914), (987515173, 1982, 'autre_refus', 208, -1, 208, -1, 0.0003576175950001925), (987515173, 1982, 'autre_refus', 240, -1, 208, -1, 0.0001959709043148905), (987515173, 1982, 'autre_refus', 272, -1, 208, -1, 0.0002866119029931724), (987515173, 1982, 'autre_refus', 304, -1, 208, -1, 0.00020335461886133999), (987515173, 1982, 'autre_refus', 336, -1, 208, -1, 0.00024350958119612187), (987515173, 1982, 'autre_refus', 112, -1, 240, -1, 0.0002360981743549928), (987515173, 1982, 'autre_refus', 144, -1, 240, -1, 0.00010847541852854192), (987515173, 1982, 'autre_refus', 176, -1, 240, -1, 6.490483065135777e-05), (987515173, 1982, 'autre_refus', 208, -1, 240, -1, 2.529977609810885e-05), (987515173, 1982, 'autre_refus', 240, -1, 240, -1, 7.294115494005382e-05), (987515173, 1982, 'autre_refus', 272, -1, 240, -1, 0.00014021786046214402), (987515173, 1982, 'autre_refus', 304, -1, 240, -1, 8.945826266426593e-05), (987515173, 1982, 'autre_refus', 336, -1, 240, -1, 8.289203833555803e-05), (987515173, 1982, 'autre_refus', 112, -1, 272, -1, 0.0002676252042874694), (987515173, 1982, 'autre_refus', 144, -1, 272, -1, 0.00011144334712298587), (987515173, 1982, 'autre_refus', 176, -1, 272, -1, 0.00012453059025574476), (987515173, 1982, 'autre_refus', 208, -1, 272, -1, 5.121962385601364e-05), (987515173, 1982, 'autre_refus', 240, -1, 272, -1, 2.922762905654963e-05), (987515173, 1982, 'autre_refus', 272, -1, 272, -1, 4.27944069087971e-05), (987515173, 1982, 'autre_refus', 304, -1, 272, -1, 6.831809878349304e-05), (987515173, 1982, 'autre_refus', 336, -1, 272, -1, 0.00014196991105563939), (987515173, 1982, 'autre_refus', 112, -1, 304, -1, 0.00011545980669325218), (987515173, 1982, 'autre_refus', 144, -1, 304, -1, 0.000217922730371356), (987515173, 1982, 'autre_refus', 176, -1, 304, -1, 0.00042608188232406974), (987515173, 1982, 'autre_refus', 208, -1, 304, -1, 0.00042769924039021134), (987515173, 1982, 'autre_refus', 240, -1, 304, -1, 6.571278208866715e-05), (987515173, 1982, 'autre_refus', 272, -1, 304, -1, 3.172958531649783e-05), (987515173, 1982, 'autre_refus', 304, -1, 304, -1, 1.1687313417496625e-05), (987515173, 1982, 'autre_refus', 336, -1, 304, -1, 1.8889093553298153e-05), (987515173, 1982, 'autre_refus', 112, -1, 336, -1, 0.0002475624205544591), (987515173, 1982, 'autre_refus', 144, -1, 336, -1, 0.00046979915350675583), (987515173, 1982, 'autre_refus', 176, -1, 336, -1, 0.0003355757798999548), (987515173, 1982, 'autre_refus', 208, -1, 336, -1, 0.00023737932497169822), (987515173, 1982, 'autre_refus', 240, -1, 336, -1, 0.00010660426778485999), (987515173, 1982, 'autre_refus', 272, -1, 336, -1, 9.579621837474406e-05), (987515173, 1982, 'autre_refus', 304, -1, 336, -1, 0.00013162456161808223), (987515173, 1982, 'autre_refus', 336, -1, 336, -1, 0.0007313883397728205)]} ############################### TEST certificat_qualite_papier ################################ TEST certificat qualite papier Inside batchDatouExec : verbose : True ##### chargement datou SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=1848 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=1848 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 1848 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=1848 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! Step 4442 tile have less inputs used (1) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 4441 detect_points is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 4443 count_percent_refus is not consistent : 4 used against 3 in the step definition ! Step 4444 send_mail_dechet have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : output 1 of step 4440 have datatype=1 whereas input 0 of step 4443 have datatype=2 WARNING : type of output 1 of step 4441 doesn't seem to be define in the database( WARNING : type of input 4 of step 4443 doesn't seem to be define in the database( DataTypes for each output/input checked ! no param json to modify List Step Type Loaded in datou : init_dechet, tile, detect_points, count_percent_refus, brightness, blur_detection, send_mail_dechet list_input_json : [] ##### fin chargement datou ##### chargement data ##### Call load_data_input : nb_thread : 5 origin SELECT ph.photo_id, ph.url FROM MTRBack.photos ph WHERE ph.photo_id IN (SELECT mtr_photo_id from MTRUser.mtr_portfolio_photos WHERE mtr_portfolio_id in (1902940) and hide_status = 0 ) ORDER BY ph.photo_id DESC LIMIT 0, 10000 Catched exception ! Connect or reconnect ! (1114, "The table '/tmp/#sqla9606_3483d4_0' is full") ERROR certificat_qualite_papier FAILED ############################### TEST image_temperature_detection ################################ t Inside batchDatouExec : verbose : True ##### chargement datou SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=1807 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=1807 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 1807 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=1807 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! no param json to modify List Step Type Loaded in datou : image_temperature_detection list_input_json : [] ##### fin chargement datou ##### chargement data ##### Call load_data_input : nb_thread : 5 origin SELECT photo_id, url FROM MTRBack.photos ph WHERE photo_id IN (984484223) Found this number of photos: 1 ##### Call download_photos : nb_thread : 5 begin to download photo : 984484223 download finish for photo 984484223 we have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB ##### After download_photos length of list_filenames : 1 ; length of list_pids : 1 ; length of list_args : 1 ##### After load_data_input time to download the photos : 0.24105477333068848 #### fin chargement data Blocking on flush ? No conitnuing About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : True number of steps : 1 step1:image_temperature_detection Mon Apr 14 04:34:21 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec After prepare type args : Here we display some param of map_info ! map_filenames : {'temp/1744598061_648272_984484223_2e25dc219a9a57a9f85bcae482a80c35.jpg': 984484223} map_photo_id_path_extension : {984484223: {'path': 'temp/1744598061_648272_984484223_2e25dc219a9a57a9f85bcae482a80c35.jpg', 'extension': 'jpg'}} map_subphoto_mainphoto : {} inside step blanche_jaune_detection treat image : temp/1744598061_648272_984484223_2e25dc219a9a57a9f85bcae482a80c35.jpg 984484223 1.004309911525615 After datou_step_exec type output : time spend for datou_step_exec : 0.17664670944213867 time spend to save output : 6.270408630371094e-05 total time spend for step 1 : 0.17670941352844238 caffe_path_current : About to save ! 0 After save, about to update current ! datou_cur_ids : [] len(datou.list_steps) : 1 output : {984484223: [(984484223, 1.004309911525615, 492630606)]} {984484223: [(984484223, 1.004309911525615, 492630606)]} ############################### TEST broca ################################ t Inside batchDatouExec : verbose : True ##### chargement datou SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4041 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4041 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4041 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4041 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! no param json to modify List Step Type Loaded in datou : split_time_score list_input_json : [] ##### fin chargement datou ##### chargement data ##### Call load_data_input : nb_thread : 5 origin SELECT ph.photo_id, ph.url FROM MTRBack.photos ph WHERE ph.photo_id IN (SELECT mtr_photo_id from MTRUser.mtr_portfolio_photos WHERE mtr_portfolio_id in (5205529) and hide_status = 0 ) ORDER BY ph.photo_id DESC LIMIT 0, 10000 Catched exception ! Connect or reconnect ! (1114, "The table '/tmp/#sqla9606_348481_0' is full") ERROR broca FAILED ############################### TEST crop_conditional ################################ t Inside batchDatouExec : verbose : True ##### chargement datou SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=719 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=719 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 719 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=719 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : step 1335 frcnn is not linked in the step_by_step architecture ! WARNING : step 1336 crop_condition is not linked in the step_by_step architecture ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! DataTypes for each output/input checked ! no param json to modify List Step Type Loaded in datou : frcnn, crop_condition list_input_json : [] ##### fin chargement datou ##### chargement data ##### Call load_data_input : nb_thread : 5 origin SELECT ph.photo_id, ph.url FROM MTRBack.photos ph WHERE ph.photo_id IN (SELECT mtr_photo_id from MTRUser.mtr_portfolio_photos WHERE mtr_portfolio_id in (1981316) and hide_status = 0 ) ORDER BY ph.photo_id DESC LIMIT 0, 10000 Catched exception ! Connect or reconnect ! (1114, "The table '/tmp/#sqla9606_3484a1_0' is full") ERROR crop_conditional FAILED ############################### TEST image_blanchir ################################ Inside batchDatouExec : verbose : True ##### chargement datou SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=1818 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=1818 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 1818 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=1818 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! no param json to modify List Step Type Loaded in datou : image_blanchir list_input_json : [] ##### fin chargement datou ##### chargement data ##### Call load_data_input : nb_thread : 5 origin SELECT photo_id, url FROM MTRBack.photos ph WHERE photo_id IN (990111206) Found this number of photos: 1 ##### Call download_photos : nb_thread : 5 begin to download photo : 990111206 download finish for photo 990111206 we have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB ##### After download_photos length of list_filenames : 1 ; length of list_pids : 1 ; length of list_args : 1 ##### After load_data_input time to download the photos : 0.587491512298584 #### fin chargement data Blocking on flush ? No conitnuing About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! WARNING : we have an input that is not a photo, we should get rid of it Calling datou_exec Inside datou_exec : verbose : True number of steps : 1 step1:image_blanchir Mon Apr 14 04:34:22 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec After prepare type args : Here we display some param of map_info ! map_filenames : {'temp/1744598062_648272_990111206_7ca22c7e68dd0a10509c7987af0cf549.png': 990111206} map_photo_id_path_extension : {990111206: {'path': 'temp/1744598062_648272_990111206_7ca22c7e68dd0a10509c7987af0cf549.png', 'extension': 'png'}} map_subphoto_mainphoto : {} inside step blanchir_image https://marlene.fotonower.com/api/v1/secured/portfolio/new?access_token=78d09a0790ec6ecbf119343125a81fdc feed_id_new_photos:22346567 treat image : temp/1744598062_648272_990111206_7ca22c7e68dd0a10509c7987af0cf549.png blanchir func in upload media Upload medias : ['temp/1744598062_648272_990111206_7ca22c7e68dd0a10509c7987af0cf549.png'] : url : https://marlene.fotonower.com/api/v1/secured/photo/upload?token=78d09a0790ec6ecbf119343125a81fdc&datou=0 temp/1744598062_648272_990111206_7ca22c7e68dd0a10509c7987af0cf549.png after data_to_send, before sending request after request b'\n\n\n\n\t\n\t\tError\n\t\t\n\t \n\t\n\t\n\t\t

Oops, an error occured

\n\n\t\t

\n\t\t\tThis exception has been logged with id 895chmjp5.\n\t\t

\n\n\t\n\n\n\n\n\n\n\n\n' 500 This exception has been logged with id 895chmjp5. ERROR in datou_step_exec, will save and exit ! 'temp/1744598062_648272_990111206_7ca22c7e68dd0a10509c7987af0cf549.png' File "/home/admin/workarea/git/Velours/python/mtr/datou/datou_lib.py", line 2329, in datou_exec output = datou_step_exec(sNext, args, cache, context, map_info, verbose, mtr_user_id) File "/home/admin/workarea/git/Velours/python/mtr/datou/datou_lib.py", line 2568, in datou_step_exec return pre_process.datou_step_exec_image_blanchir_et_save(param, json_param, args, context, map_info, verbose) File "/home/admin/workarea/git/Velours/python/mtr/datou/lib_step_exec/lib_step_pre_processing.py", line 1499, in datou_step_exec_image_blanchir_et_save list_value_to_insert.append((map_info['map_filenames'][img_path], map_result_insert_aux[new_path], 0, m-1, 0, n-1, 1, 1, "blanc")) [990111206] map_info['map_portfolio_photo'] : {} final : True mtd_id 1818 list_pids : [990111206] begin to insert list_values into mtr_datou_result : length of list_values in save_final : 1 insert ignore into MTRPhoto.mtr_datou_result (mtd_id, mtr_portfolio_id,mtr_photo_id,result,result_long,result_double,hashtag_id,proba, mtr_current_id) values (%s,%s,%s,%s,%s,%s,%s,%s,%s) on duplicate key update mtr_portfolio_id = mtr_portfolio_id list_values : [('1818', None, '990111206', '[>, , , , , "\'temp/1744598062_648272_990111206_7ca22c7e68dd0a10509c7987af0cf549.png\'"]', '-1', '-1.0', '501120777', '1.0', None)] time used for this insertion : 0.012104034423828125 save_final ERROR in last step image_blanchir, 'temp/1744598062_648272_990111206_7ca22c7e68dd0a10509c7987af0cf549.png' time spend for datou_step_exec : 69.48709273338318 time spend to save output : 0.018407583236694336 total time spend for step 0 : 69.50550031661987 Useless call to update_current_state caffe_path_current : About to save ! 1 Inside saveOutput : final : True verbose : True ouput is None saving photo_ids in datou_result photo id not in port begin to insert list_values into mtr_datou_result : length of list_values in save_final : 0 insert ignore into MTRPhoto.mtr_datou_result (mtd_id, mtr_portfolio_id,mtr_photo_id,result,result_long,result_double,hashtag_id,proba, mtr_current_id) values (%s,%s,%s,%s,%s,%s,%s,%s,%s) on duplicate key update mtr_portfolio_id = mtr_portfolio_id list_values : [] time used for this insertion : 3.5762786865234375e-06 After save, about to update current ! datou_cur_ids : [] len(datou.list_steps) : 1 output : None None 'NoneType' object is not subscriptable ERROR image_blanchir FAILED ############################### TEST darker_image ################################ Inside batchDatouExec : verbose : True ##### chargement datou SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=2085 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=2085 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 2085 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=2085 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! no param json to modify List Step Type Loaded in datou : darker_image list_input_json : [] ##### fin chargement datou ##### chargement data ##### Call load_data_input : nb_thread : 5 origin SELECT ph.photo_id, ph.url FROM MTRBack.photos ph WHERE ph.photo_id IN (SELECT mtr_photo_id from MTRUser.mtr_portfolio_photos WHERE mtr_portfolio_id in (2077915) and hide_status = 0 ) ORDER BY ph.photo_id DESC LIMIT 0, 10000 Catched exception ! Connect or reconnect ! (1114, "The table '/tmp/#sqla9606_34a7fe_0' is full") ERROR darker_image FAILED ############################### TEST img_aug ################################ Inside batchDatouExec : verbose : True ##### chargement datou SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=2041 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=2041 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 2041 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=2041 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! no param json to modify List Step Type Loaded in datou : data_aug list_input_json : [] ##### fin chargement datou ##### chargement data ##### Call load_data_input : nb_thread : 5 origin SELECT ph.photo_id, ph.url FROM MTRBack.photos ph WHERE ph.photo_id IN (SELECT mtr_photo_id from MTRUser.mtr_portfolio_photos WHERE mtr_portfolio_id in (2077915) and hide_status = 0 ) ORDER BY ph.photo_id DESC LIMIT 0, 10000 Catched exception ! Connect or reconnect ! (1114, "The table '/tmp/#sqla9606_34a81d_0' is full") ERROR img_aug FAILED ############################### TEST rubbia ################################ warning , we can't find thcl infos in json_data warning , we can't find pdt infos in json_data Inside batchDatouExec : verbose : True ##### chargement datou SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3789 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3789 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3789 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3789 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! no param json to modify List Step Type Loaded in datou : split_time_score list_input_json : [] ##### fin chargement datou ##### chargement data ##### Call load_data_input : nb_thread : 5 origin SELECT ph.photo_id, ph.url FROM MTRBack.photos ph WHERE ph.photo_id IN (SELECT mtr_photo_id from MTRUser.mtr_portfolio_photos WHERE mtr_portfolio_id in (4599398) and hide_status = 0 ) ORDER BY ph.photo_id DESC LIMIT 0, 10000 Catched exception ! Connect or reconnect ! (1114, "The table '/tmp/#sqla9606_34a859_0' is full") ERROR rubbia FAILED ############################### TEST rubbia_split_dark ################################ warning , we can't find thcl infos in json_data warning , we can't find pdt infos in json_data Inside batchDatouExec : verbose : True ##### chargement datou SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3787 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3787 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3787 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3787 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! no param json to modify List Step Type Loaded in datou : split_time_score_with_photo list_input_json : [] ##### fin chargement datou ##### chargement data ##### Call load_data_input : nb_thread : 5 origin SELECT ph.photo_id, ph.url FROM MTRBack.photos ph WHERE ph.photo_id IN (SELECT mtr_photo_id from MTRUser.mtr_portfolio_photos WHERE mtr_portfolio_id in (4608689) and hide_status = 0 ) ORDER BY ph.photo_id DESC LIMIT 0, 10000 Catched exception ! Connect or reconnect ! (1114, "The table '/tmp/#sqla9606_34a89b_0' is full") ERROR rubbia_split_dark FAILED ############################### TEST rubbia_append ################################ warning , we can't find thcl infos in json_data warning , we can't find pdt infos in json_data Catched exception ! Connect or reconnect ! (1205, 'Lock wait timeout exceeded; try restarting transaction') ERROR rubbia_append FAILED ############################### TEST rubbia_horaire ################################ warning , we can't find thcl infos in json_data warning , we can't find pdt infos in json_data Inside batchDatouExec : verbose : True ##### chargement datou SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3181 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3181 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3181 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3181 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! no param json to modify List Step Type Loaded in datou : split_time_score list_input_json : [] ##### fin chargement datou ##### chargement data ##### Call load_data_input : nb_thread : 5 origin SELECT ph.photo_id, ph.url FROM MTRBack.photos ph WHERE ph.photo_id IN (SELECT mtr_photo_id from MTRUser.mtr_portfolio_photos WHERE mtr_portfolio_id in (3609515) and hide_status = 0 ) ORDER BY ph.photo_id DESC LIMIT 0, 10000 Catched exception ! Connect or reconnect ! (1114, "The table '/tmp/#sqla9606_34c304_0' is full") ERROR rubbia_horaire FAILED ############################### TEST rle_unique_nms_with_priority ################################ t SELECT id FROM MTRPhoto.crop_hashtag_ids WHERE photo_id=998957128 AND `type`=2805 DELETE FROM MTRPhoto.crop_hashtag_ids WHERE id IN (3766822608,3766822609,3766822610,3766822611,3766822612,3766822613,3766822614,3766822615,3766822616,3766822617) Catched exception ! Connect or reconnect ! (1205, 'Lock wait timeout exceeded; try restarting transaction') ERROR rle_unique_nms_with_priority FAILED ############################### TEST random_deformation ################################ Inside batchDatouExec : verbose : True ##### chargement datou SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=2896 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=2896 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 2896 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=2896 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! no param json to modify List Step Type Loaded in datou : random_deformation list_input_json : [] ##### fin chargement datou ##### chargement data ##### Call load_data_input : nb_thread : 5 origin SELECT ph.photo_id, ph.url FROM MTRBack.photos ph WHERE ph.photo_id IN (SELECT mtr_photo_id from MTRUser.mtr_portfolio_photos WHERE mtr_portfolio_id in (3288640) and hide_status = 0 ) ORDER BY ph.photo_id DESC LIMIT 0, 10000 Catched exception ! Connect or reconnect ! (1114, "The table '/tmp/#sqla9606_35e29e_0' is full") ERROR random_deformation FAILED ############################### TEST tile ################################ test tile avec chi rectangles, rles, polygones Inside batchDatouExec : verbose : True ##### chargement datou SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=2985 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=2985 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 2985 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=2985 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! no param json to modify List Step Type Loaded in datou : tile list_input_json : [] ##### fin chargement datou ##### chargement data ##### Call load_data_input : nb_thread : 5 origin SELECT ph.photo_id, ph.url FROM MTRBack.photos ph WHERE ph.photo_id IN (SELECT mtr_photo_id from MTRUser.mtr_portfolio_photos WHERE mtr_portfolio_id in (3341855) and hide_status = 0 ) ORDER BY ph.photo_id DESC LIMIT 0, 10000 Catched exception ! Connect or reconnect ! (1114, "The table '/tmp/#sqla9606_35e2dc_0' is full") ############################### TEST rotate_chi ################################ test rotate avec chi rectangles, rles, polygones Inside batchDatouExec : verbose : True ##### chargement datou SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=2970 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=2970 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 2970 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=2970 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! no param json to modify List Step Type Loaded in datou : rotate list_input_json : [] ##### fin chargement datou ##### chargement data ##### Call load_data_input : nb_thread : 5 origin SELECT ph.photo_id, ph.url FROM MTRBack.photos ph WHERE ph.photo_id IN (SELECT mtr_photo_id from MTRUser.mtr_portfolio_photos WHERE mtr_portfolio_id in (3337029) and hide_status = 0 ) ORDER BY ph.photo_id DESC LIMIT 0, 10000 Catched exception ! Connect or reconnect ! (1114, "The table '/tmp/#sqla9606_35e302_0' is full") Ayatollah of tests excluded it ! (Bon le prochain developpeur qui passe ici peut enlever ayatollah VR 11-2-21) name : rubbia_carac_pet_clair_0121 not run because too long ############################### TEST rubbia_carac_pet_clair_0121_no_cnn ################################ Inside batchDatouExec : verbose : True ##### chargement datou SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=2719 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=2719 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 2719 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=2719 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 6479 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 6480 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7445 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 6509 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 6479 doesn't seem to be define in the database( WARNING : type of input 1 of step 6480 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 6479 doesn't seem to be define in the database( WARNING : type of input 1 of step 7445 doesn't seem to be define in the database( WARNING : type of output 1 of step 7445 doesn't seem to be define in the database( WARNING : type of input 3 of step 6509 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! DataTypes for each output/input checked ! no param json to modify List Step Type Loaded in datou : merge_mask_thcl_custom, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final list_input_json : [] ##### fin chargement datou ##### chargement data ##### Call load_data_input : nb_thread : 5 origin SELECT ph.photo_id, ph.url FROM MTRBack.photos ph WHERE ph.photo_id IN (SELECT mtr_photo_id from MTRUser.mtr_portfolio_photos WHERE mtr_portfolio_id in (3373196) and hide_status = 0 ) ORDER BY ph.photo_id DESC LIMIT 0, 10000 Catched exception ! Connect or reconnect ! (1114, "The table '/tmp/#sqla9606_35e329_0' is full") ERROR rubbia_carac_pet_clair_0121_no_cnn FAILED ############################### TEST rubbia_carac_jrm_no_mask_detect ################################ Inside batchDatouExec : verbose : True ##### chargement datou SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3164 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3164 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3164 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3164 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! Step 7557 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 7556 argmax have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 7561 merge_mask_and_thcl is not consistent : 3 used against 1 in the step definition ! WARNING : number of inputs for step 7558 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7560 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7559 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7560 doesn't seem to be define in the database( WARNING : type of input 3 of step 7559 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7556 have datatype=6 whereas input 0 of step 7561 have datatype=20 WARNING : type of output 1 of step 7561 doesn't seem to be define in the database( WARNING : type of input 1 of step 7558 doesn't seem to be define in the database( WARNING : type of output 2 of step 7561 doesn't seem to be define in the database( WARNING : type of input 1 of step 7560 doesn't seem to be define in the database( DataTypes for each output/input checked ! no param json to modify List Step Type Loaded in datou : crop_condition, thcl, argmax, merge_mask_and_thcl, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final list_input_json : [] ##### fin chargement datou ##### chargement data ##### Call load_data_input : nb_thread : 5 origin SELECT ph.photo_id, ph.url FROM MTRBack.photos ph WHERE ph.photo_id IN (SELECT mtr_photo_id from MTRUser.mtr_portfolio_photos WHERE mtr_portfolio_id in (3364276) and hide_status = 0 ) ORDER BY ph.photo_id DESC LIMIT 0, 10000 Catched exception ! Connect or reconnect ! (1114, "The table '/tmp/#sqla9606_35e334_0' is full") ERROR rubbia_carac_jrm_no_mask_detect FAILED ############################### TEST ventilate_hashtags_in_portfolio ################################ DELETE FROM MTRUser.mtr_portfolio_photos where mtr_portfolio_id = 5486631; Catched exception ! Connect or reconnect ! (1205, 'Lock wait timeout exceeded; try restarting transaction') ERROR ventilate_hashtags_in_portfolio FAILED Ayatollah of tests excluded it ! (Bon le prochain developpeur qui passe ici peut enlever ayatollah VR 11-2-21) name : merge_qualipapia_like not run because too long ############################### TEST poly_ro_rle ################################ test creation de rle a partir de polygon Inside batchDatouExec : verbose : True ##### chargement datou SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3138 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3138 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3138 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3138 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! no param json to modify List Step Type Loaded in datou : poly_to_rle list_input_json : [] ##### fin chargement datou ##### chargement data ##### Call load_data_input : nb_thread : 5 origin SELECT ph.photo_id, ph.url FROM MTRBack.photos ph WHERE ph.photo_id IN (SELECT mtr_photo_id from MTRUser.mtr_portfolio_photos WHERE mtr_portfolio_id in (3337029) and hide_status = 0 ) ORDER BY ph.photo_id DESC LIMIT 0, 10000 Catched exception ! Connect or reconnect ! (1114, "The table '/tmp/#sqla9606_35fc46_0' is full") ############################### TEST cod_sts ################################ warning , we can't find thcl infos in json_data warning , we can't find pdt infos in json_data Inside batchDatouExec : verbose : True ##### chargement datou SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3781 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3781 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3781 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3781 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! no param json to modify List Step Type Loaded in datou : split_time_score list_input_json : [] ##### fin chargement datou ##### chargement data ##### Call load_data_input : nb_thread : 5 origin SELECT ph.photo_id, ph.url FROM MTRBack.photos ph WHERE ph.photo_id IN (SELECT mtr_photo_id from MTRUser.mtr_portfolio_photos WHERE mtr_portfolio_id in (4453840) and hide_status = 0 ) ORDER BY ph.photo_id DESC LIMIT 0, 10000 Catched exception ! Connect or reconnect ! (1114, "The table '/tmp/#sqla9606_35fc62_0' is full") ERROR cod_sts FAILED ############################### TEST cod_download ################################ warning , we can't find thcl infos in json_data warning , we can't find pdt infos in json_data [] [] ############################### TEST sendgrid ################################ test sendgrid senders@fotonower.com no problem of authentification, for test if the email can be received, try with a real receiver fin du test de sendgrid ############################### TEST rym_consolidate ################################ test_rym_consolidate DELETE FROM MTRUser.portfolio_carac_ratio WHERE portfolio_id = 4709558 AND hashtag_type = 4016 Catched exception ! Connect or reconnect ! (1205, 'Lock wait timeout exceeded; try restarting transaction') ERROR rym_consolidate FAILED ############################### TEST generate_new_image_add_crop ################################ test_generate_new_image_add_crop DELETE FROM MTRUser.mtr_portfolio_photos WHERE mtr_portfolio_id = 4789106 DELETE FROM MTRPhoto.crop_hashtag_ids WHERE type = 4086 Catched exception ! Connect or reconnect ! (1205, 'Lock wait timeout exceeded; try restarting transaction') ERROR generate_new_image_add_crop FAILED ############################### TEST velours_tree ################################ test velours_tree - Retrieving photos to tag... query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=4837217 ORDER BY ph.size desc - Loading descriptors... Size : 512 len(descriptors) : 5 Compute structured hierarchical clustering... ward : AgglomerativeClustering(n_clusters=5) ward.labels_ : [4 3 2 1 0] Elapsed time: 0.004060983657836914 graph_id used : 1145 - Beta version, working pretty good on 11-5-16 ! fin du test de velours_tree ############################### TEST step ACP ################################ Inside batchDatouExec : verbose : True ##### chargement datou SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4208 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4208 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4208 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4208 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! no param json to modify List Step Type Loaded in datou : acp list_input_json : [] ##### fin chargement datou ##### chargement data ##### Call load_data_input : nb_thread : 5 origin SELECT ph.photo_id, ph.url FROM MTRBack.photos ph WHERE ph.photo_id IN (SELECT mtr_photo_id from MTRUser.mtr_portfolio_photos WHERE mtr_portfolio_id in (5709050) and hide_status = 0 ) ORDER BY ph.photo_id DESC LIMIT 0, 10000 Catched exception ! Connect or reconnect ! (1114, "The table '/tmp/#sqla9606_3632b6_0' is full") ############################### TEST blur_crop ################################ Inside batchDatouExec : verbose : True ##### chargement datou SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3990 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3990 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3990 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3990 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! no param json to modify List Step Type Loaded in datou : crop_condition list_input_json : [] ##### fin chargement datou ##### chargement data ##### Call load_data_input : nb_thread : 5 origin SELECT ph.photo_id, ph.url FROM MTRBack.photos ph WHERE ph.photo_id IN (SELECT mtr_photo_id from MTRUser.mtr_portfolio_photos WHERE mtr_portfolio_id in (6135916) and hide_status = 0 ) ORDER BY ph.photo_id DESC LIMIT 0, 10000 Catched exception ! Connect or reconnect ! (1114, "The table '/tmp/#sqla9606_3632e6_0' is full") ############################### TEST pma_consolidate ################################ update MTRUser.mtr_portfolio_photos set hide_status=1 where mtr_portfolio_id in ( select mtr_portfolio_id_2 from MTRPhoto.mtr_port_to_port_ids where mtr_portfolio_id_1 = 9778120) Catched exception ! Connect or reconnect ! (1205, 'Lock wait timeout exceeded; try restarting transaction') ERROR pma_consolidate FAILED ############################### TEST pma_ventilate ################################ delete from MTRUser.mtr_portfolio_photos where mtr_portfolio_id in ( select mtr_portfolio_id_2 from MTRPhoto.mtr_port_to_port_ids where mtr_portfolio_id_1 = 9974548); Catched exception ! Connect or reconnect ! (1205, 'Lock wait timeout exceeded; try restarting transaction') ERROR pma_ventilate FAILED [('sam', 'SUCCESS', True), ('frcnn', 'SUCCESS', True), ('thcl', 'SUCCESS', True), ('tfhub2', 'SUCCESS', True), ('ordonner', 'SUCCESS', True), ('rotate', 'FAILURE', False), ('data_augmentation_ellipse_varroa_tile_rotate', 'FAILURE', False), ('flip', 'FAILURE', False), ('crop_rles', 'FAILURE', False), ('angular_coeff', 'SUCCESS', True), ('detection_filter_by_crop', 'SUCCESS', True), ('detection_filter_by_classif', 'FAILURE', False), ('blur_detection', 'success', True), ('detect_point_224x224', 'SUCCESS', True), ('certificat_qualite_papier', 'FAILURE', False), ('image_temperature_detection', 'success', True), ('broca', 'FAILURE', False), ('crop_conditional', 'failed', False), ('image_blanchir', 'FAILURE', False), ('darker_image', 'FAILURE', False), ('img_aug', 'FAILURE', False), ('rubbia', '(1114, "The table \'/tmp/#sqla9606_34a859_0\' is full")', False), ('rubbia_split_dark', '(1114, "The table \'/tmp/#sqla9606_34a89b_0\' is full")', False), ('rubbia_append', 'FAILURE', False), ('rubbia_horaire', '(1114, "The table \'/tmp/#sqla9606_34c304_0\' is full")', False), ('rle_unique_nms_with_priority', 'FAILURE', False), ('random_deformation', 'failed', False), ('tile', 'Success', True), ('rotate_chi', 'Success', True), ('rubbia_carac_pet_clair_0121_no_cnn', 'FAILURE', False), ('rubbia_carac_jrm_no_mask_detect', 'FAILURE', False), ('ventilate_hashtags_in_portfolio', 'FAILURE', False), ('poly_ro_rle', 'Success', True), ('cod_sts', '(1114, "The table \'/tmp/#sqla9606_35fc62_0\' is full")', False), ('cod_download', 'success', True), ('sendgrid', 'Success', True), ('rym_consolidate', 'FAILURE', False), ('generate_new_image_add_crop', 'FAILURE', False), ('velours_tree', 'Success', True), ('step ACP', 'Success', True), ('blur_crop', 'Success', True), ('pma_consolidate', 'FAILURE', False), ('pma_ventilate', 'FAILURE', False)] res_total : False #&_#_#&_# TEST sam SUCCEEDED #&_#_#&_# #&_#_#&_# TEST frcnn SUCCEEDED #&_#_#&_# #&_#_#&_# TEST thcl SUCCEEDED #&_#_#&_# #&_#_#&_# TEST tfhub2 SUCCEEDED #&_#_#&_# #&_#_#&_# TEST ordonner SUCCEEDED #&_#_#&_# #&_#_#&_# TEST rotate FAILED #&_#_#&_# #&_#_#&_# TEST data_augmentation_ellipse_varroa_tile_rotate FAILED #&_#_#&_# #&_#_#&_# TEST flip FAILED #&_#_#&_# #&_#_#&_# TEST crop_rles FAILED #&_#_#&_# #&_#_#&_# TEST angular_coeff SUCCEEDED #&_#_#&_# #&_#_#&_# TEST detection_filter_by_crop SUCCEEDED #&_#_#&_# #&_#_#&_# TEST detection_filter_by_classif FAILED #&_#_#&_# #&_#_#&_# TEST blur_detection SUCCEEDED #&_#_#&_# #&_#_#&_# TEST detect_point_224x224 SUCCEEDED #&_#_#&_# #&_#_#&_# TEST certificat_qualite_papier FAILED #&_#_#&_# #&_#_#&_# TEST image_temperature_detection SUCCEEDED #&_#_#&_# #&_#_#&_# TEST broca FAILED #&_#_#&_# #&_#_#&_# TEST crop_conditional FAILED #&_#_#&_# #&_#_#&_# TEST image_blanchir FAILED #&_#_#&_# #&_#_#&_# TEST darker_image FAILED #&_#_#&_# #&_#_#&_# TEST img_aug FAILED #&_#_#&_# #&_#_#&_# TEST rubbia FAILED #&_#_#&_# #&_#_#&_# TEST rubbia_split_dark FAILED #&_#_#&_# #&_#_#&_# TEST rubbia_append FAILED #&_#_#&_# #&_#_#&_# TEST rubbia_horaire FAILED #&_#_#&_# #&_#_#&_# TEST rle_unique_nms_with_priority FAILED #&_#_#&_# #&_#_#&_# TEST random_deformation FAILED #&_#_#&_# #&_#_#&_# TEST tile SUCCEEDED #&_#_#&_# #&_#_#&_# TEST rotate_chi SUCCEEDED #&_#_#&_# #&_#_#&_# TEST rubbia_carac_pet_clair_0121_no_cnn FAILED #&_#_#&_# #&_#_#&_# TEST rubbia_carac_jrm_no_mask_detect FAILED #&_#_#&_# #&_#_#&_# TEST ventilate_hashtags_in_portfolio FAILED #&_#_#&_# #&_#_#&_# TEST poly_ro_rle SUCCEEDED #&_#_#&_# #&_#_#&_# TEST cod_sts FAILED #&_#_#&_# #&_#_#&_# TEST cod_download SUCCEEDED #&_#_#&_# #&_#_#&_# TEST sendgrid SUCCEEDED #&_#_#&_# #&_#_#&_# TEST rym_consolidate FAILED #&_#_#&_# #&_#_#&_# TEST generate_new_image_add_crop FAILED #&_#_#&_# #&_#_#&_# TEST velours_tree SUCCEEDED #&_#_#&_# #&_#_#&_# TEST step ACP SUCCEEDED #&_#_#&_# #&_#_#&_# TEST blur_crop SUCCEEDED #&_#_#&_# #&_#_#&_# TEST pma_consolidate FAILED #&_#_#&_# #&_#_#&_# TEST pma_ventilate FAILED #&_#_#&_# #&_# TEST FAILED #&_# : tests/datou_test #&_# /home/admin/workarea/git/Velours/python/tests/python_tests.py refs/heads/master_80aab10e0219982fef52d1eae72d1bddac86cb8e SQL :INSERT INTO MTRAdmin.monitor_sys (name, type, server, version_code, result_str, result_bool, lien , test_group ,test_name) VALUES ('python_test3','1','marlene','refs/heads/master_80aab10e0219982fef52d1eae72d1bddac86cb8e','{"sam": "success"}','1','http://marlene.fotonower-preprod.com/job/2025/April/14042025/python_test3//data_2/data_log/job/2025/April/14042025/python_test3/log-python3----short_python3--v--marlene-03:35:00.txt','datou','sam'); /home/admin/workarea/git/Velours/python/tests/python_tests.py refs/heads/master_80aab10e0219982fef52d1eae72d1bddac86cb8e SQL :INSERT INTO MTRAdmin.monitor_sys (name, type, server, version_code, result_str, result_bool, lien , test_group ,test_name) VALUES ('python_test3','1','marlene','refs/heads/master_80aab10e0219982fef52d1eae72d1bddac86cb8e','{"frcnn": "success"}','1','http://marlene.fotonower-preprod.com/job/2025/April/14042025/python_test3//data_2/data_log/job/2025/April/14042025/python_test3/log-python3----short_python3--v--marlene-03:35:00.txt','datou','frcnn'); /home/admin/workarea/git/Velours/python/tests/python_tests.py refs/heads/master_80aab10e0219982fef52d1eae72d1bddac86cb8e SQL :INSERT INTO MTRAdmin.monitor_sys (name, type, server, version_code, result_str, result_bool, lien , test_group ,test_name) VALUES ('python_test3','1','marlene','refs/heads/master_80aab10e0219982fef52d1eae72d1bddac86cb8e','{"thcl": "success"}','1','http://marlene.fotonower-preprod.com/job/2025/April/14042025/python_test3//data_2/data_log/job/2025/April/14042025/python_test3/log-python3----short_python3--v--marlene-03:35:00.txt','datou','thcl'); /home/admin/workarea/git/Velours/python/tests/python_tests.py refs/heads/master_80aab10e0219982fef52d1eae72d1bddac86cb8e SQL :INSERT INTO MTRAdmin.monitor_sys (name, type, server, version_code, result_str, result_bool, lien , test_group ,test_name) VALUES ('python_test3','1','marlene','refs/heads/master_80aab10e0219982fef52d1eae72d1bddac86cb8e','{"tfhub2": "success"}','1','http://marlene.fotonower-preprod.com/job/2025/April/14042025/python_test3//data_2/data_log/job/2025/April/14042025/python_test3/log-python3----short_python3--v--marlene-03:35:00.txt','datou','tfhub2'); /home/admin/workarea/git/Velours/python/tests/python_tests.py refs/heads/master_80aab10e0219982fef52d1eae72d1bddac86cb8e SQL :INSERT INTO MTRAdmin.monitor_sys (name, type, server, version_code, result_str, result_bool, lien , test_group ,test_name) VALUES ('python_test3','1','marlene','refs/heads/master_80aab10e0219982fef52d1eae72d1bddac86cb8e','{"ordonner": "success"}','1','http://marlene.fotonower-preprod.com/job/2025/April/14042025/python_test3//data_2/data_log/job/2025/April/14042025/python_test3/log-python3----short_python3--v--marlene-03:35:00.txt','datou','ordonner'); /home/admin/workarea/git/Velours/python/tests/python_tests.py refs/heads/master_80aab10e0219982fef52d1eae72d1bddac86cb8e SQL :INSERT INTO MTRAdmin.monitor_sys (name, type, server, version_code, result_str, result_bool, lien , test_group ,test_name) VALUES ('python_test3','1','marlene','refs/heads/master_80aab10e0219982fef52d1eae72d1bddac86cb8e','{"rotate": "fail"}','0','http://marlene.fotonower-preprod.com/job/2025/April/14042025/python_test3//data_2/data_log/job/2025/April/14042025/python_test3/log-python3----short_python3--v--marlene-03:35:00.txt','datou','rotate'); /home/admin/workarea/git/Velours/python/tests/python_tests.py refs/heads/master_80aab10e0219982fef52d1eae72d1bddac86cb8e SQL :INSERT INTO MTRAdmin.monitor_sys (name, type, server, version_code, result_str, result_bool, lien , test_group ,test_name) VALUES ('python_test3','1','marlene','refs/heads/master_80aab10e0219982fef52d1eae72d1bddac86cb8e','{"data_augmentation_ellipse_varroa_tile_rotate": "fail"}','0','http://marlene.fotonower-preprod.com/job/2025/April/14042025/python_test3//data_2/data_log/job/2025/April/14042025/python_test3/log-python3----short_python3--v--marlene-03:35:00.txt','datou','data_augmentation_ellipse_varroa_tile_rotate'); /home/admin/workarea/git/Velours/python/tests/python_tests.py refs/heads/master_80aab10e0219982fef52d1eae72d1bddac86cb8e SQL :INSERT INTO MTRAdmin.monitor_sys (name, type, server, version_code, result_str, result_bool, lien , test_group ,test_name) VALUES ('python_test3','1','marlene','refs/heads/master_80aab10e0219982fef52d1eae72d1bddac86cb8e','{"flip": "fail"}','0','http://marlene.fotonower-preprod.com/job/2025/April/14042025/python_test3//data_2/data_log/job/2025/April/14042025/python_test3/log-python3----short_python3--v--marlene-03:35:00.txt','datou','flip'); /home/admin/workarea/git/Velours/python/tests/python_tests.py refs/heads/master_80aab10e0219982fef52d1eae72d1bddac86cb8e SQL :INSERT INTO MTRAdmin.monitor_sys (name, type, server, version_code, result_str, result_bool, lien , test_group ,test_name) VALUES ('python_test3','1','marlene','refs/heads/master_80aab10e0219982fef52d1eae72d1bddac86cb8e','{"crop_rles": "fail"}','0','http://marlene.fotonower-preprod.com/job/2025/April/14042025/python_test3//data_2/data_log/job/2025/April/14042025/python_test3/log-python3----short_python3--v--marlene-03:35:00.txt','datou','crop_rles'); /home/admin/workarea/git/Velours/python/tests/python_tests.py refs/heads/master_80aab10e0219982fef52d1eae72d1bddac86cb8e SQL :INSERT INTO MTRAdmin.monitor_sys (name, type, server, version_code, result_str, result_bool, lien , test_group ,test_name) VALUES ('python_test3','1','marlene','refs/heads/master_80aab10e0219982fef52d1eae72d1bddac86cb8e','{"angular_coeff": "success"}','1','http://marlene.fotonower-preprod.com/job/2025/April/14042025/python_test3//data_2/data_log/job/2025/April/14042025/python_test3/log-python3----short_python3--v--marlene-03:35:00.txt','datou','angular_coeff'); /home/admin/workarea/git/Velours/python/tests/python_tests.py refs/heads/master_80aab10e0219982fef52d1eae72d1bddac86cb8e SQL :INSERT INTO MTRAdmin.monitor_sys (name, type, server, version_code, result_str, result_bool, lien , test_group ,test_name) VALUES ('python_test3','1','marlene','refs/heads/master_80aab10e0219982fef52d1eae72d1bddac86cb8e','{"detection_filter_by_crop": "success"}','1','http://marlene.fotonower-preprod.com/job/2025/April/14042025/python_test3//data_2/data_log/job/2025/April/14042025/python_test3/log-python3----short_python3--v--marlene-03:35:00.txt','datou','detection_filter_by_crop'); /home/admin/workarea/git/Velours/python/tests/python_tests.py refs/heads/master_80aab10e0219982fef52d1eae72d1bddac86cb8e SQL :INSERT INTO MTRAdmin.monitor_sys (name, type, server, version_code, result_str, result_bool, lien , test_group ,test_name) VALUES ('python_test3','1','marlene','refs/heads/master_80aab10e0219982fef52d1eae72d1bddac86cb8e','{"detection_filter_by_classif": "fail"}','0','http://marlene.fotonower-preprod.com/job/2025/April/14042025/python_test3//data_2/data_log/job/2025/April/14042025/python_test3/log-python3----short_python3--v--marlene-03:35:00.txt','datou','detection_filter_by_classif'); /home/admin/workarea/git/Velours/python/tests/python_tests.py refs/heads/master_80aab10e0219982fef52d1eae72d1bddac86cb8e SQL :INSERT INTO MTRAdmin.monitor_sys (name, type, server, version_code, result_str, result_bool, lien , test_group ,test_name) VALUES ('python_test3','1','marlene','refs/heads/master_80aab10e0219982fef52d1eae72d1bddac86cb8e','{"blur_detection": "success"}','1','http://marlene.fotonower-preprod.com/job/2025/April/14042025/python_test3//data_2/data_log/job/2025/April/14042025/python_test3/log-python3----short_python3--v--marlene-03:35:00.txt','datou','blur_detection'); /home/admin/workarea/git/Velours/python/tests/python_tests.py refs/heads/master_80aab10e0219982fef52d1eae72d1bddac86cb8e SQL :INSERT INTO MTRAdmin.monitor_sys (name, type, server, version_code, result_str, result_bool, lien , test_group ,test_name) VALUES ('python_test3','1','marlene','refs/heads/master_80aab10e0219982fef52d1eae72d1bddac86cb8e','{"detect_point_224x224": "success"}','1','http://marlene.fotonower-preprod.com/job/2025/April/14042025/python_test3//data_2/data_log/job/2025/April/14042025/python_test3/log-python3----short_python3--v--marlene-03:35:00.txt','datou','detect_point_224x224'); /home/admin/workarea/git/Velours/python/tests/python_tests.py refs/heads/master_80aab10e0219982fef52d1eae72d1bddac86cb8e SQL :INSERT INTO MTRAdmin.monitor_sys (name, type, server, version_code, result_str, result_bool, lien , test_group ,test_name) VALUES ('python_test3','1','marlene','refs/heads/master_80aab10e0219982fef52d1eae72d1bddac86cb8e','{"certificat_qualite_papier": "fail"}','0','http://marlene.fotonower-preprod.com/job/2025/April/14042025/python_test3//data_2/data_log/job/2025/April/14042025/python_test3/log-python3----short_python3--v--marlene-03:35:00.txt','datou','certificat_qualite_papier'); /home/admin/workarea/git/Velours/python/tests/python_tests.py refs/heads/master_80aab10e0219982fef52d1eae72d1bddac86cb8e SQL :INSERT INTO MTRAdmin.monitor_sys (name, type, server, version_code, result_str, result_bool, lien , test_group ,test_name) VALUES ('python_test3','1','marlene','refs/heads/master_80aab10e0219982fef52d1eae72d1bddac86cb8e','{"image_temperature_detection": "success"}','1','http://marlene.fotonower-preprod.com/job/2025/April/14042025/python_test3//data_2/data_log/job/2025/April/14042025/python_test3/log-python3----short_python3--v--marlene-03:35:00.txt','datou','image_temperature_detection'); /home/admin/workarea/git/Velours/python/tests/python_tests.py refs/heads/master_80aab10e0219982fef52d1eae72d1bddac86cb8e SQL :INSERT INTO MTRAdmin.monitor_sys (name, type, server, version_code, result_str, result_bool, lien , test_group ,test_name) VALUES ('python_test3','1','marlene','refs/heads/master_80aab10e0219982fef52d1eae72d1bddac86cb8e','{"broca": "fail"}','0','http://marlene.fotonower-preprod.com/job/2025/April/14042025/python_test3//data_2/data_log/job/2025/April/14042025/python_test3/log-python3----short_python3--v--marlene-03:35:00.txt','datou','broca'); /home/admin/workarea/git/Velours/python/tests/python_tests.py refs/heads/master_80aab10e0219982fef52d1eae72d1bddac86cb8e SQL :INSERT INTO MTRAdmin.monitor_sys (name, type, server, version_code, result_str, result_bool, lien , test_group ,test_name) VALUES ('python_test3','1','marlene','refs/heads/master_80aab10e0219982fef52d1eae72d1bddac86cb8e','{"crop_conditional": "fail"}','0','http://marlene.fotonower-preprod.com/job/2025/April/14042025/python_test3//data_2/data_log/job/2025/April/14042025/python_test3/log-python3----short_python3--v--marlene-03:35:00.txt','datou','crop_conditional'); /home/admin/workarea/git/Velours/python/tests/python_tests.py refs/heads/master_80aab10e0219982fef52d1eae72d1bddac86cb8e SQL :INSERT INTO MTRAdmin.monitor_sys (name, type, server, version_code, result_str, result_bool, lien , test_group ,test_name) VALUES ('python_test3','1','marlene','refs/heads/master_80aab10e0219982fef52d1eae72d1bddac86cb8e','{"image_blanchir": "fail"}','0','http://marlene.fotonower-preprod.com/job/2025/April/14042025/python_test3//data_2/data_log/job/2025/April/14042025/python_test3/log-python3----short_python3--v--marlene-03:35:00.txt','datou','image_blanchir'); /home/admin/workarea/git/Velours/python/tests/python_tests.py refs/heads/master_80aab10e0219982fef52d1eae72d1bddac86cb8e SQL :INSERT INTO MTRAdmin.monitor_sys (name, type, server, version_code, result_str, result_bool, lien , test_group ,test_name) VALUES ('python_test3','1','marlene','refs/heads/master_80aab10e0219982fef52d1eae72d1bddac86cb8e','{"darker_image": "fail"}','0','http://marlene.fotonower-preprod.com/job/2025/April/14042025/python_test3//data_2/data_log/job/2025/April/14042025/python_test3/log-python3----short_python3--v--marlene-03:35:00.txt','datou','darker_image'); /home/admin/workarea/git/Velours/python/tests/python_tests.py refs/heads/master_80aab10e0219982fef52d1eae72d1bddac86cb8e SQL :INSERT INTO MTRAdmin.monitor_sys (name, type, server, version_code, result_str, result_bool, lien , test_group ,test_name) VALUES ('python_test3','1','marlene','refs/heads/master_80aab10e0219982fef52d1eae72d1bddac86cb8e','{"img_aug": "fail"}','0','http://marlene.fotonower-preprod.com/job/2025/April/14042025/python_test3//data_2/data_log/job/2025/April/14042025/python_test3/log-python3----short_python3--v--marlene-03:35:00.txt','datou','img_aug'); /home/admin/workarea/git/Velours/python/tests/python_tests.py refs/heads/master_80aab10e0219982fef52d1eae72d1bddac86cb8e SQL :INSERT INTO MTRAdmin.monitor_sys (name, type, server, version_code, result_str, result_bool, lien , test_group ,test_name) VALUES ('python_test3','1','marlene','refs/heads/master_80aab10e0219982fef52d1eae72d1bddac86cb8e','{"rubbia": "fail"}','0','http://marlene.fotonower-preprod.com/job/2025/April/14042025/python_test3//data_2/data_log/job/2025/April/14042025/python_test3/log-python3----short_python3--v--marlene-03:35:00.txt','datou','rubbia'); /home/admin/workarea/git/Velours/python/tests/python_tests.py refs/heads/master_80aab10e0219982fef52d1eae72d1bddac86cb8e SQL :INSERT INTO MTRAdmin.monitor_sys (name, type, server, version_code, result_str, result_bool, lien , test_group ,test_name) VALUES ('python_test3','1','marlene','refs/heads/master_80aab10e0219982fef52d1eae72d1bddac86cb8e','{"rubbia_split_dark": "fail"}','0','http://marlene.fotonower-preprod.com/job/2025/April/14042025/python_test3//data_2/data_log/job/2025/April/14042025/python_test3/log-python3----short_python3--v--marlene-03:35:00.txt','datou','rubbia_split_dark'); /home/admin/workarea/git/Velours/python/tests/python_tests.py refs/heads/master_80aab10e0219982fef52d1eae72d1bddac86cb8e SQL :INSERT INTO MTRAdmin.monitor_sys (name, type, server, version_code, result_str, result_bool, lien , test_group ,test_name) VALUES ('python_test3','1','marlene','refs/heads/master_80aab10e0219982fef52d1eae72d1bddac86cb8e','{"rubbia_append": "fail"}','0','http://marlene.fotonower-preprod.com/job/2025/April/14042025/python_test3//data_2/data_log/job/2025/April/14042025/python_test3/log-python3----short_python3--v--marlene-03:35:00.txt','datou','rubbia_append'); /home/admin/workarea/git/Velours/python/tests/python_tests.py refs/heads/master_80aab10e0219982fef52d1eae72d1bddac86cb8e SQL :INSERT INTO MTRAdmin.monitor_sys (name, type, server, version_code, result_str, result_bool, lien , test_group ,test_name) VALUES ('python_test3','1','marlene','refs/heads/master_80aab10e0219982fef52d1eae72d1bddac86cb8e','{"rubbia_horaire": "fail"}','0','http://marlene.fotonower-preprod.com/job/2025/April/14042025/python_test3//data_2/data_log/job/2025/April/14042025/python_test3/log-python3----short_python3--v--marlene-03:35:00.txt','datou','rubbia_horaire'); /home/admin/workarea/git/Velours/python/tests/python_tests.py refs/heads/master_80aab10e0219982fef52d1eae72d1bddac86cb8e SQL :INSERT INTO MTRAdmin.monitor_sys (name, type, server, version_code, result_str, result_bool, lien , test_group ,test_name) VALUES ('python_test3','1','marlene','refs/heads/master_80aab10e0219982fef52d1eae72d1bddac86cb8e','{"rle_unique_nms_with_priority": "fail"}','0','http://marlene.fotonower-preprod.com/job/2025/April/14042025/python_test3//data_2/data_log/job/2025/April/14042025/python_test3/log-python3----short_python3--v--marlene-03:35:00.txt','datou','rle_unique_nms_with_priority'); /home/admin/workarea/git/Velours/python/tests/python_tests.py refs/heads/master_80aab10e0219982fef52d1eae72d1bddac86cb8e SQL :INSERT INTO MTRAdmin.monitor_sys (name, type, server, version_code, result_str, result_bool, lien , test_group ,test_name) VALUES ('python_test3','1','marlene','refs/heads/master_80aab10e0219982fef52d1eae72d1bddac86cb8e','{"random_deformation": "fail"}','0','http://marlene.fotonower-preprod.com/job/2025/April/14042025/python_test3//data_2/data_log/job/2025/April/14042025/python_test3/log-python3----short_python3--v--marlene-03:35:00.txt','datou','random_deformation'); /home/admin/workarea/git/Velours/python/tests/python_tests.py refs/heads/master_80aab10e0219982fef52d1eae72d1bddac86cb8e SQL :INSERT INTO MTRAdmin.monitor_sys (name, type, server, version_code, result_str, result_bool, lien , test_group ,test_name) VALUES ('python_test3','1','marlene','refs/heads/master_80aab10e0219982fef52d1eae72d1bddac86cb8e','{"tile": "success"}','1','http://marlene.fotonower-preprod.com/job/2025/April/14042025/python_test3//data_2/data_log/job/2025/April/14042025/python_test3/log-python3----short_python3--v--marlene-03:35:00.txt','datou','tile'); /home/admin/workarea/git/Velours/python/tests/python_tests.py refs/heads/master_80aab10e0219982fef52d1eae72d1bddac86cb8e SQL :INSERT INTO MTRAdmin.monitor_sys (name, type, server, version_code, result_str, result_bool, lien , test_group ,test_name) VALUES ('python_test3','1','marlene','refs/heads/master_80aab10e0219982fef52d1eae72d1bddac86cb8e','{"rotate_chi": "success"}','1','http://marlene.fotonower-preprod.com/job/2025/April/14042025/python_test3//data_2/data_log/job/2025/April/14042025/python_test3/log-python3----short_python3--v--marlene-03:35:00.txt','datou','rotate_chi'); /home/admin/workarea/git/Velours/python/tests/python_tests.py refs/heads/master_80aab10e0219982fef52d1eae72d1bddac86cb8e SQL :INSERT INTO MTRAdmin.monitor_sys (name, type, server, version_code, result_str, result_bool, lien , test_group ,test_name) VALUES ('python_test3','1','marlene','refs/heads/master_80aab10e0219982fef52d1eae72d1bddac86cb8e','{"rubbia_carac_pet_clair_0121_no_cnn": "fail"}','0','http://marlene.fotonower-preprod.com/job/2025/April/14042025/python_test3//data_2/data_log/job/2025/April/14042025/python_test3/log-python3----short_python3--v--marlene-03:35:00.txt','datou','rubbia_carac_pet_clair_0121_no_cnn'); /home/admin/workarea/git/Velours/python/tests/python_tests.py refs/heads/master_80aab10e0219982fef52d1eae72d1bddac86cb8e SQL :INSERT INTO MTRAdmin.monitor_sys (name, type, server, version_code, result_str, result_bool, lien , test_group ,test_name) VALUES ('python_test3','1','marlene','refs/heads/master_80aab10e0219982fef52d1eae72d1bddac86cb8e','{"rubbia_carac_jrm_no_mask_detect": "fail"}','0','http://marlene.fotonower-preprod.com/job/2025/April/14042025/python_test3//data_2/data_log/job/2025/April/14042025/python_test3/log-python3----short_python3--v--marlene-03:35:00.txt','datou','rubbia_carac_jrm_no_mask_detect'); /home/admin/workarea/git/Velours/python/tests/python_tests.py refs/heads/master_80aab10e0219982fef52d1eae72d1bddac86cb8e SQL :INSERT INTO MTRAdmin.monitor_sys (name, type, server, version_code, result_str, result_bool, lien , test_group ,test_name) VALUES ('python_test3','1','marlene','refs/heads/master_80aab10e0219982fef52d1eae72d1bddac86cb8e','{"ventilate_hashtags_in_portfolio": "fail"}','0','http://marlene.fotonower-preprod.com/job/2025/April/14042025/python_test3//data_2/data_log/job/2025/April/14042025/python_test3/log-python3----short_python3--v--marlene-03:35:00.txt','datou','ventilate_hashtags_in_portfolio'); /home/admin/workarea/git/Velours/python/tests/python_tests.py refs/heads/master_80aab10e0219982fef52d1eae72d1bddac86cb8e SQL :INSERT INTO MTRAdmin.monitor_sys (name, type, server, version_code, result_str, result_bool, lien , test_group ,test_name) VALUES ('python_test3','1','marlene','refs/heads/master_80aab10e0219982fef52d1eae72d1bddac86cb8e','{"poly_ro_rle": "success"}','1','http://marlene.fotonower-preprod.com/job/2025/April/14042025/python_test3//data_2/data_log/job/2025/April/14042025/python_test3/log-python3----short_python3--v--marlene-03:35:00.txt','datou','poly_ro_rle'); /home/admin/workarea/git/Velours/python/tests/python_tests.py refs/heads/master_80aab10e0219982fef52d1eae72d1bddac86cb8e SQL :INSERT INTO MTRAdmin.monitor_sys (name, type, server, version_code, result_str, result_bool, lien , test_group ,test_name) VALUES ('python_test3','1','marlene','refs/heads/master_80aab10e0219982fef52d1eae72d1bddac86cb8e','{"cod_sts": "fail"}','0','http://marlene.fotonower-preprod.com/job/2025/April/14042025/python_test3//data_2/data_log/job/2025/April/14042025/python_test3/log-python3----short_python3--v--marlene-03:35:00.txt','datou','cod_sts'); /home/admin/workarea/git/Velours/python/tests/python_tests.py refs/heads/master_80aab10e0219982fef52d1eae72d1bddac86cb8e SQL :INSERT INTO MTRAdmin.monitor_sys (name, type, server, version_code, result_str, result_bool, lien , test_group ,test_name) VALUES ('python_test3','1','marlene','refs/heads/master_80aab10e0219982fef52d1eae72d1bddac86cb8e','{"cod_download": "success"}','1','http://marlene.fotonower-preprod.com/job/2025/April/14042025/python_test3//data_2/data_log/job/2025/April/14042025/python_test3/log-python3----short_python3--v--marlene-03:35:00.txt','datou','cod_download'); /home/admin/workarea/git/Velours/python/tests/python_tests.py refs/heads/master_80aab10e0219982fef52d1eae72d1bddac86cb8e SQL :INSERT INTO MTRAdmin.monitor_sys (name, type, server, version_code, result_str, result_bool, lien , test_group ,test_name) VALUES ('python_test3','1','marlene','refs/heads/master_80aab10e0219982fef52d1eae72d1bddac86cb8e','{"sendgrid": "success"}','1','http://marlene.fotonower-preprod.com/job/2025/April/14042025/python_test3//data_2/data_log/job/2025/April/14042025/python_test3/log-python3----short_python3--v--marlene-03:35:00.txt','datou','sendgrid'); /home/admin/workarea/git/Velours/python/tests/python_tests.py refs/heads/master_80aab10e0219982fef52d1eae72d1bddac86cb8e SQL :INSERT INTO MTRAdmin.monitor_sys (name, type, server, version_code, result_str, result_bool, lien , test_group ,test_name) VALUES ('python_test3','1','marlene','refs/heads/master_80aab10e0219982fef52d1eae72d1bddac86cb8e','{"rym_consolidate": "fail"}','0','http://marlene.fotonower-preprod.com/job/2025/April/14042025/python_test3//data_2/data_log/job/2025/April/14042025/python_test3/log-python3----short_python3--v--marlene-03:35:00.txt','datou','rym_consolidate'); /home/admin/workarea/git/Velours/python/tests/python_tests.py refs/heads/master_80aab10e0219982fef52d1eae72d1bddac86cb8e SQL :INSERT INTO MTRAdmin.monitor_sys (name, type, server, version_code, result_str, result_bool, lien , test_group ,test_name) VALUES ('python_test3','1','marlene','refs/heads/master_80aab10e0219982fef52d1eae72d1bddac86cb8e','{"generate_new_image_add_crop": "fail"}','0','http://marlene.fotonower-preprod.com/job/2025/April/14042025/python_test3//data_2/data_log/job/2025/April/14042025/python_test3/log-python3----short_python3--v--marlene-03:35:00.txt','datou','generate_new_image_add_crop'); /home/admin/workarea/git/Velours/python/tests/python_tests.py refs/heads/master_80aab10e0219982fef52d1eae72d1bddac86cb8e SQL :INSERT INTO MTRAdmin.monitor_sys (name, type, server, version_code, result_str, result_bool, lien , test_group ,test_name) VALUES ('python_test3','1','marlene','refs/heads/master_80aab10e0219982fef52d1eae72d1bddac86cb8e','{"velours_tree": "success"}','1','http://marlene.fotonower-preprod.com/job/2025/April/14042025/python_test3//data_2/data_log/job/2025/April/14042025/python_test3/log-python3----short_python3--v--marlene-03:35:00.txt','datou','velours_tree'); /home/admin/workarea/git/Velours/python/tests/python_tests.py refs/heads/master_80aab10e0219982fef52d1eae72d1bddac86cb8e SQL :INSERT INTO MTRAdmin.monitor_sys (name, type, server, version_code, result_str, result_bool, lien , test_group ,test_name) VALUES ('python_test3','1','marlene','refs/heads/master_80aab10e0219982fef52d1eae72d1bddac86cb8e','{"step ACP": "success"}','1','http://marlene.fotonower-preprod.com/job/2025/April/14042025/python_test3//data_2/data_log/job/2025/April/14042025/python_test3/log-python3----short_python3--v--marlene-03:35:00.txt','datou','step ACP'); /home/admin/workarea/git/Velours/python/tests/python_tests.py refs/heads/master_80aab10e0219982fef52d1eae72d1bddac86cb8e SQL :INSERT INTO MTRAdmin.monitor_sys (name, type, server, version_code, result_str, result_bool, lien , test_group ,test_name) VALUES ('python_test3','1','marlene','refs/heads/master_80aab10e0219982fef52d1eae72d1bddac86cb8e','{"blur_crop": "success"}','1','http://marlene.fotonower-preprod.com/job/2025/April/14042025/python_test3//data_2/data_log/job/2025/April/14042025/python_test3/log-python3----short_python3--v--marlene-03:35:00.txt','datou','blur_crop'); /home/admin/workarea/git/Velours/python/tests/python_tests.py refs/heads/master_80aab10e0219982fef52d1eae72d1bddac86cb8e SQL :INSERT INTO MTRAdmin.monitor_sys (name, type, server, version_code, result_str, result_bool, lien , test_group ,test_name) VALUES ('python_test3','1','marlene','refs/heads/master_80aab10e0219982fef52d1eae72d1bddac86cb8e','{"pma_consolidate": "fail"}','0','http://marlene.fotonower-preprod.com/job/2025/April/14042025/python_test3//data_2/data_log/job/2025/April/14042025/python_test3/log-python3----short_python3--v--marlene-03:35:00.txt','datou','pma_consolidate'); /home/admin/workarea/git/Velours/python/tests/python_tests.py refs/heads/master_80aab10e0219982fef52d1eae72d1bddac86cb8e SQL :INSERT INTO MTRAdmin.monitor_sys (name, type, server, version_code, result_str, result_bool, lien , test_group ,test_name) VALUES ('python_test3','1','marlene','refs/heads/master_80aab10e0219982fef52d1eae72d1bddac86cb8e','{"pma_ventilate": "fail"}','0','http://marlene.fotonower-preprod.com/job/2025/April/14042025/python_test3//data_2/data_log/job/2025/April/14042025/python_test3/log-python3----short_python3--v--marlene-03:35:00.txt','datou','pma_ventilate'); #&_# END OF TEST #&_# : tests/datou_test #&_# #&_# BEGIN OF TEST : mtr/database_queries/CacheModelData_queries #&_# /home/admin/workarea/git/Velours/python/mtr/database_queries/CacheModelData_queries.py Test Cache Model Data test a faire VR 27-9-17 #&_# TEST SUCCEEDED #&_# : mtr/database_queries/CacheModelData_queries #&_# /home/admin/workarea/git/Velours/python/tests/python_tests.py refs/heads/master_80aab10e0219982fef52d1eae72d1bddac86cb8e SQL :INSERT INTO MTRAdmin.monitor_sys (name, type, server, version_code, result_str, result_bool, lien , test_group ,test_name) VALUES ('python_test3','1','marlene','refs/heads/master_80aab10e0219982fef52d1eae72d1bddac86cb8e','{"CacheModelData_queries": "success"}','1','http://marlene.fotonower-preprod.com/job/2025/April/14042025/python_test3//data_2/data_log/job/2025/April/14042025/python_test3/log-python3----short_python3--v--marlene-03:35:00.txt','CacheModelData_queries','unknown'); #&_# END OF TEST #&_# : mtr/database_queries/CacheModelData_queries #&_# #&_# BEGIN OF TEST : tests/cache_photo_data_test #&_# /home/admin/workarea/git/Velours/python/tests/cache_photo_data_test.py Test local_cache_photo ############################### test_download_photos_by_local_cache ################################ test download portfolio 1162416 : 574 photos SELECT ph.photo_id, ph.url FROM MTRBack.photos ph WHERE ph.photo_id IN (SELECT mtr_photo_id from MTRUser.mtr_portfolio_photos WHERE mtr_portfolio_id in (1162416) and hide_status = 0 ) ORDER BY ph.photo_id DESC LIMIT 0, 1000000 Catched exception ! Connect or reconnect ! ERROR : (1114, "The table '/tmp/#sqla9606_36707d_0' is full") reconnect to base ! warning , we can't find thcl infos in json_data warning , we can't find pdt infos in json_data #&_# TEST FAILED #&_# : tests/cache_photo_data_test #&_# Error : invalid literal for int() with base 10: '(1114, "The table \'/tmp/#sqla9606_36707d_0\' is full")' /home/admin/workarea/git/Velours/python/tests/python_tests.py refs/heads/master_80aab10e0219982fef52d1eae72d1bddac86cb8e SQL :INSERT INTO MTRAdmin.monitor_sys (name, type, server, version_code, result_str, result_bool, lien , test_group ,test_name) VALUES ('python_test3','1','marlene','refs/heads/master_80aab10e0219982fef52d1eae72d1bddac86cb8e','{"CachePhotoData_queries": "fail"}','0','http://marlene.fotonower-preprod.com/job/2025/April/14042025/python_test3//data_2/data_log/job/2025/April/14042025/python_test3/log-python3----short_python3--v--marlene-03:35:00.txt','CachePhotoData_queries','unknown'); #&_# END OF TEST #&_# : tests/cache_photo_data_test #&_# #&_# BEGIN OF TEST : mtr/mask_rcnn/prepare_maskdata #&_# /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/prepare_maskdata.py test prepare mask data c : Plaque-immatriculation 2096875719 c : capot 599722655 SELECT photo_id FROM MTRPhoto.crop_hashtag_ids WHERE type= 840 and photo_id in (SELECT mtr_photo_id FROM MTRUser.mtr_portfolio_photos where mtr_portfolio_id = 2069971 and hide_status = 0) group by photo_id batch 1 select photo_id, hashtag_id, `type`, x0, x1, y0, y1, score, id from MTRPhoto.crop_hashtag_ids where photo_id in ( 907850592) and `type` in (840) Loaded 20 chid ids of type : 840 SELECT crop_hashtag_id, points FROM MTRPhoto.crop_polygon_points WHERE crop_hashtag_id in (33750301,33750302,33750303,33750304,33750305,33750306,33750307,33750308,33750309,33750310,33750311,33750312,33750313,33750314,33750315,33750316,33750317,33750318,33750319,33750320) ++++++++++++++++++++SELECT * FROM MTRPhoto.crop_segments WHERE crop_hashtag_id in (33750301,33750302,33750303,33750304,33750305,33750306,33750307,33750308,33750309,33750310,33750311,33750312,33750313,33750314,33750315,33750316,33750317,33750318,33750319,33750320) SELECT * FROM MTRPhoto.crop_sum_segments WHERE crop_hashtag_id in (33750301,33750302,33750303,33750304,33750305,33750306,33750307,33750308,33750309,33750310,33750311,33750312,33750313,33750314,33750315,33750316,33750317,33750318,33750319,33750320) {907850592: [, , , , , , , , , , , , , , , , , , , ]} batch 1 select photo_id, hashtag_id, `type`, x0, x1, y0, y1, score, id from MTRPhoto.crop_hashtag_ids where photo_id in ( 907857924) and `type` in (840) Loaded 16 chid ids of type : 840 SELECT crop_hashtag_id, points FROM MTRPhoto.crop_polygon_points WHERE crop_hashtag_id in (33749327,33749328,33749329,33749330,33749331,33749332,33749333,33749334,33749335,33749336,33749337,33749338,33749339,33749340,33749341,33749342) +++++++++SELECT * FROM MTRPhoto.crop_segments WHERE crop_hashtag_id in (33749327,33749328,33749329,33749330,33749331,33749332,33749333,33749334,33749335,33749336,33749337,33749338,33749339,33749340,33749341,33749342) SELECT * FROM MTRPhoto.crop_sum_segments WHERE crop_hashtag_id in (33749327,33749328,33749329,33749330,33749331,33749332,33749333,33749334,33749335,33749336,33749337,33749338,33749339,33749340,33749341,33749342) {907857924: [, , , , , , , , , , , , , , , ]} batch 1 select photo_id, hashtag_id, `type`, x0, x1, y0, y1, score, id from MTRPhoto.crop_hashtag_ids where photo_id in ( 907862724) and `type` in (840) Loaded 20 chid ids of type : 840 SELECT crop_hashtag_id, points FROM MTRPhoto.crop_polygon_points WHERE crop_hashtag_id in (33750565,33750566,33750567,33750568,33750569,33750570,33750571,33750572,33750573,33750574,33750575,33750576,33750577,33750578,33750579,33750580,33750581,33750582,33750583,33750584) ++++++++++++++++++++SELECT * FROM MTRPhoto.crop_segments WHERE crop_hashtag_id in (33750565,33750566,33750567,33750568,33750569,33750570,33750571,33750572,33750573,33750574,33750575,33750576,33750577,33750578,33750579,33750580,33750581,33750582,33750583,33750584) SELECT * FROM MTRPhoto.crop_sum_segments WHERE crop_hashtag_id in (33750565,33750566,33750567,33750568,33750569,33750570,33750571,33750572,33750573,33750574,33750575,33750576,33750577,33750578,33750579,33750580,33750581,33750582,33750583,33750584) {907862724: [, , , , , , , , , , , , , , , , , , , ]} batch 1 select photo_id, hashtag_id, `type`, x0, x1, y0, y1, score, id from MTRPhoto.crop_hashtag_ids where photo_id in ( 907863602) and `type` in (840) Loaded 19 chid ids of type : 840 SELECT crop_hashtag_id, points FROM MTRPhoto.crop_polygon_points WHERE crop_hashtag_id in (33747793,33747794,33747795,33747796,33747797,33747798,33747799,33747800,33747801,33747802,33747803,33747804,33747805,33747806,33747807,33747808,33747809,33747810,33747811) ++++++++++SELECT * FROM MTRPhoto.crop_segments WHERE crop_hashtag_id in (33747793,33747794,33747795,33747796,33747797,33747798,33747799,33747800,33747801,33747802,33747803,33747804,33747805,33747806,33747807,33747808,33747809,33747810,33747811) SELECT * FROM MTRPhoto.crop_sum_segments WHERE crop_hashtag_id in (33747793,33747794,33747795,33747796,33747797,33747798,33747799,33747800,33747801,33747802,33747803,33747804,33747805,33747806,33747807,33747808,33747809,33747810,33747811) {907863602: [, , , , , , , , , , , , , , , , , , ]} batch 1 select photo_id, hashtag_id, `type`, x0, x1, y0, y1, score, id from MTRPhoto.crop_hashtag_ids where photo_id in ( 907863940) and `type` in (840) Loaded 20 chid ids of type : 840 SELECT crop_hashtag_id, points FROM MTRPhoto.crop_polygon_points WHERE crop_hashtag_id in (33747538,33747539,33747540,33747541,33747542,33747543,33747544,33747545,33747546,33747547,33747548,33747549,33747550,33747551,33747552,33747553,33747554,33747555,33747556,33747557) ++++++++++++SELECT * FROM MTRPhoto.crop_segments WHERE crop_hashtag_id in (33747538,33747539,33747540,33747541,33747542,33747543,33747544,33747545,33747546,33747547,33747548,33747549,33747550,33747551,33747552,33747553,33747554,33747555,33747556,33747557) SELECT * FROM MTRPhoto.crop_sum_segments WHERE crop_hashtag_id in (33747538,33747539,33747540,33747541,33747542,33747543,33747544,33747545,33747546,33747547,33747548,33747549,33747550,33747551,33747552,33747553,33747554,33747555,33747556,33747557) {907863940: [, , , , , , , , , , , , , , , , , , , ]} {2096875719: 'Plaque-immatriculation', 599722655: 'capot'} {907850592: [, , , , , , , , , , , , , , , , , , , ], 907862724: [, , , , , , , , , , , , , , , , , , , ], 907863602: [, , , , , , , , , , , , , , , , , , ], 907863940: [, , , , , , , , , , , , , , , , , , , ]} dict_keys([907850592, 907862724, 907863602, 907863940]) SELECT photo_id, url FROM MTRBack.photos ph WHERE photo_id IN (907850592,907862724,907863602,907863940) Found this number of photos: 4 [{'photo_id': 907850592, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2017/6/16/ed4966e7174a77396ac8fcda79dbb623-big.jpg'}, {'photo_id': 907862724, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2017/6/16/832cac3a051929b54bf6624844e6ae19-big.jpg'}, {'photo_id': 907863602, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2017/6/16/9bdc888dccb678f78cae7bd094089fa8-big.jpg'}, {'photo_id': 907863940, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2017/6/16/eab8c1f33202454ec634f443beea6485-big.jpg'}] {907850592: '/data/data_root/test_preparedata/train/907850592.jpg', 907862724: '/data/data_root/test_preparedata/train/907862724.jpg', 907863602: '/data/data_root/test_preparedata/train/907863602.jpg', 907863940: '/data/data_root/test_preparedata/val/907863940.jpg'} logo-marque 2096875717 907850592 x0 : 38 y1 : 269 width : 32, height : 38, area : 1216, score : 1.0 None pare-choc 624624117 907850592 x0 : 0 y1 : 559 width : 362, height : 235, area : 85070, score : 1.0 None coffre 495920967 907850592 x0 : 0 y1 : 398 width : 302, height : 336, area : 101472, score : 1.0 None coffre 495920967 907850592 x0 : 626 y1 : 206 width : 18, height : 35, area : 630, score : 1.0 None aile-arriere 2106233861 907850592 x0 : 189 y1 : 476 width : 282, height : 235, area : 66270, score : 1.0 None roue 492689227 907850592 x0 : 275 y1 : 620 width : 170, height : 215, area : 36550, score : 1.0 None Plaque-immatriculation 2096875719 907850592 x0 : 10 y1 : 454 width : 108, height : 84, area : 9072, score : 1.0 None feu-arriere 2096875713 907850592 x0 : 192 y1 : 359 width : 147, height : 96, area : 14112, score : 1.0 None poignee 499500794 907850592 x0 : 437 y1 : 315 width : 42, height : 37, area : 1554, score : 1.0 None poignee 499500794 907850592 x0 : 567 y1 : 282 width : 25, height : 31, area : 775, score : 1.0 None Pot-echappement 2096875720 907850592 x0 : 155 y1 : 532 width : 21, height : 20, area : 420, score : 1.0 None toit 492731002 907850592 x0 : 136 y1 : 74 width : 281, height : 21, area : 5901, score : 1.0 None Pare-brise 2096875709 907850592 x0 : 1 y1 : 241 width : 285, height : 165, area : 47025, score : 1.0 None porte 492654799 907850592 x0 : 354 y1 : 442 width : 210, height : 380, area : 79800, score : 1.0 None porte 492654799 907850592 x0 : 501 y1 : 389 width : 135, height : 324, area : 43740, score : 1.0 None Info-modele 2096875721 907850592 x0 : 132 y1 : 295 width : 53, height : 31, area : 1643, score : 1.0 None vitre 492925064 907850592 x0 : 407 y1 : 201 width : 123, height : 122, area : 15006, score : 1.0 None vitre 492925064 907850592 x0 : 377 y1 : 201 width : 64, height : 118, area : 7552, score : 1.0 None vitre 492925064 907850592 x0 : 522 y1 : 203 width : 102, height : 120, area : 12240, score : 1.0 None Essuie-glace 2096875722 907850592 x0 : 7 y1 : 250 width : 72, height : 61, area : 4392, score : 1.0 None /data/data_root/test_preparedata/train/907850592.jpg logo-marque 2096875717 907862724 x0 : 100 y1 : 282 width : 35, height : 41, area : 1435, score : 1.0 None pare-choc 624624117 907862724 x0 : 1 y1 : 483 width : 435, height : 194, area : 84390, score : 1.0 None aile-arriere 2106233861 907862724 x0 : 399 y1 : 411 width : 110, height : 128, area : 14080, score : 1.0 None retroviseur 492844413 907862724 x0 : 600 y1 : 203 width : 41, height : 37, area : 1517, score : 1.0 None coffre 495920967 907862724 x0 : 5 y1 : 351 width : 369, height : 270, area : 99630, score : 1.0 None Cache-reservoir 2096875718 907862724 x0 : 417 y1 : 289 width : 50, height : 61, area : 3050, score : 1.0 None roue 492689227 907862724 x0 : 367 y1 : 541 width : 121, height : 190, area : 22990, score : 1.0 None poignee 499500794 907862724 x0 : 478 y1 : 275 width : 33, height : 25, area : 825, score : 1.0 None toit 492731002 907862724 x0 : 226 y1 : 110 width : 223, height : 36, area : 8028, score : 1.0 None feu-arriere 2096875713 907862724 x0 : 294 y1 : 331 width : 112, height : 146, area : 16352, score : 1.0 None poignee 499500794 907862724 x0 : 566 y1 : 252 width : 20, height : 27, area : 540, score : 1.0 None Plaque-immatriculation 2096875719 907862724 x0 : 55 y1 : 436 width : 142, height : 54, area : 7668, score : 1.0 None Pare-brise 2096875709 907862724 x0 : 6 y1 : 225 width : 366, height : 132, area : 48312, score : 1.0 None porte 492654799 907862724 x0 : 395 y1 : 391 width : 170, height : 311, area : 52870, score : 1.0 None porte 492654799 907862724 x0 : 508 y1 : 354 width : 101, height : 269, area : 27169, score : 1.0 None vitre 492925064 907862724 x0 : 451 y1 : 202 width : 85, height : 99, area : 8415, score : 1.0 None vitre 492925064 907862724 x0 : 524 y1 : 202 width : 70, height : 99, area : 6930, score : 1.0 None vitre 492925064 907862724 x0 : 428 y1 : 208 width : 50, height : 102, area : 5100, score : 1.0 None Essuie-glace 2096875722 907862724 x0 : 114 y1 : 218 width : 186, height : 27, area : 5022, score : 1.0 None Info-modele 2096875721 907862724 x0 : 10 y1 : 306 width : 41, height : 33, area : 1353, score : 1.0 None /data/data_root/test_preparedata/train/907862724.jpg porte 492654799 907863602 x0 : 129 y1 : 380 width : 300, height : 279, area : 83700, score : 1.0 None porte 492654799 907863602 x0 : 193 y1 : 345 width : 228, height : 215, area : 49020, score : 1.0 None porte 492654799 907863602 x0 : 379 y1 : 385 width : 257, height : 286, area : 73502, score : 1.0 None porte 492654799 907863602 x0 : 400 y1 : 365 width : 195, height : 248, area : 48360, score : 1.0 None roue 492689227 907863602 x0 : 0 y1 : 419 width : 124, height : 148, area : 18352, score : 1.0 None roue 492689227 907863602 x0 : 0 y1 : 411 width : 127, height : 129, area : 16383, score : 1.0 None roue 492689227 907863602 x0 : 580 y1 : 449 width : 60, height : 129, area : 7740, score : 1.0 None roue 492689227 907863602 x0 : 584 y1 : 444 width : 50, height : 126, area : 6300, score : 1.0 None retroviseur 492844413 907863602 x0 : 165 y1 : 225 width : 53, height : 51, area : 2703, score : 1.0 None vitre 492925064 907863602 x0 : 211 y1 : 218 width : 197, height : 109, area : 21473, score : 1.0 None vitre 492925064 907863602 x0 : 217 y1 : 214 width : 193, height : 99, area : 19107, score : 1.0 None vitre 492925064 907863602 x0 : 409 y1 : 214 width : 188, height : 98, area : 18424, score : 1.0 None vitre 492925064 907863602 x0 : 414 y1 : 206 width : 187, height : 96, area : 17952, score : 1.0 None poignee 499500794 907863602 x0 : 320 y1 : 271 width : 46, height : 19, area : 874, score : 1.0 None poignee 499500794 907863602 x0 : 321 y1 : 270 width : 44, height : 19, area : 836, score : 1.0 None poignee 499500794 907863602 x0 : 553 y1 : 270 width : 62, height : 25, area : 1550, score : 1.0 None poignee 499500794 907863602 x0 : 565 y1 : 266 width : 42, height : 16, area : 672, score : 1.0 None capot 599722655 907863602 x0 : -1 y1 : 215 width : 135, height : 37, area : 4995, score : 1.0 None capot 599722655 907863602 x0 : 242 y1 : 123 width : 330, height : 52, area : 17160, score : 1.0 None /data/data_root/test_preparedata/train/907863602.jpg porte 492654799 907863940 x0 : 109 y1 : 426 width : 283, height : 265, area : 74995, score : 1.0 None porte 492654799 907863940 x0 : 179 y1 : 399 width : 203, height : 221, area : 44863, score : 1.0 None porte 492654799 907863940 x0 : 354 y1 : 425 width : 277, height : 266, area : 73682, score : 1.0 None porte 492654799 907863940 x0 : 370 y1 : 407 width : 179, height : 233, area : 41707, score : 1.0 None roue 492689227 907863940 x0 : -1 y1 : 463 width : 98, height : 141, area : 13818, score : 1.0 None roue 492689227 907863940 x0 : 0 y1 : 468 width : 88, height : 147, area : 12936, score : 1.0 None roue 492689227 907863940 x0 : 523 y1 : 493 width : 117, height : 146, area : 17082, score : 1.0 None roue 492689227 907863940 x0 : 525 y1 : 493 width : 111, height : 147, area : 16317, score : 1.0 None retroviseur 492844413 907863940 x0 : 138 y1 : 278 width : 46, height : 44, area : 2024, score : 1.0 None vitre 492925064 907863940 x0 : 182 y1 : 266 width : 200, height : 95, area : 19000, score : 1.0 None vitre 492925064 907863940 x0 : 385 y1 : 257 width : 172, height : 90, area : 15480, score : 1.0 None vitre 492925064 907863940 x0 : 394 y1 : 256 width : 144, height : 86, area : 12384, score : 1.0 None vitre 492925064 907863940 x0 : 549 y1 : 253 width : 58, height : 53, area : 3074, score : 1.0 None poignee 499500794 907863940 x0 : 300 y1 : 306 width : 59, height : 17, area : 1003, score : 1.0 None poignee 499500794 907863940 x0 : 307 y1 : 313 width : 51, height : 24, area : 1224, score : 1.0 None poignee 499500794 907863940 x0 : 527 y1 : 308 width : 53, height : 22, area : 1166, score : 1.0 None poignee 499500794 907863940 x0 : 536 y1 : 310 width : 45, height : 24, area : 1080, score : 1.0 None capot 599722655 907863940 x0 : 219 y1 : 181 width : 370, height : 38, area : 14060, score : 1.0 None logo-roue 2106233859 907863940 x0 : 7 y1 : 419 width : 27, height : 43, area : 1161, score : 1.0 None logo-roue 2106233859 907863940 x0 : 594 y1 : 441 width : 26, height : 25, area : 650, score : 1.0 None /data/data_root/test_preparedata/val/907863940.jpg #&_#_#&_# TEST prepare mask data poly SUCCEEDED #&_#_#&_# c : pet_clair 2107755846 SELECT photo_id FROM MTRPhoto.crop_hashtag_ids WHERE type= 2622 and photo_id in (SELECT mtr_photo_id FROM MTRUser.mtr_portfolio_photos where mtr_portfolio_id = 2880504 and hide_status = 0) group by photo_id batch 1 select photo_id, hashtag_id, `type`, x0, x1, y0, y1, score, id from MTRPhoto.crop_hashtag_ids where photo_id in ( 964453879) and `type` in (2622) Loaded 15 chid ids of type : 2622 SELECT crop_hashtag_id, points FROM MTRPhoto.crop_polygon_points WHERE crop_hashtag_id in (1902110441,1902110442,1902110443,1902110444,1902110445,1902110446,1902110447,1902110448,1902110449,1902110450,1902110451,1902110452,1902110453,2808777934,2808777935) SELECT * FROM MTRPhoto.crop_segments WHERE crop_hashtag_id in (1902110441,1902110442,1902110443,1902110444,1902110445,1902110446,1902110447,1902110448,1902110449,1902110450,1902110451,1902110452,1902110453,2808777934,2808777935) SELECT * FROM MTRPhoto.crop_sum_segments WHERE crop_hashtag_id in (1902110441,1902110442,1902110443,1902110444,1902110445,1902110446,1902110447,1902110448,1902110449,1902110450,1902110451,1902110452,1902110453,2808777934,2808777935) {964453879: [, , , , , , , , , , , , , , ]} {2107755846: 'pet_clair'} {964453879: [, , , , , , , , , , , , , , ]} dict_keys([964453879]) SELECT photo_id, url FROM MTRBack.photos ph WHERE photo_id IN (964453879) Found this number of photos: 1 [{'photo_id': 964453879, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2019/1/6/3d07bc7d06c477acf98514ee747d5c5a.jpg'}] {964453879: '/data/data_root/test_preparedata/val/964453879.jpg'} environment 492622729 964453879 x0 : 0 y1 : 479 width : 112, height : 415, area : 46480, score : 1.0 None error 501120777 964453879 x0 : 142 y1 : 479 width : 28, height : 20, area : 560, score : 1.0 None error 501120777 964453879 x0 : 151 y1 : 99 width : 23, height : 42, area : 966, score : 1.0 None error 501120777 964453879 x0 : 175 y1 : 59 width : 117, height : 59, area : 6903, score : 1.0 None error 501120777 964453879 x0 : 282 y1 : 479 width : 35, height : 62, area : 2170, score : 1.0 None error 501120777 964453879 x0 : 315 y1 : 460 width : 19, height : 26, area : 494, score : 1.0 None error 501120777 964453879 x0 : 353 y1 : 361 width : 32, height : 41, area : 1312, score : 1.0 None error 501120777 964453879 x0 : 403 y1 : 215 width : 47, height : 51, area : 2397, score : 1.0 None error 501120777 964453879 x0 : 497 y1 : 253 width : 89, height : 55, area : 4895, score : 1.0 None error 501120777 964453879 x0 : 546 y1 : 195 width : 58, height : 68, area : 3944, score : 1.0 None error 501120777 964453879 x0 : 613 y1 : 323 width : 20, height : 32, area : 640, score : 1.0 None error 501120777 964453879 x0 : 638 y1 : 225 width : 17, height : 27, area : 459, score : 1.0 None pet_clair 2107755846 964453879 x0 : 0 y1 : 479 width : 719, height : 479, area : 344401, score : 1.0 None error 501120777 964453879 x0 : 546 y1 : 195 width : 60, height : 68, area : 4080, score : 1.0 None error 501120777 964453879 x0 : 613 y1 : 323 width : 22, height : 32, area : 704, score : 1.0 None /data/data_root/test_preparedata/val/964453879.jpg #&_#_#&_# TEST prepare mask data rle SUCCEEDED #&_#_#&_# time for calcul the mask position with numpy : 0.00010633468627929688 nb_pixel_total : 6 time to create 1 rle with old method : 4.172325134277344e-05 Sanity check PASSED : sum_rle_size : 12 height * width : 12 7 #&_#_#&_# TEST prepare mask data mat SUCCEEDED #&_#_#&_# #&_# TEST SUCCEEDED #&_# : mtr/mask_rcnn/prepare_maskdata #&_# /home/admin/workarea/git/Velours/python/tests/python_tests.py refs/heads/master_80aab10e0219982fef52d1eae72d1bddac86cb8e SQL :INSERT INTO MTRAdmin.monitor_sys (name, type, server, version_code, result_str, result_bool, lien , test_group ,test_name) VALUES ('python_test3','1','marlene','refs/heads/master_80aab10e0219982fef52d1eae72d1bddac86cb8e','{"prepare mask data poly": "success"}','1','http://marlene.fotonower-preprod.com/job/2025/April/14042025/python_test3//data_2/data_log/job/2025/April/14042025/python_test3/log-python3----short_python3--v--marlene-03:35:00.txt','prepare_maskdata','prepare mask data poly'); /home/admin/workarea/git/Velours/python/tests/python_tests.py refs/heads/master_80aab10e0219982fef52d1eae72d1bddac86cb8e SQL :INSERT INTO MTRAdmin.monitor_sys (name, type, server, version_code, result_str, result_bool, lien , test_group ,test_name) VALUES ('python_test3','1','marlene','refs/heads/master_80aab10e0219982fef52d1eae72d1bddac86cb8e','{"prepare mask data rle": "success"}','1','http://marlene.fotonower-preprod.com/job/2025/April/14042025/python_test3//data_2/data_log/job/2025/April/14042025/python_test3/log-python3----short_python3--v--marlene-03:35:00.txt','prepare_maskdata','prepare mask data rle'); /home/admin/workarea/git/Velours/python/tests/python_tests.py refs/heads/master_80aab10e0219982fef52d1eae72d1bddac86cb8e SQL :INSERT INTO MTRAdmin.monitor_sys (name, type, server, version_code, result_str, result_bool, lien , test_group ,test_name) VALUES ('python_test3','1','marlene','refs/heads/master_80aab10e0219982fef52d1eae72d1bddac86cb8e','{"prepare mask data mat": "success"}','1','http://marlene.fotonower-preprod.com/job/2025/April/14042025/python_test3//data_2/data_log/job/2025/April/14042025/python_test3/log-python3----short_python3--v--marlene-03:35:00.txt','prepare_maskdata','prepare mask data mat'); #&_# END OF TEST #&_# : mtr/mask_rcnn/prepare_maskdata #&_# #&_# BEGIN OF TEST : mtr/database_queries/portfolio_queries #&_# /home/admin/workarea/git/Velours/python/mtr/database_queries/portfolio_queries.py test portfolio queries SELECT ph.photo_id,mpp.order FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=6391492 AND mpp.hide_status=0 ORDER BY mpp.order SELECT mtr_portfolio_id FROM MTRUser.mtr_portfolio_photos where mtr_photo_id=1095053596 AND `order`=14279380 SELECT mtr_portfolio_id FROM (select mtr_portfolio_id, count(*) as nb FROM MTRUser.mtr_portfolio_photos WHERE hide_status=0 AND mtr_portfolio_id IN (5773607,6180280,6391492) GROUP BY mtr_portfolio_id ) as temp WHERE nb=8 SELECT ph.photo_id,mpp.order FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=5773607 AND mpp.hide_status=0 ORDER BY mpp.order SELECT ph.photo_id,mpp.order FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=6391492 AND mpp.hide_status=0 ORDER BY mpp.order SELECT mtr_portfolio_id FROM MTRUser.mtr_portfolio_photos where mtr_photo_id=1095053584 SELECT mtr_portfolio_id FROM (select mtr_portfolio_id, count(*) as nb FROM MTRUser.mtr_portfolio_photos WHERE hide_status=0 AND mtr_portfolio_id IN (5773607,6214363,6391492,12985573,12985574) GROUP BY mtr_portfolio_id ) as temp WHERE nb=8 SELECT ph.photo_id,mpp.order FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=5773607 AND mpp.hide_status=0 ORDER BY mpp.order SELECT ph.photo_id,mpp.order FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=6391492 AND mpp.hide_status=0 ORDER BY mpp.order #&_# TEST SUCCEEDED #&_# : mtr/database_queries/portfolio_queries #&_# /home/admin/workarea/git/Velours/python/tests/python_tests.py refs/heads/master_80aab10e0219982fef52d1eae72d1bddac86cb8e SQL :INSERT INTO MTRAdmin.monitor_sys (name, type, server, version_code, result_str, result_bool, lien , test_group ,test_name) VALUES ('python_test3','1','marlene','refs/heads/master_80aab10e0219982fef52d1eae72d1bddac86cb8e','{"portfolio_queries": "success"}','1','http://marlene.fotonower-preprod.com/job/2025/April/14042025/python_test3//data_2/data_log/job/2025/April/14042025/python_test3/log-python3----short_python3--v--marlene-03:35:00.txt','portfolio_queries','unknown'); #&_# END OF TEST #&_# : mtr/database_queries/portfolio_queries #&_# #&_# BEGIN OF TEST : prod/memo/memo #&_# /home/admin/workarea/git/Velours/python/prod/memo/memo.py SLA Mensuel python version used : 3 ############################### TEST memo ################################ Removing /home/admin/workarea/git/Velours/python/prod/memo/sla_mensuel VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3981 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3981 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3981 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3981 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! {"input_values":[]} SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3994 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3994 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3994 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3994 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11488 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11496 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11497 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11492 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11492 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11495 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11495 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11489 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11489 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11575 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11575 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11491 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11490 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11490 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11498 send_mail_cod have less outputs used (0) than in the step definition (1) : some outputs may be not used ! Step 11499 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11491 doesn't seem to be define in the database( WARNING : type of input 3 of step 11490 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11488 doesn't seem to be define in the database( WARNING : type of input 2 of step 11492 doesn't seem to be define in the database( WARNING : output 1 of step 11488 have datatype=2 whereas input 1 of step 11495 have datatype=7 WARNING : type of output 2 of step 11495 doesn't seem to be define in the database( WARNING : type of input 1 of step 11489 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11491 have datatype=10 whereas input 3 of step 11498 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11575 doesn't seem to be define in the database( WARNING : output 1 of step 11489 have datatype=7 whereas input 2 of step 11575 have datatype=None WARNING : type of output 3 of step 11575 doesn't seem to be define in the database( WARNING : type of input 1 of step 11491 doesn't seem to be define in the database( WARNING : output 0 of step 11491 have datatype=10 whereas input 0 of step 11581 have datatype=18 WARNING : type of input 5 of step 11498 doesn't seem to be define in the database( WARNING : output 0 of step 11581 have datatype=11 whereas input 5 of step 11498 have datatype=None WARNING : type of output 1 of step 11496 doesn't seem to be define in the database( WARNING : type of input 3 of step 11492 doesn't seem to be define in the database( WARNING : type of output 1 of step 11497 doesn't seem to be define in the database( WARNING : type of input 3 of step 11492 doesn't seem to be define in the database( WARNING : output 0 of step 11495 have datatype=1 whereas input 0 of step 11489 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4209, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,metal,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'papier,background', 'hashtag_weights': {'barquette_opaque': 0.7, 'carton': 0.7, 'ela': 0.7, 'etiquette': 0.5, 'film_plastique': 0.5, 'kraft': 0.7, 'metal': 1.5, 'pehd': 0.7, 'pet_clair': 0.7, 'pet_opaque': 0.7, 'textiles_sanitaires': 0.5, 'pet_fonce': 0.7}, 'ETA': 600} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3993 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3993 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3993 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3993 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4207, 'hashtag_proportion': 'barquette_opaque,ela,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'carton,background', 'hashtag_weights': {'barquette_opaque': 1, 'ela': 1, 'etiquette': 1.0, 'film_plastique': 0.5, 'kraft': 1, 'metal': 3.0, 'papier': 1, 'pehd': 2, 'pet_clair': 2, 'pet_opaque': 2, 'textiles_sanitaires': 1.0, 'pet_fonce': 2}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3459 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3459 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3459 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3459 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3726, 'hashtag_proportion': 'Carton_brun,Carton_gris,Teint_Dans_La_Masse,autre_refus,cartonnette,kraft,metal,plastique', 'hashtag_parmi': 'papier,background', 'hashtag_weights': {'Carton_brun': 1.5, 'Carton_gris': 1.5, 'Teint_Dans_La_Masse': 1.0, 'autre_refus': 1.5, 'cartonnette': 1.0, 'kraft': 1.5, 'metal': 3, 'plastique': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3991 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3991 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3991 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3991 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11512 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11521 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11520 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11516 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11516 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11519 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11519 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11513 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11513 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11577 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11577 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11515 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11514 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11514 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11523 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11515 doesn't seem to be define in the database( WARNING : type of input 3 of step 11514 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11512 doesn't seem to be define in the database( WARNING : type of input 2 of step 11516 doesn't seem to be define in the database( WARNING : output 1 of step 11512 have datatype=2 whereas input 1 of step 11519 have datatype=7 WARNING : type of output 2 of step 11519 doesn't seem to be define in the database( WARNING : type of input 1 of step 11513 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11515 have datatype=10 whereas input 3 of step 11522 have datatype=6 WARNING : type of input 2 of step 11577 doesn't seem to be define in the database( WARNING : output 1 of step 11513 have datatype=7 whereas input 2 of step 11577 have datatype=None WARNING : type of output 3 of step 11577 doesn't seem to be define in the database( WARNING : type of input 1 of step 11515 doesn't seem to be define in the database( WARNING : output 0 of step 11515 have datatype=10 whereas input 0 of step 11583 have datatype=18 WARNING : type of input 5 of step 11522 doesn't seem to be define in the database( WARNING : output 0 of step 11583 have datatype=11 whereas input 5 of step 11522 have datatype=None WARNING : type of output 1 of step 11521 doesn't seem to be define in the database( WARNING : type of input 3 of step 11516 doesn't seem to be define in the database( WARNING : type of output 1 of step 11520 doesn't seem to be define in the database( WARNING : type of input 3 of step 11516 doesn't seem to be define in the database( WARNING : output 0 of step 11519 have datatype=1 whereas input 0 of step 11513 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4203, 'hashtag_proportion': 'barquette_opaque,carton,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'ela,background', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 1, 'etiquette': 0.5, 'film_plastique': 0.5, 'kraft': 0.8, 'metal': 2, 'papier': 0.8, 'pehd': 0.8, 'pet_clair': 0.8, 'pet_opaque': 0.8, 'textiles_sanitaires': 0.5, 'pet_fonce': 0.8}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3995 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3995 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3995 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3995 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11524 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11533 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11532 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11528 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11528 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11531 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11531 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11525 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11525 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11578 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11578 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11527 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11526 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11526 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11535 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11527 doesn't seem to be define in the database( WARNING : type of input 3 of step 11526 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11524 doesn't seem to be define in the database( WARNING : type of input 2 of step 11528 doesn't seem to be define in the database( WARNING : output 1 of step 11524 have datatype=2 whereas input 1 of step 11531 have datatype=7 WARNING : type of output 2 of step 11531 doesn't seem to be define in the database( WARNING : type of input 1 of step 11525 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11527 have datatype=10 whereas input 3 of step 11534 have datatype=6 WARNING : type of input 2 of step 11578 doesn't seem to be define in the database( WARNING : output 1 of step 11525 have datatype=7 whereas input 2 of step 11578 have datatype=None WARNING : type of output 3 of step 11578 doesn't seem to be define in the database( WARNING : type of input 1 of step 11527 doesn't seem to be define in the database( WARNING : output 0 of step 11527 have datatype=10 whereas input 0 of step 11584 have datatype=18 WARNING : type of input 5 of step 11534 doesn't seem to be define in the database( WARNING : output 0 of step 11584 have datatype=11 whereas input 5 of step 11534 have datatype=None WARNING : type of output 1 of step 11533 doesn't seem to be define in the database( WARNING : type of input 3 of step 11528 doesn't seem to be define in the database( WARNING : type of output 1 of step 11532 doesn't seem to be define in the database( WARNING : type of input 3 of step 11528 doesn't seem to be define in the database( WARNING : output 0 of step 11531 have datatype=1 whereas input 0 of step 11525 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4211, 'hashtag_proportion': 'barquette_opaque,carton,ela,film_plastique,kraft,metal,papier,pet_fonce,pet_clair,pet_opaque,textiles_sanitaires', 'hashtag_parmi': 'pehd,etiquette,background', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 0.3, 'ela': 0.3, 'etiquette': 0.1, 'film_plastique': 0.1, 'kraft': 0.3, 'metal': 1.5, 'papier': 0.3, 'pet_clair': 0.3, 'pet_opaque': 0.3, 'textiles_sanitaires': 0.3, 'pet_fonce': 0.3, 'background': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4153 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4153 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4153 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4153 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11548 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11556 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11557 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11552 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11552 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11555 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11555 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11580 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11580 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11551 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11550 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11550 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11559 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11551 doesn't seem to be define in the database( WARNING : type of input 3 of step 11550 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11548 doesn't seem to be define in the database( WARNING : type of input 2 of step 11552 doesn't seem to be define in the database( WARNING : output 1 of step 11548 have datatype=2 whereas input 1 of step 11555 have datatype=7 WARNING : type of output 2 of step 11555 doesn't seem to be define in the database( WARNING : type of input 1 of step 11549 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11551 have datatype=10 whereas input 3 of step 11558 have datatype=6 WARNING : type of input 2 of step 11580 doesn't seem to be define in the database( WARNING : output 1 of step 11549 have datatype=7 whereas input 2 of step 11580 have datatype=None WARNING : type of output 3 of step 11580 doesn't seem to be define in the database( WARNING : type of input 1 of step 11551 doesn't seem to be define in the database( WARNING : output 0 of step 11551 have datatype=10 whereas input 0 of step 11586 have datatype=18 WARNING : type of input 5 of step 11558 doesn't seem to be define in the database( WARNING : output 0 of step 11586 have datatype=11 whereas input 5 of step 11558 have datatype=None WARNING : type of output 1 of step 11556 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : type of output 1 of step 11557 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : output 0 of step 11555 have datatype=1 whereas input 0 of step 11549 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4200, 'hashtag_proportion': 'carton,ela,film_plastique,kraft,metal,papier,pehd,pet_opaque,textiles_sanitaires,barquette_opaque,pet_clair', 'hashtag_parmi': 'pet_fonce,etiquette,background', 'hashtag_weights': {'barquette_opaque': 1.5, 'carton': 2.5, 'ela': 1.5, 'etiquette': 1.5, 'film_plastique': 1, 'kraft': 1.5, 'metal': 3.0, 'papier': 1.2, 'pehd': 1.5, 'pet_clair': 1.5, 'pet_opaque': 1.5, 'textiles_sanitaires': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3992 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3992 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3992 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3992 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11536 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11545 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11544 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11540 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11540 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11543 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11543 merge_mask_thcl_custom have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 11537 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11579 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11579 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11539 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11538 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11538 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11547 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11539 doesn't seem to be define in the database( WARNING : type of input 3 of step 11538 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11536 doesn't seem to be define in the database( WARNING : type of input 2 of step 11540 doesn't seem to be define in the database( WARNING : output 1 of step 11536 have datatype=2 whereas input 1 of step 11543 have datatype=7 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11539 have datatype=10 whereas input 3 of step 11546 have datatype=6 WARNING : type of input 2 of step 11579 doesn't seem to be define in the database( WARNING : output 1 of step 11537 have datatype=7 whereas input 2 of step 11579 have datatype=None WARNING : type of output 3 of step 11579 doesn't seem to be define in the database( WARNING : type of input 1 of step 11539 doesn't seem to be define in the database( WARNING : output 0 of step 11539 have datatype=10 whereas input 0 of step 11585 have datatype=18 WARNING : type of input 5 of step 11546 doesn't seem to be define in the database( WARNING : output 0 of step 11585 have datatype=11 whereas input 5 of step 11546 have datatype=None WARNING : type of output 1 of step 11545 doesn't seem to be define in the database( WARNING : type of input 3 of step 11540 doesn't seem to be define in the database( WARNING : type of output 1 of step 11544 doesn't seem to be define in the database( WARNING : type of input 3 of step 11540 doesn't seem to be define in the database( WARNING : output 0 of step 11543 have datatype=1 whereas input 0 of step 11537 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4205, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'metal,background', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 1.5, 'ela': 1.5, 'etiquette': 1, 'film_plastique': 1, 'kraft': 1, 'papier': 1, 'pehd': 1.5, 'pet_clair': 1.5, 'pet_opaque': 1.5, 'textiles_sanitaires': 1.5, 'pet_fonce': 1.5}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3318 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3318 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3318 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3594, 'hashtag_proportion': 'papier,carton,metal,pet_clair,autre,pehd,pet_fonce', 'hashtag_parmi': 'refus,background', 'hashtag_weights': {'papier': 1, 'carton': 1, 'metal': 1, 'pet_clair': 1, 'autre': 1, 'pehd': 1, 'pet_fonce': 1, 'refus': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3804 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3804 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3804 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3804 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11560 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11567 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11567 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11563 crop_condition is not consistent : 4 used against 2 in the step definition ! Step 11563 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11564 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11564 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11573 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11573 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11566 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11566 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 1 of step 11560 have datatype=2 whereas input 1 of step 11564 have datatype=7 WARNING : type of output 2 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11565 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11567 doesn't seem to be define in the database( WARNING : type of input 3 of step 11563 doesn't seem to be define in the database( WARNING : type of output 3 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11568 doesn't seem to be define in the database( WARNING : type of output 1 of step 11568 doesn't seem to be define in the database( WARNING : type of input 3 of step 11566 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11570 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11569 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11570 doesn't seem to be define in the database( WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11569 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11568 have datatype=10 whereas input 3 of step 11571 have datatype=6 WARNING : type of input 2 of step 11573 doesn't seem to be define in the database( WARNING : output 1 of step 11565 have datatype=7 whereas input 2 of step 11573 have datatype=None WARNING : type of output 3 of step 11573 doesn't seem to be define in the database( WARNING : type of input 3 of step 11568 doesn't seem to be define in the database( WARNING : output 0 of step 11568 have datatype=10 whereas input 0 of step 11587 have datatype=18 WARNING : type of input 5 of step 11571 doesn't seem to be define in the database( WARNING : output 0 of step 11587 have datatype=11 whereas input 5 of step 11571 have datatype=None WARNING : output 0 of step 11564 have datatype=1 whereas input 0 of step 11565 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3327, 'hashtag_proportion': 'autre,carton,metal,papier,pehd,pet_fonce', 'hashtag_parmi': 'pet_clair,bouchon,etiquette,barquette_avec_film,background', 'hashtag_weights': {'autre': 8.0, 'barquette_avec_film': 6, 'carton': 8.0, 'metal': 12, 'papier': 5, 'pehd': 8, 'pet_fonce': 8, 'bouchon': 8, 'etiquette': 8}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier TODO : Insert select and so on SELECT id, name, misc_info, datou_id_for_right FROM MTRPhoto.dashboard_places WHERE name="Romainville_Presse_2"; SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3981 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3981 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3981 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3981 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! {"input_values":[]} SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3994 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3994 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3994 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3994 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11488 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11496 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11497 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11492 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11492 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11495 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11495 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11489 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11489 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11575 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11575 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11491 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11490 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11490 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11498 send_mail_cod have less outputs used (0) than in the step definition (1) : some outputs may be not used ! Step 11499 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11491 doesn't seem to be define in the database( WARNING : type of input 3 of step 11490 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11488 doesn't seem to be define in the database( WARNING : type of input 2 of step 11492 doesn't seem to be define in the database( WARNING : output 1 of step 11488 have datatype=2 whereas input 1 of step 11495 have datatype=7 WARNING : type of output 2 of step 11495 doesn't seem to be define in the database( WARNING : type of input 1 of step 11489 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11491 have datatype=10 whereas input 3 of step 11498 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11575 doesn't seem to be define in the database( WARNING : output 1 of step 11489 have datatype=7 whereas input 2 of step 11575 have datatype=None WARNING : type of output 3 of step 11575 doesn't seem to be define in the database( WARNING : type of input 1 of step 11491 doesn't seem to be define in the database( WARNING : output 0 of step 11491 have datatype=10 whereas input 0 of step 11581 have datatype=18 WARNING : type of input 5 of step 11498 doesn't seem to be define in the database( WARNING : output 0 of step 11581 have datatype=11 whereas input 5 of step 11498 have datatype=None WARNING : type of output 1 of step 11496 doesn't seem to be define in the database( WARNING : type of input 3 of step 11492 doesn't seem to be define in the database( WARNING : type of output 1 of step 11497 doesn't seem to be define in the database( WARNING : type of input 3 of step 11492 doesn't seem to be define in the database( WARNING : output 0 of step 11495 have datatype=1 whereas input 0 of step 11489 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4209, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,metal,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'papier,background', 'hashtag_weights': {'barquette_opaque': 0.7, 'carton': 0.7, 'ela': 0.7, 'etiquette': 0.5, 'film_plastique': 0.5, 'kraft': 0.7, 'metal': 1.5, 'pehd': 0.7, 'pet_clair': 0.7, 'pet_opaque': 0.7, 'textiles_sanitaires': 0.5, 'pet_fonce': 0.7}, 'ETA': 600} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3993 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3993 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3993 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3993 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4207, 'hashtag_proportion': 'barquette_opaque,ela,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'carton,background', 'hashtag_weights': {'barquette_opaque': 1, 'ela': 1, 'etiquette': 1.0, 'film_plastique': 0.5, 'kraft': 1, 'metal': 3.0, 'papier': 1, 'pehd': 2, 'pet_clair': 2, 'pet_opaque': 2, 'textiles_sanitaires': 1.0, 'pet_fonce': 2}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3459 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3459 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3459 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3459 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3726, 'hashtag_proportion': 'Carton_brun,Carton_gris,Teint_Dans_La_Masse,autre_refus,cartonnette,kraft,metal,plastique', 'hashtag_parmi': 'papier,background', 'hashtag_weights': {'Carton_brun': 1.5, 'Carton_gris': 1.5, 'Teint_Dans_La_Masse': 1.0, 'autre_refus': 1.5, 'cartonnette': 1.0, 'kraft': 1.5, 'metal': 3, 'plastique': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3991 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3991 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3991 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3991 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11512 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11521 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11520 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11516 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11516 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11519 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11519 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11513 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11513 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11577 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11577 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11515 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11514 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11514 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11523 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11515 doesn't seem to be define in the database( WARNING : type of input 3 of step 11514 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11512 doesn't seem to be define in the database( WARNING : type of input 2 of step 11516 doesn't seem to be define in the database( WARNING : output 1 of step 11512 have datatype=2 whereas input 1 of step 11519 have datatype=7 WARNING : type of output 2 of step 11519 doesn't seem to be define in the database( WARNING : type of input 1 of step 11513 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11515 have datatype=10 whereas input 3 of step 11522 have datatype=6 WARNING : type of input 2 of step 11577 doesn't seem to be define in the database( WARNING : output 1 of step 11513 have datatype=7 whereas input 2 of step 11577 have datatype=None WARNING : type of output 3 of step 11577 doesn't seem to be define in the database( WARNING : type of input 1 of step 11515 doesn't seem to be define in the database( WARNING : output 0 of step 11515 have datatype=10 whereas input 0 of step 11583 have datatype=18 WARNING : type of input 5 of step 11522 doesn't seem to be define in the database( WARNING : output 0 of step 11583 have datatype=11 whereas input 5 of step 11522 have datatype=None WARNING : type of output 1 of step 11521 doesn't seem to be define in the database( WARNING : type of input 3 of step 11516 doesn't seem to be define in the database( WARNING : type of output 1 of step 11520 doesn't seem to be define in the database( WARNING : type of input 3 of step 11516 doesn't seem to be define in the database( WARNING : output 0 of step 11519 have datatype=1 whereas input 0 of step 11513 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4203, 'hashtag_proportion': 'barquette_opaque,carton,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'ela,background', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 1, 'etiquette': 0.5, 'film_plastique': 0.5, 'kraft': 0.8, 'metal': 2, 'papier': 0.8, 'pehd': 0.8, 'pet_clair': 0.8, 'pet_opaque': 0.8, 'textiles_sanitaires': 0.5, 'pet_fonce': 0.8}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3995 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3995 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3995 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3995 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11524 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11533 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11532 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11528 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11528 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11531 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11531 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11525 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11525 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11578 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11578 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11527 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11526 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11526 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11535 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11527 doesn't seem to be define in the database( WARNING : type of input 3 of step 11526 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11524 doesn't seem to be define in the database( WARNING : type of input 2 of step 11528 doesn't seem to be define in the database( WARNING : output 1 of step 11524 have datatype=2 whereas input 1 of step 11531 have datatype=7 WARNING : type of output 2 of step 11531 doesn't seem to be define in the database( WARNING : type of input 1 of step 11525 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11527 have datatype=10 whereas input 3 of step 11534 have datatype=6 WARNING : type of input 2 of step 11578 doesn't seem to be define in the database( WARNING : output 1 of step 11525 have datatype=7 whereas input 2 of step 11578 have datatype=None WARNING : type of output 3 of step 11578 doesn't seem to be define in the database( WARNING : type of input 1 of step 11527 doesn't seem to be define in the database( WARNING : output 0 of step 11527 have datatype=10 whereas input 0 of step 11584 have datatype=18 WARNING : type of input 5 of step 11534 doesn't seem to be define in the database( WARNING : output 0 of step 11584 have datatype=11 whereas input 5 of step 11534 have datatype=None WARNING : type of output 1 of step 11533 doesn't seem to be define in the database( WARNING : type of input 3 of step 11528 doesn't seem to be define in the database( WARNING : type of output 1 of step 11532 doesn't seem to be define in the database( WARNING : type of input 3 of step 11528 doesn't seem to be define in the database( WARNING : output 0 of step 11531 have datatype=1 whereas input 0 of step 11525 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4211, 'hashtag_proportion': 'barquette_opaque,carton,ela,film_plastique,kraft,metal,papier,pet_fonce,pet_clair,pet_opaque,textiles_sanitaires', 'hashtag_parmi': 'pehd,etiquette,background', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 0.3, 'ela': 0.3, 'etiquette': 0.1, 'film_plastique': 0.1, 'kraft': 0.3, 'metal': 1.5, 'papier': 0.3, 'pet_clair': 0.3, 'pet_opaque': 0.3, 'textiles_sanitaires': 0.3, 'pet_fonce': 0.3, 'background': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4153 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4153 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4153 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4153 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11548 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11556 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11557 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11552 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11552 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11555 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11555 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11580 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11580 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11551 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11550 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11550 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11559 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11551 doesn't seem to be define in the database( WARNING : type of input 3 of step 11550 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11548 doesn't seem to be define in the database( WARNING : type of input 2 of step 11552 doesn't seem to be define in the database( WARNING : output 1 of step 11548 have datatype=2 whereas input 1 of step 11555 have datatype=7 WARNING : type of output 2 of step 11555 doesn't seem to be define in the database( WARNING : type of input 1 of step 11549 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11551 have datatype=10 whereas input 3 of step 11558 have datatype=6 WARNING : type of input 2 of step 11580 doesn't seem to be define in the database( WARNING : output 1 of step 11549 have datatype=7 whereas input 2 of step 11580 have datatype=None WARNING : type of output 3 of step 11580 doesn't seem to be define in the database( WARNING : type of input 1 of step 11551 doesn't seem to be define in the database( WARNING : output 0 of step 11551 have datatype=10 whereas input 0 of step 11586 have datatype=18 WARNING : type of input 5 of step 11558 doesn't seem to be define in the database( WARNING : output 0 of step 11586 have datatype=11 whereas input 5 of step 11558 have datatype=None WARNING : type of output 1 of step 11556 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : type of output 1 of step 11557 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : output 0 of step 11555 have datatype=1 whereas input 0 of step 11549 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4200, 'hashtag_proportion': 'carton,ela,film_plastique,kraft,metal,papier,pehd,pet_opaque,textiles_sanitaires,barquette_opaque,pet_clair', 'hashtag_parmi': 'pet_fonce,etiquette,background', 'hashtag_weights': {'barquette_opaque': 1.5, 'carton': 2.5, 'ela': 1.5, 'etiquette': 1.5, 'film_plastique': 1, 'kraft': 1.5, 'metal': 3.0, 'papier': 1.2, 'pehd': 1.5, 'pet_clair': 1.5, 'pet_opaque': 1.5, 'textiles_sanitaires': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3992 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3992 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3992 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3992 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11536 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11545 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11544 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11540 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11540 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11543 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11543 merge_mask_thcl_custom have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 11537 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11579 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11579 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11539 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11538 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11538 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11547 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11539 doesn't seem to be define in the database( WARNING : type of input 3 of step 11538 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11536 doesn't seem to be define in the database( WARNING : type of input 2 of step 11540 doesn't seem to be define in the database( WARNING : output 1 of step 11536 have datatype=2 whereas input 1 of step 11543 have datatype=7 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11539 have datatype=10 whereas input 3 of step 11546 have datatype=6 WARNING : type of input 2 of step 11579 doesn't seem to be define in the database( WARNING : output 1 of step 11537 have datatype=7 whereas input 2 of step 11579 have datatype=None WARNING : type of output 3 of step 11579 doesn't seem to be define in the database( WARNING : type of input 1 of step 11539 doesn't seem to be define in the database( WARNING : output 0 of step 11539 have datatype=10 whereas input 0 of step 11585 have datatype=18 WARNING : type of input 5 of step 11546 doesn't seem to be define in the database( WARNING : output 0 of step 11585 have datatype=11 whereas input 5 of step 11546 have datatype=None WARNING : type of output 1 of step 11545 doesn't seem to be define in the database( WARNING : type of input 3 of step 11540 doesn't seem to be define in the database( WARNING : type of output 1 of step 11544 doesn't seem to be define in the database( WARNING : type of input 3 of step 11540 doesn't seem to be define in the database( WARNING : output 0 of step 11543 have datatype=1 whereas input 0 of step 11537 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4205, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'metal,background', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 1.5, 'ela': 1.5, 'etiquette': 1, 'film_plastique': 1, 'kraft': 1, 'papier': 1, 'pehd': 1.5, 'pet_clair': 1.5, 'pet_opaque': 1.5, 'textiles_sanitaires': 1.5, 'pet_fonce': 1.5}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3318 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3318 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3318 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3594, 'hashtag_proportion': 'papier,carton,metal,pet_clair,autre,pehd,pet_fonce', 'hashtag_parmi': 'refus,background', 'hashtag_weights': {'papier': 1, 'carton': 1, 'metal': 1, 'pet_clair': 1, 'autre': 1, 'pehd': 1, 'pet_fonce': 1, 'refus': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3804 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3804 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3804 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3804 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11560 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11567 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11567 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11563 crop_condition is not consistent : 4 used against 2 in the step definition ! Step 11563 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11564 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11564 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11573 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11573 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11566 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11566 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 1 of step 11560 have datatype=2 whereas input 1 of step 11564 have datatype=7 WARNING : type of output 2 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11565 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11567 doesn't seem to be define in the database( WARNING : type of input 3 of step 11563 doesn't seem to be define in the database( WARNING : type of output 3 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11568 doesn't seem to be define in the database( WARNING : type of output 1 of step 11568 doesn't seem to be define in the database( WARNING : type of input 3 of step 11566 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11570 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11569 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11570 doesn't seem to be define in the database( WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11569 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11568 have datatype=10 whereas input 3 of step 11571 have datatype=6 WARNING : type of input 2 of step 11573 doesn't seem to be define in the database( WARNING : output 1 of step 11565 have datatype=7 whereas input 2 of step 11573 have datatype=None WARNING : type of output 3 of step 11573 doesn't seem to be define in the database( WARNING : type of input 3 of step 11568 doesn't seem to be define in the database( WARNING : output 0 of step 11568 have datatype=10 whereas input 0 of step 11587 have datatype=18 WARNING : type of input 5 of step 11571 doesn't seem to be define in the database( WARNING : output 0 of step 11587 have datatype=11 whereas input 5 of step 11571 have datatype=None WARNING : output 0 of step 11564 have datatype=1 whereas input 0 of step 11565 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3327, 'hashtag_proportion': 'autre,carton,metal,papier,pehd,pet_fonce', 'hashtag_parmi': 'pet_clair,bouchon,etiquette,barquette_avec_film,background', 'hashtag_weights': {'autre': 8.0, 'barquette_avec_film': 6, 'carton': 8.0, 'metal': 12, 'papier': 5, 'pehd': 8, 'pet_fonce': 8, 'bouchon': 8, 'etiquette': 8}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier nb_day : (0, 31) VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3981 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3981 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3981 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3981 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! {"input_values":[]} SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3994 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3994 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3994 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3994 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11488 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11496 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11497 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11492 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11492 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11495 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11495 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11489 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11489 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11575 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11575 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11491 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11490 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11490 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11498 send_mail_cod have less outputs used (0) than in the step definition (1) : some outputs may be not used ! Step 11499 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11491 doesn't seem to be define in the database( WARNING : type of input 3 of step 11490 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11488 doesn't seem to be define in the database( WARNING : type of input 2 of step 11492 doesn't seem to be define in the database( WARNING : output 1 of step 11488 have datatype=2 whereas input 1 of step 11495 have datatype=7 WARNING : type of output 2 of step 11495 doesn't seem to be define in the database( WARNING : type of input 1 of step 11489 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11491 have datatype=10 whereas input 3 of step 11498 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11575 doesn't seem to be define in the database( WARNING : output 1 of step 11489 have datatype=7 whereas input 2 of step 11575 have datatype=None WARNING : type of output 3 of step 11575 doesn't seem to be define in the database( WARNING : type of input 1 of step 11491 doesn't seem to be define in the database( WARNING : output 0 of step 11491 have datatype=10 whereas input 0 of step 11581 have datatype=18 WARNING : type of input 5 of step 11498 doesn't seem to be define in the database( WARNING : output 0 of step 11581 have datatype=11 whereas input 5 of step 11498 have datatype=None WARNING : type of output 1 of step 11496 doesn't seem to be define in the database( WARNING : type of input 3 of step 11492 doesn't seem to be define in the database( WARNING : type of output 1 of step 11497 doesn't seem to be define in the database( WARNING : type of input 3 of step 11492 doesn't seem to be define in the database( WARNING : output 0 of step 11495 have datatype=1 whereas input 0 of step 11489 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4209, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,metal,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'papier,background', 'hashtag_weights': {'barquette_opaque': 0.7, 'carton': 0.7, 'ela': 0.7, 'etiquette': 0.5, 'film_plastique': 0.5, 'kraft': 0.7, 'metal': 1.5, 'pehd': 0.7, 'pet_clair': 0.7, 'pet_opaque': 0.7, 'textiles_sanitaires': 0.5, 'pet_fonce': 0.7}, 'ETA': 600} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3993 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3993 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3993 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3993 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4207, 'hashtag_proportion': 'barquette_opaque,ela,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'carton,background', 'hashtag_weights': {'barquette_opaque': 1, 'ela': 1, 'etiquette': 1.0, 'film_plastique': 0.5, 'kraft': 1, 'metal': 3.0, 'papier': 1, 'pehd': 2, 'pet_clair': 2, 'pet_opaque': 2, 'textiles_sanitaires': 1.0, 'pet_fonce': 2}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3459 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3459 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3459 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3459 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3726, 'hashtag_proportion': 'Carton_brun,Carton_gris,Teint_Dans_La_Masse,autre_refus,cartonnette,kraft,metal,plastique', 'hashtag_parmi': 'papier,background', 'hashtag_weights': {'Carton_brun': 1.5, 'Carton_gris': 1.5, 'Teint_Dans_La_Masse': 1.0, 'autre_refus': 1.5, 'cartonnette': 1.0, 'kraft': 1.5, 'metal': 3, 'plastique': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3991 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3991 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3991 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3991 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11512 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11521 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11520 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11516 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11516 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11519 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11519 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11513 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11513 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11577 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11577 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11515 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11514 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11514 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11523 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11515 doesn't seem to be define in the database( WARNING : type of input 3 of step 11514 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11512 doesn't seem to be define in the database( WARNING : type of input 2 of step 11516 doesn't seem to be define in the database( WARNING : output 1 of step 11512 have datatype=2 whereas input 1 of step 11519 have datatype=7 WARNING : type of output 2 of step 11519 doesn't seem to be define in the database( WARNING : type of input 1 of step 11513 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11515 have datatype=10 whereas input 3 of step 11522 have datatype=6 WARNING : type of input 2 of step 11577 doesn't seem to be define in the database( WARNING : output 1 of step 11513 have datatype=7 whereas input 2 of step 11577 have datatype=None WARNING : type of output 3 of step 11577 doesn't seem to be define in the database( WARNING : type of input 1 of step 11515 doesn't seem to be define in the database( WARNING : output 0 of step 11515 have datatype=10 whereas input 0 of step 11583 have datatype=18 WARNING : type of input 5 of step 11522 doesn't seem to be define in the database( WARNING : output 0 of step 11583 have datatype=11 whereas input 5 of step 11522 have datatype=None WARNING : type of output 1 of step 11521 doesn't seem to be define in the database( WARNING : type of input 3 of step 11516 doesn't seem to be define in the database( WARNING : type of output 1 of step 11520 doesn't seem to be define in the database( WARNING : type of input 3 of step 11516 doesn't seem to be define in the database( WARNING : output 0 of step 11519 have datatype=1 whereas input 0 of step 11513 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4203, 'hashtag_proportion': 'barquette_opaque,carton,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'ela,background', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 1, 'etiquette': 0.5, 'film_plastique': 0.5, 'kraft': 0.8, 'metal': 2, 'papier': 0.8, 'pehd': 0.8, 'pet_clair': 0.8, 'pet_opaque': 0.8, 'textiles_sanitaires': 0.5, 'pet_fonce': 0.8}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3995 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3995 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3995 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3995 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11524 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11533 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11532 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11528 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11528 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11531 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11531 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11525 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11525 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11578 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11578 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11527 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11526 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11526 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11535 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11527 doesn't seem to be define in the database( WARNING : type of input 3 of step 11526 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11524 doesn't seem to be define in the database( WARNING : type of input 2 of step 11528 doesn't seem to be define in the database( WARNING : output 1 of step 11524 have datatype=2 whereas input 1 of step 11531 have datatype=7 WARNING : type of output 2 of step 11531 doesn't seem to be define in the database( WARNING : type of input 1 of step 11525 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11527 have datatype=10 whereas input 3 of step 11534 have datatype=6 WARNING : type of input 2 of step 11578 doesn't seem to be define in the database( WARNING : output 1 of step 11525 have datatype=7 whereas input 2 of step 11578 have datatype=None WARNING : type of output 3 of step 11578 doesn't seem to be define in the database( WARNING : type of input 1 of step 11527 doesn't seem to be define in the database( WARNING : output 0 of step 11527 have datatype=10 whereas input 0 of step 11584 have datatype=18 WARNING : type of input 5 of step 11534 doesn't seem to be define in the database( WARNING : output 0 of step 11584 have datatype=11 whereas input 5 of step 11534 have datatype=None WARNING : type of output 1 of step 11533 doesn't seem to be define in the database( WARNING : type of input 3 of step 11528 doesn't seem to be define in the database( WARNING : type of output 1 of step 11532 doesn't seem to be define in the database( WARNING : type of input 3 of step 11528 doesn't seem to be define in the database( WARNING : output 0 of step 11531 have datatype=1 whereas input 0 of step 11525 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4211, 'hashtag_proportion': 'barquette_opaque,carton,ela,film_plastique,kraft,metal,papier,pet_fonce,pet_clair,pet_opaque,textiles_sanitaires', 'hashtag_parmi': 'pehd,etiquette,background', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 0.3, 'ela': 0.3, 'etiquette': 0.1, 'film_plastique': 0.1, 'kraft': 0.3, 'metal': 1.5, 'papier': 0.3, 'pet_clair': 0.3, 'pet_opaque': 0.3, 'textiles_sanitaires': 0.3, 'pet_fonce': 0.3, 'background': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4153 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4153 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4153 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4153 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11548 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11556 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11557 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11552 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11552 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11555 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11555 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11580 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11580 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11551 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11550 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11550 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11559 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11551 doesn't seem to be define in the database( WARNING : type of input 3 of step 11550 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11548 doesn't seem to be define in the database( WARNING : type of input 2 of step 11552 doesn't seem to be define in the database( WARNING : output 1 of step 11548 have datatype=2 whereas input 1 of step 11555 have datatype=7 WARNING : type of output 2 of step 11555 doesn't seem to be define in the database( WARNING : type of input 1 of step 11549 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11551 have datatype=10 whereas input 3 of step 11558 have datatype=6 WARNING : type of input 2 of step 11580 doesn't seem to be define in the database( WARNING : output 1 of step 11549 have datatype=7 whereas input 2 of step 11580 have datatype=None WARNING : type of output 3 of step 11580 doesn't seem to be define in the database( WARNING : type of input 1 of step 11551 doesn't seem to be define in the database( WARNING : output 0 of step 11551 have datatype=10 whereas input 0 of step 11586 have datatype=18 WARNING : type of input 5 of step 11558 doesn't seem to be define in the database( WARNING : output 0 of step 11586 have datatype=11 whereas input 5 of step 11558 have datatype=None WARNING : type of output 1 of step 11556 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : type of output 1 of step 11557 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : output 0 of step 11555 have datatype=1 whereas input 0 of step 11549 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4200, 'hashtag_proportion': 'carton,ela,film_plastique,kraft,metal,papier,pehd,pet_opaque,textiles_sanitaires,barquette_opaque,pet_clair', 'hashtag_parmi': 'pet_fonce,etiquette,background', 'hashtag_weights': {'barquette_opaque': 1.5, 'carton': 2.5, 'ela': 1.5, 'etiquette': 1.5, 'film_plastique': 1, 'kraft': 1.5, 'metal': 3.0, 'papier': 1.2, 'pehd': 1.5, 'pet_clair': 1.5, 'pet_opaque': 1.5, 'textiles_sanitaires': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3992 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3992 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3992 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3992 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11536 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11545 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11544 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11540 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11540 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11543 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11543 merge_mask_thcl_custom have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 11537 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11579 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11579 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11539 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11538 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11538 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11547 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11539 doesn't seem to be define in the database( WARNING : type of input 3 of step 11538 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11536 doesn't seem to be define in the database( WARNING : type of input 2 of step 11540 doesn't seem to be define in the database( WARNING : output 1 of step 11536 have datatype=2 whereas input 1 of step 11543 have datatype=7 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11539 have datatype=10 whereas input 3 of step 11546 have datatype=6 WARNING : type of input 2 of step 11579 doesn't seem to be define in the database( WARNING : output 1 of step 11537 have datatype=7 whereas input 2 of step 11579 have datatype=None WARNING : type of output 3 of step 11579 doesn't seem to be define in the database( WARNING : type of input 1 of step 11539 doesn't seem to be define in the database( WARNING : output 0 of step 11539 have datatype=10 whereas input 0 of step 11585 have datatype=18 WARNING : type of input 5 of step 11546 doesn't seem to be define in the database( WARNING : output 0 of step 11585 have datatype=11 whereas input 5 of step 11546 have datatype=None WARNING : type of output 1 of step 11545 doesn't seem to be define in the database( WARNING : type of input 3 of step 11540 doesn't seem to be define in the database( WARNING : type of output 1 of step 11544 doesn't seem to be define in the database( WARNING : type of input 3 of step 11540 doesn't seem to be define in the database( WARNING : output 0 of step 11543 have datatype=1 whereas input 0 of step 11537 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4205, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'metal,background', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 1.5, 'ela': 1.5, 'etiquette': 1, 'film_plastique': 1, 'kraft': 1, 'papier': 1, 'pehd': 1.5, 'pet_clair': 1.5, 'pet_opaque': 1.5, 'textiles_sanitaires': 1.5, 'pet_fonce': 1.5}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3318 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3318 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3318 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3594, 'hashtag_proportion': 'papier,carton,metal,pet_clair,autre,pehd,pet_fonce', 'hashtag_parmi': 'refus,background', 'hashtag_weights': {'papier': 1, 'carton': 1, 'metal': 1, 'pet_clair': 1, 'autre': 1, 'pehd': 1, 'pet_fonce': 1, 'refus': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3804 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3804 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3804 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3804 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11560 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11567 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11567 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11563 crop_condition is not consistent : 4 used against 2 in the step definition ! Step 11563 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11564 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11564 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11573 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11573 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11566 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11566 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 1 of step 11560 have datatype=2 whereas input 1 of step 11564 have datatype=7 WARNING : type of output 2 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11565 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11567 doesn't seem to be define in the database( WARNING : type of input 3 of step 11563 doesn't seem to be define in the database( WARNING : type of output 3 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11568 doesn't seem to be define in the database( WARNING : type of output 1 of step 11568 doesn't seem to be define in the database( WARNING : type of input 3 of step 11566 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11570 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11569 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11570 doesn't seem to be define in the database( WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11569 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11568 have datatype=10 whereas input 3 of step 11571 have datatype=6 WARNING : type of input 2 of step 11573 doesn't seem to be define in the database( WARNING : output 1 of step 11565 have datatype=7 whereas input 2 of step 11573 have datatype=None WARNING : type of output 3 of step 11573 doesn't seem to be define in the database( WARNING : type of input 3 of step 11568 doesn't seem to be define in the database( WARNING : output 0 of step 11568 have datatype=10 whereas input 0 of step 11587 have datatype=18 WARNING : type of input 5 of step 11571 doesn't seem to be define in the database( WARNING : output 0 of step 11587 have datatype=11 whereas input 5 of step 11571 have datatype=None WARNING : output 0 of step 11564 have datatype=1 whereas input 0 of step 11565 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3327, 'hashtag_proportion': 'autre,carton,metal,papier,pehd,pet_fonce', 'hashtag_parmi': 'pet_clair,bouchon,etiquette,barquette_avec_film,background', 'hashtag_weights': {'autre': 8.0, 'barquette_avec_film': 6, 'carton': 8.0, 'metal': 12, 'papier': 5, 'pehd': 8, 'pet_fonce': 8, 'bouchon': 8, 'etiquette': 8}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier TODO : Insert select and so on SELECT id, name, misc_info, datou_id_for_right FROM MTRPhoto.dashboard_places WHERE name="Romainville_Presse_2"; SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3981 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3981 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3981 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3981 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! {"input_values":[]} SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3994 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3994 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3994 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3994 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11488 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11496 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11497 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11492 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11492 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11495 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11495 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11489 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11489 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11575 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11575 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11491 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11490 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11490 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11498 send_mail_cod have less outputs used (0) than in the step definition (1) : some outputs may be not used ! Step 11499 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11491 doesn't seem to be define in the database( WARNING : type of input 3 of step 11490 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11488 doesn't seem to be define in the database( WARNING : type of input 2 of step 11492 doesn't seem to be define in the database( WARNING : output 1 of step 11488 have datatype=2 whereas input 1 of step 11495 have datatype=7 WARNING : type of output 2 of step 11495 doesn't seem to be define in the database( WARNING : type of input 1 of step 11489 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11491 have datatype=10 whereas input 3 of step 11498 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11575 doesn't seem to be define in the database( WARNING : output 1 of step 11489 have datatype=7 whereas input 2 of step 11575 have datatype=None WARNING : type of output 3 of step 11575 doesn't seem to be define in the database( WARNING : type of input 1 of step 11491 doesn't seem to be define in the database( WARNING : output 0 of step 11491 have datatype=10 whereas input 0 of step 11581 have datatype=18 WARNING : type of input 5 of step 11498 doesn't seem to be define in the database( WARNING : output 0 of step 11581 have datatype=11 whereas input 5 of step 11498 have datatype=None WARNING : type of output 1 of step 11496 doesn't seem to be define in the database( WARNING : type of input 3 of step 11492 doesn't seem to be define in the database( WARNING : type of output 1 of step 11497 doesn't seem to be define in the database( WARNING : type of input 3 of step 11492 doesn't seem to be define in the database( WARNING : output 0 of step 11495 have datatype=1 whereas input 0 of step 11489 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4209, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,metal,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'papier,background', 'hashtag_weights': {'barquette_opaque': 0.7, 'carton': 0.7, 'ela': 0.7, 'etiquette': 0.5, 'film_plastique': 0.5, 'kraft': 0.7, 'metal': 1.5, 'pehd': 0.7, 'pet_clair': 0.7, 'pet_opaque': 0.7, 'textiles_sanitaires': 0.5, 'pet_fonce': 0.7}, 'ETA': 600} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3993 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3993 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3993 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3993 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4207, 'hashtag_proportion': 'barquette_opaque,ela,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'carton,background', 'hashtag_weights': {'barquette_opaque': 1, 'ela': 1, 'etiquette': 1.0, 'film_plastique': 0.5, 'kraft': 1, 'metal': 3.0, 'papier': 1, 'pehd': 2, 'pet_clair': 2, 'pet_opaque': 2, 'textiles_sanitaires': 1.0, 'pet_fonce': 2}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3459 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3459 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3459 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3459 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3726, 'hashtag_proportion': 'Carton_brun,Carton_gris,Teint_Dans_La_Masse,autre_refus,cartonnette,kraft,metal,plastique', 'hashtag_parmi': 'papier,background', 'hashtag_weights': {'Carton_brun': 1.5, 'Carton_gris': 1.5, 'Teint_Dans_La_Masse': 1.0, 'autre_refus': 1.5, 'cartonnette': 1.0, 'kraft': 1.5, 'metal': 3, 'plastique': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3991 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3991 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3991 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3991 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11512 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11521 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11520 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11516 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11516 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11519 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11519 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11513 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11513 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11577 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11577 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11515 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11514 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11514 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11523 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11515 doesn't seem to be define in the database( WARNING : type of input 3 of step 11514 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11512 doesn't seem to be define in the database( WARNING : type of input 2 of step 11516 doesn't seem to be define in the database( WARNING : output 1 of step 11512 have datatype=2 whereas input 1 of step 11519 have datatype=7 WARNING : type of output 2 of step 11519 doesn't seem to be define in the database( WARNING : type of input 1 of step 11513 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11515 have datatype=10 whereas input 3 of step 11522 have datatype=6 WARNING : type of input 2 of step 11577 doesn't seem to be define in the database( WARNING : output 1 of step 11513 have datatype=7 whereas input 2 of step 11577 have datatype=None WARNING : type of output 3 of step 11577 doesn't seem to be define in the database( WARNING : type of input 1 of step 11515 doesn't seem to be define in the database( WARNING : output 0 of step 11515 have datatype=10 whereas input 0 of step 11583 have datatype=18 WARNING : type of input 5 of step 11522 doesn't seem to be define in the database( WARNING : output 0 of step 11583 have datatype=11 whereas input 5 of step 11522 have datatype=None WARNING : type of output 1 of step 11521 doesn't seem to be define in the database( WARNING : type of input 3 of step 11516 doesn't seem to be define in the database( WARNING : type of output 1 of step 11520 doesn't seem to be define in the database( WARNING : type of input 3 of step 11516 doesn't seem to be define in the database( WARNING : output 0 of step 11519 have datatype=1 whereas input 0 of step 11513 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4203, 'hashtag_proportion': 'barquette_opaque,carton,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'ela,background', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 1, 'etiquette': 0.5, 'film_plastique': 0.5, 'kraft': 0.8, 'metal': 2, 'papier': 0.8, 'pehd': 0.8, 'pet_clair': 0.8, 'pet_opaque': 0.8, 'textiles_sanitaires': 0.5, 'pet_fonce': 0.8}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3995 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3995 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3995 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3995 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11524 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11533 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11532 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11528 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11528 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11531 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11531 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11525 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11525 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11578 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11578 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11527 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11526 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11526 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11535 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11527 doesn't seem to be define in the database( WARNING : type of input 3 of step 11526 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11524 doesn't seem to be define in the database( WARNING : type of input 2 of step 11528 doesn't seem to be define in the database( WARNING : output 1 of step 11524 have datatype=2 whereas input 1 of step 11531 have datatype=7 WARNING : type of output 2 of step 11531 doesn't seem to be define in the database( WARNING : type of input 1 of step 11525 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11527 have datatype=10 whereas input 3 of step 11534 have datatype=6 WARNING : type of input 2 of step 11578 doesn't seem to be define in the database( WARNING : output 1 of step 11525 have datatype=7 whereas input 2 of step 11578 have datatype=None WARNING : type of output 3 of step 11578 doesn't seem to be define in the database( WARNING : type of input 1 of step 11527 doesn't seem to be define in the database( WARNING : output 0 of step 11527 have datatype=10 whereas input 0 of step 11584 have datatype=18 WARNING : type of input 5 of step 11534 doesn't seem to be define in the database( WARNING : output 0 of step 11584 have datatype=11 whereas input 5 of step 11534 have datatype=None WARNING : type of output 1 of step 11533 doesn't seem to be define in the database( WARNING : type of input 3 of step 11528 doesn't seem to be define in the database( WARNING : type of output 1 of step 11532 doesn't seem to be define in the database( WARNING : type of input 3 of step 11528 doesn't seem to be define in the database( WARNING : output 0 of step 11531 have datatype=1 whereas input 0 of step 11525 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4211, 'hashtag_proportion': 'barquette_opaque,carton,ela,film_plastique,kraft,metal,papier,pet_fonce,pet_clair,pet_opaque,textiles_sanitaires', 'hashtag_parmi': 'pehd,etiquette,background', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 0.3, 'ela': 0.3, 'etiquette': 0.1, 'film_plastique': 0.1, 'kraft': 0.3, 'metal': 1.5, 'papier': 0.3, 'pet_clair': 0.3, 'pet_opaque': 0.3, 'textiles_sanitaires': 0.3, 'pet_fonce': 0.3, 'background': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4153 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4153 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4153 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4153 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11548 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11556 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11557 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11552 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11552 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11555 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11555 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11580 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11580 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11551 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11550 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11550 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11559 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11551 doesn't seem to be define in the database( WARNING : type of input 3 of step 11550 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11548 doesn't seem to be define in the database( WARNING : type of input 2 of step 11552 doesn't seem to be define in the database( WARNING : output 1 of step 11548 have datatype=2 whereas input 1 of step 11555 have datatype=7 WARNING : type of output 2 of step 11555 doesn't seem to be define in the database( WARNING : type of input 1 of step 11549 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11551 have datatype=10 whereas input 3 of step 11558 have datatype=6 WARNING : type of input 2 of step 11580 doesn't seem to be define in the database( WARNING : output 1 of step 11549 have datatype=7 whereas input 2 of step 11580 have datatype=None WARNING : type of output 3 of step 11580 doesn't seem to be define in the database( WARNING : type of input 1 of step 11551 doesn't seem to be define in the database( WARNING : output 0 of step 11551 have datatype=10 whereas input 0 of step 11586 have datatype=18 WARNING : type of input 5 of step 11558 doesn't seem to be define in the database( WARNING : output 0 of step 11586 have datatype=11 whereas input 5 of step 11558 have datatype=None WARNING : type of output 1 of step 11556 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : type of output 1 of step 11557 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : output 0 of step 11555 have datatype=1 whereas input 0 of step 11549 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4200, 'hashtag_proportion': 'carton,ela,film_plastique,kraft,metal,papier,pehd,pet_opaque,textiles_sanitaires,barquette_opaque,pet_clair', 'hashtag_parmi': 'pet_fonce,etiquette,background', 'hashtag_weights': {'barquette_opaque': 1.5, 'carton': 2.5, 'ela': 1.5, 'etiquette': 1.5, 'film_plastique': 1, 'kraft': 1.5, 'metal': 3.0, 'papier': 1.2, 'pehd': 1.5, 'pet_clair': 1.5, 'pet_opaque': 1.5, 'textiles_sanitaires': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3992 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3992 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3992 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3992 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11536 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11545 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11544 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11540 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11540 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11543 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11543 merge_mask_thcl_custom have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 11537 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11579 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11579 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11539 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11538 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11538 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11547 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11539 doesn't seem to be define in the database( WARNING : type of input 3 of step 11538 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11536 doesn't seem to be define in the database( WARNING : type of input 2 of step 11540 doesn't seem to be define in the database( WARNING : output 1 of step 11536 have datatype=2 whereas input 1 of step 11543 have datatype=7 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11539 have datatype=10 whereas input 3 of step 11546 have datatype=6 WARNING : type of input 2 of step 11579 doesn't seem to be define in the database( WARNING : output 1 of step 11537 have datatype=7 whereas input 2 of step 11579 have datatype=None WARNING : type of output 3 of step 11579 doesn't seem to be define in the database( WARNING : type of input 1 of step 11539 doesn't seem to be define in the database( WARNING : output 0 of step 11539 have datatype=10 whereas input 0 of step 11585 have datatype=18 WARNING : type of input 5 of step 11546 doesn't seem to be define in the database( WARNING : output 0 of step 11585 have datatype=11 whereas input 5 of step 11546 have datatype=None WARNING : type of output 1 of step 11545 doesn't seem to be define in the database( WARNING : type of input 3 of step 11540 doesn't seem to be define in the database( WARNING : type of output 1 of step 11544 doesn't seem to be define in the database( WARNING : type of input 3 of step 11540 doesn't seem to be define in the database( WARNING : output 0 of step 11543 have datatype=1 whereas input 0 of step 11537 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4205, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'metal,background', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 1.5, 'ela': 1.5, 'etiquette': 1, 'film_plastique': 1, 'kraft': 1, 'papier': 1, 'pehd': 1.5, 'pet_clair': 1.5, 'pet_opaque': 1.5, 'textiles_sanitaires': 1.5, 'pet_fonce': 1.5}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3318 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3318 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3318 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3594, 'hashtag_proportion': 'papier,carton,metal,pet_clair,autre,pehd,pet_fonce', 'hashtag_parmi': 'refus,background', 'hashtag_weights': {'papier': 1, 'carton': 1, 'metal': 1, 'pet_clair': 1, 'autre': 1, 'pehd': 1, 'pet_fonce': 1, 'refus': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3804 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3804 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3804 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3804 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11560 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11567 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11567 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11563 crop_condition is not consistent : 4 used against 2 in the step definition ! Step 11563 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11564 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11564 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11573 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11573 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11566 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11566 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 1 of step 11560 have datatype=2 whereas input 1 of step 11564 have datatype=7 WARNING : type of output 2 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11565 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11567 doesn't seem to be define in the database( WARNING : type of input 3 of step 11563 doesn't seem to be define in the database( WARNING : type of output 3 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11568 doesn't seem to be define in the database( WARNING : type of output 1 of step 11568 doesn't seem to be define in the database( WARNING : type of input 3 of step 11566 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11570 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11569 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11570 doesn't seem to be define in the database( WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11569 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11568 have datatype=10 whereas input 3 of step 11571 have datatype=6 WARNING : type of input 2 of step 11573 doesn't seem to be define in the database( WARNING : output 1 of step 11565 have datatype=7 whereas input 2 of step 11573 have datatype=None WARNING : type of output 3 of step 11573 doesn't seem to be define in the database( WARNING : type of input 3 of step 11568 doesn't seem to be define in the database( WARNING : output 0 of step 11568 have datatype=10 whereas input 0 of step 11587 have datatype=18 WARNING : type of input 5 of step 11571 doesn't seem to be define in the database( WARNING : output 0 of step 11587 have datatype=11 whereas input 5 of step 11571 have datatype=None WARNING : output 0 of step 11564 have datatype=1 whereas input 0 of step 11565 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3327, 'hashtag_proportion': 'autre,carton,metal,papier,pehd,pet_fonce', 'hashtag_parmi': 'pet_clair,bouchon,etiquette,barquette_avec_film,background', 'hashtag_weights': {'autre': 8.0, 'barquette_avec_film': 6, 'carton': 8.0, 'metal': 12, 'papier': 5, 'pehd': 8, 'pet_fonce': 8, 'bouchon': 8, 'etiquette': 8}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier place_id : 53 month : 08 mtr_id : 1038 dashboard_places : Romainville_Presse_2 date : 2022-08 year : 2022 raspi : 30002 select count(distinct mtr_photo_id) from MTRUser.mtr_portfolio_photos where mtr_portfolio_id in (select id from MTRUser.mtr_portfolios where id in (select mtr_portfolio_id from MTRPhoto.dashboard_results where dashboard_run_id in(select last_run_id from MTRPhoto.dashboard_entry_day where dashboard_place_id in (select id from MTRPhoto.dashboard_places where name = 'Romainville_Presse_2' and date like '%2022-08%') and created_at like '%2022-08%'))); nb_day : (0, 31) after unwanted_material_data nb_day : (0, 31) SQL: SELECT ms.id, ms.name, mst.name as type, ms.test_group, ms.test_name, ms.server, ms.version_code, ms.result_str, ms.result_bool, ms.result_float, ms.lien, ms.created_at FROM MTRAdmin.monitor_sys ms INNER JOIN MTRAdmin.monitor_sys_type mst on mst.id = ms.type WHERE ms.test_name like '%30002%' AND ms.result_str like '%2022/08%'ORDER BY ms.id desc LIMIT 0, 1000000; No photos configured for Continue since we have an error ! No photos configured for Continue since we have an error ! No photos configured for Continue since we have an error ! Since we don't have condition on date we need to verify this lately ! No photos configured for Continue since we have an error ! No photos configured for Continue since we have an error ! No photos configured for Continue since we have an error ! No photos configured for Continue since we have an error ! No photos configured for Continue since we have an error ! No photos configured for Continue since we have an error ! Since we don't have condition on date we need to verify this lately ! No photos configured for Continue since we have an error ! No photos configured for Continue since we have an error ! No photos configured for Continue since we have an error ! No photos configured for Continue since we have an error ! No photos configured for Continue since we have an error ! No photos configured for Continue since we have an error ! Since we don't have condition on date we need to verify this lately ! No photos configured for Continue since we have an error ! No photos configured for Continue since we have an error ! No photos configured for Continue since we have an error ! No photos configured for Continue since we have an error ! No photos configured for Continue since we have an error ! No photos configured for Continue since we have an error ! Since we don't have condition on date we need to verify this lately ! No photos configured for Continue since we have an error ! No photos configured for Continue since we have an error ! No photos configured for Continue since we have an error ! No photos configured for Continue since we have an error ! No photos configured for Continue since we have an error ! No photos configured for Continue since we have an error ! No photos configured for Continue since we have an error ! {'date': '2022/08/06/', 'result': ', error missing sqlite.db'} Continue since coverage is None {'date': '2022/08/05/', 'result': ', error missing sqlite.db'} Continue since coverage is None {'date': '2022/08/04/', 'result': ', error missing sqlite.db'} Continue since coverage is None {'date': '2022/08/03/', 'result': ', error missing sqlite.db'} Continue since coverage is None {'date': '2022/08/02/', 'result': ', error missing sqlite.db'} Continue since coverage is None {'date': '2022/08/01/', 'result': ', error missing sqlite.db'} Continue since coverage is None {'date': '2022/08/06/', 'result': ', error missing sqlite.db'} Continue since coverage is None {'date': '2022/08/05/', 'result': ', error missing sqlite.db'} Continue since coverage is None {'date': '2022/08/04/', 'result': ', error missing sqlite.db'} Continue since coverage is None {'date': '2022/08/03/', 'result': ', error missing sqlite.db'} Continue since coverage is None {'date': '2022/08/02/', 'result': ', error missing sqlite.db'} Continue since coverage is None {'date': '2022/08/01/', 'result': ', error missing sqlite.db'} Continue since coverage is None {'date': '2022/08/06/', 'result': ', error missing sqlite.db'} Continue since coverage is None {'date': '2022/08/05/', 'result': ', error missing sqlite.db'} Continue since coverage is None {'date': '2022/08/04/', 'result': ', error missing sqlite.db'} Continue since coverage is None {'date': '2022/08/03/', 'result': ', error missing sqlite.db'} Continue since coverage is None {'date': '2022/08/02/', 'result': ', error missing sqlite.db'} Continue since coverage is None {'date': '2022/08/01/', 'result': ', error missing sqlite.db'} Continue since coverage is None {'date': '2022/08/06/', 'result': ', error missing sqlite.db'} Continue since coverage is None {'date': '2022/08/05/', 'result': ', error missing sqlite.db'} Continue since coverage is None {'date': '2022/08/04/', 'result': ', error missing sqlite.db'} Continue since coverage is None {'date': '2022/08/03/', 'result': ', error missing sqlite.db'} Continue since coverage is None {'date': '2022/08/02/', 'result': ', error missing sqlite.db'} Continue since coverage is None {'date': '2022/08/01/', 'result': ', error missing sqlite.db'} Continue since coverage is None No error ? {'log_dict': {'total_nb_images': 11574, 'max_time_between_images': '0 days 465 seconds', 'coverage_pause': '0 days 36603 seconds', 'coverage_times_pause': '0 days 40776 seconds', 'nb_photos_decision': 11556, 'nb_gray_level_ok': 10948, 'nb_dedup_ok': 10555, 'nb_two_criteria_ok': 9947, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 2, 'end_of_day_photos_dark': 546, 'end_of_day_photos_duplicated': 1001, 'end_of_day_photos_ok_for_neural_classification': 28, 'end_of_day_photos_uploaded': 9982, 'ratio_coverage': 0.6455669412158944}, 'dashboard_dict': {'nb_ptf_finished': 10, 'nb_images_finished': 168, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 2, 'nb_images_started': 172, 'nb_selected_images': 340, 'last_update': '2022/09/02', 'portfolio_id': 6907205, 'last_run_id': 479903, 'total_number_of_photos': 9210}} No error ? {'log_dict': {'total_nb_images': 4471, 'max_time_between_images': '0 days 525 seconds', 'coverage_pause': '0 days 24594 seconds', 'coverage_times_pause': '0 days 28481 seconds', 'nb_photos_decision': 4452, 'nb_gray_level_ok': 1314, 'nb_dedup_ok': 4449, 'nb_two_criteria_ok': 1311, 'nb_forced_upload': 0, 'ratio_coverage': 0.4337642639199986}, 'dashboard_dict': {'nb_ptf_finished': 29, 'nb_images_finished': 362, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 362, 'last_update': '2022/09/02', 'portfolio_id': 6891498, 'last_run_id': 481665, 'total_number_of_photos': 1317}} No error ? {'log_dict': {'total_nb_images': 4544, 'max_time_between_images': '0 days 494 seconds', 'coverage_pause': '0 days 25014 seconds', 'coverage_times_pause': '0 days 28962 seconds', 'nb_photos_decision': 4543, 'nb_gray_level_ok': 849, 'nb_dedup_ok': 4538, 'nb_two_criteria_ok': 846, 'nb_forced_upload': 0, 'ratio_coverage': 0.4411718019718161}, 'dashboard_dict': {'nb_ptf_finished': 18, 'nb_images_finished': 233, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 233, 'last_update': '2022/08/31', 'portfolio_id': 6880717, 'last_run_id': 479832, 'total_number_of_photos': 835}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 4766, 'max_time_between_images': '0 days 675 seconds', 'coverage_pause': '0 days 26303 seconds', 'coverage_times_pause': '0 days 30348 seconds', 'nb_photos_decision': 4755, 'nb_gray_level_ok': 2280, 'nb_dedup_ok': 4743, 'nb_two_criteria_ok': 2272, 'nb_forced_upload': 0, 'ratio_coverage': 0.4639058889927512}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'last_update': '2022/08/27', 'portfolio_id': 6871304, 'last_run_id': 475316, 'total_number_of_photos': 2278}} No error ? {'log_dict': {'total_nb_images': 5107, 'max_time_between_images': '0 days 615 seconds', 'coverage_pause': '0 days 28141 seconds', 'coverage_times_pause': '0 days 32466 seconds', 'nb_photos_decision': 5097, 'nb_gray_level_ok': 522, 'nb_dedup_ok': 5079, 'nb_two_criteria_ok': 518, 'nb_forced_upload': 0, 'ratio_coverage': 0.49632268646713346}, 'dashboard_dict': {'nb_ptf_finished': 14, 'nb_images_finished': 209, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 209, 'last_update': '2022/08/27', 'portfolio_id': 6864486, 'last_run_id': 474538, 'total_number_of_photos': 518}} No error ? {'log_dict': {'total_nb_images': 5139, 'max_time_between_images': '0 days 556 seconds', 'coverage_pause': '0 days 28323 seconds', 'coverage_times_pause': '0 days 32665 seconds', 'nb_photos_decision': 5129, 'nb_gray_level_ok': 568, 'nb_dedup_ok': 5116, 'nb_two_criteria_ok': 565, 'nb_forced_upload': 0, 'ratio_coverage': 0.49953261962292106}, 'dashboard_dict': {'nb_ptf_finished': 9, 'nb_images_finished': 155, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 9, 'nb_images_started': 230, 'nb_selected_images': 385, 'last_update': '2022/08/27', 'portfolio_id': 6856460, 'last_run_id': 474892, 'total_number_of_photos': 571}} No error ? {'log_dict': {'total_nb_images': 4771, 'max_time_between_images': '0 days 615 seconds', 'coverage_pause': '0 days 26246 seconds', 'coverage_times_pause': '0 days 30416 seconds', 'nb_photos_decision': 4760, 'nb_gray_level_ok': 683, 'nb_dedup_ok': 4744, 'nb_two_criteria_ok': 672, 'nb_forced_upload': 0, 'ratio_coverage': 0.46290058025714736}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 13, 'nb_images_finished_for_older': 290, 'nb_ptf_started': 10, 'nb_images_started': 79, 'nb_selected_images': 369, 'last_update': '2022/08/26', 'portfolio_id': 6844250, 'last_run_id': 472453, 'total_number_of_photos': 672}} No error ? {'log_dict': {'total_nb_images': 4574, 'max_time_between_images': '0 days 645 seconds', 'coverage_pause': '0 days 25129 seconds', 'coverage_times_pause': '0 days 29163 seconds', 'nb_photos_decision': 4563, 'nb_gray_level_ok': 433, 'nb_dedup_ok': 4549, 'nb_two_criteria_ok': 432, 'nb_forced_upload': 0, 'ratio_coverage': 0.44320005643838517}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 10, 'nb_images_finished_for_older': 314, 'nb_ptf_started': 6, 'nb_images_started': 37, 'nb_selected_images': 351, 'last_update': '2022/08/27', 'portfolio_id': 6827218, 'last_run_id': 475039, 'total_number_of_photos': 432}} No error ? {'log_dict': {'total_nb_images': 4683, 'max_time_between_images': '0 days 615 seconds', 'coverage_pause': '0 days 25707 seconds', 'coverage_times_pause': '0 days 29852 seconds', 'nb_photos_decision': 4672, 'nb_gray_level_ok': 1557, 'nb_dedup_ok': 4640, 'nb_two_criteria_ok': 1534, 'nb_forced_upload': 0, 'ratio_coverage': 0.45339423975731497}, 'dashboard_dict': {'nb_ptf_finished': 1, 'nb_images_finished': 36, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 1, 'nb_images_started': 38, 'nb_selected_images': 74, 'last_update': '2022/08/23', 'portfolio_id': 6809148, 'last_run_id': 468129, 'total_number_of_photos': 1534}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 4862, 'max_time_between_images': '0 days 795 seconds', 'coverage_pause': '0 days 26839 seconds', 'coverage_times_pause': '0 days 30841 seconds', 'nb_photos_decision': 4852, 'nb_gray_level_ok': 3531, 'nb_dedup_ok': 4840, 'nb_two_criteria_ok': 3524, 'nb_forced_upload': 0, 'ratio_coverage': 0.47335931850649926}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'last_update': '2022/08/20', 'portfolio_id': 6798302, 'last_run_id': 465865, 'total_number_of_photos': 3527}} No error ? {'log_dict': {'total_nb_images': 4560, 'max_time_between_images': '0 days 494 seconds', 'coverage_pause': '0 days 25018 seconds', 'coverage_times_pause': '0 days 29127 seconds', 'nb_photos_decision': 4550, 'nb_gray_level_ok': 477, 'nb_dedup_ok': 4531, 'nb_two_criteria_ok': 475, 'nb_forced_upload': 0, 'ratio_coverage': 0.44124234995326195}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 18, 'nb_images_started': 277, 'nb_selected_images': 277, 'last_update': '2022/08/26', 'portfolio_id': 6783368, 'last_run_id': 472528, 'total_number_of_photos': 475}} No error ? {'log_dict': {'total_nb_images': 5265, 'max_time_between_images': '0 days 734 seconds', 'coverage_pause': '0 days 29016 seconds', 'coverage_times_pause': '0 days 33494 seconds', 'nb_photos_decision': 5264, 'nb_gray_level_ok': 484, 'nb_dedup_ok': 5253, 'nb_two_criteria_ok': 481, 'nb_forced_upload': 0, 'ratio_coverage': 0.5117550574084199}, 'dashboard_dict': {'nb_ptf_finished': 5, 'nb_images_finished': 128, 'nb_ptf_finished_for_older': 1, 'nb_images_finished_for_older': 25, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 153, 'last_update': '2022/08/19', 'portfolio_id': 6771076, 'last_run_id': 463066, 'total_number_of_photos': 493}} No error ? {'log_dict': {'total_nb_images': 4393, 'max_time_between_images': '0 days 494 seconds', 'coverage_pause': '0 days 24083 seconds', 'coverage_times_pause': '0 days 28103 seconds', 'nb_photos_decision': 4383, 'nb_gray_level_ok': 458, 'nb_dedup_ok': 4380, 'nb_two_criteria_ok': 457, 'nb_forced_upload': 0, 'ratio_coverage': 0.4247517592902873}, 'dashboard_dict': {'nb_ptf_finished': 6, 'nb_images_finished': 133, 'nb_ptf_finished_for_older': 1, 'nb_images_finished_for_older': 15, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 148, 'last_update': '2022/08/21', 'portfolio_id': 6756962, 'last_run_id': 461634, 'total_number_of_photos': 457}} No error ? {'log_dict': {'total_nb_images': 5956, 'max_time_between_images': '0 days 618 seconds', 'coverage_pause': '0 days 32980 seconds', 'coverage_times_pause': '0 days 37570 seconds', 'nb_photos_decision': 5954, 'nb_gray_level_ok': 2160, 'nb_dedup_ok': 5953, 'nb_two_criteria_ok': 2159, 'nb_forced_upload': 0, 'ratio_coverage': 0.5816681070212879}, 'dashboard_dict': {'nb_ptf_finished': 6, 'nb_images_finished': 211, 'nb_ptf_finished_for_older': 7, 'nb_images_finished_for_older': 239, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 450, 'last_update': '2022/08/22', 'portfolio_id': 6739050, 'last_run_id': 460382, 'total_number_of_photos': 2159}} No error ? {'log_dict': {'total_nb_images': 6178, 'max_time_between_images': '0 days 495 seconds', 'coverage_pause': '0 days 34258 seconds', 'coverage_times_pause': '0 days 38909 seconds', 'nb_photos_decision': 6166, 'nb_gray_level_ok': 974, 'nb_dedup_ok': 6160, 'nb_two_criteria_ok': 972, 'nb_forced_upload': 0, 'ratio_coverage': 0.6042081870932468}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 2, 'nb_images_started': 56, 'nb_selected_images': 56, 'last_update': '2022/08/16', 'portfolio_id': 6737105, 'last_run_id': 459844, 'total_number_of_photos': 984}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 4594, 'max_time_between_images': '0 days 523 seconds', 'coverage_pause': '0 days 25202 seconds', 'coverage_times_pause': '0 days 29276 seconds', 'nb_photos_decision': 4593, 'nb_gray_level_ok': 642, 'nb_dedup_ok': 4592, 'nb_two_criteria_ok': 642, 'nb_forced_upload': 0, 'ratio_coverage': 0.4444875570997725}, 'dashboard_dict': {'nb_ptf_finished': 14, 'nb_images_finished': 442, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 2, 'nb_images_started': 46, 'nb_selected_images': 488, 'last_update': '2022/08/14', 'portfolio_id': 6714492, 'last_run_id': 457649, 'total_number_of_photos': 642}} No error ? {'log_dict': {'total_nb_images': 4288, 'max_time_between_images': '0 days 1099 seconds', 'coverage_pause': '0 days 23533 seconds', 'coverage_times_pause': '0 days 27387 seconds', 'nb_photos_decision': 4278, 'nb_gray_level_ok': 1121, 'nb_dedup_ok': 4260, 'nb_two_criteria_ok': 1118, 'nb_forced_upload': 0, 'ratio_coverage': 0.4150514118414787}, 'dashboard_dict': {'nb_ptf_finished': 11, 'nb_images_finished': 482, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 482, 'last_update': '2022/08/13', 'portfolio_id': 6696131, 'last_run_id': 457375, 'total_number_of_photos': 1118}} No error ? {'log_dict': {'total_nb_images': 4606, 'max_time_between_images': '0 days 676 seconds', 'coverage_pause': '0 days 25379 seconds', 'coverage_times_pause': '0 days 29343 seconds', 'nb_photos_decision': 4596, 'nb_gray_level_ok': 637, 'nb_dedup_ok': 4567, 'nb_two_criteria_ok': 627, 'nb_forced_upload': 0, 'ratio_coverage': 0.4476093052787527}, 'dashboard_dict': {'nb_ptf_finished': 3, 'nb_images_finished': 115, 'nb_ptf_finished_for_older': 1, 'nb_images_finished_for_older': 12, 'nb_ptf_started': 2, 'nb_images_started': 80, 'nb_selected_images': 207, 'last_update': '2022/08/15', 'portfolio_id': 6680233, 'last_run_id': 454567, 'total_number_of_photos': 627}} No error ? {'log_dict': {'total_nb_images': 5000, 'max_time_between_images': '0 days 915 seconds', 'coverage_pause': '0 days 27593 seconds', 'coverage_times_pause': '0 days 31806 seconds', 'nb_photos_decision': 4999, 'nb_gray_level_ok': 2109, 'nb_dedup_ok': 4957, 'nb_two_criteria_ok': 2083, 'nb_forced_upload': 0, 'ratio_coverage': 0.48665761300904775}, 'dashboard_dict': {'nb_ptf_finished': 14, 'nb_images_finished': 407, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 407, 'last_update': '2022/08/17', 'portfolio_id': 6658698, 'last_run_id': 461498, 'total_number_of_photos': 2083}} No error ? {'log_dict': {'total_nb_images': 4720, 'max_time_between_images': '0 days 674 seconds', 'coverage_pause': '0 days 26032 seconds', 'coverage_times_pause': '0 days 30085 seconds', 'nb_photos_decision': 4719, 'nb_gray_level_ok': 1588, 'nb_dedup_ok': 4675, 'nb_two_criteria_ok': 1565, 'nb_forced_upload': 0, 'ratio_coverage': 0.4591262632497928}, 'dashboard_dict': {'nb_ptf_finished': 11, 'nb_images_finished': 320, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 320, 'last_update': '2022/08/14', 'portfolio_id': 6643366, 'last_run_id': 458795, 'total_number_of_photos': 1565}} No error ? {'log_dict': {'total_nb_images': 4690, 'max_time_between_images': '0 days 676 seconds', 'coverage_pause': '0 days 25756 seconds', 'coverage_times_pause': '0 days 29933 seconds', 'nb_photos_decision': 4689, 'nb_gray_level_ok': 504, 'nb_dedup_ok': 4669, 'nb_two_criteria_ok': 501, 'nb_forced_upload': 0, 'ratio_coverage': 0.454258452530027}, 'dashboard_dict': {'nb_ptf_finished': 12, 'nb_images_finished': 375, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 375, 'last_update': '2022/08/17', 'portfolio_id': 6633495, 'last_run_id': 456239, 'total_number_of_photos': 501}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 4735, 'max_time_between_images': '0 days 705 seconds', 'coverage_pause': '0 days 26039 seconds', 'coverage_times_pause': '0 days 30154 seconds', 'nb_photos_decision': 4734, 'nb_gray_level_ok': 2020, 'nb_dedup_ok': 4693, 'nb_two_criteria_ok': 1989, 'nb_forced_upload': 0, 'ratio_coverage': 0.4592497222173231}, 'dashboard_dict': {'nb_ptf_finished': 3, 'nb_images_finished': 54, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 12, 'nb_images_started': 417, 'nb_selected_images': 471, 'last_update': '2022/08/16', 'portfolio_id': 6631875, 'last_run_id': 454472, 'total_number_of_photos': 1989}} No error ? {'log_dict': {'total_nb_images': 4906, 'max_time_between_images': '0 days 735 seconds', 'coverage_pause': '0 days 27012 seconds', 'coverage_times_pause': '0 days 31274 seconds', 'nb_photos_decision': 4896, 'nb_gray_level_ok': 781, 'nb_dedup_ok': 4862, 'nb_two_criteria_ok': 775, 'nb_forced_upload': 0, 'ratio_coverage': 0.47641051870403356}, 'dashboard_dict': {'nb_ptf_finished': 13, 'nb_images_finished': 438, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 438, 'last_update': '2022/08/16', 'portfolio_id': 6630410, 'last_run_id': 454459, 'total_number_of_photos': 776}} No error ? {'log_dict': {'total_nb_images': 5275, 'max_time_between_images': '0 days 554 seconds', 'coverage_pause': '0 days 28988 seconds', 'coverage_times_pause': '0 days 33555 seconds', 'nb_photos_decision': 5274, 'nb_gray_level_ok': 623, 'nb_dedup_ok': 5236, 'nb_two_criteria_ok': 621, 'nb_forced_upload': 0, 'ratio_coverage': 0.5112612215382988}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 15, 'nb_images_started': 448, 'nb_selected_images': 448, 'last_update': '2022/08/14', 'portfolio_id': 6629957, 'last_run_id': 454465, 'total_number_of_photos': 621}} No error ? {'log_dict': {'total_nb_images': 5490, 'max_time_between_images': '0 days 555 seconds', 'coverage_pause': '0 days 30324 seconds', 'coverage_times_pause': '0 days 34888 seconds', 'nb_photos_decision': 5471, 'nb_gray_level_ok': 1487, 'nb_dedup_ok': 5431, 'nb_two_criteria_ok': 1473, 'nb_forced_upload': 0, 'ratio_coverage': 0.5348242473412229}, 'dashboard_dict': {'nb_ptf_finished': 8, 'nb_images_finished': 211, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 10, 'nb_images_started': 373, 'nb_selected_images': 584, 'last_update': '2022/08/15', 'portfolio_id': 6622675, 'last_run_id': 454450, 'total_number_of_photos': 1473}} No error ? {'log_dict': {'total_nb_images': 6116, 'max_time_between_images': '0 days 496 seconds', 'coverage_pause': '0 days 33822 seconds', 'coverage_times_pause': '0 days 38693 seconds', 'nb_photos_decision': 6115, 'nb_gray_level_ok': 2189, 'nb_dedup_ok': 6055, 'nb_two_criteria_ok': 2150, 'nb_forced_upload': 0, 'ratio_coverage': 0.5965184571156458}, 'dashboard_dict': {'nb_ptf_finished': 5, 'nb_images_finished': 90, 'nb_ptf_finished_for_older': 2, 'nb_images_finished_for_older': 36, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 126, 'last_update': '2022/08/11', 'portfolio_id': 6610799, 'last_run_id': 449568, 'total_number_of_photos': 2150}} No error ? {'log_dict': {'total_nb_images': 6299, 'max_time_between_images': '0 days 615 seconds', 'coverage_pause': '0 days 34914 seconds', 'coverage_times_pause': '0 days 39791 seconds', 'nb_photos_decision': 6298, 'nb_gray_level_ok': 2557, 'nb_dedup_ok': 6210, 'nb_two_criteria_ok': 2501, 'nb_forced_upload': 0, 'ratio_coverage': 0.6157780560503713}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 6, 'nb_images_finished_for_older': 164, 'nb_ptf_started': 1, 'nb_images_started': 50, 'nb_selected_images': 214, 'last_update': '2022/08/02', 'portfolio_id': 6600064, 'last_run_id': 448643, 'total_number_of_photos': 2501}} No error ? {'log_dict': {'total_nb_images': 11574, 'max_time_between_images': '0 days 465 seconds', 'coverage_pause': '0 days 36603 seconds', 'coverage_times_pause': '0 days 40776 seconds', 'nb_photos_decision': 11556, 'nb_gray_level_ok': 10948, 'nb_dedup_ok': 10555, 'nb_two_criteria_ok': 9947, 'nb_forced_upload': 0, 'ratio_coverage': 0.6778458860349266}, 'dashboard_dict': {'nb_ptf_finished': 10, 'nb_images_finished': 168, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 2, 'nb_images_started': 172, 'nb_selected_images': 340, 'last_update': '2022/09/02', 'portfolio_id': 6907205, 'last_run_id': 479903, 'total_number_of_photos': 9210}} No error ? {'log_dict': {'total_nb_images': 11574, 'max_time_between_images': '0 days 465 seconds', 'coverage_pause': '0 days 36603 seconds', 'coverage_times_pause': '0 days 40776 seconds', 'nb_photos_decision': 11556, 'nb_gray_level_ok': 10948, 'nb_dedup_ok': 10555, 'nb_two_criteria_ok': 9947, 'nb_forced_upload': 0, 'ratio_coverage': 0.6778458860349266}, 'dashboard_dict': {'nb_ptf_finished': 10, 'nb_images_finished': 168, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 2, 'nb_images_started': 172, 'nb_selected_images': 340, 'last_update': '2022/09/02', 'portfolio_id': 6907205, 'last_run_id': 479903, 'total_number_of_photos': 9198}} No error ? {'log_dict': {'total_nb_images': 4471, 'max_time_between_images': '0 days 525 seconds', 'coverage_pause': '0 days 24594 seconds', 'coverage_times_pause': '0 days 28481 seconds', 'nb_photos_decision': 4452, 'nb_gray_level_ok': 1314, 'nb_dedup_ok': 4449, 'nb_two_criteria_ok': 1311, 'nb_forced_upload': 0, 'ratio_coverage': 0.455452878757014}, 'dashboard_dict': {'nb_ptf_finished': 29, 'nb_images_finished': 362, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 362, 'last_update': '2022/09/02', 'portfolio_id': 6891498, 'last_run_id': 481665, 'total_number_of_photos': 1317}} No error ? {'log_dict': {'total_nb_images': 11574, 'max_time_between_images': '0 days 465 seconds', 'coverage_pause': '0 days 36603 seconds', 'coverage_times_pause': '0 days 40776 seconds', 'nb_photos_decision': 11556, 'nb_gray_level_ok': 10948, 'nb_dedup_ok': 10555, 'nb_two_criteria_ok': 9947, 'nb_forced_upload': 0, 'ratio_coverage': 0.6778458860349266}, 'dashboard_dict': {'nb_ptf_finished': 10, 'nb_images_finished': 168, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 2, 'nb_images_started': 172, 'nb_selected_images': 340, 'last_update': '2022/09/02', 'portfolio_id': 6907205, 'last_run_id': 479903, 'total_number_of_photos': 9198}} No error ? {'log_dict': {'total_nb_images': 4471, 'max_time_between_images': '0 days 525 seconds', 'coverage_pause': '0 days 24594 seconds', 'coverage_times_pause': '0 days 28481 seconds', 'nb_photos_decision': 4452, 'nb_gray_level_ok': 1314, 'nb_dedup_ok': 4449, 'nb_two_criteria_ok': 1311, 'nb_forced_upload': 0, 'ratio_coverage': 0.455452878757014}, 'dashboard_dict': {'nb_ptf_finished': 29, 'nb_images_finished': 362, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 362, 'last_update': '2022/09/02', 'portfolio_id': 6891498, 'last_run_id': 481665, 'total_number_of_photos': 1311}} No error ? {'log_dict': {'total_nb_images': 4544, 'max_time_between_images': '0 days 494 seconds', 'coverage_pause': '0 days 25014 seconds', 'coverage_times_pause': '0 days 28962 seconds', 'nb_photos_decision': 4543, 'nb_gray_level_ok': 849, 'nb_dedup_ok': 4538, 'nb_two_criteria_ok': 846, 'nb_forced_upload': 0, 'ratio_coverage': 0.4632308005703809}, 'dashboard_dict': {'nb_ptf_finished': 18, 'nb_images_finished': 233, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 233, 'last_update': '2022/08/31', 'portfolio_id': 6880717, 'last_run_id': 479832, 'total_number_of_photos': 835}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 4766, 'max_time_between_images': '0 days 675 seconds', 'coverage_pause': '0 days 26303 seconds', 'coverage_times_pause': '0 days 30348 seconds', 'nb_photos_decision': 4755, 'nb_gray_level_ok': 2280, 'nb_dedup_ok': 4743, 'nb_two_criteria_ok': 2272, 'nb_forced_upload': 0, 'ratio_coverage': 0.4871016129928332}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'last_update': '2022/08/27', 'portfolio_id': 6871304, 'last_run_id': 475316, 'total_number_of_photos': 2278}} No error ? {'log_dict': {'total_nb_images': 5107, 'max_time_between_images': '0 days 615 seconds', 'coverage_pause': '0 days 28141 seconds', 'coverage_times_pause': '0 days 32466 seconds', 'nb_photos_decision': 5097, 'nb_gray_level_ok': 522, 'nb_dedup_ok': 5079, 'nb_two_criteria_ok': 518, 'nb_forced_upload': 0, 'ratio_coverage': 0.5211392803570436}, 'dashboard_dict': {'nb_ptf_finished': 14, 'nb_images_finished': 209, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 209, 'last_update': '2022/08/27', 'portfolio_id': 6864486, 'last_run_id': 474538, 'total_number_of_photos': 518}} No error ? {'log_dict': {'total_nb_images': 5139, 'max_time_between_images': '0 days 556 seconds', 'coverage_pause': '0 days 28323 seconds', 'coverage_times_pause': '0 days 32665 seconds', 'nb_photos_decision': 5129, 'nb_gray_level_ok': 568, 'nb_dedup_ok': 5116, 'nb_two_criteria_ok': 565, 'nb_forced_upload': 0, 'ratio_coverage': 0.524509713142836}, 'dashboard_dict': {'nb_ptf_finished': 9, 'nb_images_finished': 155, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 9, 'nb_images_started': 230, 'nb_selected_images': 385, 'last_update': '2022/08/27', 'portfolio_id': 6856460, 'last_run_id': 474892, 'total_number_of_photos': 571}} No error ? {'log_dict': {'total_nb_images': 4771, 'max_time_between_images': '0 days 615 seconds', 'coverage_pause': '0 days 26246 seconds', 'coverage_times_pause': '0 days 30416 seconds', 'nb_photos_decision': 4760, 'nb_gray_level_ok': 683, 'nb_dedup_ok': 4744, 'nb_two_criteria_ok': 672, 'nb_forced_upload': 0, 'ratio_coverage': 0.48604603788959055}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 13, 'nb_images_finished_for_older': 290, 'nb_ptf_started': 10, 'nb_images_started': 79, 'nb_selected_images': 369, 'last_update': '2022/08/26', 'portfolio_id': 6844250, 'last_run_id': 472453, 'total_number_of_photos': 672}} No error ? {'log_dict': {'total_nb_images': 4574, 'max_time_between_images': '0 days 645 seconds', 'coverage_pause': '0 days 25129 seconds', 'coverage_times_pause': '0 days 29163 seconds', 'nb_photos_decision': 4563, 'nb_gray_level_ok': 433, 'nb_dedup_ok': 4549, 'nb_two_criteria_ok': 432, 'nb_forced_upload': 0, 'ratio_coverage': 0.4653604696383266}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 10, 'nb_images_finished_for_older': 314, 'nb_ptf_started': 6, 'nb_images_started': 37, 'nb_selected_images': 351, 'last_update': '2022/08/27', 'portfolio_id': 6827218, 'last_run_id': 475039, 'total_number_of_photos': 432}} No error ? {'log_dict': {'total_nb_images': 4683, 'max_time_between_images': '0 days 615 seconds', 'coverage_pause': '0 days 25707 seconds', 'coverage_times_pause': '0 days 29852 seconds', 'nb_photos_decision': 4672, 'nb_gray_level_ok': 1557, 'nb_dedup_ok': 4640, 'nb_two_criteria_ok': 1534, 'nb_forced_upload': 0, 'ratio_coverage': 0.47606437156243636}, 'dashboard_dict': {'nb_ptf_finished': 1, 'nb_images_finished': 36, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 1, 'nb_images_started': 38, 'nb_selected_images': 74, 'last_update': '2022/08/23', 'portfolio_id': 6809148, 'last_run_id': 468129, 'total_number_of_photos': 1534}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 4862, 'max_time_between_images': '0 days 795 seconds', 'coverage_pause': '0 days 26839 seconds', 'coverage_times_pause': '0 days 30841 seconds', 'nb_photos_decision': 4852, 'nb_gray_level_ok': 3531, 'nb_dedup_ok': 4840, 'nb_two_criteria_ok': 3524, 'nb_forced_upload': 0, 'ratio_coverage': 0.4970277227356062}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'last_update': '2022/08/20', 'portfolio_id': 6798302, 'last_run_id': 465865, 'total_number_of_photos': 3527}} No error ? {'log_dict': {'total_nb_images': 4560, 'max_time_between_images': '0 days 494 seconds', 'coverage_pause': '0 days 25018 seconds', 'coverage_times_pause': '0 days 29127 seconds', 'nb_photos_decision': 4550, 'nb_gray_level_ok': 477, 'nb_dedup_ok': 4531, 'nb_two_criteria_ok': 475, 'nb_forced_upload': 0, 'ratio_coverage': 0.4633048760162225}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 18, 'nb_images_started': 277, 'nb_selected_images': 277, 'last_update': '2022/08/26', 'portfolio_id': 6783368, 'last_run_id': 472528, 'total_number_of_photos': 475}} No error ? {'log_dict': {'total_nb_images': 5265, 'max_time_between_images': '0 days 734 seconds', 'coverage_pause': '0 days 29016 seconds', 'coverage_times_pause': '0 days 33494 seconds', 'nb_photos_decision': 5264, 'nb_gray_level_ok': 484, 'nb_dedup_ok': 5253, 'nb_two_criteria_ok': 481, 'nb_forced_upload': 0, 'ratio_coverage': 0.5373432841348914}, 'dashboard_dict': {'nb_ptf_finished': 5, 'nb_images_finished': 128, 'nb_ptf_finished_for_older': 1, 'nb_images_finished_for_older': 25, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 153, 'last_update': '2022/08/19', 'portfolio_id': 6771076, 'last_run_id': 463066, 'total_number_of_photos': 493}} No error ? {'log_dict': {'total_nb_images': 4393, 'max_time_between_images': '0 days 494 seconds', 'coverage_pause': '0 days 24083 seconds', 'coverage_times_pause': '0 days 28103 seconds', 'nb_photos_decision': 4383, 'nb_gray_level_ok': 458, 'nb_dedup_ok': 4380, 'nb_two_criteria_ok': 457, 'nb_forced_upload': 0, 'ratio_coverage': 0.4459897405507509}, 'dashboard_dict': {'nb_ptf_finished': 6, 'nb_images_finished': 133, 'nb_ptf_finished_for_older': 1, 'nb_images_finished_for_older': 15, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 148, 'last_update': '2022/08/21', 'portfolio_id': 6756962, 'last_run_id': 461634, 'total_number_of_photos': 457}} No error ? {'log_dict': {'total_nb_images': 5956, 'max_time_between_images': '0 days 618 seconds', 'coverage_pause': '0 days 32980 seconds', 'coverage_times_pause': '0 days 37570 seconds', 'nb_photos_decision': 5954, 'nb_gray_level_ok': 2160, 'nb_dedup_ok': 5953, 'nb_two_criteria_ok': 2159, 'nb_forced_upload': 0, 'ratio_coverage': 0.6107520509639067}, 'dashboard_dict': {'nb_ptf_finished': 6, 'nb_images_finished': 211, 'nb_ptf_finished_for_older': 7, 'nb_images_finished_for_older': 239, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 450, 'last_update': '2022/08/22', 'portfolio_id': 6739050, 'last_run_id': 460382, 'total_number_of_photos': 2159}} No error ? {'log_dict': {'total_nb_images': 6178, 'max_time_between_images': '0 days 495 seconds', 'coverage_pause': '0 days 34258 seconds', 'coverage_times_pause': '0 days 38909 seconds', 'nb_photos_decision': 6166, 'nb_gray_level_ok': 974, 'nb_dedup_ok': 6160, 'nb_two_criteria_ok': 972, 'nb_forced_upload': 0, 'ratio_coverage': 0.6344191559102946}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 2, 'nb_images_started': 56, 'nb_selected_images': 56, 'last_update': '2022/08/16', 'portfolio_id': 6737105, 'last_run_id': 459844, 'total_number_of_photos': 984}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 4594, 'max_time_between_images': '0 days 523 seconds', 'coverage_pause': '0 days 25202 seconds', 'coverage_times_pause': '0 days 29276 seconds', 'nb_photos_decision': 4593, 'nb_gray_level_ok': 642, 'nb_dedup_ok': 4592, 'nb_two_criteria_ok': 642, 'nb_forced_upload': 0, 'ratio_coverage': 0.46671234652493565}, 'dashboard_dict': {'nb_ptf_finished': 14, 'nb_images_finished': 442, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 2, 'nb_images_started': 46, 'nb_selected_images': 488, 'last_update': '2022/08/14', 'portfolio_id': 6714492, 'last_run_id': 457649, 'total_number_of_photos': 642}} No error ? {'log_dict': {'total_nb_images': 4288, 'max_time_between_images': '0 days 1099 seconds', 'coverage_pause': '0 days 23533 seconds', 'coverage_times_pause': '0 days 27387 seconds', 'nb_photos_decision': 4278, 'nb_gray_level_ok': 1121, 'nb_dedup_ok': 4260, 'nb_two_criteria_ok': 1118, 'nb_forced_upload': 0, 'ratio_coverage': 0.43580436674753237}, 'dashboard_dict': {'nb_ptf_finished': 11, 'nb_images_finished': 482, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 482, 'last_update': '2022/08/13', 'portfolio_id': 6696131, 'last_run_id': 457375, 'total_number_of_photos': 1118}} No error ? {'log_dict': {'total_nb_images': 4606, 'max_time_between_images': '0 days 676 seconds', 'coverage_pause': '0 days 25379 seconds', 'coverage_times_pause': '0 days 29343 seconds', 'nb_photos_decision': 4596, 'nb_gray_level_ok': 637, 'nb_dedup_ok': 4567, 'nb_two_criteria_ok': 627, 'nb_forced_upload': 0, 'ratio_coverage': 0.469990185003426}, 'dashboard_dict': {'nb_ptf_finished': 3, 'nb_images_finished': 115, 'nb_ptf_finished_for_older': 1, 'nb_images_finished_for_older': 12, 'nb_ptf_started': 2, 'nb_images_started': 80, 'nb_selected_images': 207, 'last_update': '2022/08/15', 'portfolio_id': 6680233, 'last_run_id': 454567, 'total_number_of_photos': 627}} No error ? {'log_dict': {'total_nb_images': 5000, 'max_time_between_images': '0 days 915 seconds', 'coverage_pause': '0 days 27593 seconds', 'coverage_times_pause': '0 days 31806 seconds', 'nb_photos_decision': 4999, 'nb_gray_level_ok': 2109, 'nb_dedup_ok': 4957, 'nb_two_criteria_ok': 2083, 'nb_forced_upload': 0, 'ratio_coverage': 0.5109909442767459}, 'dashboard_dict': {'nb_ptf_finished': 14, 'nb_images_finished': 407, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 407, 'last_update': '2022/08/17', 'portfolio_id': 6658698, 'last_run_id': 461498, 'total_number_of_photos': 2083}} No error ? {'log_dict': {'total_nb_images': 4720, 'max_time_between_images': '0 days 674 seconds', 'coverage_pause': '0 days 26032 seconds', 'coverage_times_pause': '0 days 30085 seconds', 'nb_photos_decision': 4719, 'nb_gray_level_ok': 1588, 'nb_dedup_ok': 4675, 'nb_two_criteria_ok': 1565, 'nb_forced_upload': 0, 'ratio_coverage': 0.4820830015370655}, 'dashboard_dict': {'nb_ptf_finished': 11, 'nb_images_finished': 320, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 320, 'last_update': '2022/08/14', 'portfolio_id': 6643366, 'last_run_id': 458795, 'total_number_of_photos': 1565}} No error ? {'log_dict': {'total_nb_images': 4690, 'max_time_between_images': '0 days 676 seconds', 'coverage_pause': '0 days 25756 seconds', 'coverage_times_pause': '0 days 29933 seconds', 'nb_photos_decision': 4689, 'nb_gray_level_ok': 504, 'nb_dedup_ok': 4669, 'nb_two_criteria_ok': 501, 'nb_forced_upload': 0, 'ratio_coverage': 0.4769717957739958}, 'dashboard_dict': {'nb_ptf_finished': 12, 'nb_images_finished': 375, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 375, 'last_update': '2022/08/17', 'portfolio_id': 6633495, 'last_run_id': 456239, 'total_number_of_photos': 501}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 4735, 'max_time_between_images': '0 days 705 seconds', 'coverage_pause': '0 days 26039 seconds', 'coverage_times_pause': '0 days 30154 seconds', 'nb_photos_decision': 4734, 'nb_gray_level_ok': 2020, 'nb_dedup_ok': 4693, 'nb_two_criteria_ok': 1989, 'nb_forced_upload': 0, 'ratio_coverage': 0.4822126335672883}, 'dashboard_dict': {'nb_ptf_finished': 3, 'nb_images_finished': 54, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 12, 'nb_images_started': 417, 'nb_selected_images': 471, 'last_update': '2022/08/16', 'portfolio_id': 6631875, 'last_run_id': 454472, 'total_number_of_photos': 1989}} No error ? {'log_dict': {'total_nb_images': 4906, 'max_time_between_images': '0 days 735 seconds', 'coverage_pause': '0 days 27012 seconds', 'coverage_times_pause': '0 days 31274 seconds', 'nb_photos_decision': 4896, 'nb_gray_level_ok': 781, 'nb_dedup_ok': 4862, 'nb_two_criteria_ok': 775, 'nb_forced_upload': 0, 'ratio_coverage': 0.5002314857682549}, 'dashboard_dict': {'nb_ptf_finished': 13, 'nb_images_finished': 438, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 438, 'last_update': '2022/08/16', 'portfolio_id': 6630410, 'last_run_id': 454459, 'total_number_of_photos': 776}} No error ? {'log_dict': {'total_nb_images': 5275, 'max_time_between_images': '0 days 554 seconds', 'coverage_pause': '0 days 28988 seconds', 'coverage_times_pause': '0 days 33555 seconds', 'nb_photos_decision': 5274, 'nb_gray_level_ok': 623, 'nb_dedup_ok': 5236, 'nb_two_criteria_ok': 621, 'nb_forced_upload': 0, 'ratio_coverage': 0.5368247560140003}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 15, 'nb_images_started': 448, 'nb_selected_images': 448, 'last_update': '2022/08/14', 'portfolio_id': 6629957, 'last_run_id': 454465, 'total_number_of_photos': 621}} No error ? {'log_dict': {'total_nb_images': 5490, 'max_time_between_images': '0 days 555 seconds', 'coverage_pause': '0 days 30324 seconds', 'coverage_times_pause': '0 days 34888 seconds', 'nb_photos_decision': 5471, 'nb_gray_level_ok': 1487, 'nb_dedup_ok': 5431, 'nb_two_criteria_ok': 1473, 'nb_forced_upload': 0, 'ratio_coverage': 0.5615659549250912}, 'dashboard_dict': {'nb_ptf_finished': 8, 'nb_images_finished': 211, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 10, 'nb_images_started': 373, 'nb_selected_images': 584, 'last_update': '2022/08/15', 'portfolio_id': 6622675, 'last_run_id': 454450, 'total_number_of_photos': 1473}} No error ? {'log_dict': {'total_nb_images': 6116, 'max_time_between_images': '0 days 496 seconds', 'coverage_pause': '0 days 33822 seconds', 'coverage_times_pause': '0 days 38693 seconds', 'nb_photos_decision': 6115, 'nb_gray_level_ok': 2189, 'nb_dedup_ok': 6055, 'nb_two_criteria_ok': 2150, 'nb_forced_upload': 0, 'ratio_coverage': 0.6263449323135614}, 'dashboard_dict': {'nb_ptf_finished': 5, 'nb_images_finished': 90, 'nb_ptf_finished_for_older': 2, 'nb_images_finished_for_older': 36, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 126, 'last_update': '2022/08/11', 'portfolio_id': 6610799, 'last_run_id': 449568, 'total_number_of_photos': 2150}} No error ? {'log_dict': {'total_nb_images': 6299, 'max_time_between_images': '0 days 615 seconds', 'coverage_pause': '0 days 34914 seconds', 'coverage_times_pause': '0 days 39791 seconds', 'nb_photos_decision': 6298, 'nb_gray_level_ok': 2557, 'nb_dedup_ok': 6210, 'nb_two_criteria_ok': 2501, 'nb_forced_upload': 0, 'ratio_coverage': 0.6465675290283154}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 6, 'nb_images_finished_for_older': 164, 'nb_ptf_started': 1, 'nb_images_started': 50, 'nb_selected_images': 214, 'last_update': '2022/08/02', 'portfolio_id': 6600064, 'last_run_id': 448643, 'total_number_of_photos': 2501}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 11556, 'nb_gray_level_ok': 10948, 'nb_dedup_ok': 10555, 'nb_two_criteria_ok': 9947, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 10, 'nb_images_finished': 168, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 2, 'nb_images_started': 172, 'nb_selected_images': 340, 'last_update': '2022/09/02', 'portfolio_id': 6907205, 'last_run_id': 479903, 'total_number_of_photos': 9198}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 4452, 'nb_gray_level_ok': 1314, 'nb_dedup_ok': 4449, 'nb_two_criteria_ok': 1311, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 29, 'nb_images_finished': 362, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 362, 'last_update': '2022/09/02', 'portfolio_id': 6891498, 'last_run_id': 481665, 'total_number_of_photos': 1311}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 4543, 'nb_gray_level_ok': 849, 'nb_dedup_ok': 4538, 'nb_two_criteria_ok': 846, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 18, 'nb_images_finished': 233, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 233, 'last_update': '2022/08/31', 'portfolio_id': 6880717, 'last_run_id': 479832, 'total_number_of_photos': 835}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 4755, 'nb_gray_level_ok': 2280, 'nb_dedup_ok': 4743, 'nb_two_criteria_ok': 2272, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'last_update': '2022/08/27', 'portfolio_id': 6871304, 'last_run_id': 475316, 'total_number_of_photos': 2278}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 5097, 'nb_gray_level_ok': 522, 'nb_dedup_ok': 5079, 'nb_two_criteria_ok': 518, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 14, 'nb_images_finished': 209, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 209, 'last_update': '2022/08/27', 'portfolio_id': 6864486, 'last_run_id': 474538, 'total_number_of_photos': 518}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 5129, 'nb_gray_level_ok': 568, 'nb_dedup_ok': 5116, 'nb_two_criteria_ok': 565, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 9, 'nb_images_finished': 155, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 9, 'nb_images_started': 230, 'nb_selected_images': 385, 'last_update': '2022/08/27', 'portfolio_id': 6856460, 'last_run_id': 474892, 'total_number_of_photos': 571}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 4760, 'nb_gray_level_ok': 683, 'nb_dedup_ok': 4744, 'nb_two_criteria_ok': 672, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 13, 'nb_images_finished_for_older': 290, 'nb_ptf_started': 10, 'nb_images_started': 79, 'nb_selected_images': 369, 'last_update': '2022/08/26', 'portfolio_id': 6844250, 'last_run_id': 472453, 'total_number_of_photos': 672}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 4563, 'nb_gray_level_ok': 433, 'nb_dedup_ok': 4549, 'nb_two_criteria_ok': 432, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 10, 'nb_images_finished_for_older': 314, 'nb_ptf_started': 6, 'nb_images_started': 37, 'nb_selected_images': 351, 'last_update': '2022/08/27', 'portfolio_id': 6827218, 'last_run_id': 475039, 'total_number_of_photos': 432}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 4672, 'nb_gray_level_ok': 1557, 'nb_dedup_ok': 4640, 'nb_two_criteria_ok': 1534, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 1, 'nb_images_finished': 36, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 1, 'nb_images_started': 38, 'nb_selected_images': 74, 'last_update': '2022/08/23', 'portfolio_id': 6809148, 'last_run_id': 468129, 'total_number_of_photos': 1534}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 4852, 'nb_gray_level_ok': 3531, 'nb_dedup_ok': 4840, 'nb_two_criteria_ok': 3524, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'last_update': '2022/08/20', 'portfolio_id': 6798302, 'last_run_id': 465865, 'total_number_of_photos': 3527}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 4550, 'nb_gray_level_ok': 477, 'nb_dedup_ok': 4531, 'nb_two_criteria_ok': 475, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 18, 'nb_images_started': 277, 'nb_selected_images': 277, 'last_update': '2022/08/26', 'portfolio_id': 6783368, 'last_run_id': 472528, 'total_number_of_photos': 475}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 5264, 'nb_gray_level_ok': 484, 'nb_dedup_ok': 5253, 'nb_two_criteria_ok': 481, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 5, 'nb_images_finished': 128, 'nb_ptf_finished_for_older': 1, 'nb_images_finished_for_older': 25, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 153, 'last_update': '2022/08/19', 'portfolio_id': 6771076, 'last_run_id': 463066, 'total_number_of_photos': 493}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 4383, 'nb_gray_level_ok': 458, 'nb_dedup_ok': 4380, 'nb_two_criteria_ok': 457, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 6, 'nb_images_finished': 133, 'nb_ptf_finished_for_older': 1, 'nb_images_finished_for_older': 15, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 148, 'last_update': '2022/08/21', 'portfolio_id': 6756962, 'last_run_id': 461634, 'total_number_of_photos': 457}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 5954, 'nb_gray_level_ok': 2160, 'nb_dedup_ok': 5953, 'nb_two_criteria_ok': 2159, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 6, 'nb_images_finished': 211, 'nb_ptf_finished_for_older': 7, 'nb_images_finished_for_older': 239, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 450, 'last_update': '2022/08/22', 'portfolio_id': 6739050, 'last_run_id': 460382, 'total_number_of_photos': 2159}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 6166, 'nb_gray_level_ok': 974, 'nb_dedup_ok': 6160, 'nb_two_criteria_ok': 972, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 2, 'nb_images_started': 56, 'nb_selected_images': 56, 'last_update': '2022/08/16', 'portfolio_id': 6737105, 'last_run_id': 459844, 'total_number_of_photos': 984}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 4593, 'nb_gray_level_ok': 642, 'nb_dedup_ok': 4592, 'nb_two_criteria_ok': 642, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 14, 'nb_images_finished': 442, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 2, 'nb_images_started': 46, 'nb_selected_images': 488, 'last_update': '2022/08/14', 'portfolio_id': 6714492, 'last_run_id': 457649, 'total_number_of_photos': 642}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 4278, 'nb_gray_level_ok': 1121, 'nb_dedup_ok': 4260, 'nb_two_criteria_ok': 1118, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 11, 'nb_images_finished': 482, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 482, 'last_update': '2022/08/13', 'portfolio_id': 6696131, 'last_run_id': 457375, 'total_number_of_photos': 1118}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 4596, 'nb_gray_level_ok': 637, 'nb_dedup_ok': 4567, 'nb_two_criteria_ok': 627, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 3, 'nb_images_finished': 115, 'nb_ptf_finished_for_older': 1, 'nb_images_finished_for_older': 12, 'nb_ptf_started': 2, 'nb_images_started': 80, 'nb_selected_images': 207, 'last_update': '2022/08/15', 'portfolio_id': 6680233, 'last_run_id': 454567, 'total_number_of_photos': 627}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 4999, 'nb_gray_level_ok': 2109, 'nb_dedup_ok': 4957, 'nb_two_criteria_ok': 2083, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 14, 'nb_images_finished': 407, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 407, 'last_update': '2022/08/17', 'portfolio_id': 6658698, 'last_run_id': 461498, 'total_number_of_photos': 2083}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 4719, 'nb_gray_level_ok': 1588, 'nb_dedup_ok': 4675, 'nb_two_criteria_ok': 1565, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 11, 'nb_images_finished': 320, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 320, 'last_update': '2022/08/14', 'portfolio_id': 6643366, 'last_run_id': 458795, 'total_number_of_photos': 1565}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 4689, 'nb_gray_level_ok': 504, 'nb_dedup_ok': 4669, 'nb_two_criteria_ok': 501, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 12, 'nb_images_finished': 375, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 375, 'last_update': '2022/08/17', 'portfolio_id': 6633495, 'last_run_id': 456239, 'total_number_of_photos': 501}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 4734, 'nb_gray_level_ok': 2020, 'nb_dedup_ok': 4693, 'nb_two_criteria_ok': 1989, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 3, 'nb_images_finished': 54, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 12, 'nb_images_started': 417, 'nb_selected_images': 471, 'last_update': '2022/08/16', 'portfolio_id': 6631875, 'last_run_id': 454472, 'total_number_of_photos': 1989}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 4896, 'nb_gray_level_ok': 781, 'nb_dedup_ok': 4862, 'nb_two_criteria_ok': 775, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 13, 'nb_images_finished': 438, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 438, 'last_update': '2022/08/16', 'portfolio_id': 6630410, 'last_run_id': 454459, 'total_number_of_photos': 776}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 5274, 'nb_gray_level_ok': 623, 'nb_dedup_ok': 5236, 'nb_two_criteria_ok': 621, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 15, 'nb_images_started': 448, 'nb_selected_images': 448, 'last_update': '2022/08/14', 'portfolio_id': 6629957, 'last_run_id': 454465, 'total_number_of_photos': 621}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 5471, 'nb_gray_level_ok': 1487, 'nb_dedup_ok': 5431, 'nb_two_criteria_ok': 1473, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 8, 'nb_images_finished': 211, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 10, 'nb_images_started': 373, 'nb_selected_images': 584, 'last_update': '2022/08/15', 'portfolio_id': 6622675, 'last_run_id': 454450, 'total_number_of_photos': 1473}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 6115, 'nb_gray_level_ok': 2189, 'nb_dedup_ok': 6055, 'nb_two_criteria_ok': 2150, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 5, 'nb_images_finished': 90, 'nb_ptf_finished_for_older': 2, 'nb_images_finished_for_older': 36, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 126, 'last_update': '2022/08/11', 'portfolio_id': 6610799, 'last_run_id': 449568, 'total_number_of_photos': 2150}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 6298, 'nb_gray_level_ok': 2557, 'nb_dedup_ok': 6210, 'nb_two_criteria_ok': 2501, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 6, 'nb_images_finished_for_older': 164, 'nb_ptf_started': 1, 'nb_images_started': 50, 'nb_selected_images': 214, 'last_update': '2022/08/02', 'portfolio_id': 6600064, 'last_run_id': 448643, 'total_number_of_photos': 2501}} No error ? {'log_dict': {'total_nb_images': 11574, 'max_time_between_images': '0 days 465 seconds', 'coverage_pause': '0 days 36603 seconds', 'coverage_times_pause': '0 days 40776 seconds', 'nb_photos_decision': 11556, 'nb_gray_level_ok': 10948, 'nb_dedup_ok': 10555, 'nb_two_criteria_ok': 9947, 'nb_forced_upload': 0, 'ratio_coverage': 0.6455669412158944}, 'dashboard_dict': {'nb_ptf_finished': 10, 'nb_images_finished': 168, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 2, 'nb_images_started': 172, 'nb_selected_images': 340, 'last_update': '2022/09/02', 'portfolio_id': 6907205, 'last_run_id': 479903, 'total_number_of_photos': 8880}} No error ? {'log_dict': {'total_nb_images': 4471, 'max_time_between_images': '0 days 525 seconds', 'coverage_pause': '0 days 24594 seconds', 'coverage_times_pause': '0 days 28481 seconds', 'nb_photos_decision': 4452, 'nb_gray_level_ok': 1314, 'nb_dedup_ok': 4449, 'nb_two_criteria_ok': 1311, 'nb_forced_upload': 0, 'ratio_coverage': 0.4337642639199986}, 'dashboard_dict': {'nb_ptf_finished': 29, 'nb_images_finished': 362, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 362, 'last_update': '2022/09/02', 'portfolio_id': 6891498, 'last_run_id': 481665, 'total_number_of_photos': 1311}} No error ? {'log_dict': {'total_nb_images': 4544, 'max_time_between_images': '0 days 494 seconds', 'coverage_pause': '0 days 25014 seconds', 'coverage_times_pause': '0 days 28962 seconds', 'nb_photos_decision': 4543, 'nb_gray_level_ok': 849, 'nb_dedup_ok': 4538, 'nb_two_criteria_ok': 846, 'nb_forced_upload': 0, 'ratio_coverage': 0.4411718019718161}, 'dashboard_dict': {'nb_ptf_finished': 18, 'nb_images_finished': 233, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 233, 'last_update': '2022/08/31', 'portfolio_id': 6880717, 'last_run_id': 479832, 'total_number_of_photos': 834}} No error ? {'log_dict': {'total_nb_images': 11574, 'max_time_between_images': '0 days 465 seconds', 'coverage_pause': '0 days 36603 seconds', 'coverage_times_pause': '0 days 40776 seconds', 'nb_photos_decision': 11556, 'nb_gray_level_ok': 10948, 'nb_dedup_ok': 10555, 'nb_two_criteria_ok': 9947, 'nb_forced_upload': 0, 'ratio_coverage': 0.6455669412158944}, 'dashboard_dict': {'nb_ptf_finished': 10, 'nb_images_finished': 168, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 2, 'nb_images_started': 172, 'nb_selected_images': 340, 'last_update': '2022/09/02', 'portfolio_id': 6907205, 'last_run_id': 479903, 'total_number_of_photos': 6813}} No error ? {'log_dict': {'total_nb_images': 4471, 'max_time_between_images': '0 days 525 seconds', 'coverage_pause': '0 days 24594 seconds', 'coverage_times_pause': '0 days 28481 seconds', 'nb_photos_decision': 4452, 'nb_gray_level_ok': 1314, 'nb_dedup_ok': 4449, 'nb_two_criteria_ok': 1311, 'nb_forced_upload': 0, 'ratio_coverage': 0.4337642639199986}, 'dashboard_dict': {'nb_ptf_finished': 29, 'nb_images_finished': 362, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 362, 'last_update': '2022/09/02', 'portfolio_id': 6891498, 'last_run_id': 481665, 'total_number_of_photos': 1311}} No error ? {'log_dict': {'total_nb_images': 4544, 'max_time_between_images': '0 days 494 seconds', 'coverage_pause': '0 days 25014 seconds', 'coverage_times_pause': '0 days 28962 seconds', 'nb_photos_decision': 4543, 'nb_gray_level_ok': 849, 'nb_dedup_ok': 4538, 'nb_two_criteria_ok': 846, 'nb_forced_upload': 0, 'ratio_coverage': 0.4411718019718161}, 'dashboard_dict': {'nb_ptf_finished': 18, 'nb_images_finished': 233, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 233, 'last_update': '2022/08/31', 'portfolio_id': 6880717, 'last_run_id': 479832, 'total_number_of_photos': 834}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 11574, 'max_time_between_images': '0 days 465 seconds', 'coverage_pause': '0 days 36603 seconds', 'coverage_times_pause': '0 days 40776 seconds', 'nb_photos_decision': 11556, 'nb_gray_level_ok': 10948, 'nb_dedup_ok': 10555, 'nb_two_criteria_ok': 9947, 'nb_forced_upload': 0, 'ratio_coverage': 0.6455669412158944}, 'dashboard_dict': {'nb_ptf_finished': 10, 'nb_images_finished': 168, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 2, 'nb_images_started': 172, 'nb_selected_images': 340, 'last_update': '2022/09/02', 'portfolio_id': 6907205, 'last_run_id': 479903, 'total_number_of_photos': 5175}} No error ? {'log_dict': {'total_nb_images': 4471, 'max_time_between_images': '0 days 525 seconds', 'coverage_pause': '0 days 24594 seconds', 'coverage_times_pause': '0 days 28481 seconds', 'nb_photos_decision': 4452, 'nb_gray_level_ok': 1314, 'nb_dedup_ok': 4449, 'nb_two_criteria_ok': 1311, 'nb_forced_upload': 0, 'ratio_coverage': 0.4337642639199986}, 'dashboard_dict': {'nb_ptf_finished': 29, 'nb_images_finished': 362, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 362, 'last_update': '2022/09/02', 'portfolio_id': 6891498, 'last_run_id': 481665, 'total_number_of_photos': 1311}} No error ? {'log_dict': {'total_nb_images': 4544, 'max_time_between_images': '0 days 494 seconds', 'coverage_pause': '0 days 25014 seconds', 'coverage_times_pause': '0 days 28962 seconds', 'nb_photos_decision': 4543, 'nb_gray_level_ok': 849, 'nb_dedup_ok': 4538, 'nb_two_criteria_ok': 846, 'nb_forced_upload': 0, 'ratio_coverage': 0.4411718019718161}, 'dashboard_dict': {'nb_ptf_finished': 18, 'nb_images_finished': 233, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 233, 'last_update': '2022/08/31', 'portfolio_id': 6880717, 'last_run_id': 479832, 'total_number_of_photos': 834}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 4766, 'max_time_between_images': '0 days 675 seconds', 'coverage_pause': '0 days 26303 seconds', 'coverage_times_pause': '0 days 30348 seconds', 'nb_photos_decision': 4755, 'nb_gray_level_ok': 2280, 'nb_dedup_ok': 4743, 'nb_two_criteria_ok': 2272, 'nb_forced_upload': 0, 'ratio_coverage': 0.4639058889927512}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'last_update': '2022/08/27', 'portfolio_id': 6871304, 'last_run_id': 475316, 'total_number_of_photos': 2278}} No error ? {'log_dict': {'total_nb_images': 11574, 'max_time_between_images': '0 days 465 seconds', 'coverage_pause': '0 days 36603 seconds', 'coverage_times_pause': '0 days 40776 seconds', 'nb_photos_decision': 11556, 'nb_gray_level_ok': 10948, 'nb_dedup_ok': 10555, 'nb_two_criteria_ok': 9947, 'nb_forced_upload': 0, 'ratio_coverage': 0.6455669412158944}, 'dashboard_dict': {'nb_ptf_finished': 10, 'nb_images_finished': 168, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 2, 'nb_images_started': 172, 'nb_selected_images': 340, 'last_update': '2022/09/02', 'portfolio_id': 6907205, 'last_run_id': 479903, 'total_number_of_photos': 3585}} No error ? {'log_dict': {'total_nb_images': 4471, 'max_time_between_images': '0 days 525 seconds', 'coverage_pause': '0 days 24594 seconds', 'coverage_times_pause': '0 days 28481 seconds', 'nb_photos_decision': 4452, 'nb_gray_level_ok': 1314, 'nb_dedup_ok': 4449, 'nb_two_criteria_ok': 1311, 'nb_forced_upload': 0, 'ratio_coverage': 0.4337642639199986}, 'dashboard_dict': {'nb_ptf_finished': 28, 'nb_images_finished': 357, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 1, 'nb_images_started': 5, 'nb_selected_images': 362, 'last_update': '2022/09/01', 'portfolio_id': 6891498, 'last_run_id': 478934, 'total_number_of_photos': 1311}} No error ? {'log_dict': {'total_nb_images': 4544, 'max_time_between_images': '0 days 494 seconds', 'coverage_pause': '0 days 25014 seconds', 'coverage_times_pause': '0 days 28962 seconds', 'nb_photos_decision': 4543, 'nb_gray_level_ok': 849, 'nb_dedup_ok': 4538, 'nb_two_criteria_ok': 846, 'nb_forced_upload': 0, 'ratio_coverage': 0.4411718019718161}, 'dashboard_dict': {'nb_ptf_finished': 18, 'nb_images_finished': 233, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 233, 'last_update': '2022/08/31', 'portfolio_id': 6880717, 'last_run_id': 479832, 'total_number_of_photos': 834}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 4766, 'max_time_between_images': '0 days 675 seconds', 'coverage_pause': '0 days 26303 seconds', 'coverage_times_pause': '0 days 30348 seconds', 'nb_photos_decision': 4755, 'nb_gray_level_ok': 2280, 'nb_dedup_ok': 4743, 'nb_two_criteria_ok': 2272, 'nb_forced_upload': 0, 'ratio_coverage': 0.4639058889927512}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'last_update': '2022/08/27', 'portfolio_id': 6871304, 'last_run_id': 475316, 'total_number_of_photos': 2278}} No error ? {'log_dict': {'total_nb_images': 5107, 'max_time_between_images': '0 days 615 seconds', 'coverage_pause': '0 days 28141 seconds', 'coverage_times_pause': '0 days 32466 seconds', 'nb_photos_decision': 5097, 'nb_gray_level_ok': 522, 'nb_dedup_ok': 5079, 'nb_two_criteria_ok': 518, 'nb_forced_upload': 0, 'ratio_coverage': 0.49632268646713346}, 'dashboard_dict': {'nb_ptf_finished': 14, 'nb_images_finished': 209, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 209, 'last_update': '2022/08/27', 'portfolio_id': 6864486, 'last_run_id': 474538, 'total_number_of_photos': 518}} No error ? {'log_dict': {'total_nb_images': 11574, 'max_time_between_images': '0 days 465 seconds', 'coverage_pause': '0 days 36603 seconds', 'coverage_times_pause': '0 days 40776 seconds', 'nb_photos_decision': 11556, 'nb_gray_level_ok': 10948, 'nb_dedup_ok': 10555, 'nb_two_criteria_ok': 9947, 'nb_forced_upload': 0, 'ratio_coverage': 0.6455669412158944}, 'dashboard_dict': {'nb_ptf_finished': 10, 'nb_images_finished': 168, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 2, 'nb_images_started': 172, 'nb_selected_images': 340, 'last_update': '2022/09/01', 'portfolio_id': 6907205, 'last_run_id': 479903, 'total_number_of_photos': 3353}} No error ? {'log_dict': {'total_nb_images': 4471, 'max_time_between_images': '0 days 525 seconds', 'coverage_pause': '0 days 24594 seconds', 'coverage_times_pause': '0 days 28481 seconds', 'nb_photos_decision': 4452, 'nb_gray_level_ok': 1314, 'nb_dedup_ok': 4449, 'nb_two_criteria_ok': 1311, 'nb_forced_upload': 0, 'ratio_coverage': 0.4337642639199986}, 'dashboard_dict': {'nb_ptf_finished': 28, 'nb_images_finished': 357, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 1, 'nb_images_started': 5, 'nb_selected_images': 362, 'last_update': '2022/09/01', 'portfolio_id': 6891498, 'last_run_id': 478934, 'total_number_of_photos': 1311}} No error ? {'log_dict': {'total_nb_images': 4544, 'max_time_between_images': '0 days 494 seconds', 'coverage_pause': '0 days 25014 seconds', 'coverage_times_pause': '0 days 28962 seconds', 'nb_photos_decision': 4543, 'nb_gray_level_ok': 849, 'nb_dedup_ok': 4538, 'nb_two_criteria_ok': 846, 'nb_forced_upload': 0, 'ratio_coverage': 0.4411718019718161}, 'dashboard_dict': {'nb_ptf_finished': 18, 'nb_images_finished': 233, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 233, 'last_update': '2022/08/31', 'portfolio_id': 6880717, 'last_run_id': 479832, 'total_number_of_photos': 834}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 4766, 'max_time_between_images': '0 days 675 seconds', 'coverage_pause': '0 days 26303 seconds', 'coverage_times_pause': '0 days 30348 seconds', 'nb_photos_decision': 4755, 'nb_gray_level_ok': 2280, 'nb_dedup_ok': 4743, 'nb_two_criteria_ok': 2272, 'nb_forced_upload': 0, 'ratio_coverage': 0.4639058889927512}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'last_update': '2022/08/27', 'portfolio_id': 6871304, 'last_run_id': 475316, 'total_number_of_photos': 2278}} No error ? {'log_dict': {'total_nb_images': 5107, 'max_time_between_images': '0 days 615 seconds', 'coverage_pause': '0 days 28141 seconds', 'coverage_times_pause': '0 days 32466 seconds', 'nb_photos_decision': 5097, 'nb_gray_level_ok': 522, 'nb_dedup_ok': 5079, 'nb_two_criteria_ok': 518, 'nb_forced_upload': 0, 'ratio_coverage': 0.49632268646713346}, 'dashboard_dict': {'nb_ptf_finished': 14, 'nb_images_finished': 209, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 209, 'last_update': '2022/08/27', 'portfolio_id': 6864486, 'last_run_id': 474538, 'total_number_of_photos': 518}} No error ? {'log_dict': {'total_nb_images': 5139, 'max_time_between_images': '0 days 556 seconds', 'coverage_pause': '0 days 28323 seconds', 'coverage_times_pause': '0 days 32665 seconds', 'nb_photos_decision': 5129, 'nb_gray_level_ok': 568, 'nb_dedup_ok': 5116, 'nb_two_criteria_ok': 565, 'nb_forced_upload': 0, 'ratio_coverage': 0.49953261962292106}, 'dashboard_dict': {'nb_ptf_finished': 9, 'nb_images_finished': 155, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 9, 'nb_images_started': 230, 'nb_selected_images': 385, 'last_update': '2022/08/27', 'portfolio_id': 6856460, 'last_run_id': 474892, 'total_number_of_photos': 571}} No error ? {'log_dict': {'total_nb_images': 4771, 'max_time_between_images': '0 days 615 seconds', 'coverage_pause': '0 days 26246 seconds', 'coverage_times_pause': '0 days 30416 seconds', 'nb_photos_decision': 4760, 'nb_gray_level_ok': 683, 'nb_dedup_ok': 4744, 'nb_two_criteria_ok': 672, 'nb_forced_upload': 0, 'ratio_coverage': 0.46290058025714736}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 13, 'nb_images_finished_for_older': 290, 'nb_ptf_started': 10, 'nb_images_started': 79, 'nb_selected_images': 369, 'last_update': '2022/08/26', 'portfolio_id': 6844250, 'last_run_id': 472453, 'total_number_of_photos': 672}} No error ? {'log_dict': {'total_nb_images': 4574, 'max_time_between_images': '0 days 645 seconds', 'coverage_pause': '0 days 25129 seconds', 'coverage_times_pause': '0 days 29163 seconds', 'nb_photos_decision': 4563, 'nb_gray_level_ok': 433, 'nb_dedup_ok': 4549, 'nb_two_criteria_ok': 432, 'nb_forced_upload': 0, 'ratio_coverage': 0.44320005643838517}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 10, 'nb_images_finished_for_older': 314, 'nb_ptf_started': 6, 'nb_images_started': 37, 'nb_selected_images': 351, 'last_update': '2022/08/27', 'portfolio_id': 6827218, 'last_run_id': 475039, 'total_number_of_photos': 432}} No error ? {'log_dict': {'total_nb_images': 4683, 'max_time_between_images': '0 days 615 seconds', 'coverage_pause': '0 days 25707 seconds', 'coverage_times_pause': '0 days 29852 seconds', 'nb_photos_decision': 4672, 'nb_gray_level_ok': 1557, 'nb_dedup_ok': 4640, 'nb_two_criteria_ok': 1534, 'nb_forced_upload': 0, 'ratio_coverage': 0.45339423975731497}, 'dashboard_dict': {'nb_ptf_finished': 1, 'nb_images_finished': 36, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 1, 'nb_images_started': 38, 'nb_selected_images': 74, 'last_update': '2022/08/23', 'portfolio_id': 6809148, 'last_run_id': 468129, 'total_number_of_photos': 1534}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 4862, 'max_time_between_images': '0 days 795 seconds', 'coverage_pause': '0 days 26839 seconds', 'coverage_times_pause': '0 days 30841 seconds', 'nb_photos_decision': 4852, 'nb_gray_level_ok': 3531, 'nb_dedup_ok': 4840, 'nb_two_criteria_ok': 3524, 'nb_forced_upload': 0, 'ratio_coverage': 0.47335931850649926}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'last_update': '2022/08/20', 'portfolio_id': 6798302, 'last_run_id': 465865, 'total_number_of_photos': 3527}} No error ? {'log_dict': {'total_nb_images': 4560, 'max_time_between_images': '0 days 494 seconds', 'coverage_pause': '0 days 25018 seconds', 'coverage_times_pause': '0 days 29127 seconds', 'nb_photos_decision': 4550, 'nb_gray_level_ok': 477, 'nb_dedup_ok': 4531, 'nb_two_criteria_ok': 475, 'nb_forced_upload': 0, 'ratio_coverage': 0.44124234995326195}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 18, 'nb_images_started': 277, 'nb_selected_images': 277, 'last_update': '2022/08/26', 'portfolio_id': 6783368, 'last_run_id': 472528, 'total_number_of_photos': 475}} No error ? {'log_dict': {'total_nb_images': 5265, 'max_time_between_images': '0 days 734 seconds', 'coverage_pause': '0 days 29016 seconds', 'coverage_times_pause': '0 days 33494 seconds', 'nb_photos_decision': 5264, 'nb_gray_level_ok': 484, 'nb_dedup_ok': 5253, 'nb_two_criteria_ok': 481, 'nb_forced_upload': 0, 'ratio_coverage': 0.5117550574084199}, 'dashboard_dict': {'nb_ptf_finished': 5, 'nb_images_finished': 128, 'nb_ptf_finished_for_older': 1, 'nb_images_finished_for_older': 25, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 153, 'last_update': '2022/08/19', 'portfolio_id': 6771076, 'last_run_id': 463066, 'total_number_of_photos': 493}} No error ? {'log_dict': {'total_nb_images': 4393, 'max_time_between_images': '0 days 494 seconds', 'coverage_pause': '0 days 24083 seconds', 'coverage_times_pause': '0 days 28103 seconds', 'nb_photos_decision': 4383, 'nb_gray_level_ok': 458, 'nb_dedup_ok': 4380, 'nb_two_criteria_ok': 457, 'nb_forced_upload': 0, 'ratio_coverage': 0.4247517592902873}, 'dashboard_dict': {'nb_ptf_finished': 6, 'nb_images_finished': 133, 'nb_ptf_finished_for_older': 1, 'nb_images_finished_for_older': 15, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 148, 'last_update': '2022/08/21', 'portfolio_id': 6756962, 'last_run_id': 461634, 'total_number_of_photos': 457}} No error ? {'log_dict': {'total_nb_images': 5956, 'max_time_between_images': '0 days 618 seconds', 'coverage_pause': '0 days 32980 seconds', 'coverage_times_pause': '0 days 37570 seconds', 'nb_photos_decision': 5954, 'nb_gray_level_ok': 2160, 'nb_dedup_ok': 5953, 'nb_two_criteria_ok': 2159, 'nb_forced_upload': 0, 'ratio_coverage': 0.5816681070212879}, 'dashboard_dict': {'nb_ptf_finished': 6, 'nb_images_finished': 211, 'nb_ptf_finished_for_older': 7, 'nb_images_finished_for_older': 239, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 450, 'last_update': '2022/08/22', 'portfolio_id': 6739050, 'last_run_id': 460382, 'total_number_of_photos': 2159}} No error ? {'log_dict': {'total_nb_images': 6178, 'max_time_between_images': '0 days 495 seconds', 'coverage_pause': '0 days 34258 seconds', 'coverage_times_pause': '0 days 38909 seconds', 'nb_photos_decision': 6166, 'nb_gray_level_ok': 974, 'nb_dedup_ok': 6160, 'nb_two_criteria_ok': 972, 'nb_forced_upload': 0, 'ratio_coverage': 0.6042081870932468}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 2, 'nb_images_started': 56, 'nb_selected_images': 56, 'last_update': '2022/08/16', 'portfolio_id': 6737105, 'last_run_id': 459844, 'total_number_of_photos': 984}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 4594, 'max_time_between_images': '0 days 523 seconds', 'coverage_pause': '0 days 25202 seconds', 'coverage_times_pause': '0 days 29276 seconds', 'nb_photos_decision': 4593, 'nb_gray_level_ok': 642, 'nb_dedup_ok': 4592, 'nb_two_criteria_ok': 642, 'nb_forced_upload': 0, 'ratio_coverage': 0.4444875570997725}, 'dashboard_dict': {'nb_ptf_finished': 14, 'nb_images_finished': 442, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 2, 'nb_images_started': 46, 'nb_selected_images': 488, 'last_update': '2022/08/14', 'portfolio_id': 6714492, 'last_run_id': 457649, 'total_number_of_photos': 642}} No error ? {'log_dict': {'total_nb_images': 4288, 'max_time_between_images': '0 days 1099 seconds', 'coverage_pause': '0 days 23533 seconds', 'coverage_times_pause': '0 days 27387 seconds', 'nb_photos_decision': 4278, 'nb_gray_level_ok': 1121, 'nb_dedup_ok': 4260, 'nb_two_criteria_ok': 1118, 'nb_forced_upload': 0, 'ratio_coverage': 0.4150514118414787}, 'dashboard_dict': {'nb_ptf_finished': 11, 'nb_images_finished': 482, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 482, 'last_update': '2022/08/13', 'portfolio_id': 6696131, 'last_run_id': 457375, 'total_number_of_photos': 1118}} No error ? {'log_dict': {'total_nb_images': 4606, 'max_time_between_images': '0 days 676 seconds', 'coverage_pause': '0 days 25379 seconds', 'coverage_times_pause': '0 days 29343 seconds', 'nb_photos_decision': 4596, 'nb_gray_level_ok': 637, 'nb_dedup_ok': 4567, 'nb_two_criteria_ok': 627, 'nb_forced_upload': 0, 'ratio_coverage': 0.4476093052787527}, 'dashboard_dict': {'nb_ptf_finished': 3, 'nb_images_finished': 115, 'nb_ptf_finished_for_older': 1, 'nb_images_finished_for_older': 12, 'nb_ptf_started': 2, 'nb_images_started': 80, 'nb_selected_images': 207, 'last_update': '2022/08/15', 'portfolio_id': 6680233, 'last_run_id': 454567, 'total_number_of_photos': 627}} No error ? {'log_dict': {'total_nb_images': 5000, 'max_time_between_images': '0 days 915 seconds', 'coverage_pause': '0 days 27593 seconds', 'coverage_times_pause': '0 days 31806 seconds', 'nb_photos_decision': 4999, 'nb_gray_level_ok': 2109, 'nb_dedup_ok': 4957, 'nb_two_criteria_ok': 2083, 'nb_forced_upload': 0, 'ratio_coverage': 0.48665761300904775}, 'dashboard_dict': {'nb_ptf_finished': 14, 'nb_images_finished': 407, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 407, 'last_update': '2022/08/17', 'portfolio_id': 6658698, 'last_run_id': 461498, 'total_number_of_photos': 2083}} No error ? {'log_dict': {'total_nb_images': 4720, 'max_time_between_images': '0 days 674 seconds', 'coverage_pause': '0 days 26032 seconds', 'coverage_times_pause': '0 days 30085 seconds', 'nb_photos_decision': 4719, 'nb_gray_level_ok': 1588, 'nb_dedup_ok': 4675, 'nb_two_criteria_ok': 1565, 'nb_forced_upload': 0, 'ratio_coverage': 0.4591262632497928}, 'dashboard_dict': {'nb_ptf_finished': 11, 'nb_images_finished': 320, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 320, 'last_update': '2022/08/14', 'portfolio_id': 6643366, 'last_run_id': 458795, 'total_number_of_photos': 1565}} No error ? {'log_dict': {'total_nb_images': 4690, 'max_time_between_images': '0 days 676 seconds', 'coverage_pause': '0 days 25756 seconds', 'coverage_times_pause': '0 days 29933 seconds', 'nb_photos_decision': 4689, 'nb_gray_level_ok': 504, 'nb_dedup_ok': 4669, 'nb_two_criteria_ok': 501, 'nb_forced_upload': 0, 'ratio_coverage': 0.454258452530027}, 'dashboard_dict': {'nb_ptf_finished': 12, 'nb_images_finished': 375, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 375, 'last_update': '2022/08/17', 'portfolio_id': 6633495, 'last_run_id': 456239, 'total_number_of_photos': 501}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 4735, 'max_time_between_images': '0 days 705 seconds', 'coverage_pause': '0 days 26039 seconds', 'coverage_times_pause': '0 days 30154 seconds', 'nb_photos_decision': 4734, 'nb_gray_level_ok': 2020, 'nb_dedup_ok': 4693, 'nb_two_criteria_ok': 1989, 'nb_forced_upload': 0, 'ratio_coverage': 0.4592497222173231}, 'dashboard_dict': {'nb_ptf_finished': 3, 'nb_images_finished': 54, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 12, 'nb_images_started': 417, 'nb_selected_images': 471, 'last_update': '2022/08/16', 'portfolio_id': 6631875, 'last_run_id': 454472, 'total_number_of_photos': 1989}} No error ? {'log_dict': {'total_nb_images': 4906, 'max_time_between_images': '0 days 735 seconds', 'coverage_pause': '0 days 27012 seconds', 'coverage_times_pause': '0 days 31274 seconds', 'nb_photos_decision': 4896, 'nb_gray_level_ok': 781, 'nb_dedup_ok': 4862, 'nb_two_criteria_ok': 775, 'nb_forced_upload': 0, 'ratio_coverage': 0.47641051870403356}, 'dashboard_dict': {'nb_ptf_finished': 13, 'nb_images_finished': 438, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 438, 'last_update': '2022/08/16', 'portfolio_id': 6630410, 'last_run_id': 454459, 'total_number_of_photos': 776}} No error ? {'log_dict': {'total_nb_images': 5275, 'max_time_between_images': '0 days 554 seconds', 'coverage_pause': '0 days 28988 seconds', 'coverage_times_pause': '0 days 33555 seconds', 'nb_photos_decision': 5274, 'nb_gray_level_ok': 623, 'nb_dedup_ok': 5236, 'nb_two_criteria_ok': 621, 'nb_forced_upload': 0, 'ratio_coverage': 0.5112612215382988}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 15, 'nb_images_started': 448, 'nb_selected_images': 448, 'last_update': '2022/08/14', 'portfolio_id': 6629957, 'last_run_id': 454465, 'total_number_of_photos': 621}} No error ? {'log_dict': {'total_nb_images': 5490, 'max_time_between_images': '0 days 555 seconds', 'coverage_pause': '0 days 30324 seconds', 'coverage_times_pause': '0 days 34888 seconds', 'nb_photos_decision': 5471, 'nb_gray_level_ok': 1487, 'nb_dedup_ok': 5431, 'nb_two_criteria_ok': 1473, 'nb_forced_upload': 0, 'ratio_coverage': 0.5348242473412229}, 'dashboard_dict': {'nb_ptf_finished': 8, 'nb_images_finished': 211, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 10, 'nb_images_started': 373, 'nb_selected_images': 584, 'last_update': '2022/08/15', 'portfolio_id': 6622675, 'last_run_id': 454450, 'total_number_of_photos': 1473}} No error ? {'log_dict': {'total_nb_images': 6116, 'max_time_between_images': '0 days 496 seconds', 'coverage_pause': '0 days 33822 seconds', 'coverage_times_pause': '0 days 38693 seconds', 'nb_photos_decision': 6115, 'nb_gray_level_ok': 2189, 'nb_dedup_ok': 6055, 'nb_two_criteria_ok': 2150, 'nb_forced_upload': 0, 'ratio_coverage': 0.5965184571156458}, 'dashboard_dict': {'nb_ptf_finished': 5, 'nb_images_finished': 90, 'nb_ptf_finished_for_older': 2, 'nb_images_finished_for_older': 36, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 126, 'last_update': '2022/08/11', 'portfolio_id': 6610799, 'last_run_id': 449568, 'total_number_of_photos': 2150}} No error ? {'log_dict': {'total_nb_images': 6299, 'max_time_between_images': '0 days 615 seconds', 'coverage_pause': '0 days 34914 seconds', 'coverage_times_pause': '0 days 39791 seconds', 'nb_photos_decision': 6298, 'nb_gray_level_ok': 2557, 'nb_dedup_ok': 6210, 'nb_two_criteria_ok': 2501, 'nb_forced_upload': 0, 'ratio_coverage': 0.6157780560503713}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 6, 'nb_images_finished_for_older': 164, 'nb_ptf_started': 1, 'nb_images_started': 50, 'nb_selected_images': 214, 'last_update': '2022/08/02', 'portfolio_id': 6600064, 'last_run_id': 448643, 'total_number_of_photos': 2501}} No error ? {'log_dict': {'total_nb_images': 4471, 'max_time_between_images': '0 days 525 seconds', 'coverage_pause': '0 days 24594 seconds', 'coverage_times_pause': '0 days 28481 seconds', 'nb_photos_decision': 4452, 'nb_gray_level_ok': 1314, 'nb_dedup_ok': 4449, 'nb_two_criteria_ok': 1311, 'nb_forced_upload': 0, 'ratio_coverage': 0.4337642639199986}, 'dashboard_dict': {'nb_ptf_finished': 28, 'nb_images_finished': 357, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 1, 'nb_images_started': 5, 'nb_selected_images': 362, 'last_update': '2022/08/31', 'portfolio_id': 6891498, 'last_run_id': 478934, 'total_number_of_photos': 1311}} No error ? {'log_dict': {'total_nb_images': 4544, 'max_time_between_images': '0 days 494 seconds', 'coverage_pause': '0 days 25014 seconds', 'coverage_times_pause': '0 days 28962 seconds', 'nb_photos_decision': 4543, 'nb_gray_level_ok': 849, 'nb_dedup_ok': 4538, 'nb_two_criteria_ok': 846, 'nb_forced_upload': 0, 'ratio_coverage': 0.4411718019718161}, 'dashboard_dict': {'nb_ptf_finished': 17, 'nb_images_finished': 225, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 1, 'nb_images_started': 8, 'nb_selected_images': 233, 'last_update': '2022/08/30', 'portfolio_id': 6880717, 'last_run_id': 477481, 'total_number_of_photos': 834}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 4766, 'max_time_between_images': '0 days 675 seconds', 'coverage_pause': '0 days 26303 seconds', 'coverage_times_pause': '0 days 30348 seconds', 'nb_photos_decision': 4755, 'nb_gray_level_ok': 2280, 'nb_dedup_ok': 4743, 'nb_two_criteria_ok': 2272, 'nb_forced_upload': 0, 'ratio_coverage': 0.4639058889927512}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'last_update': '2022/08/27', 'portfolio_id': 6871304, 'last_run_id': 475316, 'total_number_of_photos': 2278}} No error ? {'log_dict': {'total_nb_images': 5107, 'max_time_between_images': '0 days 615 seconds', 'coverage_pause': '0 days 28141 seconds', 'coverage_times_pause': '0 days 32466 seconds', 'nb_photos_decision': 5097, 'nb_gray_level_ok': 522, 'nb_dedup_ok': 5079, 'nb_two_criteria_ok': 518, 'nb_forced_upload': 0, 'ratio_coverage': 0.49632268646713346}, 'dashboard_dict': {'nb_ptf_finished': 14, 'nb_images_finished': 209, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 209, 'last_update': '2022/08/27', 'portfolio_id': 6864486, 'last_run_id': 474538, 'total_number_of_photos': 518}} No error ? {'log_dict': {'total_nb_images': 5139, 'max_time_between_images': '0 days 556 seconds', 'coverage_pause': '0 days 28323 seconds', 'coverage_times_pause': '0 days 32665 seconds', 'nb_photos_decision': 5129, 'nb_gray_level_ok': 568, 'nb_dedup_ok': 5116, 'nb_two_criteria_ok': 565, 'nb_forced_upload': 0, 'ratio_coverage': 0.49953261962292106}, 'dashboard_dict': {'nb_ptf_finished': 9, 'nb_images_finished': 155, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 9, 'nb_images_started': 230, 'nb_selected_images': 385, 'last_update': '2022/08/27', 'portfolio_id': 6856460, 'last_run_id': 474892, 'total_number_of_photos': 571}} No error ? {'log_dict': {'total_nb_images': 4771, 'max_time_between_images': '0 days 615 seconds', 'coverage_pause': '0 days 26246 seconds', 'coverage_times_pause': '0 days 30416 seconds', 'nb_photos_decision': 4760, 'nb_gray_level_ok': 683, 'nb_dedup_ok': 4744, 'nb_two_criteria_ok': 672, 'nb_forced_upload': 0, 'ratio_coverage': 0.46290058025714736}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 13, 'nb_images_finished_for_older': 290, 'nb_ptf_started': 10, 'nb_images_started': 79, 'nb_selected_images': 369, 'last_update': '2022/08/26', 'portfolio_id': 6844250, 'last_run_id': 472453, 'total_number_of_photos': 672}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 4766, 'max_time_between_images': '0 days 675 seconds', 'coverage_pause': '0 days 26303 seconds', 'coverage_times_pause': '0 days 30348 seconds', 'nb_photos_decision': 4755, 'nb_gray_level_ok': 2280, 'nb_dedup_ok': 4743, 'nb_two_criteria_ok': 2272, 'nb_forced_upload': 0, 'ratio_coverage': 0.4639058889927512}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'last_update': '2022/08/27', 'portfolio_id': 6871304, 'last_run_id': 475316, 'total_number_of_photos': 2278}} No error ? {'log_dict': {'total_nb_images': 5107, 'max_time_between_images': '0 days 615 seconds', 'coverage_pause': '0 days 28141 seconds', 'coverage_times_pause': '0 days 32466 seconds', 'nb_photos_decision': 5097, 'nb_gray_level_ok': 522, 'nb_dedup_ok': 5079, 'nb_two_criteria_ok': 518, 'nb_forced_upload': 0, 'ratio_coverage': 0.49632268646713346}, 'dashboard_dict': {'nb_ptf_finished': 14, 'nb_images_finished': 209, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 209, 'last_update': '2022/08/27', 'portfolio_id': 6864486, 'last_run_id': 474538, 'total_number_of_photos': 518}} No error ? {'log_dict': {'total_nb_images': 5139, 'max_time_between_images': '0 days 556 seconds', 'coverage_pause': '0 days 28323 seconds', 'coverage_times_pause': '0 days 32665 seconds', 'nb_photos_decision': 5129, 'nb_gray_level_ok': 568, 'nb_dedup_ok': 5116, 'nb_two_criteria_ok': 565, 'nb_forced_upload': 0, 'ratio_coverage': 0.49953261962292106}, 'dashboard_dict': {'nb_ptf_finished': 9, 'nb_images_finished': 155, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 9, 'nb_images_started': 230, 'nb_selected_images': 385, 'last_update': '2022/08/27', 'portfolio_id': 6856460, 'last_run_id': 474892, 'total_number_of_photos': 571}} No error ? {'log_dict': {'total_nb_images': 4771, 'max_time_between_images': '0 days 615 seconds', 'coverage_pause': '0 days 26246 seconds', 'coverage_times_pause': '0 days 30416 seconds', 'nb_photos_decision': 4760, 'nb_gray_level_ok': 683, 'nb_dedup_ok': 4744, 'nb_two_criteria_ok': 672, 'nb_forced_upload': 0, 'ratio_coverage': 0.46290058025714736}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 13, 'nb_images_finished_for_older': 290, 'nb_ptf_started': 10, 'nb_images_started': 79, 'nb_selected_images': 369, 'last_update': '2022/08/26', 'portfolio_id': 6844250, 'last_run_id': 472453, 'total_number_of_photos': 672}} No error ? {'log_dict': {'total_nb_images': 4574, 'max_time_between_images': '0 days 645 seconds', 'coverage_pause': '0 days 25129 seconds', 'coverage_times_pause': '0 days 29163 seconds', 'nb_photos_decision': 4563, 'nb_gray_level_ok': 433, 'nb_dedup_ok': 4549, 'nb_two_criteria_ok': 432, 'nb_forced_upload': 0, 'ratio_coverage': 0.44320005643838517}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 10, 'nb_images_finished_for_older': 314, 'nb_ptf_started': 6, 'nb_images_started': 37, 'nb_selected_images': 351, 'last_update': '2022/08/27', 'portfolio_id': 6827218, 'last_run_id': 475039, 'total_number_of_photos': 432}} No error ? {'log_dict': {'total_nb_images': 4683, 'max_time_between_images': '0 days 615 seconds', 'coverage_pause': '0 days 25707 seconds', 'coverage_times_pause': '0 days 29852 seconds', 'nb_photos_decision': 4672, 'nb_gray_level_ok': 1557, 'nb_dedup_ok': 4640, 'nb_two_criteria_ok': 1534, 'nb_forced_upload': 0, 'ratio_coverage': 0.45339423975731497}, 'dashboard_dict': {'nb_ptf_finished': 1, 'nb_images_finished': 36, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 1, 'nb_images_started': 38, 'nb_selected_images': 74, 'last_update': '2022/08/23', 'portfolio_id': 6809148, 'last_run_id': 468129, 'total_number_of_photos': 1534}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 5107, 'max_time_between_images': '0 days 615 seconds', 'coverage_pause': '0 days 28141 seconds', 'coverage_times_pause': '0 days 32466 seconds', 'nb_photos_decision': 5097, 'nb_gray_level_ok': 522, 'nb_dedup_ok': 5079, 'nb_two_criteria_ok': 518, 'nb_forced_upload': 0, 'ratio_coverage': 0.49632268646713346}, 'dashboard_dict': {'nb_ptf_finished': 14, 'nb_images_finished': 209, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 209, 'last_update': '2022/08/27', 'portfolio_id': 6864486, 'last_run_id': 474335, 'total_number_of_photos': 518}} No error ? {'log_dict': {'total_nb_images': 5139, 'max_time_between_images': '0 days 556 seconds', 'coverage_pause': '0 days 28323 seconds', 'coverage_times_pause': '0 days 32665 seconds', 'nb_photos_decision': 5129, 'nb_gray_level_ok': 568, 'nb_dedup_ok': 5116, 'nb_two_criteria_ok': 565, 'nb_forced_upload': 0, 'ratio_coverage': 0.49953261962292106}, 'dashboard_dict': {'nb_ptf_finished': 7, 'nb_images_finished': 134, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 3, 'nb_images_started': 31, 'nb_selected_images': 165, 'last_update': '2022/08/26', 'portfolio_id': 6856460, 'last_run_id': 472687, 'total_number_of_photos': 571}} No error ? {'log_dict': {'total_nb_images': 4771, 'max_time_between_images': '0 days 615 seconds', 'coverage_pause': '0 days 26246 seconds', 'coverage_times_pause': '0 days 30416 seconds', 'nb_photos_decision': 4760, 'nb_gray_level_ok': 683, 'nb_dedup_ok': 4744, 'nb_two_criteria_ok': 672, 'nb_forced_upload': 0, 'ratio_coverage': 0.46290058025714736}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 13, 'nb_images_finished_for_older': 290, 'nb_ptf_started': 10, 'nb_images_started': 79, 'nb_selected_images': 369, 'last_update': '2022/08/26', 'portfolio_id': 6844250, 'last_run_id': 472453, 'total_number_of_photos': 672}} No error ? {'log_dict': {'total_nb_images': 4574, 'max_time_between_images': '0 days 645 seconds', 'coverage_pause': '0 days 25129 seconds', 'coverage_times_pause': '0 days 29163 seconds', 'nb_photos_decision': 4563, 'nb_gray_level_ok': 433, 'nb_dedup_ok': 4549, 'nb_two_criteria_ok': 432, 'nb_forced_upload': 0, 'ratio_coverage': 0.44320005643838517}, 'dashboard_dict': {'nb_ptf_finished': 10, 'nb_images_finished': 314, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 314, 'last_update': '2022/08/24', 'portfolio_id': 6827218, 'last_run_id': 470784, 'total_number_of_photos': 432}} No error ? {'log_dict': {'total_nb_images': 4683, 'max_time_between_images': '0 days 615 seconds', 'coverage_pause': '0 days 25707 seconds', 'coverage_times_pause': '0 days 29852 seconds', 'nb_photos_decision': 4672, 'nb_gray_level_ok': 1557, 'nb_dedup_ok': 4640, 'nb_two_criteria_ok': 1534, 'nb_forced_upload': 0, 'ratio_coverage': 0.45339423975731497}, 'dashboard_dict': {'nb_ptf_finished': 1, 'nb_images_finished': 36, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 1, 'nb_images_started': 38, 'nb_selected_images': 74, 'last_update': '2022/08/23', 'portfolio_id': 6809148, 'last_run_id': 468129, 'total_number_of_photos': 1534}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 4862, 'max_time_between_images': '0 days 795 seconds', 'coverage_pause': '0 days 26839 seconds', 'coverage_times_pause': '0 days 30841 seconds', 'nb_photos_decision': 4852, 'nb_gray_level_ok': 3531, 'nb_dedup_ok': 4840, 'nb_two_criteria_ok': 3524, 'nb_forced_upload': 0, 'ratio_coverage': 0.47335931850649926}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'last_update': '2022/08/20', 'portfolio_id': 6798302, 'last_run_id': 465865, 'total_number_of_photos': 3527}} No error ? {'log_dict': {'total_nb_images': 5107, 'max_time_between_images': '0 days 615 seconds', 'coverage_pause': '0 days 28141 seconds', 'coverage_times_pause': '0 days 32466 seconds', 'nb_photos_decision': 5097, 'nb_gray_level_ok': 522, 'nb_dedup_ok': 5079, 'nb_two_criteria_ok': 518, 'nb_forced_upload': 0, 'ratio_coverage': 0.49632268646713346}, 'dashboard_dict': {'nb_ptf_finished': 14, 'nb_images_finished': 209, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 209, 'last_update': '2022/08/27', 'portfolio_id': 6864486, 'last_run_id': 474335, 'total_number_of_photos': 518}} No error ? {'log_dict': {'total_nb_images': 4771, 'max_time_between_images': '0 days 615 seconds', 'coverage_pause': '0 days 26246 seconds', 'coverage_times_pause': '0 days 30416 seconds', 'nb_photos_decision': 4760, 'nb_gray_level_ok': 683, 'nb_dedup_ok': 4744, 'nb_two_criteria_ok': 672, 'nb_forced_upload': 0, 'ratio_coverage': 0.46290058025714736}, 'dashboard_dict': {'nb_ptf_finished': 15, 'nb_images_finished': 328, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 328, 'last_update': '2022/08/25', 'portfolio_id': 6844250, 'last_run_id': 472181, 'total_number_of_photos': 672}} No error ? {'log_dict': {'total_nb_images': 4574, 'max_time_between_images': '0 days 645 seconds', 'coverage_pause': '0 days 25129 seconds', 'coverage_times_pause': '0 days 29163 seconds', 'nb_photos_decision': 4563, 'nb_gray_level_ok': 433, 'nb_dedup_ok': 4549, 'nb_two_criteria_ok': 432, 'nb_forced_upload': 0, 'ratio_coverage': 0.44320005643838517}, 'dashboard_dict': {'nb_ptf_finished': 10, 'nb_images_finished': 314, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 314, 'last_update': '2022/08/24', 'portfolio_id': 6827218, 'last_run_id': 470784, 'total_number_of_photos': 432}} No error ? {'log_dict': {'total_nb_images': 4683, 'max_time_between_images': '0 days 615 seconds', 'coverage_pause': '0 days 25707 seconds', 'coverage_times_pause': '0 days 29852 seconds', 'nb_photos_decision': 4672, 'nb_gray_level_ok': 1557, 'nb_dedup_ok': 4640, 'nb_two_criteria_ok': 1534, 'nb_forced_upload': 0, 'ratio_coverage': 0.45339423975731497}, 'dashboard_dict': {'nb_ptf_finished': 1, 'nb_images_finished': 36, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 1, 'nb_images_started': 38, 'nb_selected_images': 74, 'last_update': '2022/08/23', 'portfolio_id': 6809148, 'last_run_id': 468129, 'total_number_of_photos': 1534}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 4862, 'max_time_between_images': '0 days 795 seconds', 'coverage_pause': '0 days 26839 seconds', 'coverage_times_pause': '0 days 30841 seconds', 'nb_photos_decision': 4852, 'nb_gray_level_ok': 3531, 'nb_dedup_ok': 4840, 'nb_two_criteria_ok': 3524, 'nb_forced_upload': 0, 'ratio_coverage': 0.47335931850649926}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'last_update': '2022/08/20', 'portfolio_id': 6798302, 'last_run_id': 465865, 'total_number_of_photos': 3527}} No error ? {'log_dict': {'total_nb_images': 4560, 'max_time_between_images': '0 days 494 seconds', 'coverage_pause': '0 days 25018 seconds', 'coverage_times_pause': '0 days 29127 seconds', 'nb_photos_decision': 4550, 'nb_gray_level_ok': 477, 'nb_dedup_ok': 4531, 'nb_two_criteria_ok': 475, 'nb_forced_upload': 0, 'ratio_coverage': 0.44124234995326195}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 2, 'nb_images_finished_for_older': 57, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 57, 'last_update': '2022/08/20', 'portfolio_id': 6783368, 'last_run_id': 463638, 'total_number_of_photos': 475}} No error ? {'log_dict': {'total_nb_images': 5265, 'max_time_between_images': '0 days 734 seconds', 'coverage_pause': '0 days 29016 seconds', 'coverage_times_pause': '0 days 33494 seconds', 'nb_photos_decision': 5264, 'nb_gray_level_ok': 484, 'nb_dedup_ok': 5253, 'nb_two_criteria_ok': 481, 'nb_forced_upload': 0, 'ratio_coverage': 0.5117550574084199}, 'dashboard_dict': {'nb_ptf_finished': 5, 'nb_images_finished': 128, 'nb_ptf_finished_for_older': 1, 'nb_images_finished_for_older': 25, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 153, 'last_update': '2022/08/19', 'portfolio_id': 6771076, 'last_run_id': 463066, 'total_number_of_photos': 493}} No error ? {'log_dict': {'total_nb_images': 4771, 'max_time_between_images': '0 days 615 seconds', 'coverage_pause': '0 days 26246 seconds', 'coverage_times_pause': '0 days 30416 seconds', 'nb_photos_decision': 4760, 'nb_gray_level_ok': 683, 'nb_dedup_ok': 4744, 'nb_two_criteria_ok': 672, 'nb_forced_upload': 0, 'ratio_coverage': 0.46290058025714736}, 'dashboard_dict': {'nb_ptf_finished': 15, 'nb_images_finished': 328, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 328, 'last_update': '2022/08/25', 'portfolio_id': 6844250, 'last_run_id': 472127, 'total_number_of_photos': 672}} No error ? {'log_dict': {'total_nb_images': 4574, 'max_time_between_images': '0 days 645 seconds', 'coverage_pause': '0 days 25129 seconds', 'coverage_times_pause': '0 days 29163 seconds', 'nb_photos_decision': 4563, 'nb_gray_level_ok': 433, 'nb_dedup_ok': 4549, 'nb_two_criteria_ok': 432, 'nb_forced_upload': 0, 'ratio_coverage': 0.44320005643838517}, 'dashboard_dict': {'nb_ptf_finished': 10, 'nb_images_finished': 314, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 314, 'last_update': '2022/08/24', 'portfolio_id': 6827218, 'last_run_id': 470784, 'total_number_of_photos': 432}} No error ? {'log_dict': {'total_nb_images': 4683, 'max_time_between_images': '0 days 615 seconds', 'coverage_pause': '0 days 25707 seconds', 'coverage_times_pause': '0 days 29852 seconds', 'nb_photos_decision': 4672, 'nb_gray_level_ok': 1557, 'nb_dedup_ok': 4640, 'nb_two_criteria_ok': 1534, 'nb_forced_upload': 0, 'ratio_coverage': 0.45339423975731497}, 'dashboard_dict': {'nb_ptf_finished': 1, 'nb_images_finished': 36, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 1, 'nb_images_started': 38, 'nb_selected_images': 74, 'last_update': '2022/08/23', 'portfolio_id': 6809148, 'last_run_id': 468129, 'total_number_of_photos': 1534}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 4862, 'max_time_between_images': '0 days 795 seconds', 'coverage_pause': '0 days 26839 seconds', 'coverage_times_pause': '0 days 30841 seconds', 'nb_photos_decision': 4852, 'nb_gray_level_ok': 3531, 'nb_dedup_ok': 4840, 'nb_two_criteria_ok': 3524, 'nb_forced_upload': 0, 'ratio_coverage': 0.47335931850649926}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'last_update': '2022/08/20', 'portfolio_id': 6798302, 'last_run_id': 465865, 'total_number_of_photos': 3527}} No error ? {'log_dict': {'total_nb_images': 4560, 'max_time_between_images': '0 days 494 seconds', 'coverage_pause': '0 days 25018 seconds', 'coverage_times_pause': '0 days 29127 seconds', 'nb_photos_decision': 4550, 'nb_gray_level_ok': 477, 'nb_dedup_ok': 4531, 'nb_two_criteria_ok': 475, 'nb_forced_upload': 0, 'ratio_coverage': 0.44124234995326195}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 2, 'nb_images_finished_for_older': 57, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 57, 'last_update': '2022/08/20', 'portfolio_id': 6783368, 'last_run_id': 463638, 'total_number_of_photos': 475}} No error ? {'log_dict': {'total_nb_images': 5265, 'max_time_between_images': '0 days 734 seconds', 'coverage_pause': '0 days 29016 seconds', 'coverage_times_pause': '0 days 33494 seconds', 'nb_photos_decision': 5264, 'nb_gray_level_ok': 484, 'nb_dedup_ok': 5253, 'nb_two_criteria_ok': 481, 'nb_forced_upload': 0, 'ratio_coverage': 0.5117550574084199}, 'dashboard_dict': {'nb_ptf_finished': 5, 'nb_images_finished': 128, 'nb_ptf_finished_for_older': 1, 'nb_images_finished_for_older': 25, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 153, 'last_update': '2022/08/19', 'portfolio_id': 6771076, 'last_run_id': 463066, 'total_number_of_photos': 493}} No error ? {'log_dict': {'total_nb_images': 4393, 'max_time_between_images': '0 days 494 seconds', 'coverage_pause': '0 days 24083 seconds', 'coverage_times_pause': '0 days 28103 seconds', 'nb_photos_decision': 4383, 'nb_gray_level_ok': 458, 'nb_dedup_ok': 4380, 'nb_two_criteria_ok': 457, 'nb_forced_upload': 0, 'ratio_coverage': 0.4247517592902873}, 'dashboard_dict': {'nb_ptf_finished': 6, 'nb_images_finished': 133, 'nb_ptf_finished_for_older': 1, 'nb_images_finished_for_older': 15, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 148, 'last_update': '2022/08/21', 'portfolio_id': 6756962, 'last_run_id': 461634, 'total_number_of_photos': 457}} No error ? {'log_dict': {'total_nb_images': 4574, 'max_time_between_images': '0 days 645 seconds', 'coverage_pause': '0 days 25129 seconds', 'coverage_times_pause': '0 days 29163 seconds', 'nb_photos_decision': 4563, 'nb_gray_level_ok': 433, 'nb_dedup_ok': 4549, 'nb_two_criteria_ok': 432, 'nb_forced_upload': 0, 'ratio_coverage': 0.44320005643838517}, 'dashboard_dict': {'nb_ptf_finished': 10, 'nb_images_finished': 314, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 314, 'last_update': '2022/08/24', 'portfolio_id': 6827218, 'last_run_id': 470715, 'total_number_of_photos': 432}} No error ? {'log_dict': {'total_nb_images': 4683, 'max_time_between_images': '0 days 615 seconds', 'coverage_pause': '0 days 25707 seconds', 'coverage_times_pause': '0 days 29852 seconds', 'nb_photos_decision': 4672, 'nb_gray_level_ok': 1557, 'nb_dedup_ok': 4640, 'nb_two_criteria_ok': 1534, 'nb_forced_upload': 0, 'ratio_coverage': 0.45339423975731497}, 'dashboard_dict': {'nb_ptf_finished': 1, 'nb_images_finished': 36, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 1, 'nb_images_started': 38, 'nb_selected_images': 74, 'last_update': '2022/08/23', 'portfolio_id': 6809148, 'last_run_id': 468129, 'total_number_of_photos': 1534}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 4862, 'max_time_between_images': '0 days 795 seconds', 'coverage_pause': '0 days 26839 seconds', 'coverage_times_pause': '0 days 30841 seconds', 'nb_photos_decision': 4852, 'nb_gray_level_ok': 3531, 'nb_dedup_ok': 4840, 'nb_two_criteria_ok': 3524, 'nb_forced_upload': 0, 'ratio_coverage': 0.47335931850649926}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'last_update': '2022/08/20', 'portfolio_id': 6798302, 'last_run_id': 465865, 'total_number_of_photos': 3527}} No error ? {'log_dict': {'total_nb_images': 4560, 'max_time_between_images': '0 days 494 seconds', 'coverage_pause': '0 days 25018 seconds', 'coverage_times_pause': '0 days 29127 seconds', 'nb_photos_decision': 4550, 'nb_gray_level_ok': 477, 'nb_dedup_ok': 4531, 'nb_two_criteria_ok': 475, 'nb_forced_upload': 0, 'ratio_coverage': 0.44124234995326195}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 2, 'nb_images_finished_for_older': 57, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 57, 'last_update': '2022/08/20', 'portfolio_id': 6783368, 'last_run_id': 463638, 'total_number_of_photos': 475}} No error ? {'log_dict': {'total_nb_images': 5265, 'max_time_between_images': '0 days 734 seconds', 'coverage_pause': '0 days 29016 seconds', 'coverage_times_pause': '0 days 33494 seconds', 'nb_photos_decision': 5264, 'nb_gray_level_ok': 484, 'nb_dedup_ok': 5253, 'nb_two_criteria_ok': 481, 'nb_forced_upload': 0, 'ratio_coverage': 0.5117550574084199}, 'dashboard_dict': {'nb_ptf_finished': 5, 'nb_images_finished': 128, 'nb_ptf_finished_for_older': 1, 'nb_images_finished_for_older': 25, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 153, 'last_update': '2022/08/19', 'portfolio_id': 6771076, 'last_run_id': 463066, 'total_number_of_photos': 493}} No error ? {'log_dict': {'total_nb_images': 4393, 'max_time_between_images': '0 days 494 seconds', 'coverage_pause': '0 days 24083 seconds', 'coverage_times_pause': '0 days 28103 seconds', 'nb_photos_decision': 4383, 'nb_gray_level_ok': 458, 'nb_dedup_ok': 4380, 'nb_two_criteria_ok': 457, 'nb_forced_upload': 0, 'ratio_coverage': 0.4247517592902873}, 'dashboard_dict': {'nb_ptf_finished': 6, 'nb_images_finished': 133, 'nb_ptf_finished_for_older': 1, 'nb_images_finished_for_older': 15, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 148, 'last_update': '2022/08/21', 'portfolio_id': 6756962, 'last_run_id': 461634, 'total_number_of_photos': 457}} No error ? {'log_dict': {'total_nb_images': 5956, 'max_time_between_images': '0 days 618 seconds', 'coverage_pause': '0 days 32980 seconds', 'coverage_times_pause': '0 days 37570 seconds', 'nb_photos_decision': 5954, 'nb_gray_level_ok': 2160, 'nb_dedup_ok': 5953, 'nb_two_criteria_ok': 2159, 'nb_forced_upload': 0, 'ratio_coverage': 0.5816681070212879}, 'dashboard_dict': {'nb_ptf_finished': 6, 'nb_images_finished': 211, 'nb_ptf_finished_for_older': 7, 'nb_images_finished_for_older': 239, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 450, 'last_update': '2022/08/22', 'portfolio_id': 6739050, 'last_run_id': 460382, 'total_number_of_photos': 2159}} No error ? {'log_dict': {'total_nb_images': 4683, 'max_time_between_images': '0 days 615 seconds', 'coverage_pause': '0 days 25707 seconds', 'coverage_times_pause': '0 days 29852 seconds', 'nb_photos_decision': 4672, 'nb_gray_level_ok': 1557, 'nb_dedup_ok': 4640, 'nb_two_criteria_ok': 1534, 'nb_forced_upload': 0, 'ratio_coverage': 0.45339423975731497}, 'dashboard_dict': {'nb_ptf_finished': 1, 'nb_images_finished': 36, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 1, 'nb_images_started': 38, 'nb_selected_images': 74, 'last_update': '2022/08/23', 'portfolio_id': 6809148, 'last_run_id': 468129, 'total_number_of_photos': 1534}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 4862, 'max_time_between_images': '0 days 795 seconds', 'coverage_pause': '0 days 26839 seconds', 'coverage_times_pause': '0 days 30841 seconds', 'nb_photos_decision': 4852, 'nb_gray_level_ok': 3531, 'nb_dedup_ok': 4840, 'nb_two_criteria_ok': 3524, 'nb_forced_upload': 0, 'ratio_coverage': 0.47335931850649926}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'last_update': '2022/08/20', 'portfolio_id': 6798302, 'last_run_id': 465865, 'total_number_of_photos': 3527}} No error ? {'log_dict': {'total_nb_images': 4560, 'max_time_between_images': '0 days 494 seconds', 'coverage_pause': '0 days 25018 seconds', 'coverage_times_pause': '0 days 29127 seconds', 'nb_photos_decision': 4550, 'nb_gray_level_ok': 477, 'nb_dedup_ok': 4531, 'nb_two_criteria_ok': 475, 'nb_forced_upload': 0, 'ratio_coverage': 0.44124234995326195}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 2, 'nb_images_finished_for_older': 57, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 57, 'last_update': '2022/08/20', 'portfolio_id': 6783368, 'last_run_id': 463638, 'total_number_of_photos': 475}} No error ? {'log_dict': {'total_nb_images': 5265, 'max_time_between_images': '0 days 734 seconds', 'coverage_pause': '0 days 29016 seconds', 'coverage_times_pause': '0 days 33494 seconds', 'nb_photos_decision': 5264, 'nb_gray_level_ok': 484, 'nb_dedup_ok': 5253, 'nb_two_criteria_ok': 481, 'nb_forced_upload': 0, 'ratio_coverage': 0.5117550574084199}, 'dashboard_dict': {'nb_ptf_finished': 5, 'nb_images_finished': 128, 'nb_ptf_finished_for_older': 1, 'nb_images_finished_for_older': 25, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 153, 'last_update': '2022/08/19', 'portfolio_id': 6771076, 'last_run_id': 463066, 'total_number_of_photos': 493}} No error ? {'log_dict': {'total_nb_images': 4393, 'max_time_between_images': '0 days 494 seconds', 'coverage_pause': '0 days 24083 seconds', 'coverage_times_pause': '0 days 28103 seconds', 'nb_photos_decision': 4383, 'nb_gray_level_ok': 458, 'nb_dedup_ok': 4380, 'nb_two_criteria_ok': 457, 'nb_forced_upload': 0, 'ratio_coverage': 0.4247517592902873}, 'dashboard_dict': {'nb_ptf_finished': 6, 'nb_images_finished': 133, 'nb_ptf_finished_for_older': 1, 'nb_images_finished_for_older': 15, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 148, 'last_update': '2022/08/21', 'portfolio_id': 6756962, 'last_run_id': 461634, 'total_number_of_photos': 457}} No error ? {'log_dict': {'total_nb_images': 5956, 'max_time_between_images': '0 days 618 seconds', 'coverage_pause': '0 days 32980 seconds', 'coverage_times_pause': '0 days 37570 seconds', 'nb_photos_decision': 5954, 'nb_gray_level_ok': 2160, 'nb_dedup_ok': 5953, 'nb_two_criteria_ok': 2159, 'nb_forced_upload': 0, 'ratio_coverage': 0.5816681070212879}, 'dashboard_dict': {'nb_ptf_finished': 6, 'nb_images_finished': 211, 'nb_ptf_finished_for_older': 7, 'nb_images_finished_for_older': 239, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 450, 'last_update': '2022/08/22', 'portfolio_id': 6739050, 'last_run_id': 460382, 'total_number_of_photos': 2159}} No error ? {'log_dict': {'total_nb_images': 6178, 'max_time_between_images': '0 days 495 seconds', 'coverage_pause': '0 days 34258 seconds', 'coverage_times_pause': '0 days 38909 seconds', 'nb_photos_decision': 6166, 'nb_gray_level_ok': 974, 'nb_dedup_ok': 6160, 'nb_two_criteria_ok': 972, 'nb_forced_upload': 0, 'ratio_coverage': 0.6042081870932468}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 2, 'nb_images_started': 56, 'nb_selected_images': 56, 'last_update': '2022/08/16', 'portfolio_id': 6737105, 'last_run_id': 459844, 'total_number_of_photos': 984}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 4862, 'max_time_between_images': '0 days 795 seconds', 'coverage_pause': '0 days 26839 seconds', 'coverage_times_pause': '0 days 30841 seconds', 'nb_photos_decision': 4852, 'nb_gray_level_ok': 3531, 'nb_dedup_ok': 4840, 'nb_two_criteria_ok': 3524, 'nb_forced_upload': 0, 'ratio_coverage': 0.47335931850649926}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'last_update': '2022/08/20', 'portfolio_id': 6798302, 'last_run_id': 465865, 'total_number_of_photos': 3527}} No error ? {'log_dict': {'total_nb_images': 4560, 'max_time_between_images': '0 days 494 seconds', 'coverage_pause': '0 days 25018 seconds', 'coverage_times_pause': '0 days 29127 seconds', 'nb_photos_decision': 4550, 'nb_gray_level_ok': 477, 'nb_dedup_ok': 4531, 'nb_two_criteria_ok': 475, 'nb_forced_upload': 0, 'ratio_coverage': 0.44124234995326195}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 2, 'nb_images_finished_for_older': 57, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 57, 'last_update': '2022/08/20', 'portfolio_id': 6783368, 'last_run_id': 463638, 'total_number_of_photos': 475}} No error ? {'log_dict': {'total_nb_images': 5265, 'max_time_between_images': '0 days 734 seconds', 'coverage_pause': '0 days 29016 seconds', 'coverage_times_pause': '0 days 33494 seconds', 'nb_photos_decision': 5264, 'nb_gray_level_ok': 484, 'nb_dedup_ok': 5253, 'nb_two_criteria_ok': 481, 'nb_forced_upload': 0, 'ratio_coverage': 0.5117550574084199}, 'dashboard_dict': {'nb_ptf_finished': 5, 'nb_images_finished': 128, 'nb_ptf_finished_for_older': 1, 'nb_images_finished_for_older': 25, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 153, 'last_update': '2022/08/19', 'portfolio_id': 6771076, 'last_run_id': 463066, 'total_number_of_photos': 493}} No error ? {'log_dict': {'total_nb_images': 4393, 'max_time_between_images': '0 days 494 seconds', 'coverage_pause': '0 days 24083 seconds', 'coverage_times_pause': '0 days 28103 seconds', 'nb_photos_decision': 4383, 'nb_gray_level_ok': 458, 'nb_dedup_ok': 4380, 'nb_two_criteria_ok': 457, 'nb_forced_upload': 0, 'ratio_coverage': 0.4247517592902873}, 'dashboard_dict': {'nb_ptf_finished': 6, 'nb_images_finished': 133, 'nb_ptf_finished_for_older': 1, 'nb_images_finished_for_older': 15, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 148, 'last_update': '2022/08/18', 'portfolio_id': 6756962, 'last_run_id': 461634, 'total_number_of_photos': 457}} No error ? {'log_dict': {'total_nb_images': 5956, 'max_time_between_images': '0 days 618 seconds', 'coverage_pause': '0 days 32980 seconds', 'coverage_times_pause': '0 days 37570 seconds', 'nb_photos_decision': 5954, 'nb_gray_level_ok': 2160, 'nb_dedup_ok': 5953, 'nb_two_criteria_ok': 2159, 'nb_forced_upload': 0, 'ratio_coverage': 0.5816681070212879}, 'dashboard_dict': {'nb_ptf_finished': 6, 'nb_images_finished': 211, 'nb_ptf_finished_for_older': 7, 'nb_images_finished_for_older': 239, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 450, 'last_update': '2022/08/17', 'portfolio_id': 6739050, 'last_run_id': 460382, 'total_number_of_photos': 2159}} No error ? {'log_dict': {'total_nb_images': 6178, 'max_time_between_images': '0 days 495 seconds', 'coverage_pause': '0 days 34258 seconds', 'coverage_times_pause': '0 days 38909 seconds', 'nb_photos_decision': 6166, 'nb_gray_level_ok': 974, 'nb_dedup_ok': 6160, 'nb_two_criteria_ok': 972, 'nb_forced_upload': 0, 'ratio_coverage': 0.6042081870932468}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 2, 'nb_images_started': 56, 'nb_selected_images': 56, 'last_update': '2022/08/16', 'portfolio_id': 6737105, 'last_run_id': 459844, 'total_number_of_photos': 984}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 4862, 'max_time_between_images': '0 days 795 seconds', 'coverage_pause': '0 days 26839 seconds', 'coverage_times_pause': '0 days 30841 seconds', 'nb_photos_decision': 4852, 'nb_gray_level_ok': 3531, 'nb_dedup_ok': 4840, 'nb_two_criteria_ok': 3524, 'nb_forced_upload': 0, 'ratio_coverage': 0.47335931850649926}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'last_update': '2022/08/20', 'portfolio_id': 6798302, 'last_run_id': 465865, 'total_number_of_photos': 3527}} No error ? {'log_dict': {'total_nb_images': 4560, 'max_time_between_images': '0 days 494 seconds', 'coverage_pause': '0 days 25018 seconds', 'coverage_times_pause': '0 days 29127 seconds', 'nb_photos_decision': 4550, 'nb_gray_level_ok': 477, 'nb_dedup_ok': 4531, 'nb_two_criteria_ok': 475, 'nb_forced_upload': 0, 'ratio_coverage': 0.44124234995326195}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 2, 'nb_images_finished_for_older': 57, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 57, 'last_update': '2022/08/20', 'portfolio_id': 6783368, 'last_run_id': 463638, 'total_number_of_photos': 475}} No error ? {'log_dict': {'total_nb_images': 5265, 'max_time_between_images': '0 days 734 seconds', 'coverage_pause': '0 days 29016 seconds', 'coverage_times_pause': '0 days 33494 seconds', 'nb_photos_decision': 5264, 'nb_gray_level_ok': 484, 'nb_dedup_ok': 5253, 'nb_two_criteria_ok': 481, 'nb_forced_upload': 0, 'ratio_coverage': 0.5117550574084199}, 'dashboard_dict': {'nb_ptf_finished': 5, 'nb_images_finished': 128, 'nb_ptf_finished_for_older': 1, 'nb_images_finished_for_older': 25, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 153, 'last_update': '2022/08/19', 'portfolio_id': 6771076, 'last_run_id': 463066, 'total_number_of_photos': 493}} No error ? {'log_dict': {'total_nb_images': 4393, 'max_time_between_images': '0 days 494 seconds', 'coverage_pause': '0 days 24083 seconds', 'coverage_times_pause': '0 days 28103 seconds', 'nb_photos_decision': 4383, 'nb_gray_level_ok': 458, 'nb_dedup_ok': 4380, 'nb_two_criteria_ok': 457, 'nb_forced_upload': 0, 'ratio_coverage': 0.4247517592902873}, 'dashboard_dict': {'nb_ptf_finished': 6, 'nb_images_finished': 133, 'nb_ptf_finished_for_older': 1, 'nb_images_finished_for_older': 15, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 148, 'last_update': '2022/08/18', 'portfolio_id': 6756962, 'last_run_id': 461634, 'total_number_of_photos': 457}} No error ? {'log_dict': {'total_nb_images': 5956, 'max_time_between_images': '0 days 618 seconds', 'coverage_pause': '0 days 32980 seconds', 'coverage_times_pause': '0 days 37570 seconds', 'nb_photos_decision': 5954, 'nb_gray_level_ok': 2160, 'nb_dedup_ok': 5953, 'nb_two_criteria_ok': 2159, 'nb_forced_upload': 0, 'ratio_coverage': 0.5816681070212879}, 'dashboard_dict': {'nb_ptf_finished': 6, 'nb_images_finished': 211, 'nb_ptf_finished_for_older': 7, 'nb_images_finished_for_older': 239, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 450, 'last_update': '2022/08/17', 'portfolio_id': 6739050, 'last_run_id': 460382, 'total_number_of_photos': 2159}} No error ? {'log_dict': {'total_nb_images': 6178, 'max_time_between_images': '0 days 495 seconds', 'coverage_pause': '0 days 34258 seconds', 'coverage_times_pause': '0 days 38909 seconds', 'nb_photos_decision': 6166, 'nb_gray_level_ok': 974, 'nb_dedup_ok': 6160, 'nb_two_criteria_ok': 972, 'nb_forced_upload': 0, 'ratio_coverage': 0.6042081870932468}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 2, 'nb_images_started': 56, 'nb_selected_images': 56, 'last_update': '2022/08/16', 'portfolio_id': 6737105, 'last_run_id': 459844, 'total_number_of_photos': 984}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 4594, 'max_time_between_images': '0 days 523 seconds', 'coverage_pause': '0 days 25202 seconds', 'coverage_times_pause': '0 days 29276 seconds', 'nb_photos_decision': 4593, 'nb_gray_level_ok': 642, 'nb_dedup_ok': 4592, 'nb_two_criteria_ok': 642, 'nb_forced_upload': 0, 'ratio_coverage': 0.4444875570997725}, 'dashboard_dict': {'nb_ptf_finished': 14, 'nb_images_finished': 442, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 2, 'nb_images_started': 46, 'nb_selected_images': 488, 'last_update': '2022/08/14', 'portfolio_id': 6714492, 'last_run_id': 457649, 'total_number_of_photos': 642}} No error ? {'log_dict': {'total_nb_images': 4288, 'max_time_between_images': '0 days 1099 seconds', 'coverage_pause': '0 days 23533 seconds', 'coverage_times_pause': '0 days 27387 seconds', 'nb_photos_decision': 4278, 'nb_gray_level_ok': 1121, 'nb_dedup_ok': 4260, 'nb_two_criteria_ok': 1118, 'nb_forced_upload': 0, 'ratio_coverage': 0.4150514118414787}, 'dashboard_dict': {'nb_ptf_finished': 11, 'nb_images_finished': 482, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 482, 'last_update': '2022/08/13', 'portfolio_id': 6696131, 'last_run_id': 457375, 'total_number_of_photos': 1118}} No error ? {'log_dict': {'total_nb_images': 5265, 'max_time_between_images': '0 days 734 seconds', 'coverage_pause': '0 days 29016 seconds', 'coverage_times_pause': '0 days 33494 seconds', 'nb_photos_decision': 5264, 'nb_gray_level_ok': 484, 'nb_dedup_ok': 5253, 'nb_two_criteria_ok': 481, 'nb_forced_upload': 0, 'ratio_coverage': 0.5117550574084199}, 'dashboard_dict': {'nb_ptf_finished': 5, 'nb_images_finished': 128, 'nb_ptf_finished_for_older': 1, 'nb_images_finished_for_older': 25, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 153, 'last_update': '2022/08/19', 'portfolio_id': 6771076, 'last_run_id': 463066, 'total_number_of_photos': 493}} No error ? {'log_dict': {'total_nb_images': 4393, 'max_time_between_images': '0 days 494 seconds', 'coverage_pause': '0 days 24083 seconds', 'coverage_times_pause': '0 days 28103 seconds', 'nb_photos_decision': 4383, 'nb_gray_level_ok': 458, 'nb_dedup_ok': 4380, 'nb_two_criteria_ok': 457, 'nb_forced_upload': 0, 'ratio_coverage': 0.4247517592902873}, 'dashboard_dict': {'nb_ptf_finished': 6, 'nb_images_finished': 133, 'nb_ptf_finished_for_older': 1, 'nb_images_finished_for_older': 15, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 148, 'last_update': '2022/08/18', 'portfolio_id': 6756962, 'last_run_id': 461634, 'total_number_of_photos': 457}} No error ? {'log_dict': {'total_nb_images': 5956, 'max_time_between_images': '0 days 618 seconds', 'coverage_pause': '0 days 32980 seconds', 'coverage_times_pause': '0 days 37570 seconds', 'nb_photos_decision': 5954, 'nb_gray_level_ok': 2160, 'nb_dedup_ok': 5953, 'nb_two_criteria_ok': 2159, 'nb_forced_upload': 0, 'ratio_coverage': 0.5816681070212879}, 'dashboard_dict': {'nb_ptf_finished': 6, 'nb_images_finished': 211, 'nb_ptf_finished_for_older': 7, 'nb_images_finished_for_older': 239, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 450, 'last_update': '2022/08/17', 'portfolio_id': 6739050, 'last_run_id': 460382, 'total_number_of_photos': 2159}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 4594, 'max_time_between_images': '0 days 523 seconds', 'coverage_pause': '0 days 25202 seconds', 'coverage_times_pause': '0 days 29276 seconds', 'nb_photos_decision': 4593, 'nb_gray_level_ok': 642, 'nb_dedup_ok': 4592, 'nb_two_criteria_ok': 642, 'nb_forced_upload': 0, 'ratio_coverage': 0.4444875570997725}, 'dashboard_dict': {'nb_ptf_finished': 14, 'nb_images_finished': 442, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 2, 'nb_images_started': 46, 'nb_selected_images': 488, 'last_update': '2022/08/14', 'portfolio_id': 6714492, 'last_run_id': 457649, 'total_number_of_photos': 642}} No error ? {'log_dict': {'total_nb_images': 4288, 'max_time_between_images': '0 days 1099 seconds', 'coverage_pause': '0 days 23533 seconds', 'coverage_times_pause': '0 days 27387 seconds', 'nb_photos_decision': 4278, 'nb_gray_level_ok': 1121, 'nb_dedup_ok': 4260, 'nb_two_criteria_ok': 1118, 'nb_forced_upload': 0, 'ratio_coverage': 0.4150514118414787}, 'dashboard_dict': {'nb_ptf_finished': 11, 'nb_images_finished': 482, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 482, 'last_update': '2022/08/13', 'portfolio_id': 6696131, 'last_run_id': 457375, 'total_number_of_photos': 1118}} No error ? {'log_dict': {'total_nb_images': 4606, 'max_time_between_images': '0 days 676 seconds', 'coverage_pause': '0 days 25379 seconds', 'coverage_times_pause': '0 days 29343 seconds', 'nb_photos_decision': 4596, 'nb_gray_level_ok': 637, 'nb_dedup_ok': 4567, 'nb_two_criteria_ok': 627, 'nb_forced_upload': 0, 'ratio_coverage': 0.4476093052787527}, 'dashboard_dict': {'nb_ptf_finished': 3, 'nb_images_finished': 115, 'nb_ptf_finished_for_older': 1, 'nb_images_finished_for_older': 12, 'nb_ptf_started': 2, 'nb_images_started': 80, 'nb_selected_images': 207, 'last_update': '2022/08/15', 'portfolio_id': 6680233, 'last_run_id': 454567, 'total_number_of_photos': 627}} No error ? {'log_dict': {'total_nb_images': 5000, 'max_time_between_images': '0 days 915 seconds', 'coverage_pause': '0 days 27593 seconds', 'coverage_times_pause': '0 days 31806 seconds', 'nb_photos_decision': 4999, 'nb_gray_level_ok': 2109, 'nb_dedup_ok': 4957, 'nb_two_criteria_ok': 2083, 'nb_forced_upload': 0, 'ratio_coverage': 0.48665761300904775}, 'dashboard_dict': {'nb_ptf_finished': 14, 'nb_images_finished': 407, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 407, 'last_update': '2022/08/11', 'portfolio_id': 6658698, 'last_run_id': 454030, 'total_number_of_photos': 2083}} No error ? {'log_dict': {'total_nb_images': 4720, 'max_time_between_images': '0 days 674 seconds', 'coverage_pause': '0 days 26032 seconds', 'coverage_times_pause': '0 days 30085 seconds', 'nb_photos_decision': 4719, 'nb_gray_level_ok': 1588, 'nb_dedup_ok': 4675, 'nb_two_criteria_ok': 1565, 'nb_forced_upload': 0, 'ratio_coverage': 0.4591262632497928}, 'dashboard_dict': {'nb_ptf_finished': 11, 'nb_images_finished': 320, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 320, 'last_update': '2022/08/14', 'portfolio_id': 6643366, 'last_run_id': 458795, 'total_number_of_photos': 1565}} No error ? {'log_dict': {'total_nb_images': 4690, 'max_time_between_images': '0 days 676 seconds', 'coverage_pause': '0 days 25756 seconds', 'coverage_times_pause': '0 days 29933 seconds', 'nb_photos_decision': 4689, 'nb_gray_level_ok': 504, 'nb_dedup_ok': 4669, 'nb_two_criteria_ok': 501, 'nb_forced_upload': 0, 'ratio_coverage': 0.454258452530027}, 'dashboard_dict': {'nb_ptf_finished': 12, 'nb_images_finished': 375, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 375, 'last_update': '2022/08/13', 'portfolio_id': 6633495, 'last_run_id': 456239, 'total_number_of_photos': 501}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 4594, 'max_time_between_images': '0 days 523 seconds', 'coverage_pause': '0 days 25202 seconds', 'coverage_times_pause': '0 days 29276 seconds', 'nb_photos_decision': 4593, 'nb_gray_level_ok': 642, 'nb_dedup_ok': 4592, 'nb_two_criteria_ok': 642, 'nb_forced_upload': 0, 'ratio_coverage': 0.4444875570997725}, 'dashboard_dict': {'nb_ptf_finished': 14, 'nb_images_finished': 442, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 2, 'nb_images_started': 46, 'nb_selected_images': 488, 'last_update': '2022/08/14', 'portfolio_id': 6714492, 'last_run_id': 457649, 'total_number_of_photos': 642}} No error ? {'log_dict': {'total_nb_images': 4288, 'max_time_between_images': '0 days 1099 seconds', 'coverage_pause': '0 days 23533 seconds', 'coverage_times_pause': '0 days 27387 seconds', 'nb_photos_decision': 4278, 'nb_gray_level_ok': 1121, 'nb_dedup_ok': 4260, 'nb_two_criteria_ok': 1118, 'nb_forced_upload': 0, 'ratio_coverage': 0.4150514118414787}, 'dashboard_dict': {'nb_ptf_finished': 11, 'nb_images_finished': 482, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 482, 'last_update': '2022/08/13', 'portfolio_id': 6696131, 'last_run_id': 457375, 'total_number_of_photos': 1118}} No error ? {'log_dict': {'total_nb_images': 4606, 'max_time_between_images': '0 days 676 seconds', 'coverage_pause': '0 days 25379 seconds', 'coverage_times_pause': '0 days 29343 seconds', 'nb_photos_decision': 4596, 'nb_gray_level_ok': 637, 'nb_dedup_ok': 4567, 'nb_two_criteria_ok': 627, 'nb_forced_upload': 0, 'ratio_coverage': 0.4476093052787527}, 'dashboard_dict': {'nb_ptf_finished': 3, 'nb_images_finished': 115, 'nb_ptf_finished_for_older': 1, 'nb_images_finished_for_older': 12, 'nb_ptf_started': 2, 'nb_images_started': 80, 'nb_selected_images': 207, 'last_update': '2022/08/12', 'portfolio_id': 6680233, 'last_run_id': 454567, 'total_number_of_photos': 627}} No error ? {'log_dict': {'total_nb_images': 5000, 'max_time_between_images': '0 days 915 seconds', 'coverage_pause': '0 days 27593 seconds', 'coverage_times_pause': '0 days 31806 seconds', 'nb_photos_decision': 4999, 'nb_gray_level_ok': 2109, 'nb_dedup_ok': 4957, 'nb_two_criteria_ok': 2083, 'nb_forced_upload': 0, 'ratio_coverage': 0.48665761300904775}, 'dashboard_dict': {'nb_ptf_finished': 14, 'nb_images_finished': 407, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 407, 'last_update': '2022/08/11', 'portfolio_id': 6658698, 'last_run_id': 454030, 'total_number_of_photos': 2083}} No error ? {'log_dict': {'total_nb_images': 4720, 'max_time_between_images': '0 days 674 seconds', 'coverage_pause': '0 days 26032 seconds', 'coverage_times_pause': '0 days 30085 seconds', 'nb_photos_decision': 4719, 'nb_gray_level_ok': 1588, 'nb_dedup_ok': 4675, 'nb_two_criteria_ok': 1565, 'nb_forced_upload': 0, 'ratio_coverage': 0.4591262632497928}, 'dashboard_dict': {'nb_ptf_finished': 11, 'nb_images_finished': 320, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 320, 'last_update': '2022/08/10', 'portfolio_id': 6643366, 'last_run_id': 452634, 'total_number_of_photos': 1565}} No error ? {'log_dict': {'total_nb_images': 4690, 'max_time_between_images': '0 days 676 seconds', 'coverage_pause': '0 days 25756 seconds', 'coverage_times_pause': '0 days 29933 seconds', 'nb_photos_decision': 4689, 'nb_gray_level_ok': 504, 'nb_dedup_ok': 4669, 'nb_two_criteria_ok': 501, 'nb_forced_upload': 0, 'ratio_coverage': 0.454258452530027}, 'dashboard_dict': {'nb_ptf_finished': 12, 'nb_images_finished': 375, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 375, 'last_update': '2022/08/13', 'portfolio_id': 6633495, 'last_run_id': 456239, 'total_number_of_photos': 501}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 4594, 'max_time_between_images': '0 days 523 seconds', 'coverage_pause': '0 days 25202 seconds', 'coverage_times_pause': '0 days 29276 seconds', 'nb_photos_decision': 4593, 'nb_gray_level_ok': 642, 'nb_dedup_ok': 4592, 'nb_two_criteria_ok': 642, 'nb_forced_upload': 0, 'ratio_coverage': 0.4444875570997725}, 'dashboard_dict': {'nb_ptf_finished': 14, 'nb_images_finished': 442, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 2, 'nb_images_started': 46, 'nb_selected_images': 488, 'last_update': '2022/08/14', 'portfolio_id': 6714492, 'last_run_id': 457649, 'total_number_of_photos': 642}} No error ? {'log_dict': {'total_nb_images': 4288, 'max_time_between_images': '0 days 1099 seconds', 'coverage_pause': '0 days 23533 seconds', 'coverage_times_pause': '0 days 27387 seconds', 'nb_photos_decision': 4278, 'nb_gray_level_ok': 1121, 'nb_dedup_ok': 4260, 'nb_two_criteria_ok': 1118, 'nb_forced_upload': 0, 'ratio_coverage': 0.4150514118414787}, 'dashboard_dict': {'nb_ptf_finished': 11, 'nb_images_finished': 482, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 482, 'last_update': '2022/08/13', 'portfolio_id': 6696131, 'last_run_id': 456475, 'total_number_of_photos': 1118}} No error ? {'log_dict': {'total_nb_images': 4606, 'max_time_between_images': '0 days 676 seconds', 'coverage_pause': '0 days 25379 seconds', 'coverage_times_pause': '0 days 29343 seconds', 'nb_photos_decision': 4596, 'nb_gray_level_ok': 637, 'nb_dedup_ok': 4567, 'nb_two_criteria_ok': 627, 'nb_forced_upload': 0, 'ratio_coverage': 0.4476093052787527}, 'dashboard_dict': {'nb_ptf_finished': 3, 'nb_images_finished': 115, 'nb_ptf_finished_for_older': 1, 'nb_images_finished_for_older': 12, 'nb_ptf_started': 2, 'nb_images_started': 80, 'nb_selected_images': 207, 'last_update': '2022/08/12', 'portfolio_id': 6680233, 'last_run_id': 454567, 'total_number_of_photos': 627}} No error ? {'log_dict': {'total_nb_images': 5000, 'max_time_between_images': '0 days 915 seconds', 'coverage_pause': '0 days 27593 seconds', 'coverage_times_pause': '0 days 31806 seconds', 'nb_photos_decision': 4999, 'nb_gray_level_ok': 2109, 'nb_dedup_ok': 4957, 'nb_two_criteria_ok': 2083, 'nb_forced_upload': 0, 'ratio_coverage': 0.48665761300904775}, 'dashboard_dict': {'nb_ptf_finished': 14, 'nb_images_finished': 407, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 407, 'last_update': '2022/08/11', 'portfolio_id': 6658698, 'last_run_id': 454030, 'total_number_of_photos': 2083}} No error ? {'log_dict': {'total_nb_images': 4720, 'max_time_between_images': '0 days 674 seconds', 'coverage_pause': '0 days 26032 seconds', 'coverage_times_pause': '0 days 30085 seconds', 'nb_photos_decision': 4719, 'nb_gray_level_ok': 1588, 'nb_dedup_ok': 4675, 'nb_two_criteria_ok': 1565, 'nb_forced_upload': 0, 'ratio_coverage': 0.4591262632497928}, 'dashboard_dict': {'nb_ptf_finished': 11, 'nb_images_finished': 320, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 320, 'last_update': '2022/08/10', 'portfolio_id': 6643366, 'last_run_id': 452634, 'total_number_of_photos': 1565}} No error ? {'log_dict': {'total_nb_images': 4690, 'max_time_between_images': '0 days 676 seconds', 'coverage_pause': '0 days 25756 seconds', 'coverage_times_pause': '0 days 29933 seconds', 'nb_photos_decision': 4689, 'nb_gray_level_ok': 504, 'nb_dedup_ok': 4669, 'nb_two_criteria_ok': 501, 'nb_forced_upload': 0, 'ratio_coverage': 0.454258452530027}, 'dashboard_dict': {'nb_ptf_finished': 8, 'nb_images_finished': 284, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 4, 'nb_images_started': 91, 'nb_selected_images': 375, 'last_update': '2022/08/10', 'portfolio_id': 6633495, 'last_run_id': 451521, 'total_number_of_photos': 501}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 4735, 'max_time_between_images': '0 days 705 seconds', 'coverage_pause': '0 days 26039 seconds', 'coverage_times_pause': '0 days 30154 seconds', 'nb_photos_decision': 4734, 'nb_gray_level_ok': 2020, 'nb_dedup_ok': 4693, 'nb_two_criteria_ok': 1989, 'nb_forced_upload': 0, 'ratio_coverage': 0.4592497222173231}, 'dashboard_dict': {'nb_ptf_finished': 3, 'nb_images_finished': 54, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 12, 'nb_images_started': 417, 'nb_selected_images': 471, 'last_update': '2022/08/12', 'portfolio_id': 6631875, 'last_run_id': 454472, 'total_number_of_photos': 1989}} No error ? {'log_dict': {'total_nb_images': 4906, 'max_time_between_images': '0 days 735 seconds', 'coverage_pause': '0 days 27012 seconds', 'coverage_times_pause': '0 days 31274 seconds', 'nb_photos_decision': 4896, 'nb_gray_level_ok': 781, 'nb_dedup_ok': 4862, 'nb_two_criteria_ok': 775, 'nb_forced_upload': 0, 'ratio_coverage': 0.47641051870403356}, 'dashboard_dict': {'nb_ptf_finished': 13, 'nb_images_finished': 438, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 438, 'last_update': '2022/08/11', 'portfolio_id': 6630410, 'last_run_id': 454459, 'total_number_of_photos': 776}} No error ? {'log_dict': {'total_nb_images': 4606, 'max_time_between_images': '0 days 676 seconds', 'coverage_pause': '0 days 25379 seconds', 'coverage_times_pause': '0 days 29343 seconds', 'nb_photos_decision': 4596, 'nb_gray_level_ok': 637, 'nb_dedup_ok': 4567, 'nb_two_criteria_ok': 627, 'nb_forced_upload': 0, 'ratio_coverage': 0.4476093052787527}, 'dashboard_dict': {'nb_ptf_finished': 3, 'nb_images_finished': 115, 'nb_ptf_finished_for_older': 1, 'nb_images_finished_for_older': 12, 'nb_ptf_started': 2, 'nb_images_started': 80, 'nb_selected_images': 207, 'last_update': '2022/08/12', 'portfolio_id': 6680233, 'last_run_id': 454567, 'total_number_of_photos': 627}} No error ? {'log_dict': {'total_nb_images': 5000, 'max_time_between_images': '0 days 915 seconds', 'coverage_pause': '0 days 27593 seconds', 'coverage_times_pause': '0 days 31806 seconds', 'nb_photos_decision': 4999, 'nb_gray_level_ok': 2109, 'nb_dedup_ok': 4957, 'nb_two_criteria_ok': 2083, 'nb_forced_upload': 0, 'ratio_coverage': 0.48665761300904775}, 'dashboard_dict': {'nb_ptf_finished': 14, 'nb_images_finished': 407, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 407, 'last_update': '2022/08/11', 'portfolio_id': 6658698, 'last_run_id': 454030, 'total_number_of_photos': 2083}} No error ? {'log_dict': {'total_nb_images': 4720, 'max_time_between_images': '0 days 674 seconds', 'coverage_pause': '0 days 26032 seconds', 'coverage_times_pause': '0 days 30085 seconds', 'nb_photos_decision': 4719, 'nb_gray_level_ok': 1588, 'nb_dedup_ok': 4675, 'nb_two_criteria_ok': 1565, 'nb_forced_upload': 0, 'ratio_coverage': 0.4591262632497928}, 'dashboard_dict': {'nb_ptf_finished': 11, 'nb_images_finished': 320, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 320, 'last_update': '2022/08/10', 'portfolio_id': 6643366, 'last_run_id': 452634, 'total_number_of_photos': 1565}} No error ? {'log_dict': {'total_nb_images': 4690, 'max_time_between_images': '0 days 676 seconds', 'coverage_pause': '0 days 25756 seconds', 'coverage_times_pause': '0 days 29933 seconds', 'nb_photos_decision': 4689, 'nb_gray_level_ok': 504, 'nb_dedup_ok': 4669, 'nb_two_criteria_ok': 501, 'nb_forced_upload': 0, 'ratio_coverage': 0.454258452530027}, 'dashboard_dict': {'nb_ptf_finished': 8, 'nb_images_finished': 284, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 4, 'nb_images_started': 91, 'nb_selected_images': 375, 'last_update': '2022/08/10', 'portfolio_id': 6633495, 'last_run_id': 451521, 'total_number_of_photos': 501}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 4735, 'max_time_between_images': '0 days 705 seconds', 'coverage_pause': '0 days 26039 seconds', 'coverage_times_pause': '0 days 30154 seconds', 'nb_photos_decision': 4734, 'nb_gray_level_ok': 2020, 'nb_dedup_ok': 4693, 'nb_two_criteria_ok': 1989, 'nb_forced_upload': 0, 'ratio_coverage': 0.4592497222173231}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 4, 'nb_images_started': 65, 'nb_selected_images': 65, 'last_update': '2022/08/10', 'portfolio_id': 6631875, 'last_run_id': 450783, 'total_number_of_photos': 1989}} No error ? {'log_dict': {'total_nb_images': 4906, 'max_time_between_images': '0 days 735 seconds', 'coverage_pause': '0 days 27012 seconds', 'coverage_times_pause': '0 days 31274 seconds', 'nb_photos_decision': 4896, 'nb_gray_level_ok': 781, 'nb_dedup_ok': 4862, 'nb_two_criteria_ok': 775, 'nb_forced_upload': 0, 'ratio_coverage': 0.47641051870403356}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 13, 'nb_images_started': 438, 'nb_selected_images': 438, 'last_update': '2022/08/11', 'portfolio_id': 6630410, 'last_run_id': 450676, 'total_number_of_photos': 776}} No error ? {'log_dict': {'total_nb_images': 5275, 'max_time_between_images': '0 days 554 seconds', 'coverage_pause': '0 days 28988 seconds', 'coverage_times_pause': '0 days 33555 seconds', 'nb_photos_decision': 5274, 'nb_gray_level_ok': 623, 'nb_dedup_ok': 5236, 'nb_two_criteria_ok': 621, 'nb_forced_upload': 0, 'ratio_coverage': 0.5112612215382988}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'last_update': '2022/08/06', 'portfolio_id': 6629957, 'last_run_id': 450648, 'total_number_of_photos': 621}} No error ? {'log_dict': {'total_nb_images': 5000, 'max_time_between_images': '0 days 915 seconds', 'coverage_pause': '0 days 27593 seconds', 'coverage_times_pause': '0 days 31806 seconds', 'nb_photos_decision': 4999, 'nb_gray_level_ok': 2109, 'nb_dedup_ok': 4957, 'nb_two_criteria_ok': 2083, 'nb_forced_upload': 0, 'ratio_coverage': 0.48665761300904775}, 'dashboard_dict': {'nb_ptf_finished': 14, 'nb_images_finished': 407, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 407, 'last_update': '2022/08/11', 'portfolio_id': 6658698, 'last_run_id': 454030, 'total_number_of_photos': 2083}} No error ? {'log_dict': {'total_nb_images': 4720, 'max_time_between_images': '0 days 674 seconds', 'coverage_pause': '0 days 26032 seconds', 'coverage_times_pause': '0 days 30085 seconds', 'nb_photos_decision': 4719, 'nb_gray_level_ok': 1588, 'nb_dedup_ok': 4675, 'nb_two_criteria_ok': 1565, 'nb_forced_upload': 0, 'ratio_coverage': 0.4591262632497928}, 'dashboard_dict': {'nb_ptf_finished': 11, 'nb_images_finished': 320, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 320, 'last_update': '2022/08/10', 'portfolio_id': 6643366, 'last_run_id': 452634, 'total_number_of_photos': 1565}} No error ? {'log_dict': {'total_nb_images': 4690, 'max_time_between_images': '0 days 676 seconds', 'coverage_pause': '0 days 25756 seconds', 'coverage_times_pause': '0 days 29933 seconds', 'nb_photos_decision': 4689, 'nb_gray_level_ok': 504, 'nb_dedup_ok': 4669, 'nb_two_criteria_ok': 501, 'nb_forced_upload': 0, 'ratio_coverage': 0.454258452530027}, 'dashboard_dict': {'nb_ptf_finished': 8, 'nb_images_finished': 284, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 4, 'nb_images_started': 91, 'nb_selected_images': 375, 'last_update': '2022/08/10', 'portfolio_id': 6633495, 'last_run_id': 451521, 'total_number_of_photos': 501}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 4735, 'max_time_between_images': '0 days 705 seconds', 'coverage_pause': '0 days 26039 seconds', 'coverage_times_pause': '0 days 30154 seconds', 'nb_photos_decision': 4734, 'nb_gray_level_ok': 2020, 'nb_dedup_ok': 4693, 'nb_two_criteria_ok': 1989, 'nb_forced_upload': 0, 'ratio_coverage': 0.4592497222173231}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 4, 'nb_images_started': 65, 'nb_selected_images': 65, 'last_update': '2022/08/10', 'portfolio_id': 6631875, 'last_run_id': 450783, 'total_number_of_photos': 1989}} No error ? {'log_dict': {'total_nb_images': 4906, 'max_time_between_images': '0 days 735 seconds', 'coverage_pause': '0 days 27012 seconds', 'coverage_times_pause': '0 days 31274 seconds', 'nb_photos_decision': 4896, 'nb_gray_level_ok': 781, 'nb_dedup_ok': 4862, 'nb_two_criteria_ok': 775, 'nb_forced_upload': 0, 'ratio_coverage': 0.47641051870403356}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 13, 'nb_images_started': 438, 'nb_selected_images': 438, 'last_update': '2022/08/06', 'portfolio_id': 6630410, 'last_run_id': 450676, 'total_number_of_photos': 776}} No error ? {'log_dict': {'total_nb_images': 5275, 'max_time_between_images': '0 days 554 seconds', 'coverage_pause': '0 days 28988 seconds', 'coverage_times_pause': '0 days 33555 seconds', 'nb_photos_decision': 5274, 'nb_gray_level_ok': 623, 'nb_dedup_ok': 5236, 'nb_two_criteria_ok': 621, 'nb_forced_upload': 0, 'ratio_coverage': 0.5112612215382988}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'last_update': '2022/08/06', 'portfolio_id': 6629957, 'last_run_id': 450648, 'total_number_of_photos': 621}} No error ? {'log_dict': {'total_nb_images': 5490, 'max_time_between_images': '0 days 555 seconds', 'coverage_pause': '0 days 30324 seconds', 'coverage_times_pause': '0 days 34888 seconds', 'nb_photos_decision': 5471, 'nb_gray_level_ok': 1487, 'nb_dedup_ok': 5431, 'nb_two_criteria_ok': 1473, 'nb_forced_upload': 0, 'ratio_coverage': 0.5348242473412229}, 'dashboard_dict': {'nb_ptf_finished': 8, 'nb_images_finished': 211, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 1, 'nb_images_started': 37, 'nb_selected_images': 248, 'last_update': '2022/08/06', 'portfolio_id': 6622675, 'last_run_id': 450630, 'total_number_of_photos': 1473}} No error ? {'log_dict': {'total_nb_images': 4720, 'max_time_between_images': '0 days 674 seconds', 'coverage_pause': '0 days 26032 seconds', 'coverage_times_pause': '0 days 30085 seconds', 'nb_photos_decision': 4719, 'nb_gray_level_ok': 1588, 'nb_dedup_ok': 4675, 'nb_two_criteria_ok': 1565, 'nb_forced_upload': 0, 'ratio_coverage': 0.4591262632497928}, 'dashboard_dict': {'nb_ptf_finished': 11, 'nb_images_finished': 320, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 320, 'last_update': '2022/08/10', 'portfolio_id': 6643366, 'last_run_id': 452634, 'total_number_of_photos': 1565}} No error ? {'log_dict': {'total_nb_images': 4690, 'max_time_between_images': '0 days 676 seconds', 'coverage_pause': '0 days 25756 seconds', 'coverage_times_pause': '0 days 29933 seconds', 'nb_photos_decision': 4689, 'nb_gray_level_ok': 504, 'nb_dedup_ok': 4669, 'nb_two_criteria_ok': 501, 'nb_forced_upload': 0, 'ratio_coverage': 0.454258452530027}, 'dashboard_dict': {'nb_ptf_finished': 8, 'nb_images_finished': 284, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 4, 'nb_images_started': 91, 'nb_selected_images': 375, 'last_update': '2022/08/09', 'portfolio_id': 6633495, 'last_run_id': 451521, 'total_number_of_photos': 501}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 4735, 'max_time_between_images': '0 days 705 seconds', 'coverage_pause': '0 days 26039 seconds', 'coverage_times_pause': '0 days 30154 seconds', 'nb_photos_decision': 4734, 'nb_gray_level_ok': 2020, 'nb_dedup_ok': 4693, 'nb_two_criteria_ok': 1989, 'nb_forced_upload': 0, 'ratio_coverage': 0.4592497222173231}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 4, 'nb_images_started': 65, 'nb_selected_images': 65, 'last_update': '2022/08/06', 'portfolio_id': 6631875, 'last_run_id': 450783, 'total_number_of_photos': 1989}} No error ? {'log_dict': {'total_nb_images': 4906, 'max_time_between_images': '0 days 735 seconds', 'coverage_pause': '0 days 27012 seconds', 'coverage_times_pause': '0 days 31274 seconds', 'nb_photos_decision': 4896, 'nb_gray_level_ok': 781, 'nb_dedup_ok': 4862, 'nb_two_criteria_ok': 775, 'nb_forced_upload': 0, 'ratio_coverage': 0.47641051870403356}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 13, 'nb_images_started': 438, 'nb_selected_images': 438, 'last_update': '2022/08/06', 'portfolio_id': 6630410, 'last_run_id': 450676, 'total_number_of_photos': 776}} No error ? {'log_dict': {'total_nb_images': 5275, 'max_time_between_images': '0 days 554 seconds', 'coverage_pause': '0 days 28988 seconds', 'coverage_times_pause': '0 days 33555 seconds', 'nb_photos_decision': 5274, 'nb_gray_level_ok': 623, 'nb_dedup_ok': 5236, 'nb_two_criteria_ok': 621, 'nb_forced_upload': 0, 'ratio_coverage': 0.5112612215382988}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'last_update': '2022/08/06', 'portfolio_id': 6629957, 'last_run_id': 450648, 'total_number_of_photos': 621}} No error ? {'log_dict': {'total_nb_images': 5490, 'max_time_between_images': '0 days 555 seconds', 'coverage_pause': '0 days 30324 seconds', 'coverage_times_pause': '0 days 34888 seconds', 'nb_photos_decision': 5471, 'nb_gray_level_ok': 1487, 'nb_dedup_ok': 5431, 'nb_two_criteria_ok': 1473, 'nb_forced_upload': 0, 'ratio_coverage': 0.5348242473412229}, 'dashboard_dict': {'nb_ptf_finished': 8, 'nb_images_finished': 211, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 1, 'nb_images_started': 37, 'nb_selected_images': 248, 'last_update': '2022/08/06', 'portfolio_id': 6622675, 'last_run_id': 450630, 'total_number_of_photos': 1473}} No error ? {'log_dict': {'total_nb_images': 6116, 'max_time_between_images': '0 days 496 seconds', 'coverage_pause': '0 days 33822 seconds', 'coverage_times_pause': '0 days 38693 seconds', 'nb_photos_decision': 6115, 'nb_gray_level_ok': 2189, 'nb_dedup_ok': 6055, 'nb_two_criteria_ok': 2150, 'nb_forced_upload': 0, 'ratio_coverage': 0.5965184571156458}, 'dashboard_dict': {'nb_ptf_finished': 5, 'nb_images_finished': 90, 'nb_ptf_finished_for_older': 2, 'nb_images_finished_for_older': 36, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 126, 'last_update': '2022/08/03', 'portfolio_id': 6610799, 'last_run_id': 449568, 'total_number_of_photos': 2150}} No error ? {'log_dict': {'total_nb_images': 4906, 'max_time_between_images': '0 days 735 seconds', 'coverage_pause': '0 days 27012 seconds', 'coverage_times_pause': '0 days 31274 seconds', 'nb_photos_decision': 4896, 'nb_gray_level_ok': 781, 'nb_dedup_ok': 4862, 'nb_two_criteria_ok': 775, 'nb_forced_upload': 0, 'ratio_coverage': 0.47641051870403356}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 13, 'nb_images_started': 438, 'nb_selected_images': 438, 'last_update': '2022/08/06', 'portfolio_id': 6630410, 'last_run_id': 450667, 'total_number_of_photos': 776}} No error ? {'log_dict': {'total_nb_images': 5275, 'max_time_between_images': '0 days 554 seconds', 'coverage_pause': '0 days 28988 seconds', 'coverage_times_pause': '0 days 33555 seconds', 'nb_photos_decision': 5274, 'nb_gray_level_ok': 623, 'nb_dedup_ok': 5236, 'nb_two_criteria_ok': 621, 'nb_forced_upload': 0, 'ratio_coverage': 0.5112612215382988}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'last_update': '2022/08/06', 'portfolio_id': 6629957, 'last_run_id': 450648, 'total_number_of_photos': 621}} No error ? {'log_dict': {'total_nb_images': 5490, 'max_time_between_images': '0 days 555 seconds', 'coverage_pause': '0 days 30324 seconds', 'coverage_times_pause': '0 days 34888 seconds', 'nb_photos_decision': 5471, 'nb_gray_level_ok': 1487, 'nb_dedup_ok': 5431, 'nb_two_criteria_ok': 1473, 'nb_forced_upload': 0, 'ratio_coverage': 0.5348242473412229}, 'dashboard_dict': {'nb_ptf_finished': 8, 'nb_images_finished': 211, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 1, 'nb_images_started': 37, 'nb_selected_images': 248, 'last_update': '2022/08/06', 'portfolio_id': 6622675, 'last_run_id': 450630, 'total_number_of_photos': 1473}} No error ? {'log_dict': {'total_nb_images': 6116, 'max_time_between_images': '0 days 496 seconds', 'coverage_pause': '0 days 33822 seconds', 'coverage_times_pause': '0 days 38693 seconds', 'nb_photos_decision': 6115, 'nb_gray_level_ok': 2189, 'nb_dedup_ok': 6055, 'nb_two_criteria_ok': 2150, 'nb_forced_upload': 0, 'ratio_coverage': 0.5965184571156458}, 'dashboard_dict': {'nb_ptf_finished': 5, 'nb_images_finished': 90, 'nb_ptf_finished_for_older': 2, 'nb_images_finished_for_older': 36, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 126, 'last_update': '2022/08/03', 'portfolio_id': 6610799, 'last_run_id': 449568, 'total_number_of_photos': 2150}} No error ? {'log_dict': {'total_nb_images': 6299, 'max_time_between_images': '0 days 615 seconds', 'coverage_pause': '0 days 34914 seconds', 'coverage_times_pause': '0 days 39791 seconds', 'nb_photos_decision': 6298, 'nb_gray_level_ok': 2557, 'nb_dedup_ok': 6210, 'nb_two_criteria_ok': 2501, 'nb_forced_upload': 0, 'ratio_coverage': 0.6157780560503713}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 6, 'nb_images_finished_for_older': 164, 'nb_ptf_started': 1, 'nb_images_started': 50, 'nb_selected_images': 214, 'last_update': '2022/08/02', 'portfolio_id': 6600064, 'last_run_id': 448643, 'total_number_of_photos': 2501}} No error ? {'log_dict': {'total_nb_images': 4906, 'max_time_between_images': '0 days 735 seconds', 'coverage_pause': '0 days 27012 seconds', 'coverage_times_pause': '0 days 31274 seconds', 'nb_photos_decision': 4896, 'nb_gray_level_ok': 781, 'nb_dedup_ok': 4862, 'nb_two_criteria_ok': 775, 'nb_forced_upload': 0, 'ratio_coverage': 0.47641051870403356}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 13, 'nb_images_started': 438, 'nb_selected_images': 438, 'last_update': '2022/08/06', 'portfolio_id': 6630410, 'last_run_id': 450667, 'total_number_of_photos': 776}} No error ? {'log_dict': {'total_nb_images': 6116, 'max_time_between_images': '0 days 496 seconds', 'coverage_pause': '0 days 33822 seconds', 'coverage_times_pause': '0 days 38693 seconds', 'nb_photos_decision': 6115, 'nb_gray_level_ok': 2189, 'nb_dedup_ok': 6055, 'nb_two_criteria_ok': 2150, 'nb_forced_upload': 0, 'ratio_coverage': 0.5965184571156458}, 'dashboard_dict': {'nb_ptf_finished': 5, 'nb_images_finished': 90, 'nb_ptf_finished_for_older': 2, 'nb_images_finished_for_older': 36, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 126, 'last_update': '2022/08/03', 'portfolio_id': 6610799, 'last_run_id': 449568, 'total_number_of_photos': 2150}} No error ? {'log_dict': {'total_nb_images': 6299, 'max_time_between_images': '0 days 615 seconds', 'coverage_pause': '0 days 34914 seconds', 'coverage_times_pause': '0 days 39791 seconds', 'nb_photos_decision': 6298, 'nb_gray_level_ok': 2557, 'nb_dedup_ok': 6210, 'nb_two_criteria_ok': 2501, 'nb_forced_upload': 0, 'ratio_coverage': 0.6157780560503713}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 6, 'nb_images_finished_for_older': 164, 'nb_ptf_started': 1, 'nb_images_started': 50, 'nb_selected_images': 214, 'last_update': '2022/08/02', 'portfolio_id': 6600064, 'last_run_id': 448643, 'total_number_of_photos': 2501}} No error ? {'log_dict': {'total_nb_images': 6116, 'max_time_between_images': '0 days 496 seconds', 'coverage_pause': '0 days 33822 seconds', 'coverage_times_pause': '0 days 38693 seconds', 'nb_photos_decision': 6115, 'nb_gray_level_ok': 2189, 'nb_dedup_ok': 6055, 'nb_two_criteria_ok': 2150, 'nb_forced_upload': 0, 'ratio_coverage': 0.5965184571156458}, 'dashboard_dict': {'nb_ptf_finished': 5, 'nb_images_finished': 90, 'nb_ptf_finished_for_older': 2, 'nb_images_finished_for_older': 36, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 126, 'last_update': '2022/08/03', 'portfolio_id': 6610799, 'last_run_id': 449568, 'total_number_of_photos': 2150}} No error ? {'log_dict': {'total_nb_images': 6299, 'max_time_between_images': '0 days 615 seconds', 'coverage_pause': '0 days 34914 seconds', 'coverage_times_pause': '0 days 39791 seconds', 'nb_photos_decision': 6298, 'nb_gray_level_ok': 2557, 'nb_dedup_ok': 6210, 'nb_two_criteria_ok': 2501, 'nb_forced_upload': 0, 'ratio_coverage': 0.6157780560503713}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 6, 'nb_images_finished_for_older': 164, 'nb_ptf_started': 1, 'nb_images_started': 50, 'nb_selected_images': 214, 'last_update': '2022/08/02', 'portfolio_id': 6600064, 'last_run_id': 448643, 'total_number_of_photos': 2501}} No error ? {'log_dict': {'total_nb_images': 6299, 'max_time_between_images': '0 days 615 seconds', 'coverage_pause': '0 days 34914 seconds', 'coverage_times_pause': '0 days 39791 seconds', 'nb_photos_decision': 6298, 'nb_gray_level_ok': 2557, 'nb_dedup_ok': 6210, 'nb_two_criteria_ok': 2501, 'nb_forced_upload': 0, 'ratio_coverage': 0.6157780560503713}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 6, 'nb_images_finished_for_older': 164, 'nb_ptf_started': 1, 'nb_images_started': 50, 'nb_selected_images': 214, 'last_update': '2022/08/02', 'portfolio_id': 6600064, 'last_run_id': 448643, 'total_number_of_photos': 2501}} Found day : 2022-08-31 00:00:00 Found day : 2022-08-30 00:00:00 Found day : 2022-08-29 00:00:00 Found day : 2022-08-27 00:00:00 Found day : 2022-08-26 00:00:00 Found day : 2022-08-25 00:00:00 Found day : 2022-08-24 00:00:00 Found day : 2022-08-23 00:00:00 Found day : 2022-08-22 00:00:00 Found day : 2022-08-20 00:00:00 Found day : 2022-08-19 00:00:00 Found day : 2022-08-18 00:00:00 Found day : 2022-08-17 00:00:00 Found day : 2022-08-16 00:00:00 Found day : 2022-08-15 00:00:00 Found day : 2022-08-13 00:00:00 Found day : 2022-08-12 00:00:00 Found day : 2022-08-11 00:00:00 Found day : 2022-08-10 00:00:00 Found day : 2022-08-09 00:00:00 Found day : 2022-08-08 00:00:00 Found day : 2022-08-06 00:00:00 Found day : 2022-08-05 00:00:00 Found day : 2022-08-04 00:00:00 Found day : 2022-08-03 00:00:00 Found day : 2022-08-02 00:00:00 Found day : 2022-08-01 00:00:00 after coverage_data SELECT DATE(date_debut) as date, sum(qualite*nombre_balle)/sum(nombre_balle), count(distinct mtr_photo_id) FROM MTRPhoto.dashboard_results dr, MTRUser.mtr_portfolio_photos mpp, MTRPhoto.dashboard_entry_day ded where mpp.mtr_portfolio_id=dr.mtr_portfolio_id and ded.dashboard_place_id = 53 and month(ded.date) = 08 and year(ded.date) = 2022 and dr.dashboard_run_id=ded.last_run_id and dr.qualite>=0 GROUP BY ded.date order by dr.date_debut; SELECT DATE(date_debut) as date, sum(qualite*nombre_balle)/sum(nombre_balle), count(distinct mtr_photo_id) FROM MTRPhoto.dashboard_results dr, MTRUser.mtr_portfolio_photos mpp, MTRPhoto.dashboard_entry_day ded where mpp.mtr_portfolio_id=dr.mtr_portfolio_id and dr.hashtag = '_______emr' and ded.dashboard_place_id = 53 and month(ded.date) = 08 and year(ded.date) = 2022 and dr.dashboard_run_id=ded.last_run_id and dr.qualite>=0 GROUP BY ded.date order by dr.date_debut; SELECT DATE(date_debut) as date, sum(qualite*nombre_balle)/sum(nombre_balle), count(distinct mtr_photo_id) FROM MTRPhoto.dashboard_results dr, MTRUser.mtr_portfolio_photos mpp, MTRPhoto.dashboard_entry_day ded where mpp.mtr_portfolio_id=dr.mtr_portfolio_id and dr.hashtag = '_______jrm' and ded.dashboard_place_id = 53 and month(ded.date) = 08 and year(ded.date) = 2022 and dr.dashboard_run_id=ded.last_run_id and dr.qualite>=0 GROUP BY ded.date order by dr.date_debut; SELECT DATE(date_debut) as date, sum(qualite*nombre_balle)/sum(nombre_balle), count(distinct mtr_photo_id) FROM MTRPhoto.dashboard_results dr, MTRUser.mtr_portfolio_photos mpp, MTRPhoto.dashboard_entry_day ded where mpp.mtr_portfolio_id=dr.mtr_portfolio_id and dr.hashtag = '_______aluminium' and ded.dashboard_place_id = 53 and month(ded.date) = 08 and year(ded.date) = 2022 and dr.dashboard_run_id=ded.last_run_id and dr.qualite>=0 GROUP BY ded.date order by dr.date_debut; SELECT DATE(date_debut) as date, sum(qualite*nombre_balle)/sum(nombre_balle), count(distinct mtr_photo_id) FROM MTRPhoto.dashboard_results dr, MTRUser.mtr_portfolio_photos mpp, MTRPhoto.dashboard_entry_day ded where mpp.mtr_portfolio_id=dr.mtr_portfolio_id and dr.hashtag = '_______pet_fonce' and ded.dashboard_place_id = 53 and month(ded.date) = 08 and year(ded.date) = 2022 and dr.dashboard_run_id=ded.last_run_id and dr.qualite>=0 GROUP BY ded.date order by dr.date_debut; SELECT DATE(date_debut) as date, sum(qualite*nombre_balle)/sum(nombre_balle), count(distinct mtr_photo_id) FROM MTRPhoto.dashboard_results dr, MTRUser.mtr_portfolio_photos mpp, MTRPhoto.dashboard_entry_day ded where mpp.mtr_portfolio_id=dr.mtr_portfolio_id and dr.hashtag = '_______gm' and ded.dashboard_place_id = 53 and month(ded.date) = 08 and year(ded.date) = 2022 and dr.dashboard_run_id=ded.last_run_id and dr.qualite>=0 GROUP BY ded.date order by dr.date_debut; select avg(cps.score) as score, SUBSTRING_INDEX(SUBSTRING_INDEX(mp.name,'__', -1), '_', 1) as sbstr, SUBSTRING_INDEX(SUBSTRING_INDEX(mp.name,'_', -2), '_', 1) as sbstr2, SUBSTRING_INDEX(mp.name,'_', -1) as sbstr3 FROM MTRUser.mtr_portfolio_photos mpp, MTRUser.mtr_portfolios mp,MTRPhoto.class_photo_score cps,MTRBack.hashtags h,MTRPhoto.dashboard_results dr,MTRPhoto.dashboard_entry_day ded, MTRPhoto.dashboard_places dp WHERE mp.id=mpp.mtr_portfolio_id and cps.photo_id=mpp.mtr_photo_id and h.hashtag_id=cps.hashtag_id and dr.mtr_portfolio_id = mpp.mtr_portfolio_id and dr.dashboard_run_id = ded.last_run_id and ded.dashboard_place_id = dp.id and h.hashtag in ('blur', 'mean_blur', 'clear') and dp.id = 53 and mp.name like '%082022%' and cps.thcl = 1533 GROUP BY sbstr ; after number_of_batch date_start : 2022-08-01 : dt_date_just_month_year : 2022-08-01 00:00:00 : VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! Error parsing crontab ! [Errno 2] No such file or directory: '' You better check your LOGRASPI env !!! after pl.get_datou_sts_from_crontab : verbose : True no sts found, try to find from database SELECT dri.id FROM MTRPhoto.dashboard_run_ids dri, MTRPhoto.dashboard_entry_day ded, MTRPhoto.dashboard_places dp WHERE dp.name= "Romainville_Presse_2" AND ded.dashboard_place_id=dp.id AND dri.dashboard_entry_day=ded.id AND dri.id=ded.last_run_id AND ded.date >= "2022-08-01" AND ded.date <= "2022-08-31" apple3 {'gm': {'mat': 'gm', 'pht': 4209, 'datou_carac_id': 3994, 'unwanted_material': [], 'hashtag_majoritaire_from_carac': 'papier,background'}, 'emr': {'mat': 'emr', 'pht': 4207, 'datou_carac_id': 3993, 'unwanted_material': [], 'hashtag_majoritaire_from_carac': 'carton,background'}, 'jrm': {'mat': 'jrm', 'pht': 3726, 'datou_carac_id': 3459, 'unwanted_material': [], 'hashtag_majoritaire_from_carac': 'papier,background'}, 'ela': {'mat': 'ela', 'pht': 4203, 'datou_carac_id': 3991, 'unwanted_material': [], 'hashtag_majoritaire_from_carac': 'ela,background'}, 'pehd_pp': {'mat': 'pehd_pp', 'pht': 4211, 'datou_carac_id': 3995, 'unwanted_material': [], 'hashtag_majoritaire_from_carac': 'pehd,etiquette,background'}, 'pet_fonce': {'mat': 'pet_fonce', 'pht': 4200, 'datou_carac_id': 4153, 'unwanted_material': [], 'hashtag_majoritaire_from_carac': 'pet_fonce,etiquette,background'}, 'aluminium': {'mat': 'aluminium', 'pht': 4205, 'datou_carac_id': 3992, 'unwanted_material': [], 'hashtag_majoritaire_from_carac': 'metal,background'}, 'refus': {'mat': 'refus', 'pht': 3594, 'datou_carac_id': 3318, 'unwanted_material': [], 'hashtag_majoritaire_from_carac': 'refus,background'}, 'pet_clair': {'mat': 'pet_clair', 'pht': 3327, 'datou_carac_id': 3804, 'unwanted_material': [], 'hashtag_majoritaire_from_carac': 'pet_clair,bouchon,etiquette,barquette_avec_film,background'}} SELECT h.hashtag as unwanted_material, substr(dr.hashtag,8) as main_material, ptp.type as pht_type, sum(pcr.value*dr.nombre_balle)/sum(dr.nombre_balle) as ratio, count(distinct mpp.mtr_photo_id) as nb_photo, group_concat(distinct ptp.mtr_portfolio_id_2) as list_port_cont, group_concat(distinct concat(cast(ptp.mtr_portfolio_id_1 as char), ":", cast(ptp.mtr_portfolio_id_2 as char))) as assoc_port, group_concat(distinct concat(cast(ptp.mtr_portfolio_id_1 as char), ":", h.hashtag, ":", cast(ptp.type as char), ":", cast(ptp.mtr_portfolio_id_2 as char))) as assoc_mat FROM MTRPhoto.dashboard_results dr, MTRPhoto.mtr_port_to_port_ids ptp, MTRUser.mtr_portfolio_photos mpp, MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h WHERE dr.dashboard_run_id IN (448643,449568,454450,454465,454459,454472,456239,458795,461498,454567,457375,457649,459844,460382,461634,463066,472528,465865,469297,468129,475039,472453,474892,474538,475316,476524,479832,481665,479903) AND dr.mtr_portfolio_id=ptp.mtr_portfolio_id_1 AND dr.qualite >= 0 AND mpp.mtr_portfolio_id=ptp.mtr_portfolio_id_2 AND pcr.portfolio_id=ptp.mtr_portfolio_id_1 AND h.hashtag_id = pcr.hashtag_id AND ptp.type = pcr.hashtag_type AND mpp.hide_status = 0 AND ptp.hashtag_id=h.hashtag_id AND ptp.type IN (4209,4207,3726,4203,4211,4200,4205,3594,3327) group by h.hashtag, dr.hashtag, ptp.type; VR TODO TO BETTER PARSE ! ({'unwanted_material': 'barquette_opaque', 'main_material': 'emr', 'pht_type': 4207, 'ratio': 0.0001728785023265608, 'nb_photo': 18, 'list_port_cont': '6861407,6862123,6862547,6867908,6868674,6869389,6869558,6877707,6877972,6881690,6891352,6894202,6907047,6922714,6925593', 'assoc_port': '6790887:6862547,6794193:6862123,6834822:6877972,6840554:6877707,6845438:6869389,6846972:6869558,6851003:6868674,6853215:6861407,6864848:6867908,6881492:6881690,6889190:6891352,6894094:6894202,6906036:6907047,6921897:6922714,6925484:6925593', 'assoc_mat': '6790887:barquette_opaque:4207:6862547,6794193:barquette_opaque:4207:6862123,6834822:barquette_opaque:4207:6877972,6840554:barquette_opaque:4207:6877707,6845438:barquette_opaque:4207:6869389,6846972:barquette_opaque:4207:6869558,6851003:barquette_opaque:4207:6868674,6853215:barquette_opaque:4207:6861407,6864848:barquette_opaque:4207:6867908,6881492:barquette_opaque:4207:6881690,6889190:barquette_opaque:4207:6891352,6894094:barquette_opaque:4207:6894202,6906036:barquette_opaque:4207:6907047,6921897:barquette_opaque:4207:6922714,6925484:barquette_opaque:4207:6925593'}, {'unwanted_material': 'barquette_opaque', 'main_material': 'emr', 'pht_type': 4209, 'ratio': 8.469862336652651e-05, 'nb_photo': 44, 'list_port_cont': '6626450,6627857,6628405,6628829,6644425,6664932,6665236,6666075,6666652,6669243,6669771,6706891,6712605,6719637,6720391,6720629,6722154,6744912,6762879,6775287,6835808,6841133,6842925,6846016,6852775,6853230', 'assoc_port': '6625827:6626450,6627447:6627857,6627801:6628405,6628455:6628829,6630580:6664932,6630581:6665236,6630822:6666075,6631618:6669771,6639123:6644425,6665718:6666652,6668655:6669243,6706262:6706891,6708643:6712605,6719441:6719637,6719951:6720391,6720202:6720629,6721827:6722154,6744086:6744912,6762224:6762879,6774283:6775287,6834821:6835808,6840554:6841133,6842390:6842925,6845438:6846016,6852117:6852775,6852533:6853230', 'assoc_mat': '6625827:barquette_opaque:4209:6626450,6627447:barquette_opaque:4209:6627857,6627801:barquette_opaque:4209:6628405,6628455:barquette_opaque:4209:6628829,6630580:barquette_opaque:4209:6664932,6630581:barquette_opaque:4209:6665236,6630822:barquette_opaque:4209:6666075,6631618:barquette_opaque:4209:6669771,6639123:barquette_opaque:4209:6644425,6665718:barquette_opaque:4209:6666652,6668655:barquette_opaque:4209:6669243,6706262:barquette_opaque:4209:6706891,6708643:barquette_opaque:4209:6712605,6719441:barquette_opaque:4209:6719637,6719951:barquette_opaque:4209:6720391,6720202:barquette_opaque:4209:6720629,6721827:barquette_opaque:4209:6722154,6744086:barquette_opaque:4209:6744912,6762224:barquette_opaque:4209:6762879,6774283:barquette_opaque:4209:6775287,6834821:barquette_opaque:4209:6835808,6840554:barquette_opaque:4209:6841133,6842390:barquette_opaque:4209:6842925,6845438:barquette_opaque:4209:6846016,6852117:barquette_opaque:4209:6852775,6852533:barquette_opaque:4209:6853230'}, {'unwanted_material': 'carton', 'main_material': 'aluminium', 'pht_type': 4205, 'ratio': 0.01022994561299725, 'nb_photo': 16, 'list_port_cont': '6625532,6880743,6880786', 'assoc_port': '6625304:6625532,6880715:6880786,6880716:6880743', 'assoc_mat': '6625304:carton:4205:6625532,6880715:carton:4205:6880786,6880716:carton:4205:6880743'}, {'unwanted_material': 'carton', 'main_material': 'emr', 'pht_type': 4207, 'ratio': 0.9683717828305286, 'nb_photo': 2565, 'list_port_cont': '6860769,6860801,6860841,6860928,6860987,6861035,6861210,6861405,6861437,6861808,6861831,6861929,6862023,6862130,6862206,6862328,6862365,6862540,6862581,6862649,6862984,6863819,6864050,6866304,6866467,6866495,6866955,6867660,6867837,6867907,6868220,6868254,6868280,6868378,6868398,6868623,6868676,6868731,6868887,6868963,6869104,6869323,6869395,6869455,6869560,6876859,6876893,6876912,6876948,6877006,6877054,6877103,6877189,6877551,6877616,6877676,6877710,6877780,6877820,6877867,6877909,6877915,6877971,6877996,6878027,6881699,6884486,6886468,6886876,6887990,6888294,6889466,6891082,6891177,6891354,6894196,6894492,6895946,6896156,6897897,6898092,6898471,6898488,6900295,6900456,6904480,6904513,6905153,6905998,6906484,6907056,6908162,6908516,6908935,6909121,6914618,6915177,6915209,6915268,6916694,6917250,6917397,6920809,6922717,6925589', 'assoc_port': '6790886:6864050,6790887:6862540,6794193:6862130,6832752:6877915,6832753:6877867,6833565:6878027,6834821:6877996,6834822:6877971,6836050:6877780,6838973:6877676,6838974:6877616,6840554:6877710,6842390:6877820,6845438:6869395,6846972:6869560,6846973:6869455,6848417:6869323,6849526:6868887,6851003:6868676,6852117:6868731,6852533:6869104,6852534:6868963,6853215:6861405,6853569:6861437,6853919:6868623,6855642:6860801,6859123:6861831,6860530:6861210,6860531:6861035,6860532:6860987,6860535:6860928,6860537:6860841,6860538:6860769,6861512:6868220,6861514:6868280,6861516:6868254,6861517:6868378,6861519:6862581,6861520:6862649,6861522:6861808,6861523:6862328,6861524:6862206,6861525:6861929,6861635:6862365,6861636:6862023,6862501:6862984,6863220:6863819,6864848:6867907,6864850:6867837,6864851:6867660,6864853:6866955,6864855:6866495,6865738:6866304,6865739:6866467,6868332:6868398,6876683:6877189,6876684:6876912,6876685:6877006,6876686:6877054,6876687:6877103,6876688:6876893,6876689:6876948,6876691:6876859,6877478:6877909,', 'assoc_mat': '6790886:carton:4207:6864050,6790887:carton:4207:6862540,6794193:carton:4207:6862130,6832752:carton:4207:6877915,6832753:carton:4207:6877867,6833565:carton:4207:6878027,6834821:carton:4207:6877996,6834822:carton:4207:6877971,6836050:carton:4207:6877780,6838973:carton:4207:6877676,6838974:carton:4207:6877616,6840554:carton:4207:6877710,6842390:carton:4207:6877820,6845438:carton:4207:6869395,6846972:carton:4207:6869560,6846973:carton:4207:6869455,6848417:carton:4207:6869323,6849526:carton:4207:6868887,6851003:carton:4207:6868676,6852117:carton:4207:6868731,6852533:carton:4207:6869104,6852534:carton:4207:6868963,6853215:carton:4207:6861405,6853569:carton:4207:6861437,6853919:carton:4207:6868623,6855642:carton:4207:6860801,6859123:carton:4207:6861831,6860530:carton:4207:6861210,6860531:carton:4207:6861035,6860532:carton:4207:6860987,6860535:carton:4207:6860928,6860537:carton:4207:6860841,6860538:carton:4207:6860769,6861512:carton:4207:6868220,6861514:carton:4207:6868280,6861516:carton:4207:6868254,6861517:carton:4'}, {'unwanted_material': 'carton', 'main_material': 'emr', 'pht_type': 4209, 'ratio': 0.007834080277437061, 'nb_photo': 1462, 'list_port_cont': '6613099,6614127,6614585,6615525,6616029,6626453,6627860,6628395,6628840,6629152,6629205,6629281,6635304,6635369,6635432,6639702,6640661,6641608,6642551,6644436,6646356,6647438,6648160,6648884,6654375,6655819,6657180,6658370,6659145,6659232,6660891,6661075,6664557,6664640,6664706,6664802,6664929,6665234,6666043,6666077,6666648,6666765,6666944,6668004,6668673,6668922,6669250,6669483,6669559,6669701,6669786,6669812,6670114,6671149,6671463,6671574,6671847,6672297,6674151,6674264,6674794,6676772,6678452,6681186,6683438,6683967,6700222,6702222,6704712,6706887,6708974,6709414,6709569,6710040,6710776,6711299,6712611,6716502,6718348,6718717,6718883,6719281,6719649,6719891,6720389,6720622,6722163,6722585,6722885,6723449,6723510,6744917,6745245,6746407,6748615,6748946,6749029,6758826,6760253,6760547,6761445,6761998,6762877,6774108,6774613,6775298,6776475,6776981,6813192,6834126,6834362,6834696,6835803,6836102,6837017,6839291,6839592,6841138,6842928,6846019,6847495,6847556,6849259,6850419,6851368,6852770,6853216,6853519,', 'assoc_port': '6612572:6613099,6613636:6614127,6614336:6614585,6614890:6615525,6614891:6616029,6625827:6626453,6627447:6627860,6627801:6628395,6627802:6629281,6628455:6628840,6628735:6629152,6628736:6629205,6630577:6664557,6630578:6664706,6630579:6664640,6630580:6664929,6630581:6665234,6630822:6666077,6630823:6666043,6631154:6668004,6631384:6668673,6631385:6668922,6631618:6669786,6631619:6669812,6631901:6670114,6632901:6671149,6632902:6671463,6633542:6635432,6633543:6635304,6633544:6671847,6633545:6635369,6633546:6672297,6635651:6661075,6635653:6660891,6639123:6644436,6639124:6639702,6639695:6642551,6640066:6640661,6640928:6641608,6645791:6646356,6646682:6647438,6647202:6648160,6648217:6648884,6652800:6654375,6655088:6655819,6656505:6657180,6656506:6658370,6657819:6659145,6659025:6659232,6663042:6664802,6665067:6666944,6665718:6666648,6665719:6666765,6668654:6669701,6668655:6669250,6668656:6669483,6668657:6669559,6670886:6671574,6671756:6676772,6673385:6674151,6673850:6674264,6674357:6674794,6678032:6678452,6680947:6681186,', 'assoc_mat': '6612572:carton:4209:6613099,6613636:carton:4209:6614127,6614336:carton:4209:6614585,6614890:carton:4209:6615525,6614891:carton:4209:6616029,6625827:carton:4209:6626453,6627447:carton:4209:6627860,6627801:carton:4209:6628395,6627802:carton:4209:6629281,6628455:carton:4209:6628840,6628735:carton:4209:6629152,6628736:carton:4209:6629205,6630577:carton:4209:6664557,6630578:carton:4209:6664706,6630579:carton:4209:6664640,6630580:carton:4209:6664929,6630581:carton:4209:6665234,6630822:carton:4209:6666077,6630823:carton:4209:6666043,6631154:carton:4209:6668004,6631384:carton:4209:6668673,6631385:carton:4209:6668922,6631618:carton:4209:6669786,6631619:carton:4209:6669812,6631901:carton:4209:6670114,6632901:carton:4209:6671149,6632902:carton:4209:6671463,6633542:carton:4209:6635432,6633543:carton:4209:6635304,6633544:carton:4209:6671847,6633545:carton:4209:6635369,6633546:carton:4209:6672297,6635651:carton:4209:6661075,6635653:carton:4209:6660891,6639123:carton:4209:6644436,6639124:carton:4209:6639702,6639695:carton:4'}, {'unwanted_material': 'carton', 'main_material': 'gm', 'pht_type': 4209, 'ratio': 0.0029313403454804565, 'nb_photo': 10, 'list_port_cont': '6861174,6862613,6886392,6902824,6905431,6920955', 'assoc_port': '6860533:6861174,6861515:6862613,6886257:6886392,6900676:6902824,6905103:6905431,6920015:6920955', 'assoc_mat': '6860533:carton:4209:6861174,6861515:carton:4209:6862613,6886257:carton:4209:6886392,6900676:carton:4209:6902824,6905103:carton:4209:6905431,6920015:carton:4209:6920955'}, {'unwanted_material': 'carton', 'main_material': 'pet_fonce', 'pht_type': 4200, 'ratio': 0.005861756255830517, 'nb_photo': 4, 'list_port_cont': '6647696', 'assoc_port': '6647200:6647696', 'assoc_mat': '6647200:carton:4200:6647696'}, {'unwanted_material': 'ela', 'main_material': 'emr', 'pht_type': 4207, 'ratio': 0.0001359155180754883, 'nb_photo': 1, 'list_port_cont': '6877603', 'assoc_port': '6838974:6877603', 'assoc_mat': '6838974:ela:4207:6877603'}, {'unwanted_material': 'ela', 'main_material': 'emr', 'pht_type': 4209, 'ratio': 5.6302219709875656e-05, 'nb_photo': 3, 'list_port_cont': '6635371,6644435,6657178', 'assoc_port': '6633545:6635371,6639123:6644435,6656505:6657178', 'assoc_mat': '6633545:ela:4209:6635371,6639123:ela:4209:6644435,6656505:ela:4209:6657178'}, {'unwanted_material': 'etiquette', 'main_material': 'emr', 'pht_type': 4207, 'ratio': 0.0004908205603477037, 'nb_photo': 82, 'list_port_cont': '6860802,6860985,6861441,6861842,6861919,6862212,6862342,6862370,6862544,6862643,6868221,6868633,6868729,6869099,6869322,6869388,6869458,6876887,6877052,6877109,6877190,6877547,6877688,6877715,6877814,6877918,6877964,6877998,6878028,6886871,6891088,6891171,6896147,6900293,6900464,6904479,6907053,6908947,6909124,6915211,6915265,6916685,6917252,6920804,6922718', 'assoc_port': '6790887:6862544,6832752:6877918,6833565:6878028,6834821:6877998,6834822:6877964,6838973:6877688,6840554:6877715,6842390:6877814,6845438:6869388,6846973:6869458,6848417:6869322,6852117:6868729,6852533:6869099,6853569:6861441,6853919:6868633,6855642:6860802,6859123:6861842,6860532:6860985,6861512:6868221,6861520:6862643,6861523:6862342,6861524:6862212,6861525:6861919,6861635:6862370,6876683:6877190,6876686:6877052,6876687:6877109,6876688:6876887,6877480:6877547,6886258:6886871,6889185:6891088,6891024:6891171,6895749:6896147,6899246:6900464,6899248:6900293,6900677:6909124,6900678:6908947,6903712:6904479,6906036:6907053,6914258:6915211,6914260:6916685,6914751:6915265,6917033:6917252,6920014:6920804,6921897:6922718', 'assoc_mat': '6790887:etiquette:4207:6862544,6832752:etiquette:4207:6877918,6833565:etiquette:4207:6878028,6834821:etiquette:4207:6877998,6834822:etiquette:4207:6877964,6838973:etiquette:4207:6877688,6840554:etiquette:4207:6877715,6842390:etiquette:4207:6877814,6845438:etiquette:4207:6869388,6846973:etiquette:4207:6869458,6848417:etiquette:4207:6869322,6852117:etiquette:4207:6868729,6852533:etiquette:4207:6869099,6853569:etiquette:4207:6861441,6853919:etiquette:4207:6868633,6855642:etiquette:4207:6860802,6859123:etiquette:4207:6861842,6860532:etiquette:4207:6860985,6861512:etiquette:4207:6868221,6861520:etiquette:4207:6862643,6861523:etiquette:4207:6862342,6861524:etiquette:4207:6862212,6861525:etiquette:4207:6861919,6861635:etiquette:4207:6862370,6876683:etiquette:4207:6877190,6876686:etiquette:4207:6877052,6876687:etiquette:4207:6877109,6876688:etiquette:4207:6876887,6877480:etiquette:4207:6877547,6886258:etiquette:4207:6886871,6889185:etiquette:4207:6891088,6891024:etiquette:4207:6891171,6895749:etiquette:4207:6896147,6'}, {'unwanted_material': 'etiquette', 'main_material': 'emr', 'pht_type': 4209, 'ratio': 0.0008238173967106119, 'nb_photo': 1049, 'list_port_cont': '6613101,6614126,6614587,6616038,6626458,6627864,6628397,6628838,6629141,6629204,6629280,6635302,6635366,6635430,6640667,6641598,6642545,6644428,6646362,6647450,6648167,6648890,6654367,6655834,6657182,6658372,6659142,6659220,6660894,6661081,6664553,6664638,6664707,6664807,6664938,6665231,6666055,6666086,6666643,6666770,6666946,6668001,6668670,6668913,6669257,6669490,6669555,6669702,6669778,6669808,6670117,6671148,6671464,6671561,6671836,6672301,6674153,6674271,6674799,6676771,6678460,6681184,6683436,6683981,6700231,6702226,6704721,6706890,6708962,6709416,6709579,6710035,6710785,6711300,6712603,6716517,6718720,6718877,6719278,6719639,6719881,6720398,6720627,6722161,6722583,6722896,6723446,6723519,6744916,6745258,6746410,6748605,6748955,6749037,6760261,6760532,6761442,6762007,6774112,6774618,6775290,6776483,6776974,6813185,6834132,6834363,6834703,6835800,6836101,6837027,6839290,6839587,6841136,6842924,6846017,6847494,6847557,6849269,6850421,6852780,6853222,6853521,6853980,6854357,6855828,6859399', 'assoc_port': '6612572:6613101,6613636:6614126,6614336:6614587,6614891:6616038,6625827:6626458,6627447:6627864,6627801:6628397,6627802:6629280,6628455:6628838,6628735:6629141,6628736:6629204,6630577:6664553,6630578:6664707,6630579:6664638,6630580:6664938,6630581:6665231,6630822:6666086,6630823:6666055,6631154:6668001,6631384:6668670,6631385:6668913,6631618:6669778,6631619:6669808,6631901:6670117,6632901:6671148,6632902:6671464,6633542:6635430,6633543:6635302,6633544:6671836,6633545:6635366,6633546:6672301,6635651:6661081,6635653:6660894,6639123:6644428,6639695:6642545,6640066:6640667,6640928:6641598,6645791:6646362,6646682:6647450,6647202:6648167,6648217:6648890,6652800:6654367,6655088:6655834,6656505:6657182,6656506:6658372,6657819:6659142,6659025:6659220,6663042:6664807,6665067:6666946,6665718:6666643,6665719:6666770,6668654:6669702,6668655:6669257,6668656:6669490,6668657:6669555,6670886:6671561,6671756:6676771,6673385:6674153,6673850:6674271,6674357:6674799,6678032:6678460,6680947:6681184,6682633:6683436,6683289:6683981,', 'assoc_mat': '6612572:etiquette:4209:6613101,6613636:etiquette:4209:6614126,6614336:etiquette:4209:6614587,6614891:etiquette:4209:6616038,6625827:etiquette:4209:6626458,6627447:etiquette:4209:6627864,6627801:etiquette:4209:6628397,6627802:etiquette:4209:6629280,6628455:etiquette:4209:6628838,6628735:etiquette:4209:6629141,6628736:etiquette:4209:6629204,6630577:etiquette:4209:6664553,6630578:etiquette:4209:6664707,6630579:etiquette:4209:6664638,6630580:etiquette:4209:6664938,6630581:etiquette:4209:6665231,6630822:etiquette:4209:6666086,6630823:etiquette:4209:6666055,6631154:etiquette:4209:6668001,6631384:etiquette:4209:6668670,6631385:etiquette:4209:6668913,6631618:etiquette:4209:6669778,6631619:etiquette:4209:6669808,6631901:etiquette:4209:6670117,6632901:etiquette:4209:6671148,6632902:etiquette:4209:6671464,6633542:etiquette:4209:6635430,6633543:etiquette:4209:6635302,6633544:etiquette:4209:6671836,6633545:etiquette:4209:6635366,6633546:etiquette:4209:6672301,6635651:etiquette:4209:6661081,6635653:etiquette:4209:6660894,6'}, {'unwanted_material': 'etiquette', 'main_material': 'gm', 'pht_type': 4209, 'ratio': 0.0007589310876444754, 'nb_photo': 16, 'list_port_cont': '6860869,6861178,6861533,6862611,6863435,6876769,6889758,6894819,6902814,6920942', 'assoc_port': '6860533:6861178,6860536:6860869,6861163:6861533,6861515:6862611,6863221:6863435,6876690:6876769,6889188:6889758,6894658:6894819,6900676:6902814,6920015:6920942', 'assoc_mat': '6860533:etiquette:4209:6861178,6860536:etiquette:4209:6860869,6861163:etiquette:4209:6861533,6861515:etiquette:4209:6862611,6863221:etiquette:4209:6863435,6876690:etiquette:4209:6876769,6889188:etiquette:4209:6889758,6894658:etiquette:4209:6894819,6900676:etiquette:4209:6902814,6920015:etiquette:4209:6920942'}, {'unwanted_material': 'etiquette', 'main_material': 'pet_fonce', 'pht_type': 4200, 'ratio': 0.0010885671487047438, 'nb_photo': 5, 'list_port_cont': '6647706', 'assoc_port': '6647200:6647706', 'assoc_mat': '6647200:etiquette:4200:6647706'}, {'unwanted_material': 'film_plastique', 'main_material': 'emr', 'pht_type': 4207, 'ratio': 0.00029682028164317286, 'nb_photo': 8, 'list_port_cont': '6862648,6866460,6877060,6877718,6877925,6922720,6925580', 'assoc_port': '6832752:6877925,6840554:6877718,6861520:6862648,6865739:6866460,6876686:6877060,6921897:6922720,6925484:6925580', 'assoc_mat': '6832752:film_plastique:4207:6877925,6840554:film_plastique:4207:6877718,6861520:film_plastique:4207:6862648,6865739:film_plastique:4207:6866460,6876686:film_plastique:4207:6877060,6921897:film_plastique:4207:6922720,6925484:film_plastique:4207:6925580'}, {'unwanted_material': 'film_plastique', 'main_material': 'emr', 'pht_type': 4209, 'ratio': 9.746706181821035e-05, 'nb_photo': 9, 'list_port_cont': '6614124,6644434,6702223,6711304,6712598,6744913,6834700', 'assoc_port': '6613636:6614124,6639123:6644434,6701501:6702223,6708643:6712598,6708644:6711304,6744086:6744913,6832752:6834700', 'assoc_mat': '6613636:film_plastique:4209:6614124,6639123:film_plastique:4209:6644434,6701501:film_plastique:4209:6702223,6708643:film_plastique:4209:6712598,6708644:film_plastique:4209:6711304,6744086:film_plastique:4209:6744913,6832752:film_plastique:4209:6834700'}, {'unwanted_material': 'kraft', 'main_material': 'emr', 'pht_type': 4207, 'ratio': 0.0011039430628874177, 'nb_photo': 1, 'list_port_cont': '6917403', 'assoc_port': '6917034:6917403', 'assoc_mat': '6917034:kraft:4207:6917403'}, {'unwanted_material': 'metal', 'main_material': 'aluminium', 'pht_type': 4205, 'ratio': 0.9896715615394742, 'nb_photo': 54, 'list_port_cont': '6625531,6661187,6880740,6880777,6881860,6918649', 'assoc_port': '6625304:6625531,6632479:6661187,6880715:6880777,6880716:6880740,6881491:6881860,6887696:6918649', 'assoc_mat': '6625304:metal:4205:6625531,6632479:metal:4205:6661187,6880715:metal:4205:6880777,6880716:metal:4205:6880740,6881491:metal:4205:6881860,6887696:metal:4205:6918649'}, {'unwanted_material': 'metal', 'main_material': 'emr', 'pht_type': 4207, 'ratio': 0.002857356890964171, 'nb_photo': 188, 'list_port_cont': '6860922,6860979,6861033,6861211,6861400,6861433,6861833,6862030,6862128,6862210,6862338,6862362,6862534,6862572,6862638,6863807,6864053,6866290,6866466,6866498,6866956,6867841,6867914,6868223,6868261,6868374,6868621,6868667,6868732,6869091,6869331,6869392,6869468,6869545,6876850,6876885,6876957,6877055,6877099,6877198,6877539,6877618,6877678,6877719,6877785,6877818,6877877,6877912,6877928,6877966,6878004,6878040,6884491,6886881,6887977,6888302,6894497,6895947,6896159,6897898,6898087,6898465,6898489,6900299,6900468,6904477,6905148,6905987,6907057,6908937,6909122,6915222,6915272,6916692,6917256,6920805,6925583', 'assoc_port': '6790886:6864053,6790887:6862534,6794193:6862128,6832752:6877928,6832753:6877877,6833565:6878040,6834821:6878004,6834822:6877966,6836050:6877785,6838973:6877678,6838974:6877618,6840554:6877719,6842390:6877818,6845438:6869392,6846972:6869545,6846973:6869468,6848417:6869331,6851003:6868667,6852117:6868732,6852533:6869091,6853215:6861400,6853569:6861433,6853919:6868621,6859123:6861833,6860530:6861211,6860531:6861033,6860532:6860979,6860535:6860922,6861512:6868223,6861516:6868261,6861517:6868374,6861519:6862572,6861520:6862638,6861523:6862338,6861524:6862210,6861635:6862362,6861636:6862030,6863220:6863807,6864848:6867914,6864850:6867841,6864853:6866956,6864855:6866498,6865738:6866290,6865739:6866466,6876683:6877198,6876686:6877055,6876687:6877099,6876688:6876885,6876689:6876957,6876691:6876850,6877478:6877912,6877480:6877539,6884290:6884491,6886258:6886881,6887695:6888302,6887732:6887977,6894095:6894497,6895749:6896159,6895752:6895947,6897575:6898087,6897576:6897898,6898175:6898489,6898176:6898465,6899246:6900468,', 'assoc_mat': '6790886:metal:4207:6864053,6790887:metal:4207:6862534,6794193:metal:4207:6862128,6832752:metal:4207:6877928,6832753:metal:4207:6877877,6833565:metal:4207:6878040,6834821:metal:4207:6878004,6834822:metal:4207:6877966,6836050:metal:4207:6877785,6838973:metal:4207:6877678,6838974:metal:4207:6877618,6840554:metal:4207:6877719,6842390:metal:4207:6877818,6845438:metal:4207:6869392,6846972:metal:4207:6869545,6846973:metal:4207:6869468,6848417:metal:4207:6869331,6851003:metal:4207:6868667,6852117:metal:4207:6868732,6852533:metal:4207:6869091,6853215:metal:4207:6861400,6853569:metal:4207:6861433,6853919:metal:4207:6868621,6859123:metal:4207:6861833,6860530:metal:4207:6861211,6860531:metal:4207:6861033,6860532:metal:4207:6860979,6860535:metal:4207:6860922,6861512:metal:4207:6868223,6861516:metal:4207:6868261,6861517:metal:4207:6868374,6861519:metal:4207:6862572,6861520:metal:4207:6862638,6861523:metal:4207:6862338,6861524:metal:4207:6862210,6861635:metal:4207:6862362,6861636:metal:4207:6862030,6863220:metal:4207:686380'}, {'unwanted_material': 'metal', 'main_material': 'emr', 'pht_type': 4209, 'ratio': 0.026017127541676587, 'nb_photo': 787, 'list_port_cont': '6613097,6614121,6615521,6616026,6626451,6627868,6628403,6628835,6629153,6629208,6629277,6635307,6635359,6635433,6639705,6640666,6641594,6642552,6644427,6647437,6648164,6648886,6654370,6655828,6657169,6658371,6659139,6660892,6661087,6664549,6664633,6664701,6664796,6664935,6665224,6666046,6666081,6666646,6666766,6666945,6667992,6668663,6668912,6669249,6669482,6669546,6669703,6669773,6669806,6670109,6671159,6671466,6671576,6672296,6674155,6674267,6674795,6676776,6678453,6681189,6683437,6683972,6700233,6702218,6704725,6706893,6708961,6709417,6709566,6710044,6710774,6711296,6712599,6716510,6718358,6718713,6718870,6719287,6719648,6720401,6720631,6722162,6722586,6722893,6723437,6723512,6744909,6745246,6746419,6748619,6748941,6749034,6758839,6760267,6760542,6761443,6762005,6774106,6774607,6775285,6776482,6776987,6813179,6834120,6834369,6834695,6835802,6836110,6837026,6839593,6841134,6846021,6847508,6847568,6849264,6850424,6851374,6852778,6853219,6853526,6854348,6855834,6859395', 'assoc_port': '6612572:6613097,6613636:6614121,6614890:6615521,6614891:6616026,6625827:6626451,6627447:6627868,6627801:6628403,6627802:6629277,6628455:6628835,6628735:6629153,6628736:6629208,6630577:6664549,6630578:6664701,6630579:6664633,6630580:6664935,6630581:6665224,6630822:6666081,6630823:6666046,6631154:6667992,6631384:6668663,6631385:6668912,6631618:6669773,6631619:6669806,6631901:6670109,6632901:6671159,6632902:6671466,6633542:6635433,6633543:6635307,6633545:6635359,6633546:6672296,6635651:6661087,6635653:6660892,6639123:6644427,6639124:6639705,6639695:6642552,6640066:6640666,6640928:6641594,6646682:6647437,6647202:6648164,6648217:6648886,6652800:6654370,6655088:6655828,6656505:6657169,6656506:6658371,6657819:6659139,6663042:6664796,6665067:6666945,6665718:6666646,6665719:6666766,6668654:6669703,6668655:6669249,6668656:6669482,6668657:6669546,6670886:6671576,6671756:6676776,6673385:6674155,6673850:6674267,6674357:6674795,6678032:6678453,6680947:6681189,6682633:6683437,6683289:6683972,6699726:6700233,6700555:6704725,', 'assoc_mat': '6612572:metal:4209:6613097,6613636:metal:4209:6614121,6614890:metal:4209:6615521,6614891:metal:4209:6616026,6625827:metal:4209:6626451,6627447:metal:4209:6627868,6627801:metal:4209:6628403,6627802:metal:4209:6629277,6628455:metal:4209:6628835,6628735:metal:4209:6629153,6628736:metal:4209:6629208,6630577:metal:4209:6664549,6630578:metal:4209:6664701,6630579:metal:4209:6664633,6630580:metal:4209:6664935,6630581:metal:4209:6665224,6630822:metal:4209:6666081,6630823:metal:4209:6666046,6631154:metal:4209:6667992,6631384:metal:4209:6668663,6631385:metal:4209:6668912,6631618:metal:4209:6669773,6631619:metal:4209:6669806,6631901:metal:4209:6670109,6632901:metal:4209:6671159,6632902:metal:4209:6671466,6633542:metal:4209:6635433,6633543:metal:4209:6635307,6633545:metal:4209:6635359,6633546:metal:4209:6672296,6635651:metal:4209:6661087,6635653:metal:4209:6660892,6639123:metal:4209:6644427,6639124:metal:4209:6639705,6639695:metal:4209:6642552,6640066:metal:4209:6640666,6640928:metal:4209:6641594,6646682:metal:4209:664743'}, {'unwanted_material': 'metal', 'main_material': 'gm', 'pht_type': 4209, 'ratio': 0.03426755560145856, 'nb_photo': 14, 'list_port_cont': '6861172,6863427,6863597,6865059,6876772,6881616,6889760,6902821,6920943', 'assoc_port': '6860533:6861172,6863219:6863597,6863221:6863427,6864849:6865059,6876690:6876772,6881493:6881616,6889188:6889760,6900676:6902821,6920015:6920943', 'assoc_mat': '6860533:metal:4209:6861172,6863219:metal:4209:6863597,6863221:metal:4209:6863427,6864849:metal:4209:6865059,6876690:metal:4209:6876772,6881493:metal:4209:6881616,6889188:metal:4209:6889760,6900676:metal:4209:6902821,6920015:metal:4209:6920943'}, {'unwanted_material': 'papier', 'main_material': 'aluminium', 'pht_type': 4205, 'ratio': 0.0013353682339268438, 'nb_photo': 9, 'list_port_cont': '6625537,6880784', 'assoc_port': '6625304:6625537,6880715:6880784', 'assoc_mat': '6625304:papier:4205:6625537,6880715:papier:4205:6880784'}, {'unwanted_material': 'papier', 'main_material': 'emr', 'pht_type': 4207, 'ratio': 0.030078019576209876, 'nb_photo': 6564, 'list_port_cont': '6860765,6860809,6860834,6860929,6860974,6861044,6861206,6861412,6861434,6861798,6861840,6861924,6862024,6862135,6862201,6862331,6862374,6862545,6862582,6862651,6862990,6863820,6864046,6866293,6866465,6866499,6866949,6867662,6867830,6867915,6868217,6868247,6868293,6868379,6868403,6868626,6868668,6868733,6868889,6868970,6869094,6869326,6869384,6869464,6869555,6876860,6876889,6876921,6876951,6877008,6877057,6877102,6877186,6877542,6877605,6877685,6877711,6877787,6877810,6877872,6877908,6877920,6877963,6878007,6878032,6881693,6884489,6886474,6886878,6887983,6888296,6889465,6891084,6891165,6891355,6894204,6894504,6895937,6896154,6897893,6898095,6898457,6898491,6900292,6900467,6904483,6904508,6905154,6905995,6906491,6907050,6908161,6908519,6908941,6909123,6914622,6915183,6915210,6915259,6916693,6917258,6917398,6920814,6922713,6925594', 'assoc_port': '6790886:6864046,6790887:6862545,6794193:6862135,6832752:6877920,6832753:6877872,6833565:6878032,6834821:6878007,6834822:6877963,6836050:6877787,6838973:6877685,6838974:6877605,6840554:6877711,6842390:6877810,6845438:6869384,6846972:6869555,6846973:6869464,6848417:6869326,6849526:6868889,6851003:6868668,6852117:6868733,6852533:6869094,6852534:6868970,6853215:6861412,6853569:6861434,6853919:6868626,6855642:6860809,6859123:6861840,6860530:6861206,6860531:6861044,6860532:6860974,6860535:6860929,6860537:6860834,6860538:6860765,6861512:6868217,6861514:6868293,6861516:6868247,6861517:6868379,6861519:6862582,6861520:6862651,6861522:6861798,6861523:6862331,6861524:6862201,6861525:6861924,6861635:6862374,6861636:6862024,6862501:6862990,6863220:6863820,6864848:6867915,6864850:6867830,6864851:6867662,6864853:6866949,6864855:6866499,6865738:6866293,6865739:6866465,6868332:6868403,6876683:6877186,6876684:6876921,6876685:6877008,6876686:6877057,6876687:6877102,6876688:6876889,6876689:6876951,6876691:6876860,6877478:6877908,', 'assoc_mat': '6790886:papier:4207:6864046,6790887:papier:4207:6862545,6794193:papier:4207:6862135,6832752:papier:4207:6877920,6832753:papier:4207:6877872,6833565:papier:4207:6878032,6834821:papier:4207:6878007,6834822:papier:4207:6877963,6836050:papier:4207:6877787,6838973:papier:4207:6877685,6838974:papier:4207:6877605,6840554:papier:4207:6877711,6842390:papier:4207:6877810,6845438:papier:4207:6869384,6846972:papier:4207:6869555,6846973:papier:4207:6869464,6848417:papier:4207:6869326,6849526:papier:4207:6868889,6851003:papier:4207:6868668,6852117:papier:4207:6868733,6852533:papier:4207:6869094,6852534:papier:4207:6868970,6853215:papier:4207:6861412,6853569:papier:4207:6861434,6853919:papier:4207:6868626,6855642:papier:4207:6860809,6859123:papier:4207:6861840,6860530:papier:4207:6861206,6860531:papier:4207:6861044,6860532:papier:4207:6860974,6860535:papier:4207:6860929,6860537:papier:4207:6860834,6860538:papier:4207:6860765,6861512:papier:4207:6868217,6861514:papier:4207:6868293,6861516:papier:4207:6868247,6861517:papier:4'}, {'unwanted_material': 'papier', 'main_material': 'emr', 'pht_type': 4209, 'ratio': 0.9686131104416358, 'nb_photo': 148871, 'list_port_cont': '6613100,6614114,6614594,6615529,6616034,6626462,6627859,6628399,6628843,6629142,6629212,6629275,6635305,6635363,6635424,6639712,6640665,6641601,6642549,6644429,6646359,6647443,6648156,6648888,6654374,6655830,6657171,6658366,6659151,6659226,6660896,6661088,6664555,6664630,6664696,6664799,6664931,6665226,6666045,6666080,6666650,6666767,6666948,6667998,6668669,6668911,6669246,6669487,6669556,6669704,6669775,6669818,6670116,6671162,6671475,6671569,6671851,6672303,6674157,6674272,6674793,6676777,6678463,6681194,6683426,6683976,6700220,6702213,6704717,6706880,6708963,6709412,6709561,6710050,6710787,6711302,6712597,6716513,6718354,6718721,6718876,6719283,6719641,6719885,6720392,6720623,6722156,6722577,6722881,6723438,6723515,6744914,6745255,6746412,6748609,6748948,6749033,6758834,6760258,6760534,6761446,6762006,6762872,6774101,6774621,6775292,6776474,6776980,6813189,6834129,6834360,6834694,6835804,6836115,6837019,6839283,6839590,6841139,6842937,6846030,6847507,6847554,6849265,6850417,6851367,6852769,6853226,6853512,', 'assoc_port': '6612572:6613100,6613636:6614114,6614336:6614594,6614890:6615529,6614891:6616034,6625827:6626462,6627447:6627859,6627801:6628399,6627802:6629275,6628455:6628843,6628735:6629142,6628736:6629212,6630577:6664555,6630578:6664696,6630579:6664630,6630580:6664931,6630581:6665226,6630822:6666080,6630823:6666045,6631154:6667998,6631384:6668669,6631385:6668911,6631618:6669775,6631619:6669818,6631901:6670116,6632901:6671162,6632902:6671475,6633542:6635424,6633543:6635305,6633544:6671851,6633545:6635363,6633546:6672303,6635651:6661088,6635653:6660896,6639123:6644429,6639124:6639712,6639695:6642549,6640066:6640665,6640928:6641601,6645791:6646359,6646682:6647443,6647202:6648156,6648217:6648888,6652800:6654374,6655088:6655830,6656505:6657171,6656506:6658366,6657819:6659151,6659025:6659226,6663042:6664799,6665067:6666948,6665718:6666650,6665719:6666767,6668654:6669704,6668655:6669246,6668656:6669487,6668657:6669556,6670886:6671569,6671756:6676777,6673385:6674157,6673850:6674272,6674357:6674793,6678032:6678463,6680947:6681194,', 'assoc_mat': '6612572:papier:4209:6613100,6613636:papier:4209:6614114,6614336:papier:4209:6614594,6614890:papier:4209:6615529,6614891:papier:4209:6616034,6625827:papier:4209:6626462,6627447:papier:4209:6627859,6627801:papier:4209:6628399,6627802:papier:4209:6629275,6628455:papier:4209:6628843,6628735:papier:4209:6629142,6628736:papier:4209:6629212,6630577:papier:4209:6664555,6630578:papier:4209:6664696,6630579:papier:4209:6664630,6630580:papier:4209:6664931,6630581:papier:4209:6665226,6630822:papier:4209:6666080,6630823:papier:4209:6666045,6631154:papier:4209:6667998,6631384:papier:4209:6668669,6631385:papier:4209:6668911,6631618:papier:4209:6669775,6631619:papier:4209:6669818,6631901:papier:4209:6670116,6632901:papier:4209:6671162,6632902:papier:4209:6671475,6633542:papier:4209:6635424,6633543:papier:4209:6635305,6633544:papier:4209:6671851,6633545:papier:4209:6635363,6633546:papier:4209:6672303,6635651:papier:4209:6661088,6635653:papier:4209:6660896,6639123:papier:4209:6644429,6639124:papier:4209:6639712,6639695:papier:4'}, {'unwanted_material': 'papier', 'main_material': 'gm', 'pht_type': 4209, 'ratio': 0.9902901831097267, 'nb_photo': 2955, 'list_port_cont': '6860598,6860874,6861066,6861173,6861345,6861539,6861959,6862604,6863422,6863593,6864917,6865058,6866086,6866174,6876761,6877571,6877655,6877751,6881620,6886395,6888025,6889756,6894811,6902822,6905423,6907081,6909151,6920947', 'assoc_port': '6860529:6861066,6860533:6861173,6860534:6860598,6860536:6860874,6861163:6861539,6861164:6861345,6861513:6861959,6861515:6862604,6863219:6863593,6863221:6863422,6864847:6866174,6864849:6865058,6864854:6864917,6865737:6866086,6876690:6876761,6877477:6877751,6877481:6877655,6877482:6877571,6881493:6881620,6886257:6886395,6887731:6888025,6889188:6889756,6894658:6894811,6899249:6909151,6900676:6902822,6903711:6907081,6905103:6905423,6920015:6920947', 'assoc_mat': '6860529:papier:4209:6861066,6860533:papier:4209:6861173,6860534:papier:4209:6860598,6860536:papier:4209:6860874,6861163:papier:4209:6861539,6861164:papier:4209:6861345,6861513:papier:4209:6861959,6861515:papier:4209:6862604,6863219:papier:4209:6863593,6863221:papier:4209:6863422,6864847:papier:4209:6866174,6864849:papier:4209:6865058,6864854:papier:4209:6864917,6865737:papier:4209:6866086,6876690:papier:4209:6876761,6877477:papier:4209:6877751,6877481:papier:4209:6877655,6877482:papier:4209:6877571,6881493:papier:4209:6881620,6886257:papier:4209:6886395,6887731:papier:4209:6888025,6889188:papier:4209:6889756,6894658:papier:4209:6894811,6899249:papier:4209:6909151,6900676:papier:4209:6902822,6903711:papier:4209:6907081,6905103:papier:4209:6905423,6920015:papier:4209:6920947'}, {'unwanted_material': 'papier', 'main_material': 'pet_fonce', 'pht_type': 4200, 'ratio': 0.010245453120925422, 'nb_photo': 31, 'list_port_cont': '6647707,6861711', 'assoc_port': '6647200:6647707,6861521:6861711', 'assoc_mat': '6647200:papier:4200:6647707,6861521:papier:4200:6861711'}, {'unwanted_material': 'pehd', 'main_material': 'emr', 'pht_type': 4209, 'ratio': 2.520265649788176e-05, 'nb_photo': 2, 'list_port_cont': '6678458', 'assoc_port': '6678032:6678458', 'assoc_mat': '6678032:pehd:4209:6678458'}, {'unwanted_material': 'pet_clair', 'main_material': 'emr', 'pht_type': 4207, 'ratio': 0.0009691335779369147, 'nb_photo': 50, 'list_port_cont': '6862208,6862361,6862535,6862580,6862650,6867917,6868229,6868248,6868281,6868376,6868672,6869102,6869324,6869466,6869550,6877011,6877046,6877191,6877677,6877777,6877812,6877923,6877993,6878035,6886875,6888290,6891353,6896153,6898498,6904509,6907044,6917257,6922719,6925591', 'assoc_port': '6790887:6862535,6832752:6877923,6833565:6878035,6834821:6877993,6836050:6877777,6838973:6877677,6842390:6877812,6846972:6869550,6846973:6869466,6848417:6869324,6851003:6868672,6852533:6869102,6861512:6868229,6861514:6868281,6861516:6868248,6861517:6868376,6861519:6862580,6861520:6862650,6861524:6862208,6861635:6862361,6864848:6867917,6876683:6877191,6876685:6877011,6876686:6877046,6886258:6886875,6887695:6888290,6889190:6891353,6895749:6896153,6898175:6898498,6904057:6904509,6906036:6907044,6917033:6917257,6921897:6922719,6925484:6925591', 'assoc_mat': '6790887:pet_clair:4207:6862535,6832752:pet_clair:4207:6877923,6833565:pet_clair:4207:6878035,6834821:pet_clair:4207:6877993,6836050:pet_clair:4207:6877777,6838973:pet_clair:4207:6877677,6842390:pet_clair:4207:6877812,6846972:pet_clair:4207:6869550,6846973:pet_clair:4207:6869466,6848417:pet_clair:4207:6869324,6851003:pet_clair:4207:6868672,6852533:pet_clair:4207:6869102,6861512:pet_clair:4207:6868229,6861514:pet_clair:4207:6868281,6861516:pet_clair:4207:6868248,6861517:pet_clair:4207:6868376,6861519:pet_clair:4207:6862580,6861520:pet_clair:4207:6862650,6861524:pet_clair:4207:6862208,6861635:pet_clair:4207:6862361,6864848:pet_clair:4207:6867917,6876683:pet_clair:4207:6877191,6876685:pet_clair:4207:6877011,6876686:pet_clair:4207:6877046,6886258:pet_clair:4207:6886875,6887695:pet_clair:4207:6888290,6889190:pet_clair:4207:6891353,6895749:pet_clair:4207:6896153,6898175:pet_clair:4207:6898498,6904057:pet_clair:4207:6904509,6906036:pet_clair:4207:6907044,6917033:pet_clair:4207:6917257,6921897:pet_clair:4207:6922719,6'}, {'unwanted_material': 'pet_clair', 'main_material': 'emr', 'pht_type': 4209, 'ratio': 0.00038788845724592604, 'nb_photo': 52, 'list_port_cont': '6613103,6648162,6655833,6657176,6658378,6660889,6666083,6666651,6666947,6668915,6669550,6669705,6669777,6671157,6700228,6704711,6706879,6709548,6712610,6720621,6722887,6723439,6744920,6748621,6748942,6761453,6774102,6776478,6837016,6841130,6846026,6853934', 'assoc_port': '6612572:6613103,6630822:6666083,6631385:6668915,6631618:6669777,6632901:6671157,6635653:6660889,6647202:6648162,6655088:6655833,6656505:6657176,6656506:6658378,6665067:6666947,6665718:6666651,6668654:6669705,6668657:6669550,6699726:6700228,6700555:6704711,6706262:6706879,6707499:6709548,6708643:6712610,6720202:6720621,6722573:6722887,6723094:6723439,6744086:6744920,6747584:6748621,6748313:6748942,6761126:6761453,6773386:6774102,6776077:6776478,6836050:6837016,6840554:6841130,6845438:6846026,6852534:6853934', 'assoc_mat': '6612572:pet_clair:4209:6613103,6630822:pet_clair:4209:6666083,6631385:pet_clair:4209:6668915,6631618:pet_clair:4209:6669777,6632901:pet_clair:4209:6671157,6635653:pet_clair:4209:6660889,6647202:pet_clair:4209:6648162,6655088:pet_clair:4209:6655833,6656505:pet_clair:4209:6657176,6656506:pet_clair:4209:6658378,6665067:pet_clair:4209:6666947,6665718:pet_clair:4209:6666651,6668654:pet_clair:4209:6669705,6668657:pet_clair:4209:6669550,6699726:pet_clair:4209:6700228,6700555:pet_clair:4209:6704711,6706262:pet_clair:4209:6706879,6707499:pet_clair:4209:6709548,6708643:pet_clair:4209:6712610,6720202:pet_clair:4209:6720621,6722573:pet_clair:4209:6722887,6723094:pet_clair:4209:6723439,6744086:pet_clair:4209:6744920,6747584:pet_clair:4209:6748621,6748313:pet_clair:4209:6748942,6761126:pet_clair:4209:6761453,6773386:pet_clair:4209:6774102,6776077:pet_clair:4209:6776478,6836050:pet_clair:4209:6837016,6840554:pet_clair:4209:6841130,6845438:pet_clair:4209:6846026,6852534:pet_clair:4209:6853934'}, {'unwanted_material': 'pet_clair', 'main_material': 'gm', 'pht_type': 4209, 'ratio': 0.00042088720046359597, 'nb_photo': 1, 'list_port_cont': '6862605', 'assoc_port': '6861515:6862605', 'assoc_mat': '6861515:pet_clair:4209:6862605'}, {'unwanted_material': 'pet_fonce', 'main_material': 'emr', 'pht_type': 4207, 'ratio': 0.0008578698895049885, 'nb_photo': 28, 'list_port_cont': '6860798,6861839,6862207,6868256,6868671,6869549,6877674,6877708,6877816,6877879,6878008,6886869,6888301,6889467,6898496,6904520,6915175,6922716', 'assoc_port': '6832753:6877879,6834821:6878008,6838973:6877674,6840554:6877708,6842390:6877816,6846972:6869549,6851003:6868671,6855642:6860798,6859123:6861839,6861516:6868256,6861524:6862207,6886258:6886869,6887695:6888301,6887698:6889467,6898175:6898496,6904057:6904520,6914259:6915175,6921897:6922716', 'assoc_mat': '6832753:pet_fonce:4207:6877879,6834821:pet_fonce:4207:6878008,6838973:pet_fonce:4207:6877674,6840554:pet_fonce:4207:6877708,6842390:pet_fonce:4207:6877816,6846972:pet_fonce:4207:6869549,6851003:pet_fonce:4207:6868671,6855642:pet_fonce:4207:6860798,6859123:pet_fonce:4207:6861839,6861516:pet_fonce:4207:6868256,6861524:pet_fonce:4207:6862207,6886258:pet_fonce:4207:6886869,6887695:pet_fonce:4207:6888301,6887698:pet_fonce:4207:6889467,6898175:pet_fonce:4207:6898496,6904057:pet_fonce:4207:6904520,6914259:pet_fonce:4207:6915175,6921897:pet_fonce:4207:6922716'}, {'unwanted_material': 'pet_fonce', 'main_material': 'emr', 'pht_type': 4209, 'ratio': 0.002001176734086916, 'nb_photo': 165, 'list_port_cont': '6613106,6614596,6626457,6628830,6629210,6635370,6641607,6642548,6644426,6646347,6647448,6648893,6654377,6659140,6659225,6660883,6661079,6664546,6664700,6665227,6666079,6666644,6666756,6666950,6668662,6669252,6669485,6669785,6671575,6674270,6678461,6683425,6683978,6702227,6704714,6706892,6708972,6709423,6709577,6711293,6712608,6718881,6719276,6719647,6720634,6722892,6723506,6744910,6748597,6762003,6774109,6776983,6841135,6842934,6847565,6859391', 'assoc_port': '6612572:6613106,6614336:6614596,6625827:6626457,6628455:6628830,6628736:6629210,6630577:6664546,6630578:6664700,6630581:6665227,6630822:6666079,6631384:6668662,6631618:6669785,6633545:6635370,6635651:6661079,6635653:6660883,6639123:6644426,6639695:6642548,6640928:6641607,6645791:6646347,6646682:6647448,6648217:6648893,6652800:6654377,6657819:6659140,6659025:6659225,6665067:6666950,6665718:6666644,6665719:6666756,6668655:6669252,6668656:6669485,6670886:6671575,6673850:6674270,6678032:6678461,6682633:6683425,6683289:6683978,6700555:6704714,6701501:6702227,6706262:6706892,6706760:6709423,6707163:6708972,6707499:6709577,6708643:6712608,6708644:6711293,6718520:6719276,6718521:6718881,6719441:6719647,6720202:6720634,6722573:6722892,6723192:6723506,6744086:6744910,6747584:6748597,6759349:6762003,6773386:6774109,6775574:6776983,6840554:6841135,6842390:6842934,6846972:6847565,6859123:6859391', 'assoc_mat': '6612572:pet_fonce:4209:6613106,6614336:pet_fonce:4209:6614596,6625827:pet_fonce:4209:6626457,6628455:pet_fonce:4209:6628830,6628736:pet_fonce:4209:6629210,6630577:pet_fonce:4209:6664546,6630578:pet_fonce:4209:6664700,6630581:pet_fonce:4209:6665227,6630822:pet_fonce:4209:6666079,6631384:pet_fonce:4209:6668662,6631618:pet_fonce:4209:6669785,6633545:pet_fonce:4209:6635370,6635651:pet_fonce:4209:6661079,6635653:pet_fonce:4209:6660883,6639123:pet_fonce:4209:6644426,6639695:pet_fonce:4209:6642548,6640928:pet_fonce:4209:6641607,6645791:pet_fonce:4209:6646347,6646682:pet_fonce:4209:6647448,6648217:pet_fonce:4209:6648893,6652800:pet_fonce:4209:6654377,6657819:pet_fonce:4209:6659140,6659025:pet_fonce:4209:6659225,6665067:pet_fonce:4209:6666950,6665718:pet_fonce:4209:6666644,6665719:pet_fonce:4209:6666756,6668655:pet_fonce:4209:6669252,6668656:pet_fonce:4209:6669485,6670886:pet_fonce:4209:6671575,6673850:pet_fonce:4209:6674270,6678032:pet_fonce:4209:6678461,6682633:pet_fonce:4209:6683425,6683289:pet_fonce:4209:6683978,6'}, {'unwanted_material': 'pet_fonce', 'main_material': 'gm', 'pht_type': 4209, 'ratio': 0.0009882492230258019, 'nb_photo': 2, 'list_port_cont': '6894805', 'assoc_port': '6894658:6894805', 'assoc_mat': '6894658:pet_fonce:4209:6894805'}, {'unwanted_material': 'pet_fonce', 'main_material': 'pet_fonce', 'pht_type': 4200, 'ratio': 0.9832720072705387, 'nb_photo': 21, 'list_port_cont': '6647700,6861697', 'assoc_port': '6647200:6647700,6861521:6861697', 'assoc_mat': '6647200:pet_fonce:4200:6647700,6861521:pet_fonce:4200:6861697'}, {'unwanted_material': 'pet_opaque', 'main_material': 'emr', 'pht_type': 4207, 'ratio': 0.0006428090611349251, 'nb_photo': 9, 'list_port_cont': '6866496,6868369,6869096,6869546,6878036,6904487,6905142,6905991,6922715', 'assoc_port': '6833565:6878036,6846972:6869546,6852533:6869096,6861517:6868369,6864855:6866496,6903710:6905991,6903712:6904487,6905102:6905142,6921897:6922715', 'assoc_mat': '6833565:pet_opaque:4207:6878036,6846972:pet_opaque:4207:6869546,6852533:pet_opaque:4207:6869096,6861517:pet_opaque:4207:6868369,6864855:pet_opaque:4207:6866496,6903710:pet_opaque:4207:6905991,6903712:pet_opaque:4207:6904487,6905102:pet_opaque:4207:6905142,6921897:pet_opaque:4207:6922715'}, {'unwanted_material': 'pet_opaque', 'main_material': 'emr', 'pht_type': 4209, 'ratio': 0.0005744915736568625, 'nb_photo': 214, 'list_port_cont': '6613105,6614118,6616031,6627858,6628408,6628839,6629216,6629282,6635308,6635367,6639706,6640660,6641595,6644422,6647441,6655823,6657172,6658373,6659149,6660897,6661077,6664543,6664634,6664804,6664940,6665229,6666078,6666656,6666757,6666952,6667994,6668664,6668914,6669254,6669547,6669695,6669784,6669814,6670110,6671566,6671848,6672292,6674152,6676774,6678456,6681180,6683428,6683979,6700223,6704719,6706884,6709575,6711305,6712607,6718352,6718715,6719280,6719890,6720396,6722151,6722589,6722891,6723435,6744915,6748617,6748952,6749035,6760254,6761440,6774110,6776978,6813183,6834135,6834365,6834702,6835809,6839582,6841141,6842938,6853225,6853523,6859402', 'assoc_port': '6612572:6613105,6613636:6614118,6614891:6616031,6627447:6627858,6627801:6628408,6627802:6629282,6628455:6628839,6628736:6629216,6630577:6664543,6630579:6664634,6630580:6664940,6630581:6665229,6630822:6666078,6631154:6667994,6631384:6668664,6631385:6668914,6631618:6669784,6631619:6669814,6631901:6670110,6633543:6635308,6633544:6671848,6633545:6635367,6633546:6672292,6635651:6661077,6635653:6660897,6639123:6644422,6639124:6639706,6640066:6640660,6640928:6641595,6646682:6647441,6655088:6655823,6656505:6657172,6656506:6658373,6657819:6659149,6663042:6664804,6665067:6666952,6665718:6666656,6665719:6666757,6668654:6669695,6668655:6669254,6668657:6669547,6670886:6671566,6671756:6676774,6673385:6674152,6678032:6678456,6680947:6681180,6682633:6683428,6683289:6683979,6699726:6700223,6700555:6704719,6706262:6706884,6707499:6709575,6708643:6712607,6708644:6711305,6715973:6718352,6716500:6718715,6717201:6719890,6718520:6719280,6719951:6720396,6721826:6722589,6721827:6722151,6722573:6722891,6723094:6723435,6744086:6744915,', 'assoc_mat': '6612572:pet_opaque:4209:6613105,6613636:pet_opaque:4209:6614118,6614891:pet_opaque:4209:6616031,6627447:pet_opaque:4209:6627858,6627801:pet_opaque:4209:6628408,6627802:pet_opaque:4209:6629282,6628455:pet_opaque:4209:6628839,6628736:pet_opaque:4209:6629216,6630577:pet_opaque:4209:6664543,6630579:pet_opaque:4209:6664634,6630580:pet_opaque:4209:6664940,6630581:pet_opaque:4209:6665229,6630822:pet_opaque:4209:6666078,6631154:pet_opaque:4209:6667994,6631384:pet_opaque:4209:6668664,6631385:pet_opaque:4209:6668914,6631618:pet_opaque:4209:6669784,6631619:pet_opaque:4209:6669814,6631901:pet_opaque:4209:6670110,6633543:pet_opaque:4209:6635308,6633544:pet_opaque:4209:6671848,6633545:pet_opaque:4209:6635367,6633546:pet_opaque:4209:6672292,6635651:pet_opaque:4209:6661077,6635653:pet_opaque:4209:6660897,6639123:pet_opaque:4209:6644422,6639124:pet_opaque:4209:6639706,6640066:pet_opaque:4209:6640660,6640928:pet_opaque:4209:6641595,6646682:pet_opaque:4209:6647441,6655088:pet_opaque:4209:6655823,6656505:pet_opaque:4209:6657172,'}) select count(distinct mtr_photo_id) from MTRUser.mtr_portfolio_photos where mtr_portfolio_id in (select mtr_portfolio_id from MTRPhoto.dashboard_results where dashboard_run_id in(448643,449568,454450,454465,454459,454472,456239,458795,461498,454567,457375,457649,459844,460382,461634,463066,472528,465865,469297,468129,475039,472453,474892,474538,475316,476524,479832,481665,479903)); after get_hostname_from_raspi hasthag : emr hasthag that could be used but not yet : _______carton,background SELECT substr(hashtag,8), substr(date_debut,1,7) as month, (sum(qualite*nombre_balle)/sum(nombre_balle)) FROM MTRPhoto.dashboard_results WHERE hashtag = '_______emr' and mtr_portfolio_id in (select id FROM MTRUser.mtr_portfolios where mtr_user_id=1038) and qualite >=0 and dashboard_run_id in (select last_run_id from MTRPhoto.dashboard_entry_day where dashboard_place_id=53 and date >='2022-08-01' and date <= '2022-08-31') GROUP BY month order by month; hasthag : jrm hasthag that could be used but not yet : _______papier,background SELECT substr(hashtag,8), substr(date_debut,1,7) as month, (sum(qualite*nombre_balle)/sum(nombre_balle)) FROM MTRPhoto.dashboard_results WHERE hashtag = '_______jrm' and mtr_portfolio_id in (select id FROM MTRUser.mtr_portfolios where mtr_user_id=1038) and qualite >=0 and dashboard_run_id in (select last_run_id from MTRPhoto.dashboard_entry_day where dashboard_place_id=53 and date >='2022-08-01' and date <= '2022-08-31') GROUP BY month order by month; hasthag : aluminium hasthag that could be used but not yet : _______metal,background SELECT substr(hashtag,8), substr(date_debut,1,7) as month, (sum(qualite*nombre_balle)/sum(nombre_balle)) FROM MTRPhoto.dashboard_results WHERE hashtag = '_______aluminium' and mtr_portfolio_id in (select id FROM MTRUser.mtr_portfolios where mtr_user_id=1038) and qualite >=0 and dashboard_run_id in (select last_run_id from MTRPhoto.dashboard_entry_day where dashboard_place_id=53 and date >='2022-08-01' and date <= '2022-08-31') GROUP BY month order by month; hasthag : pet_fonce hasthag that could be used but not yet : _______pet_fonce,etiquette,background SELECT substr(hashtag,8), substr(date_debut,1,7) as month, (sum(qualite*nombre_balle)/sum(nombre_balle)) FROM MTRPhoto.dashboard_results WHERE hashtag = '_______pet_fonce' and mtr_portfolio_id in (select id FROM MTRUser.mtr_portfolios where mtr_user_id=1038) and qualite >=0 and dashboard_run_id in (select last_run_id from MTRPhoto.dashboard_entry_day where dashboard_place_id=53 and date >='2022-08-01' and date <= '2022-08-31') GROUP BY month order by month; hasthag : gm hasthag that could be used but not yet : _______papier,background SELECT substr(hashtag,8), substr(date_debut,1,7) as month, (sum(qualite*nombre_balle)/sum(nombre_balle)) FROM MTRPhoto.dashboard_results WHERE hashtag = '_______gm' and mtr_portfolio_id in (select id FROM MTRUser.mtr_portfolios where mtr_user_id=1038) and qualite >=0 and dashboard_run_id in (select last_run_id from MTRPhoto.dashboard_entry_day where dashboard_place_id=53 and date >='2022-08-01' and date <= '2022-08-31') GROUP BY month order by month; after impurety_average_per_hashtag {'number_of_analysed_photos': ((8000,),), 'unwanted_material_monthly_percentage': ((0.02991916097445073,),), 'material_repartition': (('emr', 5015), ('gm', 135), ('aluminium', 89), ('jrm', 45), ('pet_fonce', 28)), 'material_dict': {'emr': 5015, 'autres': 297}, 'coverage_data': (('2022/08/31/', 0.645567), ('2022/08/30/', 1.0), ('2022/08/29/', 1.0), ('2022/08/27/', 0.463906), ('2022/08/26/', 1.0), ('2022/08/25/', 0.812121), ('2022/08/24/', 1.0), ('2022/08/23/', 1.0), ('2022/08/22/', 0.486486), ('2022/08/20/', 0.473359), ('2022/08/19/', 0.441242), ('2022/08/18/', 0.836601), ('2022/08/17/', 0.898649), ('2022/08/16/', 0.581668), ('2022/08/15/', 0.604208), ('2022/08/13/', 0.905738), ('2022/08/12/', 1.0), ('2022/08/11/', 0.555556), ('2022/08/10/', 1.0), ('2022/08/09/', 1.0), ('2022/08/08/', 1.0), ('2022/08/06/', 0.45925), ('2022/08/05/', 1.0), ('2022/08/04/', 0.511261), ('2022/08/03/', 0.850806), ('2022/08/02/', 0.714286), ('2022/08/01/', 0.615778)), 'impurety_average_data': ((datetime.date(2022, 8, 2), 0.014282331762157728, 103), (datetime.date(2022, 8, 3), 0.03494206677880239, 211), (datetime.date(2022, 8, 5), 0.029420780762543012, 438), (datetime.date(2022, 8, 6), 0.04557840319999026, 54), (datetime.date(2022, 8, 8), 0.022841014228638157, 375), (datetime.date(2022, 8, 9), 0.02268268592206632, 320), (datetime.date(2022, 8, 10), 0.021294981158255618, 407), (datetime.date(2022, 8, 11), 0.022496316372650236, 115), (datetime.date(2022, 8, 12), 0.037292023387041164, 482), (datetime.date(2022, 8, 13), 0.030188267365227943, 442), (datetime.date(2022, 8, 16), 0.06353963932551064, 211), (datetime.date(2022, 8, 17), 0.055518220907447555, 133), (datetime.date(2022, 8, 18), 0.028245770796200272, 128), (datetime.date(2022, 8, 19), 0.029592761588569258, 277), (datetime.date(2022, 8, 22), 0.010668998327936066, 36), (datetime.date(2022, 8, 23), 0.02985658365132344, 351), (datetime.date(2022, 8, 24), 0.02890717923269598, 369), (datetime.date(2022, 8, 25), 0.02964405365672207, 385), (datetime.date(2022, 8, 26), 0.027188360813364603, 209), (datetime.date(2022, 8, 28), 0.014876381935804891, 33), (datetime.date(2022, 8, 29), 0.023942954543620824, 233), (datetime.date(2022, 8, 30), 0.03176500481166622, 362), (datetime.date(2022, 8, 31), 0.024400799858355637, 340)), 'impurety_average_data_per_hashtag': {'emr': ((datetime.date(2022, 8, 2), 0.014497225753743103, 90), (datetime.date(2022, 8, 3), 0.035407726190541, 201), (datetime.date(2022, 8, 5), 0.029420780762543012, 438), (datetime.date(2022, 8, 6), 0.051389769677544335, 43), (datetime.date(2022, 8, 8), 0.022841014228638157, 375), (datetime.date(2022, 8, 9), 0.022808792662868328, 304), (datetime.date(2022, 8, 10), 0.021294981158255618, 407), (datetime.date(2022, 8, 11), 0.022496316372650236, 115), (datetime.date(2022, 8, 12), 0.037292023387041164, 482), (datetime.date(2022, 8, 13), 0.030188267365227943, 442), (datetime.date(2022, 8, 16), 0.06353963932551064, 211), (datetime.date(2022, 8, 17), 0.055518220907447555, 133), (datetime.date(2022, 8, 18), 0.028245770796200272, 128), (datetime.date(2022, 8, 19), 0.03144342737311807, 238), (datetime.date(2022, 8, 22), 0.010668998327936066, 36), (datetime.date(2022, 8, 23), 0.030080632780942033, 330), (datetime.date(2022, 8, 24), 0.029230789634089597, 345), (datetime.date(2022, 8, 25), 0.029901630015503007, 357), (datetime.date(2022, 8, 26), 0.028097448563616227, 175), (datetime.date(2022, 8, 29), 0.03005524006484819, 165), (datetime.date(2022, 8, 30), 0.03263495327830263, 307), (datetime.date(2022, 8, 31), 0.02525588399363416, 301)), 'jrm': ((datetime.date(2022, 8, 2), 0.012085072487249132, 13), (datetime.date(2022, 8, 19), 0.010114825333022708, 10), (datetime.date(2022, 8, 23), 0.024498907798673017, 5), (datetime.date(2022, 8, 26), 0.0052974707656706635, 12), (datetime.date(2022, 8, 29), 0.0180872193641313, 5), (datetime.date(2022, 8, 30), 0.012309361035885383, 18), (datetime.date(2022, 8, 31), 0.0, 30)), 'aluminium': ((datetime.date(2022, 8, 3), 0.0029466085982426723, 10), (datetime.date(2022, 8, 6), 0.0, 11), (datetime.date(2022, 8, 28), 0.014876381935804891, 33), (datetime.date(2022, 8, 29), 0.0027249051959917212, 35), (datetime.date(2022, 8, 30), 0.0, 5)), 'pet_fonce': ((datetime.date(2022, 8, 9), 0.01691330253037371, 16), (datetime.date(2022, 8, 19), 0.01514668242834379, 6), (datetime.date(2022, 8, 29), 0.0, 6)), 'gm': ((datetime.date(2022, 8, 19), 0.0036688743500458555, 23), (datetime.date(2022, 8, 23), 2.7541150063779214e-07, 16), (datetime.date(2022, 8, 24), 0.009998135847154843, 24), (datetime.date(2022, 8, 25), 0.007110951820118182, 28), (datetime.date(2022, 8, 26), 0.0026635914561474365, 22), (datetime.date(2022, 8, 29), 0.005845156606103965, 22), (datetime.date(2022, 8, 30), 0.01774597693816732, 32), (datetime.date(2022, 8, 31), 0.04037847154938461, 9))}, 'quality_array': [['7.002742885641196', '01082022'], ['7.276538764582762', '02082022'], ['7.489191991610414', '03082022'], ['7.1515808570282635', '04082022'], ['7.481548146738859', '05082022'], ['7.304119764213931', '06082022'], ['7.180322525692267', '08082022'], ['6.878113539107664', '09082022'], ['7.100998473868195', '10082022'], ['7.303181417036363', '11082022'], ['6.929539513848952', '12082022'], ['6.949887273916412', '13082022'], ['6.952864344290567', '15082022'], ['6.946439599449299', '16082022'], ['8.200164971876198', '17082022'], ['7.414826551741067', '18082022'], ['7.567049552876916', '19082022'], ['8.275572615180698', '22082022'], ['8.683058890962057', '23082022'], ['9.447587725285345', '24082022'], ['9.907266828738836', '25082022'], ['9.398694081509628', '26082022'], ['3.699836545530341', '28082022'], ['9.278913980706943', '29082022'], ['9.808918378829057', '30082022'], ['12.679394134058633', '31082022']], 'number_of_batch': ((325,),), 'datou_id_sts': 3981, 'map_hashtag_number_mat': {'hash_to_mat_nb': ({'unwanted_material': 'barquette_opaque', 'main_material': 'emr', 'pht_type': 4207, 'ratio': 0.0001728785023265608, 'nb_photo': 18, 'list_port_cont': '6861407,6862123,6862547,6867908,6868674,6869389,6869558,6877707,6877972,6881690,6891352,6894202,6907047,6922714,6925593', 'assoc_port': '6790887:6862547,6794193:6862123,6834822:6877972,6840554:6877707,6845438:6869389,6846972:6869558,6851003:6868674,6853215:6861407,6864848:6867908,6881492:6881690,6889190:6891352,6894094:6894202,6906036:6907047,6921897:6922714,6925484:6925593', 'assoc_mat': '6790887:barquette_opaque:4207:6862547,6794193:barquette_opaque:4207:6862123,6834822:barquette_opaque:4207:6877972,6840554:barquette_opaque:4207:6877707,6845438:barquette_opaque:4207:6869389,6846972:barquette_opaque:4207:6869558,6851003:barquette_opaque:4207:6868674,6853215:barquette_opaque:4207:6861407,6864848:barquette_opaque:4207:6867908,6881492:barquette_opaque:4207:6881690,6889190:barquette_opaque:4207:6891352,6894094:barquette_opaque:4207:6894202,6906036:barquette_opaque:4207:6907047,6921897:barquette_opaque:4207:6922714,6925484:barquette_opaque:4207:6925593'}, {'unwanted_material': 'barquette_opaque', 'main_material': 'emr', 'pht_type': 4209, 'ratio': 8.469862336652651e-05, 'nb_photo': 44, 'list_port_cont': '6626450,6627857,6628405,6628829,6644425,6664932,6665236,6666075,6666652,6669243,6669771,6706891,6712605,6719637,6720391,6720629,6722154,6744912,6762879,6775287,6835808,6841133,6842925,6846016,6852775,6853230', 'assoc_port': '6625827:6626450,6627447:6627857,6627801:6628405,6628455:6628829,6630580:6664932,6630581:6665236,6630822:6666075,6631618:6669771,6639123:6644425,6665718:6666652,6668655:6669243,6706262:6706891,6708643:6712605,6719441:6719637,6719951:6720391,6720202:6720629,6721827:6722154,6744086:6744912,6762224:6762879,6774283:6775287,6834821:6835808,6840554:6841133,6842390:6842925,6845438:6846016,6852117:6852775,6852533:6853230', 'assoc_mat': '6625827:barquette_opaque:4209:6626450,6627447:barquette_opaque:4209:6627857,6627801:barquette_opaque:4209:6628405,6628455:barquette_opaque:4209:6628829,6630580:barquette_opaque:4209:6664932,6630581:barquette_opaque:4209:6665236,6630822:barquette_opaque:4209:6666075,6631618:barquette_opaque:4209:6669771,6639123:barquette_opaque:4209:6644425,6665718:barquette_opaque:4209:6666652,6668655:barquette_opaque:4209:6669243,6706262:barquette_opaque:4209:6706891,6708643:barquette_opaque:4209:6712605,6719441:barquette_opaque:4209:6719637,6719951:barquette_opaque:4209:6720391,6720202:barquette_opaque:4209:6720629,6721827:barquette_opaque:4209:6722154,6744086:barquette_opaque:4209:6744912,6762224:barquette_opaque:4209:6762879,6774283:barquette_opaque:4209:6775287,6834821:barquette_opaque:4209:6835808,6840554:barquette_opaque:4209:6841133,6842390:barquette_opaque:4209:6842925,6845438:barquette_opaque:4209:6846016,6852117:barquette_opaque:4209:6852775,6852533:barquette_opaque:4209:6853230'}, {'unwanted_material': 'carton', 'main_material': 'aluminium', 'pht_type': 4205, 'ratio': 0.01022994561299725, 'nb_photo': 16, 'list_port_cont': '6625532,6880743,6880786', 'assoc_port': '6625304:6625532,6880715:6880786,6880716:6880743', 'assoc_mat': '6625304:carton:4205:6625532,6880715:carton:4205:6880786,6880716:carton:4205:6880743'}, {'unwanted_material': 'carton', 'main_material': 'emr', 'pht_type': 4207, 'ratio': 0.9683717828305286, 'nb_photo': 2565, 'list_port_cont': '6860769,6860801,6860841,6860928,6860987,6861035,6861210,6861405,6861437,6861808,6861831,6861929,6862023,6862130,6862206,6862328,6862365,6862540,6862581,6862649,6862984,6863819,6864050,6866304,6866467,6866495,6866955,6867660,6867837,6867907,6868220,6868254,6868280,6868378,6868398,6868623,6868676,6868731,6868887,6868963,6869104,6869323,6869395,6869455,6869560,6876859,6876893,6876912,6876948,6877006,6877054,6877103,6877189,6877551,6877616,6877676,6877710,6877780,6877820,6877867,6877909,6877915,6877971,6877996,6878027,6881699,6884486,6886468,6886876,6887990,6888294,6889466,6891082,6891177,6891354,6894196,6894492,6895946,6896156,6897897,6898092,6898471,6898488,6900295,6900456,6904480,6904513,6905153,6905998,6906484,6907056,6908162,6908516,6908935,6909121,6914618,6915177,6915209,6915268,6916694,6917250,6917397,6920809,6922717,6925589', 'assoc_port': '6790886:6864050,6790887:6862540,6794193:6862130,6832752:6877915,6832753:6877867,6833565:6878027,6834821:6877996,6834822:6877971,6836050:6877780,6838973:6877676,6838974:6877616,6840554:6877710,6842390:6877820,6845438:6869395,6846972:6869560,6846973:6869455,6848417:6869323,6849526:6868887,6851003:6868676,6852117:6868731,6852533:6869104,6852534:6868963,6853215:6861405,6853569:6861437,6853919:6868623,6855642:6860801,6859123:6861831,6860530:6861210,6860531:6861035,6860532:6860987,6860535:6860928,6860537:6860841,6860538:6860769,6861512:6868220,6861514:6868280,6861516:6868254,6861517:6868378,6861519:6862581,6861520:6862649,6861522:6861808,6861523:6862328,6861524:6862206,6861525:6861929,6861635:6862365,6861636:6862023,6862501:6862984,6863220:6863819,6864848:6867907,6864850:6867837,6864851:6867660,6864853:6866955,6864855:6866495,6865738:6866304,6865739:6866467,6868332:6868398,6876683:6877189,6876684:6876912,6876685:6877006,6876686:6877054,6876687:6877103,6876688:6876893,6876689:6876948,6876691:6876859,6877478:6877909,', 'assoc_mat': '6790886:carton:4207:6864050,6790887:carton:4207:6862540,6794193:carton:4207:6862130,6832752:carton:4207:6877915,6832753:carton:4207:6877867,6833565:carton:4207:6878027,6834821:carton:4207:6877996,6834822:carton:4207:6877971,6836050:carton:4207:6877780,6838973:carton:4207:6877676,6838974:carton:4207:6877616,6840554:carton:4207:6877710,6842390:carton:4207:6877820,6845438:carton:4207:6869395,6846972:carton:4207:6869560,6846973:carton:4207:6869455,6848417:carton:4207:6869323,6849526:carton:4207:6868887,6851003:carton:4207:6868676,6852117:carton:4207:6868731,6852533:carton:4207:6869104,6852534:carton:4207:6868963,6853215:carton:4207:6861405,6853569:carton:4207:6861437,6853919:carton:4207:6868623,6855642:carton:4207:6860801,6859123:carton:4207:6861831,6860530:carton:4207:6861210,6860531:carton:4207:6861035,6860532:carton:4207:6860987,6860535:carton:4207:6860928,6860537:carton:4207:6860841,6860538:carton:4207:6860769,6861512:carton:4207:6868220,6861514:carton:4207:6868280,6861516:carton:4207:6868254,6861517:carton:4'}, {'unwanted_material': 'carton', 'main_material': 'emr', 'pht_type': 4209, 'ratio': 0.007834080277437061, 'nb_photo': 1462, 'list_port_cont': '6613099,6614127,6614585,6615525,6616029,6626453,6627860,6628395,6628840,6629152,6629205,6629281,6635304,6635369,6635432,6639702,6640661,6641608,6642551,6644436,6646356,6647438,6648160,6648884,6654375,6655819,6657180,6658370,6659145,6659232,6660891,6661075,6664557,6664640,6664706,6664802,6664929,6665234,6666043,6666077,6666648,6666765,6666944,6668004,6668673,6668922,6669250,6669483,6669559,6669701,6669786,6669812,6670114,6671149,6671463,6671574,6671847,6672297,6674151,6674264,6674794,6676772,6678452,6681186,6683438,6683967,6700222,6702222,6704712,6706887,6708974,6709414,6709569,6710040,6710776,6711299,6712611,6716502,6718348,6718717,6718883,6719281,6719649,6719891,6720389,6720622,6722163,6722585,6722885,6723449,6723510,6744917,6745245,6746407,6748615,6748946,6749029,6758826,6760253,6760547,6761445,6761998,6762877,6774108,6774613,6775298,6776475,6776981,6813192,6834126,6834362,6834696,6835803,6836102,6837017,6839291,6839592,6841138,6842928,6846019,6847495,6847556,6849259,6850419,6851368,6852770,6853216,6853519,', 'assoc_port': '6612572:6613099,6613636:6614127,6614336:6614585,6614890:6615525,6614891:6616029,6625827:6626453,6627447:6627860,6627801:6628395,6627802:6629281,6628455:6628840,6628735:6629152,6628736:6629205,6630577:6664557,6630578:6664706,6630579:6664640,6630580:6664929,6630581:6665234,6630822:6666077,6630823:6666043,6631154:6668004,6631384:6668673,6631385:6668922,6631618:6669786,6631619:6669812,6631901:6670114,6632901:6671149,6632902:6671463,6633542:6635432,6633543:6635304,6633544:6671847,6633545:6635369,6633546:6672297,6635651:6661075,6635653:6660891,6639123:6644436,6639124:6639702,6639695:6642551,6640066:6640661,6640928:6641608,6645791:6646356,6646682:6647438,6647202:6648160,6648217:6648884,6652800:6654375,6655088:6655819,6656505:6657180,6656506:6658370,6657819:6659145,6659025:6659232,6663042:6664802,6665067:6666944,6665718:6666648,6665719:6666765,6668654:6669701,6668655:6669250,6668656:6669483,6668657:6669559,6670886:6671574,6671756:6676772,6673385:6674151,6673850:6674264,6674357:6674794,6678032:6678452,6680947:6681186,', 'assoc_mat': '6612572:carton:4209:6613099,6613636:carton:4209:6614127,6614336:carton:4209:6614585,6614890:carton:4209:6615525,6614891:carton:4209:6616029,6625827:carton:4209:6626453,6627447:carton:4209:6627860,6627801:carton:4209:6628395,6627802:carton:4209:6629281,6628455:carton:4209:6628840,6628735:carton:4209:6629152,6628736:carton:4209:6629205,6630577:carton:4209:6664557,6630578:carton:4209:6664706,6630579:carton:4209:6664640,6630580:carton:4209:6664929,6630581:carton:4209:6665234,6630822:carton:4209:6666077,6630823:carton:4209:6666043,6631154:carton:4209:6668004,6631384:carton:4209:6668673,6631385:carton:4209:6668922,6631618:carton:4209:6669786,6631619:carton:4209:6669812,6631901:carton:4209:6670114,6632901:carton:4209:6671149,6632902:carton:4209:6671463,6633542:carton:4209:6635432,6633543:carton:4209:6635304,6633544:carton:4209:6671847,6633545:carton:4209:6635369,6633546:carton:4209:6672297,6635651:carton:4209:6661075,6635653:carton:4209:6660891,6639123:carton:4209:6644436,6639124:carton:4209:6639702,6639695:carton:4'}, {'unwanted_material': 'carton', 'main_material': 'gm', 'pht_type': 4209, 'ratio': 0.0029313403454804565, 'nb_photo': 10, 'list_port_cont': '6861174,6862613,6886392,6902824,6905431,6920955', 'assoc_port': '6860533:6861174,6861515:6862613,6886257:6886392,6900676:6902824,6905103:6905431,6920015:6920955', 'assoc_mat': '6860533:carton:4209:6861174,6861515:carton:4209:6862613,6886257:carton:4209:6886392,6900676:carton:4209:6902824,6905103:carton:4209:6905431,6920015:carton:4209:6920955'}, {'unwanted_material': 'carton', 'main_material': 'pet_fonce', 'pht_type': 4200, 'ratio': 0.005861756255830517, 'nb_photo': 4, 'list_port_cont': '6647696', 'assoc_port': '6647200:6647696', 'assoc_mat': '6647200:carton:4200:6647696'}, {'unwanted_material': 'ela', 'main_material': 'emr', 'pht_type': 4207, 'ratio': 0.0001359155180754883, 'nb_photo': 1, 'list_port_cont': '6877603', 'assoc_port': '6838974:6877603', 'assoc_mat': '6838974:ela:4207:6877603'}, {'unwanted_material': 'ela', 'main_material': 'emr', 'pht_type': 4209, 'ratio': 5.6302219709875656e-05, 'nb_photo': 3, 'list_port_cont': '6635371,6644435,6657178', 'assoc_port': '6633545:6635371,6639123:6644435,6656505:6657178', 'assoc_mat': '6633545:ela:4209:6635371,6639123:ela:4209:6644435,6656505:ela:4209:6657178'}, {'unwanted_material': 'etiquette', 'main_material': 'emr', 'pht_type': 4207, 'ratio': 0.0004908205603477037, 'nb_photo': 82, 'list_port_cont': '6860802,6860985,6861441,6861842,6861919,6862212,6862342,6862370,6862544,6862643,6868221,6868633,6868729,6869099,6869322,6869388,6869458,6876887,6877052,6877109,6877190,6877547,6877688,6877715,6877814,6877918,6877964,6877998,6878028,6886871,6891088,6891171,6896147,6900293,6900464,6904479,6907053,6908947,6909124,6915211,6915265,6916685,6917252,6920804,6922718', 'assoc_port': '6790887:6862544,6832752:6877918,6833565:6878028,6834821:6877998,6834822:6877964,6838973:6877688,6840554:6877715,6842390:6877814,6845438:6869388,6846973:6869458,6848417:6869322,6852117:6868729,6852533:6869099,6853569:6861441,6853919:6868633,6855642:6860802,6859123:6861842,6860532:6860985,6861512:6868221,6861520:6862643,6861523:6862342,6861524:6862212,6861525:6861919,6861635:6862370,6876683:6877190,6876686:6877052,6876687:6877109,6876688:6876887,6877480:6877547,6886258:6886871,6889185:6891088,6891024:6891171,6895749:6896147,6899246:6900464,6899248:6900293,6900677:6909124,6900678:6908947,6903712:6904479,6906036:6907053,6914258:6915211,6914260:6916685,6914751:6915265,6917033:6917252,6920014:6920804,6921897:6922718', 'assoc_mat': '6790887:etiquette:4207:6862544,6832752:etiquette:4207:6877918,6833565:etiquette:4207:6878028,6834821:etiquette:4207:6877998,6834822:etiquette:4207:6877964,6838973:etiquette:4207:6877688,6840554:etiquette:4207:6877715,6842390:etiquette:4207:6877814,6845438:etiquette:4207:6869388,6846973:etiquette:4207:6869458,6848417:etiquette:4207:6869322,6852117:etiquette:4207:6868729,6852533:etiquette:4207:6869099,6853569:etiquette:4207:6861441,6853919:etiquette:4207:6868633,6855642:etiquette:4207:6860802,6859123:etiquette:4207:6861842,6860532:etiquette:4207:6860985,6861512:etiquette:4207:6868221,6861520:etiquette:4207:6862643,6861523:etiquette:4207:6862342,6861524:etiquette:4207:6862212,6861525:etiquette:4207:6861919,6861635:etiquette:4207:6862370,6876683:etiquette:4207:6877190,6876686:etiquette:4207:6877052,6876687:etiquette:4207:6877109,6876688:etiquette:4207:6876887,6877480:etiquette:4207:6877547,6886258:etiquette:4207:6886871,6889185:etiquette:4207:6891088,6891024:etiquette:4207:6891171,6895749:etiquette:4207:6896147,6'}, {'unwanted_material': 'etiquette', 'main_material': 'emr', 'pht_type': 4209, 'ratio': 0.0008238173967106119, 'nb_photo': 1049, 'list_port_cont': '6613101,6614126,6614587,6616038,6626458,6627864,6628397,6628838,6629141,6629204,6629280,6635302,6635366,6635430,6640667,6641598,6642545,6644428,6646362,6647450,6648167,6648890,6654367,6655834,6657182,6658372,6659142,6659220,6660894,6661081,6664553,6664638,6664707,6664807,6664938,6665231,6666055,6666086,6666643,6666770,6666946,6668001,6668670,6668913,6669257,6669490,6669555,6669702,6669778,6669808,6670117,6671148,6671464,6671561,6671836,6672301,6674153,6674271,6674799,6676771,6678460,6681184,6683436,6683981,6700231,6702226,6704721,6706890,6708962,6709416,6709579,6710035,6710785,6711300,6712603,6716517,6718720,6718877,6719278,6719639,6719881,6720398,6720627,6722161,6722583,6722896,6723446,6723519,6744916,6745258,6746410,6748605,6748955,6749037,6760261,6760532,6761442,6762007,6774112,6774618,6775290,6776483,6776974,6813185,6834132,6834363,6834703,6835800,6836101,6837027,6839290,6839587,6841136,6842924,6846017,6847494,6847557,6849269,6850421,6852780,6853222,6853521,6853980,6854357,6855828,6859399', 'assoc_port': '6612572:6613101,6613636:6614126,6614336:6614587,6614891:6616038,6625827:6626458,6627447:6627864,6627801:6628397,6627802:6629280,6628455:6628838,6628735:6629141,6628736:6629204,6630577:6664553,6630578:6664707,6630579:6664638,6630580:6664938,6630581:6665231,6630822:6666086,6630823:6666055,6631154:6668001,6631384:6668670,6631385:6668913,6631618:6669778,6631619:6669808,6631901:6670117,6632901:6671148,6632902:6671464,6633542:6635430,6633543:6635302,6633544:6671836,6633545:6635366,6633546:6672301,6635651:6661081,6635653:6660894,6639123:6644428,6639695:6642545,6640066:6640667,6640928:6641598,6645791:6646362,6646682:6647450,6647202:6648167,6648217:6648890,6652800:6654367,6655088:6655834,6656505:6657182,6656506:6658372,6657819:6659142,6659025:6659220,6663042:6664807,6665067:6666946,6665718:6666643,6665719:6666770,6668654:6669702,6668655:6669257,6668656:6669490,6668657:6669555,6670886:6671561,6671756:6676771,6673385:6674153,6673850:6674271,6674357:6674799,6678032:6678460,6680947:6681184,6682633:6683436,6683289:6683981,', 'assoc_mat': '6612572:etiquette:4209:6613101,6613636:etiquette:4209:6614126,6614336:etiquette:4209:6614587,6614891:etiquette:4209:6616038,6625827:etiquette:4209:6626458,6627447:etiquette:4209:6627864,6627801:etiquette:4209:6628397,6627802:etiquette:4209:6629280,6628455:etiquette:4209:6628838,6628735:etiquette:4209:6629141,6628736:etiquette:4209:6629204,6630577:etiquette:4209:6664553,6630578:etiquette:4209:6664707,6630579:etiquette:4209:6664638,6630580:etiquette:4209:6664938,6630581:etiquette:4209:6665231,6630822:etiquette:4209:6666086,6630823:etiquette:4209:6666055,6631154:etiquette:4209:6668001,6631384:etiquette:4209:6668670,6631385:etiquette:4209:6668913,6631618:etiquette:4209:6669778,6631619:etiquette:4209:6669808,6631901:etiquette:4209:6670117,6632901:etiquette:4209:6671148,6632902:etiquette:4209:6671464,6633542:etiquette:4209:6635430,6633543:etiquette:4209:6635302,6633544:etiquette:4209:6671836,6633545:etiquette:4209:6635366,6633546:etiquette:4209:6672301,6635651:etiquette:4209:6661081,6635653:etiquette:4209:6660894,6'}, {'unwanted_material': 'etiquette', 'main_material': 'gm', 'pht_type': 4209, 'ratio': 0.0007589310876444754, 'nb_photo': 16, 'list_port_cont': '6860869,6861178,6861533,6862611,6863435,6876769,6889758,6894819,6902814,6920942', 'assoc_port': '6860533:6861178,6860536:6860869,6861163:6861533,6861515:6862611,6863221:6863435,6876690:6876769,6889188:6889758,6894658:6894819,6900676:6902814,6920015:6920942', 'assoc_mat': '6860533:etiquette:4209:6861178,6860536:etiquette:4209:6860869,6861163:etiquette:4209:6861533,6861515:etiquette:4209:6862611,6863221:etiquette:4209:6863435,6876690:etiquette:4209:6876769,6889188:etiquette:4209:6889758,6894658:etiquette:4209:6894819,6900676:etiquette:4209:6902814,6920015:etiquette:4209:6920942'}, {'unwanted_material': 'etiquette', 'main_material': 'pet_fonce', 'pht_type': 4200, 'ratio': 0.0010885671487047438, 'nb_photo': 5, 'list_port_cont': '6647706', 'assoc_port': '6647200:6647706', 'assoc_mat': '6647200:etiquette:4200:6647706'}, {'unwanted_material': 'film_plastique', 'main_material': 'emr', 'pht_type': 4207, 'ratio': 0.00029682028164317286, 'nb_photo': 8, 'list_port_cont': '6862648,6866460,6877060,6877718,6877925,6922720,6925580', 'assoc_port': '6832752:6877925,6840554:6877718,6861520:6862648,6865739:6866460,6876686:6877060,6921897:6922720,6925484:6925580', 'assoc_mat': '6832752:film_plastique:4207:6877925,6840554:film_plastique:4207:6877718,6861520:film_plastique:4207:6862648,6865739:film_plastique:4207:6866460,6876686:film_plastique:4207:6877060,6921897:film_plastique:4207:6922720,6925484:film_plastique:4207:6925580'}, {'unwanted_material': 'film_plastique', 'main_material': 'emr', 'pht_type': 4209, 'ratio': 9.746706181821035e-05, 'nb_photo': 9, 'list_port_cont': '6614124,6644434,6702223,6711304,6712598,6744913,6834700', 'assoc_port': '6613636:6614124,6639123:6644434,6701501:6702223,6708643:6712598,6708644:6711304,6744086:6744913,6832752:6834700', 'assoc_mat': '6613636:film_plastique:4209:6614124,6639123:film_plastique:4209:6644434,6701501:film_plastique:4209:6702223,6708643:film_plastique:4209:6712598,6708644:film_plastique:4209:6711304,6744086:film_plastique:4209:6744913,6832752:film_plastique:4209:6834700'}, {'unwanted_material': 'kraft', 'main_material': 'emr', 'pht_type': 4207, 'ratio': 0.0011039430628874177, 'nb_photo': 1, 'list_port_cont': '6917403', 'assoc_port': '6917034:6917403', 'assoc_mat': '6917034:kraft:4207:6917403'}, {'unwanted_material': 'metal', 'main_material': 'aluminium', 'pht_type': 4205, 'ratio': 0.9896715615394742, 'nb_photo': 54, 'list_port_cont': '6625531,6661187,6880740,6880777,6881860,6918649', 'assoc_port': '6625304:6625531,6632479:6661187,6880715:6880777,6880716:6880740,6881491:6881860,6887696:6918649', 'assoc_mat': '6625304:metal:4205:6625531,6632479:metal:4205:6661187,6880715:metal:4205:6880777,6880716:metal:4205:6880740,6881491:metal:4205:6881860,6887696:metal:4205:6918649'}, {'unwanted_material': 'metal', 'main_material': 'emr', 'pht_type': 4207, 'ratio': 0.002857356890964171, 'nb_photo': 188, 'list_port_cont': '6860922,6860979,6861033,6861211,6861400,6861433,6861833,6862030,6862128,6862210,6862338,6862362,6862534,6862572,6862638,6863807,6864053,6866290,6866466,6866498,6866956,6867841,6867914,6868223,6868261,6868374,6868621,6868667,6868732,6869091,6869331,6869392,6869468,6869545,6876850,6876885,6876957,6877055,6877099,6877198,6877539,6877618,6877678,6877719,6877785,6877818,6877877,6877912,6877928,6877966,6878004,6878040,6884491,6886881,6887977,6888302,6894497,6895947,6896159,6897898,6898087,6898465,6898489,6900299,6900468,6904477,6905148,6905987,6907057,6908937,6909122,6915222,6915272,6916692,6917256,6920805,6925583', 'assoc_port': '6790886:6864053,6790887:6862534,6794193:6862128,6832752:6877928,6832753:6877877,6833565:6878040,6834821:6878004,6834822:6877966,6836050:6877785,6838973:6877678,6838974:6877618,6840554:6877719,6842390:6877818,6845438:6869392,6846972:6869545,6846973:6869468,6848417:6869331,6851003:6868667,6852117:6868732,6852533:6869091,6853215:6861400,6853569:6861433,6853919:6868621,6859123:6861833,6860530:6861211,6860531:6861033,6860532:6860979,6860535:6860922,6861512:6868223,6861516:6868261,6861517:6868374,6861519:6862572,6861520:6862638,6861523:6862338,6861524:6862210,6861635:6862362,6861636:6862030,6863220:6863807,6864848:6867914,6864850:6867841,6864853:6866956,6864855:6866498,6865738:6866290,6865739:6866466,6876683:6877198,6876686:6877055,6876687:6877099,6876688:6876885,6876689:6876957,6876691:6876850,6877478:6877912,6877480:6877539,6884290:6884491,6886258:6886881,6887695:6888302,6887732:6887977,6894095:6894497,6895749:6896159,6895752:6895947,6897575:6898087,6897576:6897898,6898175:6898489,6898176:6898465,6899246:6900468,', 'assoc_mat': '6790886:metal:4207:6864053,6790887:metal:4207:6862534,6794193:metal:4207:6862128,6832752:metal:4207:6877928,6832753:metal:4207:6877877,6833565:metal:4207:6878040,6834821:metal:4207:6878004,6834822:metal:4207:6877966,6836050:metal:4207:6877785,6838973:metal:4207:6877678,6838974:metal:4207:6877618,6840554:metal:4207:6877719,6842390:metal:4207:6877818,6845438:metal:4207:6869392,6846972:metal:4207:6869545,6846973:metal:4207:6869468,6848417:metal:4207:6869331,6851003:metal:4207:6868667,6852117:metal:4207:6868732,6852533:metal:4207:6869091,6853215:metal:4207:6861400,6853569:metal:4207:6861433,6853919:metal:4207:6868621,6859123:metal:4207:6861833,6860530:metal:4207:6861211,6860531:metal:4207:6861033,6860532:metal:4207:6860979,6860535:metal:4207:6860922,6861512:metal:4207:6868223,6861516:metal:4207:6868261,6861517:metal:4207:6868374,6861519:metal:4207:6862572,6861520:metal:4207:6862638,6861523:metal:4207:6862338,6861524:metal:4207:6862210,6861635:metal:4207:6862362,6861636:metal:4207:6862030,6863220:metal:4207:686380'}, {'unwanted_material': 'metal', 'main_material': 'emr', 'pht_type': 4209, 'ratio': 0.026017127541676587, 'nb_photo': 787, 'list_port_cont': '6613097,6614121,6615521,6616026,6626451,6627868,6628403,6628835,6629153,6629208,6629277,6635307,6635359,6635433,6639705,6640666,6641594,6642552,6644427,6647437,6648164,6648886,6654370,6655828,6657169,6658371,6659139,6660892,6661087,6664549,6664633,6664701,6664796,6664935,6665224,6666046,6666081,6666646,6666766,6666945,6667992,6668663,6668912,6669249,6669482,6669546,6669703,6669773,6669806,6670109,6671159,6671466,6671576,6672296,6674155,6674267,6674795,6676776,6678453,6681189,6683437,6683972,6700233,6702218,6704725,6706893,6708961,6709417,6709566,6710044,6710774,6711296,6712599,6716510,6718358,6718713,6718870,6719287,6719648,6720401,6720631,6722162,6722586,6722893,6723437,6723512,6744909,6745246,6746419,6748619,6748941,6749034,6758839,6760267,6760542,6761443,6762005,6774106,6774607,6775285,6776482,6776987,6813179,6834120,6834369,6834695,6835802,6836110,6837026,6839593,6841134,6846021,6847508,6847568,6849264,6850424,6851374,6852778,6853219,6853526,6854348,6855834,6859395', 'assoc_port': '6612572:6613097,6613636:6614121,6614890:6615521,6614891:6616026,6625827:6626451,6627447:6627868,6627801:6628403,6627802:6629277,6628455:6628835,6628735:6629153,6628736:6629208,6630577:6664549,6630578:6664701,6630579:6664633,6630580:6664935,6630581:6665224,6630822:6666081,6630823:6666046,6631154:6667992,6631384:6668663,6631385:6668912,6631618:6669773,6631619:6669806,6631901:6670109,6632901:6671159,6632902:6671466,6633542:6635433,6633543:6635307,6633545:6635359,6633546:6672296,6635651:6661087,6635653:6660892,6639123:6644427,6639124:6639705,6639695:6642552,6640066:6640666,6640928:6641594,6646682:6647437,6647202:6648164,6648217:6648886,6652800:6654370,6655088:6655828,6656505:6657169,6656506:6658371,6657819:6659139,6663042:6664796,6665067:6666945,6665718:6666646,6665719:6666766,6668654:6669703,6668655:6669249,6668656:6669482,6668657:6669546,6670886:6671576,6671756:6676776,6673385:6674155,6673850:6674267,6674357:6674795,6678032:6678453,6680947:6681189,6682633:6683437,6683289:6683972,6699726:6700233,6700555:6704725,', 'assoc_mat': '6612572:metal:4209:6613097,6613636:metal:4209:6614121,6614890:metal:4209:6615521,6614891:metal:4209:6616026,6625827:metal:4209:6626451,6627447:metal:4209:6627868,6627801:metal:4209:6628403,6627802:metal:4209:6629277,6628455:metal:4209:6628835,6628735:metal:4209:6629153,6628736:metal:4209:6629208,6630577:metal:4209:6664549,6630578:metal:4209:6664701,6630579:metal:4209:6664633,6630580:metal:4209:6664935,6630581:metal:4209:6665224,6630822:metal:4209:6666081,6630823:metal:4209:6666046,6631154:metal:4209:6667992,6631384:metal:4209:6668663,6631385:metal:4209:6668912,6631618:metal:4209:6669773,6631619:metal:4209:6669806,6631901:metal:4209:6670109,6632901:metal:4209:6671159,6632902:metal:4209:6671466,6633542:metal:4209:6635433,6633543:metal:4209:6635307,6633545:metal:4209:6635359,6633546:metal:4209:6672296,6635651:metal:4209:6661087,6635653:metal:4209:6660892,6639123:metal:4209:6644427,6639124:metal:4209:6639705,6639695:metal:4209:6642552,6640066:metal:4209:6640666,6640928:metal:4209:6641594,6646682:metal:4209:664743'}, {'unwanted_material': 'metal', 'main_material': 'gm', 'pht_type': 4209, 'ratio': 0.03426755560145856, 'nb_photo': 14, 'list_port_cont': '6861172,6863427,6863597,6865059,6876772,6881616,6889760,6902821,6920943', 'assoc_port': '6860533:6861172,6863219:6863597,6863221:6863427,6864849:6865059,6876690:6876772,6881493:6881616,6889188:6889760,6900676:6902821,6920015:6920943', 'assoc_mat': '6860533:metal:4209:6861172,6863219:metal:4209:6863597,6863221:metal:4209:6863427,6864849:metal:4209:6865059,6876690:metal:4209:6876772,6881493:metal:4209:6881616,6889188:metal:4209:6889760,6900676:metal:4209:6902821,6920015:metal:4209:6920943'}, {'unwanted_material': 'papier', 'main_material': 'aluminium', 'pht_type': 4205, 'ratio': 0.0013353682339268438, 'nb_photo': 9, 'list_port_cont': '6625537,6880784', 'assoc_port': '6625304:6625537,6880715:6880784', 'assoc_mat': '6625304:papier:4205:6625537,6880715:papier:4205:6880784'}, {'unwanted_material': 'papier', 'main_material': 'emr', 'pht_type': 4207, 'ratio': 0.030078019576209876, 'nb_photo': 6564, 'list_port_cont': '6860765,6860809,6860834,6860929,6860974,6861044,6861206,6861412,6861434,6861798,6861840,6861924,6862024,6862135,6862201,6862331,6862374,6862545,6862582,6862651,6862990,6863820,6864046,6866293,6866465,6866499,6866949,6867662,6867830,6867915,6868217,6868247,6868293,6868379,6868403,6868626,6868668,6868733,6868889,6868970,6869094,6869326,6869384,6869464,6869555,6876860,6876889,6876921,6876951,6877008,6877057,6877102,6877186,6877542,6877605,6877685,6877711,6877787,6877810,6877872,6877908,6877920,6877963,6878007,6878032,6881693,6884489,6886474,6886878,6887983,6888296,6889465,6891084,6891165,6891355,6894204,6894504,6895937,6896154,6897893,6898095,6898457,6898491,6900292,6900467,6904483,6904508,6905154,6905995,6906491,6907050,6908161,6908519,6908941,6909123,6914622,6915183,6915210,6915259,6916693,6917258,6917398,6920814,6922713,6925594', 'assoc_port': '6790886:6864046,6790887:6862545,6794193:6862135,6832752:6877920,6832753:6877872,6833565:6878032,6834821:6878007,6834822:6877963,6836050:6877787,6838973:6877685,6838974:6877605,6840554:6877711,6842390:6877810,6845438:6869384,6846972:6869555,6846973:6869464,6848417:6869326,6849526:6868889,6851003:6868668,6852117:6868733,6852533:6869094,6852534:6868970,6853215:6861412,6853569:6861434,6853919:6868626,6855642:6860809,6859123:6861840,6860530:6861206,6860531:6861044,6860532:6860974,6860535:6860929,6860537:6860834,6860538:6860765,6861512:6868217,6861514:6868293,6861516:6868247,6861517:6868379,6861519:6862582,6861520:6862651,6861522:6861798,6861523:6862331,6861524:6862201,6861525:6861924,6861635:6862374,6861636:6862024,6862501:6862990,6863220:6863820,6864848:6867915,6864850:6867830,6864851:6867662,6864853:6866949,6864855:6866499,6865738:6866293,6865739:6866465,6868332:6868403,6876683:6877186,6876684:6876921,6876685:6877008,6876686:6877057,6876687:6877102,6876688:6876889,6876689:6876951,6876691:6876860,6877478:6877908,', 'assoc_mat': '6790886:papier:4207:6864046,6790887:papier:4207:6862545,6794193:papier:4207:6862135,6832752:papier:4207:6877920,6832753:papier:4207:6877872,6833565:papier:4207:6878032,6834821:papier:4207:6878007,6834822:papier:4207:6877963,6836050:papier:4207:6877787,6838973:papier:4207:6877685,6838974:papier:4207:6877605,6840554:papier:4207:6877711,6842390:papier:4207:6877810,6845438:papier:4207:6869384,6846972:papier:4207:6869555,6846973:papier:4207:6869464,6848417:papier:4207:6869326,6849526:papier:4207:6868889,6851003:papier:4207:6868668,6852117:papier:4207:6868733,6852533:papier:4207:6869094,6852534:papier:4207:6868970,6853215:papier:4207:6861412,6853569:papier:4207:6861434,6853919:papier:4207:6868626,6855642:papier:4207:6860809,6859123:papier:4207:6861840,6860530:papier:4207:6861206,6860531:papier:4207:6861044,6860532:papier:4207:6860974,6860535:papier:4207:6860929,6860537:papier:4207:6860834,6860538:papier:4207:6860765,6861512:papier:4207:6868217,6861514:papier:4207:6868293,6861516:papier:4207:6868247,6861517:papier:4'}, {'unwanted_material': 'papier', 'main_material': 'emr', 'pht_type': 4209, 'ratio': 0.9686131104416358, 'nb_photo': 148871, 'list_port_cont': '6613100,6614114,6614594,6615529,6616034,6626462,6627859,6628399,6628843,6629142,6629212,6629275,6635305,6635363,6635424,6639712,6640665,6641601,6642549,6644429,6646359,6647443,6648156,6648888,6654374,6655830,6657171,6658366,6659151,6659226,6660896,6661088,6664555,6664630,6664696,6664799,6664931,6665226,6666045,6666080,6666650,6666767,6666948,6667998,6668669,6668911,6669246,6669487,6669556,6669704,6669775,6669818,6670116,6671162,6671475,6671569,6671851,6672303,6674157,6674272,6674793,6676777,6678463,6681194,6683426,6683976,6700220,6702213,6704717,6706880,6708963,6709412,6709561,6710050,6710787,6711302,6712597,6716513,6718354,6718721,6718876,6719283,6719641,6719885,6720392,6720623,6722156,6722577,6722881,6723438,6723515,6744914,6745255,6746412,6748609,6748948,6749033,6758834,6760258,6760534,6761446,6762006,6762872,6774101,6774621,6775292,6776474,6776980,6813189,6834129,6834360,6834694,6835804,6836115,6837019,6839283,6839590,6841139,6842937,6846030,6847507,6847554,6849265,6850417,6851367,6852769,6853226,6853512,', 'assoc_port': '6612572:6613100,6613636:6614114,6614336:6614594,6614890:6615529,6614891:6616034,6625827:6626462,6627447:6627859,6627801:6628399,6627802:6629275,6628455:6628843,6628735:6629142,6628736:6629212,6630577:6664555,6630578:6664696,6630579:6664630,6630580:6664931,6630581:6665226,6630822:6666080,6630823:6666045,6631154:6667998,6631384:6668669,6631385:6668911,6631618:6669775,6631619:6669818,6631901:6670116,6632901:6671162,6632902:6671475,6633542:6635424,6633543:6635305,6633544:6671851,6633545:6635363,6633546:6672303,6635651:6661088,6635653:6660896,6639123:6644429,6639124:6639712,6639695:6642549,6640066:6640665,6640928:6641601,6645791:6646359,6646682:6647443,6647202:6648156,6648217:6648888,6652800:6654374,6655088:6655830,6656505:6657171,6656506:6658366,6657819:6659151,6659025:6659226,6663042:6664799,6665067:6666948,6665718:6666650,6665719:6666767,6668654:6669704,6668655:6669246,6668656:6669487,6668657:6669556,6670886:6671569,6671756:6676777,6673385:6674157,6673850:6674272,6674357:6674793,6678032:6678463,6680947:6681194,', 'assoc_mat': '6612572:papier:4209:6613100,6613636:papier:4209:6614114,6614336:papier:4209:6614594,6614890:papier:4209:6615529,6614891:papier:4209:6616034,6625827:papier:4209:6626462,6627447:papier:4209:6627859,6627801:papier:4209:6628399,6627802:papier:4209:6629275,6628455:papier:4209:6628843,6628735:papier:4209:6629142,6628736:papier:4209:6629212,6630577:papier:4209:6664555,6630578:papier:4209:6664696,6630579:papier:4209:6664630,6630580:papier:4209:6664931,6630581:papier:4209:6665226,6630822:papier:4209:6666080,6630823:papier:4209:6666045,6631154:papier:4209:6667998,6631384:papier:4209:6668669,6631385:papier:4209:6668911,6631618:papier:4209:6669775,6631619:papier:4209:6669818,6631901:papier:4209:6670116,6632901:papier:4209:6671162,6632902:papier:4209:6671475,6633542:papier:4209:6635424,6633543:papier:4209:6635305,6633544:papier:4209:6671851,6633545:papier:4209:6635363,6633546:papier:4209:6672303,6635651:papier:4209:6661088,6635653:papier:4209:6660896,6639123:papier:4209:6644429,6639124:papier:4209:6639712,6639695:papier:4'}, {'unwanted_material': 'papier', 'main_material': 'gm', 'pht_type': 4209, 'ratio': 0.9902901831097267, 'nb_photo': 2955, 'list_port_cont': '6860598,6860874,6861066,6861173,6861345,6861539,6861959,6862604,6863422,6863593,6864917,6865058,6866086,6866174,6876761,6877571,6877655,6877751,6881620,6886395,6888025,6889756,6894811,6902822,6905423,6907081,6909151,6920947', 'assoc_port': '6860529:6861066,6860533:6861173,6860534:6860598,6860536:6860874,6861163:6861539,6861164:6861345,6861513:6861959,6861515:6862604,6863219:6863593,6863221:6863422,6864847:6866174,6864849:6865058,6864854:6864917,6865737:6866086,6876690:6876761,6877477:6877751,6877481:6877655,6877482:6877571,6881493:6881620,6886257:6886395,6887731:6888025,6889188:6889756,6894658:6894811,6899249:6909151,6900676:6902822,6903711:6907081,6905103:6905423,6920015:6920947', 'assoc_mat': '6860529:papier:4209:6861066,6860533:papier:4209:6861173,6860534:papier:4209:6860598,6860536:papier:4209:6860874,6861163:papier:4209:6861539,6861164:papier:4209:6861345,6861513:papier:4209:6861959,6861515:papier:4209:6862604,6863219:papier:4209:6863593,6863221:papier:4209:6863422,6864847:papier:4209:6866174,6864849:papier:4209:6865058,6864854:papier:4209:6864917,6865737:papier:4209:6866086,6876690:papier:4209:6876761,6877477:papier:4209:6877751,6877481:papier:4209:6877655,6877482:papier:4209:6877571,6881493:papier:4209:6881620,6886257:papier:4209:6886395,6887731:papier:4209:6888025,6889188:papier:4209:6889756,6894658:papier:4209:6894811,6899249:papier:4209:6909151,6900676:papier:4209:6902822,6903711:papier:4209:6907081,6905103:papier:4209:6905423,6920015:papier:4209:6920947'}, {'unwanted_material': 'papier', 'main_material': 'pet_fonce', 'pht_type': 4200, 'ratio': 0.010245453120925422, 'nb_photo': 31, 'list_port_cont': '6647707,6861711', 'assoc_port': '6647200:6647707,6861521:6861711', 'assoc_mat': '6647200:papier:4200:6647707,6861521:papier:4200:6861711'}, {'unwanted_material': 'pehd', 'main_material': 'emr', 'pht_type': 4209, 'ratio': 2.520265649788176e-05, 'nb_photo': 2, 'list_port_cont': '6678458', 'assoc_port': '6678032:6678458', 'assoc_mat': '6678032:pehd:4209:6678458'}, {'unwanted_material': 'pet_clair', 'main_material': 'emr', 'pht_type': 4207, 'ratio': 0.0009691335779369147, 'nb_photo': 50, 'list_port_cont': '6862208,6862361,6862535,6862580,6862650,6867917,6868229,6868248,6868281,6868376,6868672,6869102,6869324,6869466,6869550,6877011,6877046,6877191,6877677,6877777,6877812,6877923,6877993,6878035,6886875,6888290,6891353,6896153,6898498,6904509,6907044,6917257,6922719,6925591', 'assoc_port': '6790887:6862535,6832752:6877923,6833565:6878035,6834821:6877993,6836050:6877777,6838973:6877677,6842390:6877812,6846972:6869550,6846973:6869466,6848417:6869324,6851003:6868672,6852533:6869102,6861512:6868229,6861514:6868281,6861516:6868248,6861517:6868376,6861519:6862580,6861520:6862650,6861524:6862208,6861635:6862361,6864848:6867917,6876683:6877191,6876685:6877011,6876686:6877046,6886258:6886875,6887695:6888290,6889190:6891353,6895749:6896153,6898175:6898498,6904057:6904509,6906036:6907044,6917033:6917257,6921897:6922719,6925484:6925591', 'assoc_mat': '6790887:pet_clair:4207:6862535,6832752:pet_clair:4207:6877923,6833565:pet_clair:4207:6878035,6834821:pet_clair:4207:6877993,6836050:pet_clair:4207:6877777,6838973:pet_clair:4207:6877677,6842390:pet_clair:4207:6877812,6846972:pet_clair:4207:6869550,6846973:pet_clair:4207:6869466,6848417:pet_clair:4207:6869324,6851003:pet_clair:4207:6868672,6852533:pet_clair:4207:6869102,6861512:pet_clair:4207:6868229,6861514:pet_clair:4207:6868281,6861516:pet_clair:4207:6868248,6861517:pet_clair:4207:6868376,6861519:pet_clair:4207:6862580,6861520:pet_clair:4207:6862650,6861524:pet_clair:4207:6862208,6861635:pet_clair:4207:6862361,6864848:pet_clair:4207:6867917,6876683:pet_clair:4207:6877191,6876685:pet_clair:4207:6877011,6876686:pet_clair:4207:6877046,6886258:pet_clair:4207:6886875,6887695:pet_clair:4207:6888290,6889190:pet_clair:4207:6891353,6895749:pet_clair:4207:6896153,6898175:pet_clair:4207:6898498,6904057:pet_clair:4207:6904509,6906036:pet_clair:4207:6907044,6917033:pet_clair:4207:6917257,6921897:pet_clair:4207:6922719,6'}, {'unwanted_material': 'pet_clair', 'main_material': 'emr', 'pht_type': 4209, 'ratio': 0.00038788845724592604, 'nb_photo': 52, 'list_port_cont': '6613103,6648162,6655833,6657176,6658378,6660889,6666083,6666651,6666947,6668915,6669550,6669705,6669777,6671157,6700228,6704711,6706879,6709548,6712610,6720621,6722887,6723439,6744920,6748621,6748942,6761453,6774102,6776478,6837016,6841130,6846026,6853934', 'assoc_port': '6612572:6613103,6630822:6666083,6631385:6668915,6631618:6669777,6632901:6671157,6635653:6660889,6647202:6648162,6655088:6655833,6656505:6657176,6656506:6658378,6665067:6666947,6665718:6666651,6668654:6669705,6668657:6669550,6699726:6700228,6700555:6704711,6706262:6706879,6707499:6709548,6708643:6712610,6720202:6720621,6722573:6722887,6723094:6723439,6744086:6744920,6747584:6748621,6748313:6748942,6761126:6761453,6773386:6774102,6776077:6776478,6836050:6837016,6840554:6841130,6845438:6846026,6852534:6853934', 'assoc_mat': '6612572:pet_clair:4209:6613103,6630822:pet_clair:4209:6666083,6631385:pet_clair:4209:6668915,6631618:pet_clair:4209:6669777,6632901:pet_clair:4209:6671157,6635653:pet_clair:4209:6660889,6647202:pet_clair:4209:6648162,6655088:pet_clair:4209:6655833,6656505:pet_clair:4209:6657176,6656506:pet_clair:4209:6658378,6665067:pet_clair:4209:6666947,6665718:pet_clair:4209:6666651,6668654:pet_clair:4209:6669705,6668657:pet_clair:4209:6669550,6699726:pet_clair:4209:6700228,6700555:pet_clair:4209:6704711,6706262:pet_clair:4209:6706879,6707499:pet_clair:4209:6709548,6708643:pet_clair:4209:6712610,6720202:pet_clair:4209:6720621,6722573:pet_clair:4209:6722887,6723094:pet_clair:4209:6723439,6744086:pet_clair:4209:6744920,6747584:pet_clair:4209:6748621,6748313:pet_clair:4209:6748942,6761126:pet_clair:4209:6761453,6773386:pet_clair:4209:6774102,6776077:pet_clair:4209:6776478,6836050:pet_clair:4209:6837016,6840554:pet_clair:4209:6841130,6845438:pet_clair:4209:6846026,6852534:pet_clair:4209:6853934'}, {'unwanted_material': 'pet_clair', 'main_material': 'gm', 'pht_type': 4209, 'ratio': 0.00042088720046359597, 'nb_photo': 1, 'list_port_cont': '6862605', 'assoc_port': '6861515:6862605', 'assoc_mat': '6861515:pet_clair:4209:6862605'}, {'unwanted_material': 'pet_fonce', 'main_material': 'emr', 'pht_type': 4207, 'ratio': 0.0008578698895049885, 'nb_photo': 28, 'list_port_cont': '6860798,6861839,6862207,6868256,6868671,6869549,6877674,6877708,6877816,6877879,6878008,6886869,6888301,6889467,6898496,6904520,6915175,6922716', 'assoc_port': '6832753:6877879,6834821:6878008,6838973:6877674,6840554:6877708,6842390:6877816,6846972:6869549,6851003:6868671,6855642:6860798,6859123:6861839,6861516:6868256,6861524:6862207,6886258:6886869,6887695:6888301,6887698:6889467,6898175:6898496,6904057:6904520,6914259:6915175,6921897:6922716', 'assoc_mat': '6832753:pet_fonce:4207:6877879,6834821:pet_fonce:4207:6878008,6838973:pet_fonce:4207:6877674,6840554:pet_fonce:4207:6877708,6842390:pet_fonce:4207:6877816,6846972:pet_fonce:4207:6869549,6851003:pet_fonce:4207:6868671,6855642:pet_fonce:4207:6860798,6859123:pet_fonce:4207:6861839,6861516:pet_fonce:4207:6868256,6861524:pet_fonce:4207:6862207,6886258:pet_fonce:4207:6886869,6887695:pet_fonce:4207:6888301,6887698:pet_fonce:4207:6889467,6898175:pet_fonce:4207:6898496,6904057:pet_fonce:4207:6904520,6914259:pet_fonce:4207:6915175,6921897:pet_fonce:4207:6922716'}, {'unwanted_material': 'pet_fonce', 'main_material': 'emr', 'pht_type': 4209, 'ratio': 0.002001176734086916, 'nb_photo': 165, 'list_port_cont': '6613106,6614596,6626457,6628830,6629210,6635370,6641607,6642548,6644426,6646347,6647448,6648893,6654377,6659140,6659225,6660883,6661079,6664546,6664700,6665227,6666079,6666644,6666756,6666950,6668662,6669252,6669485,6669785,6671575,6674270,6678461,6683425,6683978,6702227,6704714,6706892,6708972,6709423,6709577,6711293,6712608,6718881,6719276,6719647,6720634,6722892,6723506,6744910,6748597,6762003,6774109,6776983,6841135,6842934,6847565,6859391', 'assoc_port': '6612572:6613106,6614336:6614596,6625827:6626457,6628455:6628830,6628736:6629210,6630577:6664546,6630578:6664700,6630581:6665227,6630822:6666079,6631384:6668662,6631618:6669785,6633545:6635370,6635651:6661079,6635653:6660883,6639123:6644426,6639695:6642548,6640928:6641607,6645791:6646347,6646682:6647448,6648217:6648893,6652800:6654377,6657819:6659140,6659025:6659225,6665067:6666950,6665718:6666644,6665719:6666756,6668655:6669252,6668656:6669485,6670886:6671575,6673850:6674270,6678032:6678461,6682633:6683425,6683289:6683978,6700555:6704714,6701501:6702227,6706262:6706892,6706760:6709423,6707163:6708972,6707499:6709577,6708643:6712608,6708644:6711293,6718520:6719276,6718521:6718881,6719441:6719647,6720202:6720634,6722573:6722892,6723192:6723506,6744086:6744910,6747584:6748597,6759349:6762003,6773386:6774109,6775574:6776983,6840554:6841135,6842390:6842934,6846972:6847565,6859123:6859391', 'assoc_mat': '6612572:pet_fonce:4209:6613106,6614336:pet_fonce:4209:6614596,6625827:pet_fonce:4209:6626457,6628455:pet_fonce:4209:6628830,6628736:pet_fonce:4209:6629210,6630577:pet_fonce:4209:6664546,6630578:pet_fonce:4209:6664700,6630581:pet_fonce:4209:6665227,6630822:pet_fonce:4209:6666079,6631384:pet_fonce:4209:6668662,6631618:pet_fonce:4209:6669785,6633545:pet_fonce:4209:6635370,6635651:pet_fonce:4209:6661079,6635653:pet_fonce:4209:6660883,6639123:pet_fonce:4209:6644426,6639695:pet_fonce:4209:6642548,6640928:pet_fonce:4209:6641607,6645791:pet_fonce:4209:6646347,6646682:pet_fonce:4209:6647448,6648217:pet_fonce:4209:6648893,6652800:pet_fonce:4209:6654377,6657819:pet_fonce:4209:6659140,6659025:pet_fonce:4209:6659225,6665067:pet_fonce:4209:6666950,6665718:pet_fonce:4209:6666644,6665719:pet_fonce:4209:6666756,6668655:pet_fonce:4209:6669252,6668656:pet_fonce:4209:6669485,6670886:pet_fonce:4209:6671575,6673850:pet_fonce:4209:6674270,6678032:pet_fonce:4209:6678461,6682633:pet_fonce:4209:6683425,6683289:pet_fonce:4209:6683978,6'}, {'unwanted_material': 'pet_fonce', 'main_material': 'gm', 'pht_type': 4209, 'ratio': 0.0009882492230258019, 'nb_photo': 2, 'list_port_cont': '6894805', 'assoc_port': '6894658:6894805', 'assoc_mat': '6894658:pet_fonce:4209:6894805'}, {'unwanted_material': 'pet_fonce', 'main_material': 'pet_fonce', 'pht_type': 4200, 'ratio': 0.9832720072705387, 'nb_photo': 21, 'list_port_cont': '6647700,6861697', 'assoc_port': '6647200:6647700,6861521:6861697', 'assoc_mat': '6647200:pet_fonce:4200:6647700,6861521:pet_fonce:4200:6861697'}, {'unwanted_material': 'pet_opaque', 'main_material': 'emr', 'pht_type': 4207, 'ratio': 0.0006428090611349251, 'nb_photo': 9, 'list_port_cont': '6866496,6868369,6869096,6869546,6878036,6904487,6905142,6905991,6922715', 'assoc_port': '6833565:6878036,6846972:6869546,6852533:6869096,6861517:6868369,6864855:6866496,6903710:6905991,6903712:6904487,6905102:6905142,6921897:6922715', 'assoc_mat': '6833565:pet_opaque:4207:6878036,6846972:pet_opaque:4207:6869546,6852533:pet_opaque:4207:6869096,6861517:pet_opaque:4207:6868369,6864855:pet_opaque:4207:6866496,6903710:pet_opaque:4207:6905991,6903712:pet_opaque:4207:6904487,6905102:pet_opaque:4207:6905142,6921897:pet_opaque:4207:6922715'}, {'unwanted_material': 'pet_opaque', 'main_material': 'emr', 'pht_type': 4209, 'ratio': 0.0005744915736568625, 'nb_photo': 214, 'list_port_cont': '6613105,6614118,6616031,6627858,6628408,6628839,6629216,6629282,6635308,6635367,6639706,6640660,6641595,6644422,6647441,6655823,6657172,6658373,6659149,6660897,6661077,6664543,6664634,6664804,6664940,6665229,6666078,6666656,6666757,6666952,6667994,6668664,6668914,6669254,6669547,6669695,6669784,6669814,6670110,6671566,6671848,6672292,6674152,6676774,6678456,6681180,6683428,6683979,6700223,6704719,6706884,6709575,6711305,6712607,6718352,6718715,6719280,6719890,6720396,6722151,6722589,6722891,6723435,6744915,6748617,6748952,6749035,6760254,6761440,6774110,6776978,6813183,6834135,6834365,6834702,6835809,6839582,6841141,6842938,6853225,6853523,6859402', 'assoc_port': '6612572:6613105,6613636:6614118,6614891:6616031,6627447:6627858,6627801:6628408,6627802:6629282,6628455:6628839,6628736:6629216,6630577:6664543,6630579:6664634,6630580:6664940,6630581:6665229,6630822:6666078,6631154:6667994,6631384:6668664,6631385:6668914,6631618:6669784,6631619:6669814,6631901:6670110,6633543:6635308,6633544:6671848,6633545:6635367,6633546:6672292,6635651:6661077,6635653:6660897,6639123:6644422,6639124:6639706,6640066:6640660,6640928:6641595,6646682:6647441,6655088:6655823,6656505:6657172,6656506:6658373,6657819:6659149,6663042:6664804,6665067:6666952,6665718:6666656,6665719:6666757,6668654:6669695,6668655:6669254,6668657:6669547,6670886:6671566,6671756:6676774,6673385:6674152,6678032:6678456,6680947:6681180,6682633:6683428,6683289:6683979,6699726:6700223,6700555:6704719,6706262:6706884,6707499:6709575,6708643:6712607,6708644:6711305,6715973:6718352,6716500:6718715,6717201:6719890,6718520:6719280,6719951:6720396,6721826:6722589,6721827:6722151,6722573:6722891,6723094:6723435,6744086:6744915,', 'assoc_mat': '6612572:pet_opaque:4209:6613105,6613636:pet_opaque:4209:6614118,6614891:pet_opaque:4209:6616031,6627447:pet_opaque:4209:6627858,6627801:pet_opaque:4209:6628408,6627802:pet_opaque:4209:6629282,6628455:pet_opaque:4209:6628839,6628736:pet_opaque:4209:6629216,6630577:pet_opaque:4209:6664543,6630579:pet_opaque:4209:6664634,6630580:pet_opaque:4209:6664940,6630581:pet_opaque:4209:6665229,6630822:pet_opaque:4209:6666078,6631154:pet_opaque:4209:6667994,6631384:pet_opaque:4209:6668664,6631385:pet_opaque:4209:6668914,6631618:pet_opaque:4209:6669784,6631619:pet_opaque:4209:6669814,6631901:pet_opaque:4209:6670110,6633543:pet_opaque:4209:6635308,6633544:pet_opaque:4209:6671848,6633545:pet_opaque:4209:6635367,6633546:pet_opaque:4209:6672292,6635651:pet_opaque:4209:6661077,6635653:pet_opaque:4209:6660897,6639123:pet_opaque:4209:6644422,6639124:pet_opaque:4209:6639706,6640066:pet_opaque:4209:6640660,6640928:pet_opaque:4209:6641595,6646682:pet_opaque:4209:6647441,6655088:pet_opaque:4209:6655823,6656505:pet_opaque:4209:6657172,'}), 'main_stat': {'nb_photos': 8000}}, 'hostname': (('jetson-2',),), 'impurety_average_per_hashtag': [(('emr', '2022-08', 0.03139712425437559),), (('jrm', '2022-08', 0.00838254816722681),), (('aluminium', '2022-08', 0.006832126052700646),), (('pet_fonce', '2022-08', 0.012910461966287217),), (('gm', '2022-08', 0.009116560536537937),)]} VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3981 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3981 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3981 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3981 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! {"input_values":[]} SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3994 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3994 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3994 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3994 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11488 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11496 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11497 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11492 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11492 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11495 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11495 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11489 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11489 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11575 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11575 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11491 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11490 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11490 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11498 send_mail_cod have less outputs used (0) than in the step definition (1) : some outputs may be not used ! Step 11499 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11491 doesn't seem to be define in the database( WARNING : type of input 3 of step 11490 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11488 doesn't seem to be define in the database( WARNING : type of input 2 of step 11492 doesn't seem to be define in the database( WARNING : output 1 of step 11488 have datatype=2 whereas input 1 of step 11495 have datatype=7 WARNING : type of output 2 of step 11495 doesn't seem to be define in the database( WARNING : type of input 1 of step 11489 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11491 have datatype=10 whereas input 3 of step 11498 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11575 doesn't seem to be define in the database( WARNING : output 1 of step 11489 have datatype=7 whereas input 2 of step 11575 have datatype=None WARNING : type of output 3 of step 11575 doesn't seem to be define in the database( WARNING : type of input 1 of step 11491 doesn't seem to be define in the database( WARNING : output 0 of step 11491 have datatype=10 whereas input 0 of step 11581 have datatype=18 WARNING : type of input 5 of step 11498 doesn't seem to be define in the database( WARNING : output 0 of step 11581 have datatype=11 whereas input 5 of step 11498 have datatype=None WARNING : type of output 1 of step 11496 doesn't seem to be define in the database( WARNING : type of input 3 of step 11492 doesn't seem to be define in the database( WARNING : type of output 1 of step 11497 doesn't seem to be define in the database( WARNING : type of input 3 of step 11492 doesn't seem to be define in the database( WARNING : output 0 of step 11495 have datatype=1 whereas input 0 of step 11489 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4209, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,metal,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'papier,background', 'hashtag_weights': {'barquette_opaque': 0.7, 'carton': 0.7, 'ela': 0.7, 'etiquette': 0.5, 'film_plastique': 0.5, 'kraft': 0.7, 'metal': 1.5, 'pehd': 0.7, 'pet_clair': 0.7, 'pet_opaque': 0.7, 'textiles_sanitaires': 0.5, 'pet_fonce': 0.7}, 'ETA': 600} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3993 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3993 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3993 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3993 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4207, 'hashtag_proportion': 'barquette_opaque,ela,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'carton,background', 'hashtag_weights': {'barquette_opaque': 1, 'ela': 1, 'etiquette': 1.0, 'film_plastique': 0.5, 'kraft': 1, 'metal': 3.0, 'papier': 1, 'pehd': 2, 'pet_clair': 2, 'pet_opaque': 2, 'textiles_sanitaires': 1.0, 'pet_fonce': 2}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3459 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3459 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3459 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3459 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3726, 'hashtag_proportion': 'Carton_brun,Carton_gris,Teint_Dans_La_Masse,autre_refus,cartonnette,kraft,metal,plastique', 'hashtag_parmi': 'papier,background', 'hashtag_weights': {'Carton_brun': 1.5, 'Carton_gris': 1.5, 'Teint_Dans_La_Masse': 1.0, 'autre_refus': 1.5, 'cartonnette': 1.0, 'kraft': 1.5, 'metal': 3, 'plastique': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3991 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3991 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3991 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3991 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11512 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11521 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11520 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11516 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11516 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11519 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11519 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11513 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11513 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11577 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11577 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11515 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11514 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11514 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11523 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11515 doesn't seem to be define in the database( WARNING : type of input 3 of step 11514 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11512 doesn't seem to be define in the database( WARNING : type of input 2 of step 11516 doesn't seem to be define in the database( WARNING : output 1 of step 11512 have datatype=2 whereas input 1 of step 11519 have datatype=7 WARNING : type of output 2 of step 11519 doesn't seem to be define in the database( WARNING : type of input 1 of step 11513 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11515 have datatype=10 whereas input 3 of step 11522 have datatype=6 WARNING : type of input 2 of step 11577 doesn't seem to be define in the database( WARNING : output 1 of step 11513 have datatype=7 whereas input 2 of step 11577 have datatype=None WARNING : type of output 3 of step 11577 doesn't seem to be define in the database( WARNING : type of input 1 of step 11515 doesn't seem to be define in the database( WARNING : output 0 of step 11515 have datatype=10 whereas input 0 of step 11583 have datatype=18 WARNING : type of input 5 of step 11522 doesn't seem to be define in the database( WARNING : output 0 of step 11583 have datatype=11 whereas input 5 of step 11522 have datatype=None WARNING : type of output 1 of step 11521 doesn't seem to be define in the database( WARNING : type of input 3 of step 11516 doesn't seem to be define in the database( WARNING : type of output 1 of step 11520 doesn't seem to be define in the database( WARNING : type of input 3 of step 11516 doesn't seem to be define in the database( WARNING : output 0 of step 11519 have datatype=1 whereas input 0 of step 11513 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4203, 'hashtag_proportion': 'barquette_opaque,carton,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'ela,background', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 1, 'etiquette': 0.5, 'film_plastique': 0.5, 'kraft': 0.8, 'metal': 2, 'papier': 0.8, 'pehd': 0.8, 'pet_clair': 0.8, 'pet_opaque': 0.8, 'textiles_sanitaires': 0.5, 'pet_fonce': 0.8}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3995 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3995 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3995 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3995 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11524 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11533 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11532 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11528 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11528 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11531 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11531 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11525 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11525 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11578 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11578 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11527 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11526 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11526 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11535 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11527 doesn't seem to be define in the database( WARNING : type of input 3 of step 11526 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11524 doesn't seem to be define in the database( WARNING : type of input 2 of step 11528 doesn't seem to be define in the database( WARNING : output 1 of step 11524 have datatype=2 whereas input 1 of step 11531 have datatype=7 WARNING : type of output 2 of step 11531 doesn't seem to be define in the database( WARNING : type of input 1 of step 11525 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11527 have datatype=10 whereas input 3 of step 11534 have datatype=6 WARNING : type of input 2 of step 11578 doesn't seem to be define in the database( WARNING : output 1 of step 11525 have datatype=7 whereas input 2 of step 11578 have datatype=None WARNING : type of output 3 of step 11578 doesn't seem to be define in the database( WARNING : type of input 1 of step 11527 doesn't seem to be define in the database( WARNING : output 0 of step 11527 have datatype=10 whereas input 0 of step 11584 have datatype=18 WARNING : type of input 5 of step 11534 doesn't seem to be define in the database( WARNING : output 0 of step 11584 have datatype=11 whereas input 5 of step 11534 have datatype=None WARNING : type of output 1 of step 11533 doesn't seem to be define in the database( WARNING : type of input 3 of step 11528 doesn't seem to be define in the database( WARNING : type of output 1 of step 11532 doesn't seem to be define in the database( WARNING : type of input 3 of step 11528 doesn't seem to be define in the database( WARNING : output 0 of step 11531 have datatype=1 whereas input 0 of step 11525 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4211, 'hashtag_proportion': 'barquette_opaque,carton,ela,film_plastique,kraft,metal,papier,pet_fonce,pet_clair,pet_opaque,textiles_sanitaires', 'hashtag_parmi': 'pehd,etiquette,background', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 0.3, 'ela': 0.3, 'etiquette': 0.1, 'film_plastique': 0.1, 'kraft': 0.3, 'metal': 1.5, 'papier': 0.3, 'pet_clair': 0.3, 'pet_opaque': 0.3, 'textiles_sanitaires': 0.3, 'pet_fonce': 0.3, 'background': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4153 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4153 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4153 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4153 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11548 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11556 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11557 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11552 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11552 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11555 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11555 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11580 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11580 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11551 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11550 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11550 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11559 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11551 doesn't seem to be define in the database( WARNING : type of input 3 of step 11550 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11548 doesn't seem to be define in the database( WARNING : type of input 2 of step 11552 doesn't seem to be define in the database( WARNING : output 1 of step 11548 have datatype=2 whereas input 1 of step 11555 have datatype=7 WARNING : type of output 2 of step 11555 doesn't seem to be define in the database( WARNING : type of input 1 of step 11549 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11551 have datatype=10 whereas input 3 of step 11558 have datatype=6 WARNING : type of input 2 of step 11580 doesn't seem to be define in the database( WARNING : output 1 of step 11549 have datatype=7 whereas input 2 of step 11580 have datatype=None WARNING : type of output 3 of step 11580 doesn't seem to be define in the database( WARNING : type of input 1 of step 11551 doesn't seem to be define in the database( WARNING : output 0 of step 11551 have datatype=10 whereas input 0 of step 11586 have datatype=18 WARNING : type of input 5 of step 11558 doesn't seem to be define in the database( WARNING : output 0 of step 11586 have datatype=11 whereas input 5 of step 11558 have datatype=None WARNING : type of output 1 of step 11556 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : type of output 1 of step 11557 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : output 0 of step 11555 have datatype=1 whereas input 0 of step 11549 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4200, 'hashtag_proportion': 'carton,ela,film_plastique,kraft,metal,papier,pehd,pet_opaque,textiles_sanitaires,barquette_opaque,pet_clair', 'hashtag_parmi': 'pet_fonce,etiquette,background', 'hashtag_weights': {'barquette_opaque': 1.5, 'carton': 2.5, 'ela': 1.5, 'etiquette': 1.5, 'film_plastique': 1, 'kraft': 1.5, 'metal': 3.0, 'papier': 1.2, 'pehd': 1.5, 'pet_clair': 1.5, 'pet_opaque': 1.5, 'textiles_sanitaires': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3992 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3992 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3992 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3992 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11536 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11545 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11544 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11540 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11540 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11543 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11543 merge_mask_thcl_custom have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 11537 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11579 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11579 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11539 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11538 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11538 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11547 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11539 doesn't seem to be define in the database( WARNING : type of input 3 of step 11538 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11536 doesn't seem to be define in the database( WARNING : type of input 2 of step 11540 doesn't seem to be define in the database( WARNING : output 1 of step 11536 have datatype=2 whereas input 1 of step 11543 have datatype=7 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11539 have datatype=10 whereas input 3 of step 11546 have datatype=6 WARNING : type of input 2 of step 11579 doesn't seem to be define in the database( WARNING : output 1 of step 11537 have datatype=7 whereas input 2 of step 11579 have datatype=None WARNING : type of output 3 of step 11579 doesn't seem to be define in the database( WARNING : type of input 1 of step 11539 doesn't seem to be define in the database( WARNING : output 0 of step 11539 have datatype=10 whereas input 0 of step 11585 have datatype=18 WARNING : type of input 5 of step 11546 doesn't seem to be define in the database( WARNING : output 0 of step 11585 have datatype=11 whereas input 5 of step 11546 have datatype=None WARNING : type of output 1 of step 11545 doesn't seem to be define in the database( WARNING : type of input 3 of step 11540 doesn't seem to be define in the database( WARNING : type of output 1 of step 11544 doesn't seem to be define in the database( WARNING : type of input 3 of step 11540 doesn't seem to be define in the database( WARNING : output 0 of step 11543 have datatype=1 whereas input 0 of step 11537 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4205, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'metal,background', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 1.5, 'ela': 1.5, 'etiquette': 1, 'film_plastique': 1, 'kraft': 1, 'papier': 1, 'pehd': 1.5, 'pet_clair': 1.5, 'pet_opaque': 1.5, 'textiles_sanitaires': 1.5, 'pet_fonce': 1.5}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3318 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3318 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3318 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3594, 'hashtag_proportion': 'papier,carton,metal,pet_clair,autre,pehd,pet_fonce', 'hashtag_parmi': 'refus,background', 'hashtag_weights': {'papier': 1, 'carton': 1, 'metal': 1, 'pet_clair': 1, 'autre': 1, 'pehd': 1, 'pet_fonce': 1, 'refus': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3804 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3804 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3804 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3804 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11560 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11567 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11567 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11563 crop_condition is not consistent : 4 used against 2 in the step definition ! Step 11563 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11564 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11564 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11573 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11573 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11566 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11566 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 1 of step 11560 have datatype=2 whereas input 1 of step 11564 have datatype=7 WARNING : type of output 2 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11565 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11567 doesn't seem to be define in the database( WARNING : type of input 3 of step 11563 doesn't seem to be define in the database( WARNING : type of output 3 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11568 doesn't seem to be define in the database( WARNING : type of output 1 of step 11568 doesn't seem to be define in the database( WARNING : type of input 3 of step 11566 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11570 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11569 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11570 doesn't seem to be define in the database( WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11569 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11568 have datatype=10 whereas input 3 of step 11571 have datatype=6 WARNING : type of input 2 of step 11573 doesn't seem to be define in the database( WARNING : output 1 of step 11565 have datatype=7 whereas input 2 of step 11573 have datatype=None WARNING : type of output 3 of step 11573 doesn't seem to be define in the database( WARNING : type of input 3 of step 11568 doesn't seem to be define in the database( WARNING : output 0 of step 11568 have datatype=10 whereas input 0 of step 11587 have datatype=18 WARNING : type of input 5 of step 11571 doesn't seem to be define in the database( WARNING : output 0 of step 11587 have datatype=11 whereas input 5 of step 11571 have datatype=None WARNING : output 0 of step 11564 have datatype=1 whereas input 0 of step 11565 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3327, 'hashtag_proportion': 'autre,carton,metal,papier,pehd,pet_fonce', 'hashtag_parmi': 'pet_clair,bouchon,etiquette,barquette_avec_film,background', 'hashtag_weights': {'autre': 8.0, 'barquette_avec_film': 6, 'carton': 8.0, 'metal': 12, 'papier': 5, 'pehd': 8, 'pet_fonce': 8, 'bouchon': 8, 'etiquette': 8}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier TODO : Insert select and so on SELECT id, name, misc_info, datou_id_for_right FROM MTRPhoto.dashboard_places WHERE name="Romainville_Presse_2"; SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3981 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3981 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3981 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3981 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! {"input_values":[]} SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3994 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3994 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3994 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3994 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11488 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11496 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11497 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11492 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11492 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11495 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11495 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11489 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11489 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11575 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11575 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11491 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11490 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11490 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11498 send_mail_cod have less outputs used (0) than in the step definition (1) : some outputs may be not used ! Step 11499 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11491 doesn't seem to be define in the database( WARNING : type of input 3 of step 11490 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11488 doesn't seem to be define in the database( WARNING : type of input 2 of step 11492 doesn't seem to be define in the database( WARNING : output 1 of step 11488 have datatype=2 whereas input 1 of step 11495 have datatype=7 WARNING : type of output 2 of step 11495 doesn't seem to be define in the database( WARNING : type of input 1 of step 11489 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11491 have datatype=10 whereas input 3 of step 11498 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11575 doesn't seem to be define in the database( WARNING : output 1 of step 11489 have datatype=7 whereas input 2 of step 11575 have datatype=None WARNING : type of output 3 of step 11575 doesn't seem to be define in the database( WARNING : type of input 1 of step 11491 doesn't seem to be define in the database( WARNING : output 0 of step 11491 have datatype=10 whereas input 0 of step 11581 have datatype=18 WARNING : type of input 5 of step 11498 doesn't seem to be define in the database( WARNING : output 0 of step 11581 have datatype=11 whereas input 5 of step 11498 have datatype=None WARNING : type of output 1 of step 11496 doesn't seem to be define in the database( WARNING : type of input 3 of step 11492 doesn't seem to be define in the database( WARNING : type of output 1 of step 11497 doesn't seem to be define in the database( WARNING : type of input 3 of step 11492 doesn't seem to be define in the database( WARNING : output 0 of step 11495 have datatype=1 whereas input 0 of step 11489 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4209, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,metal,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'papier,background', 'hashtag_weights': {'barquette_opaque': 0.7, 'carton': 0.7, 'ela': 0.7, 'etiquette': 0.5, 'film_plastique': 0.5, 'kraft': 0.7, 'metal': 1.5, 'pehd': 0.7, 'pet_clair': 0.7, 'pet_opaque': 0.7, 'textiles_sanitaires': 0.5, 'pet_fonce': 0.7}, 'ETA': 600} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3993 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3993 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3993 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3993 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4207, 'hashtag_proportion': 'barquette_opaque,ela,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'carton,background', 'hashtag_weights': {'barquette_opaque': 1, 'ela': 1, 'etiquette': 1.0, 'film_plastique': 0.5, 'kraft': 1, 'metal': 3.0, 'papier': 1, 'pehd': 2, 'pet_clair': 2, 'pet_opaque': 2, 'textiles_sanitaires': 1.0, 'pet_fonce': 2}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3459 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3459 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3459 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3459 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3726, 'hashtag_proportion': 'Carton_brun,Carton_gris,Teint_Dans_La_Masse,autre_refus,cartonnette,kraft,metal,plastique', 'hashtag_parmi': 'papier,background', 'hashtag_weights': {'Carton_brun': 1.5, 'Carton_gris': 1.5, 'Teint_Dans_La_Masse': 1.0, 'autre_refus': 1.5, 'cartonnette': 1.0, 'kraft': 1.5, 'metal': 3, 'plastique': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3991 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3991 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3991 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3991 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11512 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11521 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11520 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11516 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11516 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11519 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11519 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11513 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11513 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11577 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11577 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11515 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11514 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11514 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11523 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11515 doesn't seem to be define in the database( WARNING : type of input 3 of step 11514 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11512 doesn't seem to be define in the database( WARNING : type of input 2 of step 11516 doesn't seem to be define in the database( WARNING : output 1 of step 11512 have datatype=2 whereas input 1 of step 11519 have datatype=7 WARNING : type of output 2 of step 11519 doesn't seem to be define in the database( WARNING : type of input 1 of step 11513 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11515 have datatype=10 whereas input 3 of step 11522 have datatype=6 WARNING : type of input 2 of step 11577 doesn't seem to be define in the database( WARNING : output 1 of step 11513 have datatype=7 whereas input 2 of step 11577 have datatype=None WARNING : type of output 3 of step 11577 doesn't seem to be define in the database( WARNING : type of input 1 of step 11515 doesn't seem to be define in the database( WARNING : output 0 of step 11515 have datatype=10 whereas input 0 of step 11583 have datatype=18 WARNING : type of input 5 of step 11522 doesn't seem to be define in the database( WARNING : output 0 of step 11583 have datatype=11 whereas input 5 of step 11522 have datatype=None WARNING : type of output 1 of step 11521 doesn't seem to be define in the database( WARNING : type of input 3 of step 11516 doesn't seem to be define in the database( WARNING : type of output 1 of step 11520 doesn't seem to be define in the database( WARNING : type of input 3 of step 11516 doesn't seem to be define in the database( WARNING : output 0 of step 11519 have datatype=1 whereas input 0 of step 11513 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4203, 'hashtag_proportion': 'barquette_opaque,carton,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'ela,background', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 1, 'etiquette': 0.5, 'film_plastique': 0.5, 'kraft': 0.8, 'metal': 2, 'papier': 0.8, 'pehd': 0.8, 'pet_clair': 0.8, 'pet_opaque': 0.8, 'textiles_sanitaires': 0.5, 'pet_fonce': 0.8}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3995 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3995 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3995 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3995 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11524 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11533 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11532 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11528 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11528 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11531 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11531 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11525 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11525 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11578 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11578 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11527 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11526 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11526 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11535 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11527 doesn't seem to be define in the database( WARNING : type of input 3 of step 11526 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11524 doesn't seem to be define in the database( WARNING : type of input 2 of step 11528 doesn't seem to be define in the database( WARNING : output 1 of step 11524 have datatype=2 whereas input 1 of step 11531 have datatype=7 WARNING : type of output 2 of step 11531 doesn't seem to be define in the database( WARNING : type of input 1 of step 11525 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11527 have datatype=10 whereas input 3 of step 11534 have datatype=6 WARNING : type of input 2 of step 11578 doesn't seem to be define in the database( WARNING : output 1 of step 11525 have datatype=7 whereas input 2 of step 11578 have datatype=None WARNING : type of output 3 of step 11578 doesn't seem to be define in the database( WARNING : type of input 1 of step 11527 doesn't seem to be define in the database( WARNING : output 0 of step 11527 have datatype=10 whereas input 0 of step 11584 have datatype=18 WARNING : type of input 5 of step 11534 doesn't seem to be define in the database( WARNING : output 0 of step 11584 have datatype=11 whereas input 5 of step 11534 have datatype=None WARNING : type of output 1 of step 11533 doesn't seem to be define in the database( WARNING : type of input 3 of step 11528 doesn't seem to be define in the database( WARNING : type of output 1 of step 11532 doesn't seem to be define in the database( WARNING : type of input 3 of step 11528 doesn't seem to be define in the database( WARNING : output 0 of step 11531 have datatype=1 whereas input 0 of step 11525 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4211, 'hashtag_proportion': 'barquette_opaque,carton,ela,film_plastique,kraft,metal,papier,pet_fonce,pet_clair,pet_opaque,textiles_sanitaires', 'hashtag_parmi': 'pehd,etiquette,background', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 0.3, 'ela': 0.3, 'etiquette': 0.1, 'film_plastique': 0.1, 'kraft': 0.3, 'metal': 1.5, 'papier': 0.3, 'pet_clair': 0.3, 'pet_opaque': 0.3, 'textiles_sanitaires': 0.3, 'pet_fonce': 0.3, 'background': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4153 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4153 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4153 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4153 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11548 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11556 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11557 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11552 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11552 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11555 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11555 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11580 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11580 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11551 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11550 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11550 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11559 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11551 doesn't seem to be define in the database( WARNING : type of input 3 of step 11550 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11548 doesn't seem to be define in the database( WARNING : type of input 2 of step 11552 doesn't seem to be define in the database( WARNING : output 1 of step 11548 have datatype=2 whereas input 1 of step 11555 have datatype=7 WARNING : type of output 2 of step 11555 doesn't seem to be define in the database( WARNING : type of input 1 of step 11549 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11551 have datatype=10 whereas input 3 of step 11558 have datatype=6 WARNING : type of input 2 of step 11580 doesn't seem to be define in the database( WARNING : output 1 of step 11549 have datatype=7 whereas input 2 of step 11580 have datatype=None WARNING : type of output 3 of step 11580 doesn't seem to be define in the database( WARNING : type of input 1 of step 11551 doesn't seem to be define in the database( WARNING : output 0 of step 11551 have datatype=10 whereas input 0 of step 11586 have datatype=18 WARNING : type of input 5 of step 11558 doesn't seem to be define in the database( WARNING : output 0 of step 11586 have datatype=11 whereas input 5 of step 11558 have datatype=None WARNING : type of output 1 of step 11556 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : type of output 1 of step 11557 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : output 0 of step 11555 have datatype=1 whereas input 0 of step 11549 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4200, 'hashtag_proportion': 'carton,ela,film_plastique,kraft,metal,papier,pehd,pet_opaque,textiles_sanitaires,barquette_opaque,pet_clair', 'hashtag_parmi': 'pet_fonce,etiquette,background', 'hashtag_weights': {'barquette_opaque': 1.5, 'carton': 2.5, 'ela': 1.5, 'etiquette': 1.5, 'film_plastique': 1, 'kraft': 1.5, 'metal': 3.0, 'papier': 1.2, 'pehd': 1.5, 'pet_clair': 1.5, 'pet_opaque': 1.5, 'textiles_sanitaires': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3992 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3992 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3992 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3992 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11536 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11545 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11544 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11540 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11540 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11543 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11543 merge_mask_thcl_custom have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 11537 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11579 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11579 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11539 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11538 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11538 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11547 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11539 doesn't seem to be define in the database( WARNING : type of input 3 of step 11538 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11536 doesn't seem to be define in the database( WARNING : type of input 2 of step 11540 doesn't seem to be define in the database( WARNING : output 1 of step 11536 have datatype=2 whereas input 1 of step 11543 have datatype=7 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11539 have datatype=10 whereas input 3 of step 11546 have datatype=6 WARNING : type of input 2 of step 11579 doesn't seem to be define in the database( WARNING : output 1 of step 11537 have datatype=7 whereas input 2 of step 11579 have datatype=None WARNING : type of output 3 of step 11579 doesn't seem to be define in the database( WARNING : type of input 1 of step 11539 doesn't seem to be define in the database( WARNING : output 0 of step 11539 have datatype=10 whereas input 0 of step 11585 have datatype=18 WARNING : type of input 5 of step 11546 doesn't seem to be define in the database( WARNING : output 0 of step 11585 have datatype=11 whereas input 5 of step 11546 have datatype=None WARNING : type of output 1 of step 11545 doesn't seem to be define in the database( WARNING : type of input 3 of step 11540 doesn't seem to be define in the database( WARNING : type of output 1 of step 11544 doesn't seem to be define in the database( WARNING : type of input 3 of step 11540 doesn't seem to be define in the database( WARNING : output 0 of step 11543 have datatype=1 whereas input 0 of step 11537 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4205, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'metal,background', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 1.5, 'ela': 1.5, 'etiquette': 1, 'film_plastique': 1, 'kraft': 1, 'papier': 1, 'pehd': 1.5, 'pet_clair': 1.5, 'pet_opaque': 1.5, 'textiles_sanitaires': 1.5, 'pet_fonce': 1.5}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3318 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3318 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3318 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3594, 'hashtag_proportion': 'papier,carton,metal,pet_clair,autre,pehd,pet_fonce', 'hashtag_parmi': 'refus,background', 'hashtag_weights': {'papier': 1, 'carton': 1, 'metal': 1, 'pet_clair': 1, 'autre': 1, 'pehd': 1, 'pet_fonce': 1, 'refus': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3804 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3804 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3804 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3804 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11560 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11567 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11567 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11563 crop_condition is not consistent : 4 used against 2 in the step definition ! Step 11563 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11564 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11564 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11573 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11573 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11566 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11566 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 1 of step 11560 have datatype=2 whereas input 1 of step 11564 have datatype=7 WARNING : type of output 2 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11565 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11567 doesn't seem to be define in the database( WARNING : type of input 3 of step 11563 doesn't seem to be define in the database( WARNING : type of output 3 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11568 doesn't seem to be define in the database( WARNING : type of output 1 of step 11568 doesn't seem to be define in the database( WARNING : type of input 3 of step 11566 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11570 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11569 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11570 doesn't seem to be define in the database( WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11569 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11568 have datatype=10 whereas input 3 of step 11571 have datatype=6 WARNING : type of input 2 of step 11573 doesn't seem to be define in the database( WARNING : output 1 of step 11565 have datatype=7 whereas input 2 of step 11573 have datatype=None WARNING : type of output 3 of step 11573 doesn't seem to be define in the database( WARNING : type of input 3 of step 11568 doesn't seem to be define in the database( WARNING : output 0 of step 11568 have datatype=10 whereas input 0 of step 11587 have datatype=18 WARNING : type of input 5 of step 11571 doesn't seem to be define in the database( WARNING : output 0 of step 11587 have datatype=11 whereas input 5 of step 11571 have datatype=None WARNING : output 0 of step 11564 have datatype=1 whereas input 0 of step 11565 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3327, 'hashtag_proportion': 'autre,carton,metal,papier,pehd,pet_fonce', 'hashtag_parmi': 'pet_clair,bouchon,etiquette,barquette_avec_film,background', 'hashtag_weights': {'autre': 8.0, 'barquette_avec_film': 6, 'carton': 8.0, 'metal': 12, 'papier': 5, 'pehd': 8, 'pet_fonce': 8, 'bouchon': 8, 'etiquette': 8}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier {'number_of_analysed_photos': ((8000,),), 'unwanted_material_monthly_percentage': ((0.02991916097445073,),), 'material_repartition': (('emr', 5015), ('gm', 135), ('aluminium', 89), ('jrm', 45), ('pet_fonce', 28)), 'material_dict': {'emr': 5015, 'autres': 297}, 'coverage_data': (('2022/08/31/', 0.645567), ('2022/08/30/', 1.0), ('2022/08/29/', 1.0), ('2022/08/27/', 0.463906), ('2022/08/26/', 1.0), ('2022/08/25/', 0.812121), ('2022/08/24/', 1.0), ('2022/08/23/', 1.0), ('2022/08/22/', 0.486486), ('2022/08/20/', 0.473359), ('2022/08/19/', 0.441242), ('2022/08/18/', 0.836601), ('2022/08/17/', 0.898649), ('2022/08/16/', 0.581668), ('2022/08/15/', 0.604208), ('2022/08/13/', 0.905738), ('2022/08/12/', 1.0), ('2022/08/11/', 0.555556), ('2022/08/10/', 1.0), ('2022/08/09/', 1.0), ('2022/08/08/', 1.0), ('2022/08/06/', 0.45925), ('2022/08/05/', 1.0), ('2022/08/04/', 0.511261), ('2022/08/03/', 0.850806), ('2022/08/02/', 0.714286), ('2022/08/01/', 0.615778)), 'impurety_average_data': ((datetime.date(2022, 8, 2), 0.014282331762157728, 103), (datetime.date(2022, 8, 3), 0.03494206677880239, 211), (datetime.date(2022, 8, 5), 0.029420780762543012, 438), (datetime.date(2022, 8, 6), 0.04557840319999026, 54), (datetime.date(2022, 8, 8), 0.022841014228638157, 375), (datetime.date(2022, 8, 9), 0.02268268592206632, 320), (datetime.date(2022, 8, 10), 0.021294981158255618, 407), (datetime.date(2022, 8, 11), 0.022496316372650236, 115), (datetime.date(2022, 8, 12), 0.037292023387041164, 482), (datetime.date(2022, 8, 13), 0.030188267365227943, 442), (datetime.date(2022, 8, 16), 0.06353963932551064, 211), (datetime.date(2022, 8, 17), 0.055518220907447555, 133), (datetime.date(2022, 8, 18), 0.028245770796200272, 128), (datetime.date(2022, 8, 19), 0.029592761588569258, 277), (datetime.date(2022, 8, 22), 0.010668998327936066, 36), (datetime.date(2022, 8, 23), 0.02985658365132344, 351), (datetime.date(2022, 8, 24), 0.02890717923269598, 369), (datetime.date(2022, 8, 25), 0.02964405365672207, 385), (datetime.date(2022, 8, 26), 0.027188360813364603, 209), (datetime.date(2022, 8, 28), 0.014876381935804891, 33), (datetime.date(2022, 8, 29), 0.023942954543620824, 233), (datetime.date(2022, 8, 30), 0.03176500481166622, 362), (datetime.date(2022, 8, 31), 0.024400799858355637, 340)), 'impurety_average_data_per_hashtag': {'emr': ((datetime.date(2022, 8, 2), 0.014497225753743103, 90), (datetime.date(2022, 8, 3), 0.035407726190541, 201), (datetime.date(2022, 8, 5), 0.029420780762543012, 438), (datetime.date(2022, 8, 6), 0.051389769677544335, 43), (datetime.date(2022, 8, 8), 0.022841014228638157, 375), (datetime.date(2022, 8, 9), 0.022808792662868328, 304), (datetime.date(2022, 8, 10), 0.021294981158255618, 407), (datetime.date(2022, 8, 11), 0.022496316372650236, 115), (datetime.date(2022, 8, 12), 0.037292023387041164, 482), (datetime.date(2022, 8, 13), 0.030188267365227943, 442), (datetime.date(2022, 8, 16), 0.06353963932551064, 211), (datetime.date(2022, 8, 17), 0.055518220907447555, 133), (datetime.date(2022, 8, 18), 0.028245770796200272, 128), (datetime.date(2022, 8, 19), 0.03144342737311807, 238), (datetime.date(2022, 8, 22), 0.010668998327936066, 36), (datetime.date(2022, 8, 23), 0.030080632780942033, 330), (datetime.date(2022, 8, 24), 0.029230789634089597, 345), (datetime.date(2022, 8, 25), 0.029901630015503007, 357), (datetime.date(2022, 8, 26), 0.028097448563616227, 175), (datetime.date(2022, 8, 29), 0.03005524006484819, 165), (datetime.date(2022, 8, 30), 0.03263495327830263, 307), (datetime.date(2022, 8, 31), 0.02525588399363416, 301)), 'jrm': ((datetime.date(2022, 8, 2), 0.012085072487249132, 13), (datetime.date(2022, 8, 19), 0.010114825333022708, 10), (datetime.date(2022, 8, 23), 0.024498907798673017, 5), (datetime.date(2022, 8, 26), 0.0052974707656706635, 12), (datetime.date(2022, 8, 29), 0.0180872193641313, 5), (datetime.date(2022, 8, 30), 0.012309361035885383, 18), (datetime.date(2022, 8, 31), 0.0, 30)), 'aluminium': ((datetime.date(2022, 8, 3), 0.0029466085982426723, 10), (datetime.date(2022, 8, 6), 0.0, 11), (datetime.date(2022, 8, 28), 0.014876381935804891, 33), (datetime.date(2022, 8, 29), 0.0027249051959917212, 35), (datetime.date(2022, 8, 30), 0.0, 5)), 'pet_fonce': ((datetime.date(2022, 8, 9), 0.01691330253037371, 16), (datetime.date(2022, 8, 19), 0.01514668242834379, 6), (datetime.date(2022, 8, 29), 0.0, 6)), 'gm': ((datetime.date(2022, 8, 19), 0.0036688743500458555, 23), (datetime.date(2022, 8, 23), 2.7541150063779214e-07, 16), (datetime.date(2022, 8, 24), 0.009998135847154843, 24), (datetime.date(2022, 8, 25), 0.007110951820118182, 28), (datetime.date(2022, 8, 26), 0.0026635914561474365, 22), (datetime.date(2022, 8, 29), 0.005845156606103965, 22), (datetime.date(2022, 8, 30), 0.01774597693816732, 32), (datetime.date(2022, 8, 31), 0.04037847154938461, 9))}, 'quality_array': [['7.002742885641196', '01082022'], ['7.276538764582762', '02082022'], ['7.489191991610414', '03082022'], ['7.1515808570282635', '04082022'], ['7.481548146738859', '05082022'], ['7.304119764213931', '06082022'], ['7.180322525692267', '08082022'], ['6.878113539107664', '09082022'], ['7.100998473868195', '10082022'], ['7.303181417036363', '11082022'], ['6.929539513848952', '12082022'], ['6.949887273916412', '13082022'], ['6.952864344290567', '15082022'], ['6.946439599449299', '16082022'], ['8.200164971876198', '17082022'], ['7.414826551741067', '18082022'], ['7.567049552876916', '19082022'], ['8.275572615180698', '22082022'], ['8.683058890962057', '23082022'], ['9.447587725285345', '24082022'], ['9.907266828738836', '25082022'], ['9.398694081509628', '26082022'], ['3.699836545530341', '28082022'], ['9.278913980706943', '29082022'], ['9.808918378829057', '30082022'], ['12.679394134058633', '31082022']], 'number_of_batch': ((325,),), 'datou_id_sts': 3981, 'map_hashtag_number_mat': {'hash_to_mat_nb': ({'unwanted_material': 'barquette_opaque', 'main_material': 'emr', 'pht_type': 4207, 'ratio': 0.0001728785023265608, 'nb_photo': 18, 'list_port_cont': '6861407,6862123,6862547,6867908,6868674,6869389,6869558,6877707,6877972,6881690,6891352,6894202,6907047,6922714,6925593', 'assoc_port': '6790887:6862547,6794193:6862123,6834822:6877972,6840554:6877707,6845438:6869389,6846972:6869558,6851003:6868674,6853215:6861407,6864848:6867908,6881492:6881690,6889190:6891352,6894094:6894202,6906036:6907047,6921897:6922714,6925484:6925593', 'assoc_mat': '6790887:barquette_opaque:4207:6862547,6794193:barquette_opaque:4207:6862123,6834822:barquette_opaque:4207:6877972,6840554:barquette_opaque:4207:6877707,6845438:barquette_opaque:4207:6869389,6846972:barquette_opaque:4207:6869558,6851003:barquette_opaque:4207:6868674,6853215:barquette_opaque:4207:6861407,6864848:barquette_opaque:4207:6867908,6881492:barquette_opaque:4207:6881690,6889190:barquette_opaque:4207:6891352,6894094:barquette_opaque:4207:6894202,6906036:barquette_opaque:4207:6907047,6921897:barquette_opaque:4207:6922714,6925484:barquette_opaque:4207:6925593'}, {'unwanted_material': 'barquette_opaque', 'main_material': 'emr', 'pht_type': 4209, 'ratio': 8.469862336652651e-05, 'nb_photo': 44, 'list_port_cont': '6626450,6627857,6628405,6628829,6644425,6664932,6665236,6666075,6666652,6669243,6669771,6706891,6712605,6719637,6720391,6720629,6722154,6744912,6762879,6775287,6835808,6841133,6842925,6846016,6852775,6853230', 'assoc_port': '6625827:6626450,6627447:6627857,6627801:6628405,6628455:6628829,6630580:6664932,6630581:6665236,6630822:6666075,6631618:6669771,6639123:6644425,6665718:6666652,6668655:6669243,6706262:6706891,6708643:6712605,6719441:6719637,6719951:6720391,6720202:6720629,6721827:6722154,6744086:6744912,6762224:6762879,6774283:6775287,6834821:6835808,6840554:6841133,6842390:6842925,6845438:6846016,6852117:6852775,6852533:6853230', 'assoc_mat': '6625827:barquette_opaque:4209:6626450,6627447:barquette_opaque:4209:6627857,6627801:barquette_opaque:4209:6628405,6628455:barquette_opaque:4209:6628829,6630580:barquette_opaque:4209:6664932,6630581:barquette_opaque:4209:6665236,6630822:barquette_opaque:4209:6666075,6631618:barquette_opaque:4209:6669771,6639123:barquette_opaque:4209:6644425,6665718:barquette_opaque:4209:6666652,6668655:barquette_opaque:4209:6669243,6706262:barquette_opaque:4209:6706891,6708643:barquette_opaque:4209:6712605,6719441:barquette_opaque:4209:6719637,6719951:barquette_opaque:4209:6720391,6720202:barquette_opaque:4209:6720629,6721827:barquette_opaque:4209:6722154,6744086:barquette_opaque:4209:6744912,6762224:barquette_opaque:4209:6762879,6774283:barquette_opaque:4209:6775287,6834821:barquette_opaque:4209:6835808,6840554:barquette_opaque:4209:6841133,6842390:barquette_opaque:4209:6842925,6845438:barquette_opaque:4209:6846016,6852117:barquette_opaque:4209:6852775,6852533:barquette_opaque:4209:6853230'}, {'unwanted_material': 'carton', 'main_material': 'aluminium', 'pht_type': 4205, 'ratio': 0.01022994561299725, 'nb_photo': 16, 'list_port_cont': '6625532,6880743,6880786', 'assoc_port': '6625304:6625532,6880715:6880786,6880716:6880743', 'assoc_mat': '6625304:carton:4205:6625532,6880715:carton:4205:6880786,6880716:carton:4205:6880743'}, {'unwanted_material': 'carton', 'main_material': 'emr', 'pht_type': 4207, 'ratio': 0.9683717828305286, 'nb_photo': 2565, 'list_port_cont': '6860769,6860801,6860841,6860928,6860987,6861035,6861210,6861405,6861437,6861808,6861831,6861929,6862023,6862130,6862206,6862328,6862365,6862540,6862581,6862649,6862984,6863819,6864050,6866304,6866467,6866495,6866955,6867660,6867837,6867907,6868220,6868254,6868280,6868378,6868398,6868623,6868676,6868731,6868887,6868963,6869104,6869323,6869395,6869455,6869560,6876859,6876893,6876912,6876948,6877006,6877054,6877103,6877189,6877551,6877616,6877676,6877710,6877780,6877820,6877867,6877909,6877915,6877971,6877996,6878027,6881699,6884486,6886468,6886876,6887990,6888294,6889466,6891082,6891177,6891354,6894196,6894492,6895946,6896156,6897897,6898092,6898471,6898488,6900295,6900456,6904480,6904513,6905153,6905998,6906484,6907056,6908162,6908516,6908935,6909121,6914618,6915177,6915209,6915268,6916694,6917250,6917397,6920809,6922717,6925589', 'assoc_port': '6790886:6864050,6790887:6862540,6794193:6862130,6832752:6877915,6832753:6877867,6833565:6878027,6834821:6877996,6834822:6877971,6836050:6877780,6838973:6877676,6838974:6877616,6840554:6877710,6842390:6877820,6845438:6869395,6846972:6869560,6846973:6869455,6848417:6869323,6849526:6868887,6851003:6868676,6852117:6868731,6852533:6869104,6852534:6868963,6853215:6861405,6853569:6861437,6853919:6868623,6855642:6860801,6859123:6861831,6860530:6861210,6860531:6861035,6860532:6860987,6860535:6860928,6860537:6860841,6860538:6860769,6861512:6868220,6861514:6868280,6861516:6868254,6861517:6868378,6861519:6862581,6861520:6862649,6861522:6861808,6861523:6862328,6861524:6862206,6861525:6861929,6861635:6862365,6861636:6862023,6862501:6862984,6863220:6863819,6864848:6867907,6864850:6867837,6864851:6867660,6864853:6866955,6864855:6866495,6865738:6866304,6865739:6866467,6868332:6868398,6876683:6877189,6876684:6876912,6876685:6877006,6876686:6877054,6876687:6877103,6876688:6876893,6876689:6876948,6876691:6876859,6877478:6877909,', 'assoc_mat': '6790886:carton:4207:6864050,6790887:carton:4207:6862540,6794193:carton:4207:6862130,6832752:carton:4207:6877915,6832753:carton:4207:6877867,6833565:carton:4207:6878027,6834821:carton:4207:6877996,6834822:carton:4207:6877971,6836050:carton:4207:6877780,6838973:carton:4207:6877676,6838974:carton:4207:6877616,6840554:carton:4207:6877710,6842390:carton:4207:6877820,6845438:carton:4207:6869395,6846972:carton:4207:6869560,6846973:carton:4207:6869455,6848417:carton:4207:6869323,6849526:carton:4207:6868887,6851003:carton:4207:6868676,6852117:carton:4207:6868731,6852533:carton:4207:6869104,6852534:carton:4207:6868963,6853215:carton:4207:6861405,6853569:carton:4207:6861437,6853919:carton:4207:6868623,6855642:carton:4207:6860801,6859123:carton:4207:6861831,6860530:carton:4207:6861210,6860531:carton:4207:6861035,6860532:carton:4207:6860987,6860535:carton:4207:6860928,6860537:carton:4207:6860841,6860538:carton:4207:6860769,6861512:carton:4207:6868220,6861514:carton:4207:6868280,6861516:carton:4207:6868254,6861517:carton:4'}, {'unwanted_material': 'carton', 'main_material': 'emr', 'pht_type': 4209, 'ratio': 0.007834080277437061, 'nb_photo': 1462, 'list_port_cont': '6613099,6614127,6614585,6615525,6616029,6626453,6627860,6628395,6628840,6629152,6629205,6629281,6635304,6635369,6635432,6639702,6640661,6641608,6642551,6644436,6646356,6647438,6648160,6648884,6654375,6655819,6657180,6658370,6659145,6659232,6660891,6661075,6664557,6664640,6664706,6664802,6664929,6665234,6666043,6666077,6666648,6666765,6666944,6668004,6668673,6668922,6669250,6669483,6669559,6669701,6669786,6669812,6670114,6671149,6671463,6671574,6671847,6672297,6674151,6674264,6674794,6676772,6678452,6681186,6683438,6683967,6700222,6702222,6704712,6706887,6708974,6709414,6709569,6710040,6710776,6711299,6712611,6716502,6718348,6718717,6718883,6719281,6719649,6719891,6720389,6720622,6722163,6722585,6722885,6723449,6723510,6744917,6745245,6746407,6748615,6748946,6749029,6758826,6760253,6760547,6761445,6761998,6762877,6774108,6774613,6775298,6776475,6776981,6813192,6834126,6834362,6834696,6835803,6836102,6837017,6839291,6839592,6841138,6842928,6846019,6847495,6847556,6849259,6850419,6851368,6852770,6853216,6853519,', 'assoc_port': '6612572:6613099,6613636:6614127,6614336:6614585,6614890:6615525,6614891:6616029,6625827:6626453,6627447:6627860,6627801:6628395,6627802:6629281,6628455:6628840,6628735:6629152,6628736:6629205,6630577:6664557,6630578:6664706,6630579:6664640,6630580:6664929,6630581:6665234,6630822:6666077,6630823:6666043,6631154:6668004,6631384:6668673,6631385:6668922,6631618:6669786,6631619:6669812,6631901:6670114,6632901:6671149,6632902:6671463,6633542:6635432,6633543:6635304,6633544:6671847,6633545:6635369,6633546:6672297,6635651:6661075,6635653:6660891,6639123:6644436,6639124:6639702,6639695:6642551,6640066:6640661,6640928:6641608,6645791:6646356,6646682:6647438,6647202:6648160,6648217:6648884,6652800:6654375,6655088:6655819,6656505:6657180,6656506:6658370,6657819:6659145,6659025:6659232,6663042:6664802,6665067:6666944,6665718:6666648,6665719:6666765,6668654:6669701,6668655:6669250,6668656:6669483,6668657:6669559,6670886:6671574,6671756:6676772,6673385:6674151,6673850:6674264,6674357:6674794,6678032:6678452,6680947:6681186,', 'assoc_mat': '6612572:carton:4209:6613099,6613636:carton:4209:6614127,6614336:carton:4209:6614585,6614890:carton:4209:6615525,6614891:carton:4209:6616029,6625827:carton:4209:6626453,6627447:carton:4209:6627860,6627801:carton:4209:6628395,6627802:carton:4209:6629281,6628455:carton:4209:6628840,6628735:carton:4209:6629152,6628736:carton:4209:6629205,6630577:carton:4209:6664557,6630578:carton:4209:6664706,6630579:carton:4209:6664640,6630580:carton:4209:6664929,6630581:carton:4209:6665234,6630822:carton:4209:6666077,6630823:carton:4209:6666043,6631154:carton:4209:6668004,6631384:carton:4209:6668673,6631385:carton:4209:6668922,6631618:carton:4209:6669786,6631619:carton:4209:6669812,6631901:carton:4209:6670114,6632901:carton:4209:6671149,6632902:carton:4209:6671463,6633542:carton:4209:6635432,6633543:carton:4209:6635304,6633544:carton:4209:6671847,6633545:carton:4209:6635369,6633546:carton:4209:6672297,6635651:carton:4209:6661075,6635653:carton:4209:6660891,6639123:carton:4209:6644436,6639124:carton:4209:6639702,6639695:carton:4'}, {'unwanted_material': 'carton', 'main_material': 'gm', 'pht_type': 4209, 'ratio': 0.0029313403454804565, 'nb_photo': 10, 'list_port_cont': '6861174,6862613,6886392,6902824,6905431,6920955', 'assoc_port': '6860533:6861174,6861515:6862613,6886257:6886392,6900676:6902824,6905103:6905431,6920015:6920955', 'assoc_mat': '6860533:carton:4209:6861174,6861515:carton:4209:6862613,6886257:carton:4209:6886392,6900676:carton:4209:6902824,6905103:carton:4209:6905431,6920015:carton:4209:6920955'}, {'unwanted_material': 'carton', 'main_material': 'pet_fonce', 'pht_type': 4200, 'ratio': 0.005861756255830517, 'nb_photo': 4, 'list_port_cont': '6647696', 'assoc_port': '6647200:6647696', 'assoc_mat': '6647200:carton:4200:6647696'}, {'unwanted_material': 'ela', 'main_material': 'emr', 'pht_type': 4207, 'ratio': 0.0001359155180754883, 'nb_photo': 1, 'list_port_cont': '6877603', 'assoc_port': '6838974:6877603', 'assoc_mat': '6838974:ela:4207:6877603'}, {'unwanted_material': 'ela', 'main_material': 'emr', 'pht_type': 4209, 'ratio': 5.6302219709875656e-05, 'nb_photo': 3, 'list_port_cont': '6635371,6644435,6657178', 'assoc_port': '6633545:6635371,6639123:6644435,6656505:6657178', 'assoc_mat': '6633545:ela:4209:6635371,6639123:ela:4209:6644435,6656505:ela:4209:6657178'}, {'unwanted_material': 'etiquette', 'main_material': 'emr', 'pht_type': 4207, 'ratio': 0.0004908205603477037, 'nb_photo': 82, 'list_port_cont': '6860802,6860985,6861441,6861842,6861919,6862212,6862342,6862370,6862544,6862643,6868221,6868633,6868729,6869099,6869322,6869388,6869458,6876887,6877052,6877109,6877190,6877547,6877688,6877715,6877814,6877918,6877964,6877998,6878028,6886871,6891088,6891171,6896147,6900293,6900464,6904479,6907053,6908947,6909124,6915211,6915265,6916685,6917252,6920804,6922718', 'assoc_port': '6790887:6862544,6832752:6877918,6833565:6878028,6834821:6877998,6834822:6877964,6838973:6877688,6840554:6877715,6842390:6877814,6845438:6869388,6846973:6869458,6848417:6869322,6852117:6868729,6852533:6869099,6853569:6861441,6853919:6868633,6855642:6860802,6859123:6861842,6860532:6860985,6861512:6868221,6861520:6862643,6861523:6862342,6861524:6862212,6861525:6861919,6861635:6862370,6876683:6877190,6876686:6877052,6876687:6877109,6876688:6876887,6877480:6877547,6886258:6886871,6889185:6891088,6891024:6891171,6895749:6896147,6899246:6900464,6899248:6900293,6900677:6909124,6900678:6908947,6903712:6904479,6906036:6907053,6914258:6915211,6914260:6916685,6914751:6915265,6917033:6917252,6920014:6920804,6921897:6922718', 'assoc_mat': '6790887:etiquette:4207:6862544,6832752:etiquette:4207:6877918,6833565:etiquette:4207:6878028,6834821:etiquette:4207:6877998,6834822:etiquette:4207:6877964,6838973:etiquette:4207:6877688,6840554:etiquette:4207:6877715,6842390:etiquette:4207:6877814,6845438:etiquette:4207:6869388,6846973:etiquette:4207:6869458,6848417:etiquette:4207:6869322,6852117:etiquette:4207:6868729,6852533:etiquette:4207:6869099,6853569:etiquette:4207:6861441,6853919:etiquette:4207:6868633,6855642:etiquette:4207:6860802,6859123:etiquette:4207:6861842,6860532:etiquette:4207:6860985,6861512:etiquette:4207:6868221,6861520:etiquette:4207:6862643,6861523:etiquette:4207:6862342,6861524:etiquette:4207:6862212,6861525:etiquette:4207:6861919,6861635:etiquette:4207:6862370,6876683:etiquette:4207:6877190,6876686:etiquette:4207:6877052,6876687:etiquette:4207:6877109,6876688:etiquette:4207:6876887,6877480:etiquette:4207:6877547,6886258:etiquette:4207:6886871,6889185:etiquette:4207:6891088,6891024:etiquette:4207:6891171,6895749:etiquette:4207:6896147,6'}, {'unwanted_material': 'etiquette', 'main_material': 'emr', 'pht_type': 4209, 'ratio': 0.0008238173967106119, 'nb_photo': 1049, 'list_port_cont': '6613101,6614126,6614587,6616038,6626458,6627864,6628397,6628838,6629141,6629204,6629280,6635302,6635366,6635430,6640667,6641598,6642545,6644428,6646362,6647450,6648167,6648890,6654367,6655834,6657182,6658372,6659142,6659220,6660894,6661081,6664553,6664638,6664707,6664807,6664938,6665231,6666055,6666086,6666643,6666770,6666946,6668001,6668670,6668913,6669257,6669490,6669555,6669702,6669778,6669808,6670117,6671148,6671464,6671561,6671836,6672301,6674153,6674271,6674799,6676771,6678460,6681184,6683436,6683981,6700231,6702226,6704721,6706890,6708962,6709416,6709579,6710035,6710785,6711300,6712603,6716517,6718720,6718877,6719278,6719639,6719881,6720398,6720627,6722161,6722583,6722896,6723446,6723519,6744916,6745258,6746410,6748605,6748955,6749037,6760261,6760532,6761442,6762007,6774112,6774618,6775290,6776483,6776974,6813185,6834132,6834363,6834703,6835800,6836101,6837027,6839290,6839587,6841136,6842924,6846017,6847494,6847557,6849269,6850421,6852780,6853222,6853521,6853980,6854357,6855828,6859399', 'assoc_port': '6612572:6613101,6613636:6614126,6614336:6614587,6614891:6616038,6625827:6626458,6627447:6627864,6627801:6628397,6627802:6629280,6628455:6628838,6628735:6629141,6628736:6629204,6630577:6664553,6630578:6664707,6630579:6664638,6630580:6664938,6630581:6665231,6630822:6666086,6630823:6666055,6631154:6668001,6631384:6668670,6631385:6668913,6631618:6669778,6631619:6669808,6631901:6670117,6632901:6671148,6632902:6671464,6633542:6635430,6633543:6635302,6633544:6671836,6633545:6635366,6633546:6672301,6635651:6661081,6635653:6660894,6639123:6644428,6639695:6642545,6640066:6640667,6640928:6641598,6645791:6646362,6646682:6647450,6647202:6648167,6648217:6648890,6652800:6654367,6655088:6655834,6656505:6657182,6656506:6658372,6657819:6659142,6659025:6659220,6663042:6664807,6665067:6666946,6665718:6666643,6665719:6666770,6668654:6669702,6668655:6669257,6668656:6669490,6668657:6669555,6670886:6671561,6671756:6676771,6673385:6674153,6673850:6674271,6674357:6674799,6678032:6678460,6680947:6681184,6682633:6683436,6683289:6683981,', 'assoc_mat': '6612572:etiquette:4209:6613101,6613636:etiquette:4209:6614126,6614336:etiquette:4209:6614587,6614891:etiquette:4209:6616038,6625827:etiquette:4209:6626458,6627447:etiquette:4209:6627864,6627801:etiquette:4209:6628397,6627802:etiquette:4209:6629280,6628455:etiquette:4209:6628838,6628735:etiquette:4209:6629141,6628736:etiquette:4209:6629204,6630577:etiquette:4209:6664553,6630578:etiquette:4209:6664707,6630579:etiquette:4209:6664638,6630580:etiquette:4209:6664938,6630581:etiquette:4209:6665231,6630822:etiquette:4209:6666086,6630823:etiquette:4209:6666055,6631154:etiquette:4209:6668001,6631384:etiquette:4209:6668670,6631385:etiquette:4209:6668913,6631618:etiquette:4209:6669778,6631619:etiquette:4209:6669808,6631901:etiquette:4209:6670117,6632901:etiquette:4209:6671148,6632902:etiquette:4209:6671464,6633542:etiquette:4209:6635430,6633543:etiquette:4209:6635302,6633544:etiquette:4209:6671836,6633545:etiquette:4209:6635366,6633546:etiquette:4209:6672301,6635651:etiquette:4209:6661081,6635653:etiquette:4209:6660894,6'}, {'unwanted_material': 'etiquette', 'main_material': 'gm', 'pht_type': 4209, 'ratio': 0.0007589310876444754, 'nb_photo': 16, 'list_port_cont': '6860869,6861178,6861533,6862611,6863435,6876769,6889758,6894819,6902814,6920942', 'assoc_port': '6860533:6861178,6860536:6860869,6861163:6861533,6861515:6862611,6863221:6863435,6876690:6876769,6889188:6889758,6894658:6894819,6900676:6902814,6920015:6920942', 'assoc_mat': '6860533:etiquette:4209:6861178,6860536:etiquette:4209:6860869,6861163:etiquette:4209:6861533,6861515:etiquette:4209:6862611,6863221:etiquette:4209:6863435,6876690:etiquette:4209:6876769,6889188:etiquette:4209:6889758,6894658:etiquette:4209:6894819,6900676:etiquette:4209:6902814,6920015:etiquette:4209:6920942'}, {'unwanted_material': 'etiquette', 'main_material': 'pet_fonce', 'pht_type': 4200, 'ratio': 0.0010885671487047438, 'nb_photo': 5, 'list_port_cont': '6647706', 'assoc_port': '6647200:6647706', 'assoc_mat': '6647200:etiquette:4200:6647706'}, {'unwanted_material': 'film_plastique', 'main_material': 'emr', 'pht_type': 4207, 'ratio': 0.00029682028164317286, 'nb_photo': 8, 'list_port_cont': '6862648,6866460,6877060,6877718,6877925,6922720,6925580', 'assoc_port': '6832752:6877925,6840554:6877718,6861520:6862648,6865739:6866460,6876686:6877060,6921897:6922720,6925484:6925580', 'assoc_mat': '6832752:film_plastique:4207:6877925,6840554:film_plastique:4207:6877718,6861520:film_plastique:4207:6862648,6865739:film_plastique:4207:6866460,6876686:film_plastique:4207:6877060,6921897:film_plastique:4207:6922720,6925484:film_plastique:4207:6925580'}, {'unwanted_material': 'film_plastique', 'main_material': 'emr', 'pht_type': 4209, 'ratio': 9.746706181821035e-05, 'nb_photo': 9, 'list_port_cont': '6614124,6644434,6702223,6711304,6712598,6744913,6834700', 'assoc_port': '6613636:6614124,6639123:6644434,6701501:6702223,6708643:6712598,6708644:6711304,6744086:6744913,6832752:6834700', 'assoc_mat': '6613636:film_plastique:4209:6614124,6639123:film_plastique:4209:6644434,6701501:film_plastique:4209:6702223,6708643:film_plastique:4209:6712598,6708644:film_plastique:4209:6711304,6744086:film_plastique:4209:6744913,6832752:film_plastique:4209:6834700'}, {'unwanted_material': 'kraft', 'main_material': 'emr', 'pht_type': 4207, 'ratio': 0.0011039430628874177, 'nb_photo': 1, 'list_port_cont': '6917403', 'assoc_port': '6917034:6917403', 'assoc_mat': '6917034:kraft:4207:6917403'}, {'unwanted_material': 'metal', 'main_material': 'aluminium', 'pht_type': 4205, 'ratio': 0.9896715615394742, 'nb_photo': 54, 'list_port_cont': '6625531,6661187,6880740,6880777,6881860,6918649', 'assoc_port': '6625304:6625531,6632479:6661187,6880715:6880777,6880716:6880740,6881491:6881860,6887696:6918649', 'assoc_mat': '6625304:metal:4205:6625531,6632479:metal:4205:6661187,6880715:metal:4205:6880777,6880716:metal:4205:6880740,6881491:metal:4205:6881860,6887696:metal:4205:6918649'}, {'unwanted_material': 'metal', 'main_material': 'emr', 'pht_type': 4207, 'ratio': 0.002857356890964171, 'nb_photo': 188, 'list_port_cont': '6860922,6860979,6861033,6861211,6861400,6861433,6861833,6862030,6862128,6862210,6862338,6862362,6862534,6862572,6862638,6863807,6864053,6866290,6866466,6866498,6866956,6867841,6867914,6868223,6868261,6868374,6868621,6868667,6868732,6869091,6869331,6869392,6869468,6869545,6876850,6876885,6876957,6877055,6877099,6877198,6877539,6877618,6877678,6877719,6877785,6877818,6877877,6877912,6877928,6877966,6878004,6878040,6884491,6886881,6887977,6888302,6894497,6895947,6896159,6897898,6898087,6898465,6898489,6900299,6900468,6904477,6905148,6905987,6907057,6908937,6909122,6915222,6915272,6916692,6917256,6920805,6925583', 'assoc_port': '6790886:6864053,6790887:6862534,6794193:6862128,6832752:6877928,6832753:6877877,6833565:6878040,6834821:6878004,6834822:6877966,6836050:6877785,6838973:6877678,6838974:6877618,6840554:6877719,6842390:6877818,6845438:6869392,6846972:6869545,6846973:6869468,6848417:6869331,6851003:6868667,6852117:6868732,6852533:6869091,6853215:6861400,6853569:6861433,6853919:6868621,6859123:6861833,6860530:6861211,6860531:6861033,6860532:6860979,6860535:6860922,6861512:6868223,6861516:6868261,6861517:6868374,6861519:6862572,6861520:6862638,6861523:6862338,6861524:6862210,6861635:6862362,6861636:6862030,6863220:6863807,6864848:6867914,6864850:6867841,6864853:6866956,6864855:6866498,6865738:6866290,6865739:6866466,6876683:6877198,6876686:6877055,6876687:6877099,6876688:6876885,6876689:6876957,6876691:6876850,6877478:6877912,6877480:6877539,6884290:6884491,6886258:6886881,6887695:6888302,6887732:6887977,6894095:6894497,6895749:6896159,6895752:6895947,6897575:6898087,6897576:6897898,6898175:6898489,6898176:6898465,6899246:6900468,', 'assoc_mat': '6790886:metal:4207:6864053,6790887:metal:4207:6862534,6794193:metal:4207:6862128,6832752:metal:4207:6877928,6832753:metal:4207:6877877,6833565:metal:4207:6878040,6834821:metal:4207:6878004,6834822:metal:4207:6877966,6836050:metal:4207:6877785,6838973:metal:4207:6877678,6838974:metal:4207:6877618,6840554:metal:4207:6877719,6842390:metal:4207:6877818,6845438:metal:4207:6869392,6846972:metal:4207:6869545,6846973:metal:4207:6869468,6848417:metal:4207:6869331,6851003:metal:4207:6868667,6852117:metal:4207:6868732,6852533:metal:4207:6869091,6853215:metal:4207:6861400,6853569:metal:4207:6861433,6853919:metal:4207:6868621,6859123:metal:4207:6861833,6860530:metal:4207:6861211,6860531:metal:4207:6861033,6860532:metal:4207:6860979,6860535:metal:4207:6860922,6861512:metal:4207:6868223,6861516:metal:4207:6868261,6861517:metal:4207:6868374,6861519:metal:4207:6862572,6861520:metal:4207:6862638,6861523:metal:4207:6862338,6861524:metal:4207:6862210,6861635:metal:4207:6862362,6861636:metal:4207:6862030,6863220:metal:4207:686380'}, {'unwanted_material': 'metal', 'main_material': 'emr', 'pht_type': 4209, 'ratio': 0.026017127541676587, 'nb_photo': 787, 'list_port_cont': '6613097,6614121,6615521,6616026,6626451,6627868,6628403,6628835,6629153,6629208,6629277,6635307,6635359,6635433,6639705,6640666,6641594,6642552,6644427,6647437,6648164,6648886,6654370,6655828,6657169,6658371,6659139,6660892,6661087,6664549,6664633,6664701,6664796,6664935,6665224,6666046,6666081,6666646,6666766,6666945,6667992,6668663,6668912,6669249,6669482,6669546,6669703,6669773,6669806,6670109,6671159,6671466,6671576,6672296,6674155,6674267,6674795,6676776,6678453,6681189,6683437,6683972,6700233,6702218,6704725,6706893,6708961,6709417,6709566,6710044,6710774,6711296,6712599,6716510,6718358,6718713,6718870,6719287,6719648,6720401,6720631,6722162,6722586,6722893,6723437,6723512,6744909,6745246,6746419,6748619,6748941,6749034,6758839,6760267,6760542,6761443,6762005,6774106,6774607,6775285,6776482,6776987,6813179,6834120,6834369,6834695,6835802,6836110,6837026,6839593,6841134,6846021,6847508,6847568,6849264,6850424,6851374,6852778,6853219,6853526,6854348,6855834,6859395', 'assoc_port': '6612572:6613097,6613636:6614121,6614890:6615521,6614891:6616026,6625827:6626451,6627447:6627868,6627801:6628403,6627802:6629277,6628455:6628835,6628735:6629153,6628736:6629208,6630577:6664549,6630578:6664701,6630579:6664633,6630580:6664935,6630581:6665224,6630822:6666081,6630823:6666046,6631154:6667992,6631384:6668663,6631385:6668912,6631618:6669773,6631619:6669806,6631901:6670109,6632901:6671159,6632902:6671466,6633542:6635433,6633543:6635307,6633545:6635359,6633546:6672296,6635651:6661087,6635653:6660892,6639123:6644427,6639124:6639705,6639695:6642552,6640066:6640666,6640928:6641594,6646682:6647437,6647202:6648164,6648217:6648886,6652800:6654370,6655088:6655828,6656505:6657169,6656506:6658371,6657819:6659139,6663042:6664796,6665067:6666945,6665718:6666646,6665719:6666766,6668654:6669703,6668655:6669249,6668656:6669482,6668657:6669546,6670886:6671576,6671756:6676776,6673385:6674155,6673850:6674267,6674357:6674795,6678032:6678453,6680947:6681189,6682633:6683437,6683289:6683972,6699726:6700233,6700555:6704725,', 'assoc_mat': '6612572:metal:4209:6613097,6613636:metal:4209:6614121,6614890:metal:4209:6615521,6614891:metal:4209:6616026,6625827:metal:4209:6626451,6627447:metal:4209:6627868,6627801:metal:4209:6628403,6627802:metal:4209:6629277,6628455:metal:4209:6628835,6628735:metal:4209:6629153,6628736:metal:4209:6629208,6630577:metal:4209:6664549,6630578:metal:4209:6664701,6630579:metal:4209:6664633,6630580:metal:4209:6664935,6630581:metal:4209:6665224,6630822:metal:4209:6666081,6630823:metal:4209:6666046,6631154:metal:4209:6667992,6631384:metal:4209:6668663,6631385:metal:4209:6668912,6631618:metal:4209:6669773,6631619:metal:4209:6669806,6631901:metal:4209:6670109,6632901:metal:4209:6671159,6632902:metal:4209:6671466,6633542:metal:4209:6635433,6633543:metal:4209:6635307,6633545:metal:4209:6635359,6633546:metal:4209:6672296,6635651:metal:4209:6661087,6635653:metal:4209:6660892,6639123:metal:4209:6644427,6639124:metal:4209:6639705,6639695:metal:4209:6642552,6640066:metal:4209:6640666,6640928:metal:4209:6641594,6646682:metal:4209:664743'}, {'unwanted_material': 'metal', 'main_material': 'gm', 'pht_type': 4209, 'ratio': 0.03426755560145856, 'nb_photo': 14, 'list_port_cont': '6861172,6863427,6863597,6865059,6876772,6881616,6889760,6902821,6920943', 'assoc_port': '6860533:6861172,6863219:6863597,6863221:6863427,6864849:6865059,6876690:6876772,6881493:6881616,6889188:6889760,6900676:6902821,6920015:6920943', 'assoc_mat': '6860533:metal:4209:6861172,6863219:metal:4209:6863597,6863221:metal:4209:6863427,6864849:metal:4209:6865059,6876690:metal:4209:6876772,6881493:metal:4209:6881616,6889188:metal:4209:6889760,6900676:metal:4209:6902821,6920015:metal:4209:6920943'}, {'unwanted_material': 'papier', 'main_material': 'aluminium', 'pht_type': 4205, 'ratio': 0.0013353682339268438, 'nb_photo': 9, 'list_port_cont': '6625537,6880784', 'assoc_port': '6625304:6625537,6880715:6880784', 'assoc_mat': '6625304:papier:4205:6625537,6880715:papier:4205:6880784'}, {'unwanted_material': 'papier', 'main_material': 'emr', 'pht_type': 4207, 'ratio': 0.030078019576209876, 'nb_photo': 6564, 'list_port_cont': '6860765,6860809,6860834,6860929,6860974,6861044,6861206,6861412,6861434,6861798,6861840,6861924,6862024,6862135,6862201,6862331,6862374,6862545,6862582,6862651,6862990,6863820,6864046,6866293,6866465,6866499,6866949,6867662,6867830,6867915,6868217,6868247,6868293,6868379,6868403,6868626,6868668,6868733,6868889,6868970,6869094,6869326,6869384,6869464,6869555,6876860,6876889,6876921,6876951,6877008,6877057,6877102,6877186,6877542,6877605,6877685,6877711,6877787,6877810,6877872,6877908,6877920,6877963,6878007,6878032,6881693,6884489,6886474,6886878,6887983,6888296,6889465,6891084,6891165,6891355,6894204,6894504,6895937,6896154,6897893,6898095,6898457,6898491,6900292,6900467,6904483,6904508,6905154,6905995,6906491,6907050,6908161,6908519,6908941,6909123,6914622,6915183,6915210,6915259,6916693,6917258,6917398,6920814,6922713,6925594', 'assoc_port': '6790886:6864046,6790887:6862545,6794193:6862135,6832752:6877920,6832753:6877872,6833565:6878032,6834821:6878007,6834822:6877963,6836050:6877787,6838973:6877685,6838974:6877605,6840554:6877711,6842390:6877810,6845438:6869384,6846972:6869555,6846973:6869464,6848417:6869326,6849526:6868889,6851003:6868668,6852117:6868733,6852533:6869094,6852534:6868970,6853215:6861412,6853569:6861434,6853919:6868626,6855642:6860809,6859123:6861840,6860530:6861206,6860531:6861044,6860532:6860974,6860535:6860929,6860537:6860834,6860538:6860765,6861512:6868217,6861514:6868293,6861516:6868247,6861517:6868379,6861519:6862582,6861520:6862651,6861522:6861798,6861523:6862331,6861524:6862201,6861525:6861924,6861635:6862374,6861636:6862024,6862501:6862990,6863220:6863820,6864848:6867915,6864850:6867830,6864851:6867662,6864853:6866949,6864855:6866499,6865738:6866293,6865739:6866465,6868332:6868403,6876683:6877186,6876684:6876921,6876685:6877008,6876686:6877057,6876687:6877102,6876688:6876889,6876689:6876951,6876691:6876860,6877478:6877908,', 'assoc_mat': '6790886:papier:4207:6864046,6790887:papier:4207:6862545,6794193:papier:4207:6862135,6832752:papier:4207:6877920,6832753:papier:4207:6877872,6833565:papier:4207:6878032,6834821:papier:4207:6878007,6834822:papier:4207:6877963,6836050:papier:4207:6877787,6838973:papier:4207:6877685,6838974:papier:4207:6877605,6840554:papier:4207:6877711,6842390:papier:4207:6877810,6845438:papier:4207:6869384,6846972:papier:4207:6869555,6846973:papier:4207:6869464,6848417:papier:4207:6869326,6849526:papier:4207:6868889,6851003:papier:4207:6868668,6852117:papier:4207:6868733,6852533:papier:4207:6869094,6852534:papier:4207:6868970,6853215:papier:4207:6861412,6853569:papier:4207:6861434,6853919:papier:4207:6868626,6855642:papier:4207:6860809,6859123:papier:4207:6861840,6860530:papier:4207:6861206,6860531:papier:4207:6861044,6860532:papier:4207:6860974,6860535:papier:4207:6860929,6860537:papier:4207:6860834,6860538:papier:4207:6860765,6861512:papier:4207:6868217,6861514:papier:4207:6868293,6861516:papier:4207:6868247,6861517:papier:4'}, {'unwanted_material': 'papier', 'main_material': 'emr', 'pht_type': 4209, 'ratio': 0.9686131104416358, 'nb_photo': 148871, 'list_port_cont': '6613100,6614114,6614594,6615529,6616034,6626462,6627859,6628399,6628843,6629142,6629212,6629275,6635305,6635363,6635424,6639712,6640665,6641601,6642549,6644429,6646359,6647443,6648156,6648888,6654374,6655830,6657171,6658366,6659151,6659226,6660896,6661088,6664555,6664630,6664696,6664799,6664931,6665226,6666045,6666080,6666650,6666767,6666948,6667998,6668669,6668911,6669246,6669487,6669556,6669704,6669775,6669818,6670116,6671162,6671475,6671569,6671851,6672303,6674157,6674272,6674793,6676777,6678463,6681194,6683426,6683976,6700220,6702213,6704717,6706880,6708963,6709412,6709561,6710050,6710787,6711302,6712597,6716513,6718354,6718721,6718876,6719283,6719641,6719885,6720392,6720623,6722156,6722577,6722881,6723438,6723515,6744914,6745255,6746412,6748609,6748948,6749033,6758834,6760258,6760534,6761446,6762006,6762872,6774101,6774621,6775292,6776474,6776980,6813189,6834129,6834360,6834694,6835804,6836115,6837019,6839283,6839590,6841139,6842937,6846030,6847507,6847554,6849265,6850417,6851367,6852769,6853226,6853512,', 'assoc_port': '6612572:6613100,6613636:6614114,6614336:6614594,6614890:6615529,6614891:6616034,6625827:6626462,6627447:6627859,6627801:6628399,6627802:6629275,6628455:6628843,6628735:6629142,6628736:6629212,6630577:6664555,6630578:6664696,6630579:6664630,6630580:6664931,6630581:6665226,6630822:6666080,6630823:6666045,6631154:6667998,6631384:6668669,6631385:6668911,6631618:6669775,6631619:6669818,6631901:6670116,6632901:6671162,6632902:6671475,6633542:6635424,6633543:6635305,6633544:6671851,6633545:6635363,6633546:6672303,6635651:6661088,6635653:6660896,6639123:6644429,6639124:6639712,6639695:6642549,6640066:6640665,6640928:6641601,6645791:6646359,6646682:6647443,6647202:6648156,6648217:6648888,6652800:6654374,6655088:6655830,6656505:6657171,6656506:6658366,6657819:6659151,6659025:6659226,6663042:6664799,6665067:6666948,6665718:6666650,6665719:6666767,6668654:6669704,6668655:6669246,6668656:6669487,6668657:6669556,6670886:6671569,6671756:6676777,6673385:6674157,6673850:6674272,6674357:6674793,6678032:6678463,6680947:6681194,', 'assoc_mat': '6612572:papier:4209:6613100,6613636:papier:4209:6614114,6614336:papier:4209:6614594,6614890:papier:4209:6615529,6614891:papier:4209:6616034,6625827:papier:4209:6626462,6627447:papier:4209:6627859,6627801:papier:4209:6628399,6627802:papier:4209:6629275,6628455:papier:4209:6628843,6628735:papier:4209:6629142,6628736:papier:4209:6629212,6630577:papier:4209:6664555,6630578:papier:4209:6664696,6630579:papier:4209:6664630,6630580:papier:4209:6664931,6630581:papier:4209:6665226,6630822:papier:4209:6666080,6630823:papier:4209:6666045,6631154:papier:4209:6667998,6631384:papier:4209:6668669,6631385:papier:4209:6668911,6631618:papier:4209:6669775,6631619:papier:4209:6669818,6631901:papier:4209:6670116,6632901:papier:4209:6671162,6632902:papier:4209:6671475,6633542:papier:4209:6635424,6633543:papier:4209:6635305,6633544:papier:4209:6671851,6633545:papier:4209:6635363,6633546:papier:4209:6672303,6635651:papier:4209:6661088,6635653:papier:4209:6660896,6639123:papier:4209:6644429,6639124:papier:4209:6639712,6639695:papier:4'}, {'unwanted_material': 'papier', 'main_material': 'gm', 'pht_type': 4209, 'ratio': 0.9902901831097267, 'nb_photo': 2955, 'list_port_cont': '6860598,6860874,6861066,6861173,6861345,6861539,6861959,6862604,6863422,6863593,6864917,6865058,6866086,6866174,6876761,6877571,6877655,6877751,6881620,6886395,6888025,6889756,6894811,6902822,6905423,6907081,6909151,6920947', 'assoc_port': '6860529:6861066,6860533:6861173,6860534:6860598,6860536:6860874,6861163:6861539,6861164:6861345,6861513:6861959,6861515:6862604,6863219:6863593,6863221:6863422,6864847:6866174,6864849:6865058,6864854:6864917,6865737:6866086,6876690:6876761,6877477:6877751,6877481:6877655,6877482:6877571,6881493:6881620,6886257:6886395,6887731:6888025,6889188:6889756,6894658:6894811,6899249:6909151,6900676:6902822,6903711:6907081,6905103:6905423,6920015:6920947', 'assoc_mat': '6860529:papier:4209:6861066,6860533:papier:4209:6861173,6860534:papier:4209:6860598,6860536:papier:4209:6860874,6861163:papier:4209:6861539,6861164:papier:4209:6861345,6861513:papier:4209:6861959,6861515:papier:4209:6862604,6863219:papier:4209:6863593,6863221:papier:4209:6863422,6864847:papier:4209:6866174,6864849:papier:4209:6865058,6864854:papier:4209:6864917,6865737:papier:4209:6866086,6876690:papier:4209:6876761,6877477:papier:4209:6877751,6877481:papier:4209:6877655,6877482:papier:4209:6877571,6881493:papier:4209:6881620,6886257:papier:4209:6886395,6887731:papier:4209:6888025,6889188:papier:4209:6889756,6894658:papier:4209:6894811,6899249:papier:4209:6909151,6900676:papier:4209:6902822,6903711:papier:4209:6907081,6905103:papier:4209:6905423,6920015:papier:4209:6920947'}, {'unwanted_material': 'papier', 'main_material': 'pet_fonce', 'pht_type': 4200, 'ratio': 0.010245453120925422, 'nb_photo': 31, 'list_port_cont': '6647707,6861711', 'assoc_port': '6647200:6647707,6861521:6861711', 'assoc_mat': '6647200:papier:4200:6647707,6861521:papier:4200:6861711'}, {'unwanted_material': 'pehd', 'main_material': 'emr', 'pht_type': 4209, 'ratio': 2.520265649788176e-05, 'nb_photo': 2, 'list_port_cont': '6678458', 'assoc_port': '6678032:6678458', 'assoc_mat': '6678032:pehd:4209:6678458'}, {'unwanted_material': 'pet_clair', 'main_material': 'emr', 'pht_type': 4207, 'ratio': 0.0009691335779369147, 'nb_photo': 50, 'list_port_cont': '6862208,6862361,6862535,6862580,6862650,6867917,6868229,6868248,6868281,6868376,6868672,6869102,6869324,6869466,6869550,6877011,6877046,6877191,6877677,6877777,6877812,6877923,6877993,6878035,6886875,6888290,6891353,6896153,6898498,6904509,6907044,6917257,6922719,6925591', 'assoc_port': '6790887:6862535,6832752:6877923,6833565:6878035,6834821:6877993,6836050:6877777,6838973:6877677,6842390:6877812,6846972:6869550,6846973:6869466,6848417:6869324,6851003:6868672,6852533:6869102,6861512:6868229,6861514:6868281,6861516:6868248,6861517:6868376,6861519:6862580,6861520:6862650,6861524:6862208,6861635:6862361,6864848:6867917,6876683:6877191,6876685:6877011,6876686:6877046,6886258:6886875,6887695:6888290,6889190:6891353,6895749:6896153,6898175:6898498,6904057:6904509,6906036:6907044,6917033:6917257,6921897:6922719,6925484:6925591', 'assoc_mat': '6790887:pet_clair:4207:6862535,6832752:pet_clair:4207:6877923,6833565:pet_clair:4207:6878035,6834821:pet_clair:4207:6877993,6836050:pet_clair:4207:6877777,6838973:pet_clair:4207:6877677,6842390:pet_clair:4207:6877812,6846972:pet_clair:4207:6869550,6846973:pet_clair:4207:6869466,6848417:pet_clair:4207:6869324,6851003:pet_clair:4207:6868672,6852533:pet_clair:4207:6869102,6861512:pet_clair:4207:6868229,6861514:pet_clair:4207:6868281,6861516:pet_clair:4207:6868248,6861517:pet_clair:4207:6868376,6861519:pet_clair:4207:6862580,6861520:pet_clair:4207:6862650,6861524:pet_clair:4207:6862208,6861635:pet_clair:4207:6862361,6864848:pet_clair:4207:6867917,6876683:pet_clair:4207:6877191,6876685:pet_clair:4207:6877011,6876686:pet_clair:4207:6877046,6886258:pet_clair:4207:6886875,6887695:pet_clair:4207:6888290,6889190:pet_clair:4207:6891353,6895749:pet_clair:4207:6896153,6898175:pet_clair:4207:6898498,6904057:pet_clair:4207:6904509,6906036:pet_clair:4207:6907044,6917033:pet_clair:4207:6917257,6921897:pet_clair:4207:6922719,6'}, {'unwanted_material': 'pet_clair', 'main_material': 'emr', 'pht_type': 4209, 'ratio': 0.00038788845724592604, 'nb_photo': 52, 'list_port_cont': '6613103,6648162,6655833,6657176,6658378,6660889,6666083,6666651,6666947,6668915,6669550,6669705,6669777,6671157,6700228,6704711,6706879,6709548,6712610,6720621,6722887,6723439,6744920,6748621,6748942,6761453,6774102,6776478,6837016,6841130,6846026,6853934', 'assoc_port': '6612572:6613103,6630822:6666083,6631385:6668915,6631618:6669777,6632901:6671157,6635653:6660889,6647202:6648162,6655088:6655833,6656505:6657176,6656506:6658378,6665067:6666947,6665718:6666651,6668654:6669705,6668657:6669550,6699726:6700228,6700555:6704711,6706262:6706879,6707499:6709548,6708643:6712610,6720202:6720621,6722573:6722887,6723094:6723439,6744086:6744920,6747584:6748621,6748313:6748942,6761126:6761453,6773386:6774102,6776077:6776478,6836050:6837016,6840554:6841130,6845438:6846026,6852534:6853934', 'assoc_mat': '6612572:pet_clair:4209:6613103,6630822:pet_clair:4209:6666083,6631385:pet_clair:4209:6668915,6631618:pet_clair:4209:6669777,6632901:pet_clair:4209:6671157,6635653:pet_clair:4209:6660889,6647202:pet_clair:4209:6648162,6655088:pet_clair:4209:6655833,6656505:pet_clair:4209:6657176,6656506:pet_clair:4209:6658378,6665067:pet_clair:4209:6666947,6665718:pet_clair:4209:6666651,6668654:pet_clair:4209:6669705,6668657:pet_clair:4209:6669550,6699726:pet_clair:4209:6700228,6700555:pet_clair:4209:6704711,6706262:pet_clair:4209:6706879,6707499:pet_clair:4209:6709548,6708643:pet_clair:4209:6712610,6720202:pet_clair:4209:6720621,6722573:pet_clair:4209:6722887,6723094:pet_clair:4209:6723439,6744086:pet_clair:4209:6744920,6747584:pet_clair:4209:6748621,6748313:pet_clair:4209:6748942,6761126:pet_clair:4209:6761453,6773386:pet_clair:4209:6774102,6776077:pet_clair:4209:6776478,6836050:pet_clair:4209:6837016,6840554:pet_clair:4209:6841130,6845438:pet_clair:4209:6846026,6852534:pet_clair:4209:6853934'}, {'unwanted_material': 'pet_clair', 'main_material': 'gm', 'pht_type': 4209, 'ratio': 0.00042088720046359597, 'nb_photo': 1, 'list_port_cont': '6862605', 'assoc_port': '6861515:6862605', 'assoc_mat': '6861515:pet_clair:4209:6862605'}, {'unwanted_material': 'pet_fonce', 'main_material': 'emr', 'pht_type': 4207, 'ratio': 0.0008578698895049885, 'nb_photo': 28, 'list_port_cont': '6860798,6861839,6862207,6868256,6868671,6869549,6877674,6877708,6877816,6877879,6878008,6886869,6888301,6889467,6898496,6904520,6915175,6922716', 'assoc_port': '6832753:6877879,6834821:6878008,6838973:6877674,6840554:6877708,6842390:6877816,6846972:6869549,6851003:6868671,6855642:6860798,6859123:6861839,6861516:6868256,6861524:6862207,6886258:6886869,6887695:6888301,6887698:6889467,6898175:6898496,6904057:6904520,6914259:6915175,6921897:6922716', 'assoc_mat': '6832753:pet_fonce:4207:6877879,6834821:pet_fonce:4207:6878008,6838973:pet_fonce:4207:6877674,6840554:pet_fonce:4207:6877708,6842390:pet_fonce:4207:6877816,6846972:pet_fonce:4207:6869549,6851003:pet_fonce:4207:6868671,6855642:pet_fonce:4207:6860798,6859123:pet_fonce:4207:6861839,6861516:pet_fonce:4207:6868256,6861524:pet_fonce:4207:6862207,6886258:pet_fonce:4207:6886869,6887695:pet_fonce:4207:6888301,6887698:pet_fonce:4207:6889467,6898175:pet_fonce:4207:6898496,6904057:pet_fonce:4207:6904520,6914259:pet_fonce:4207:6915175,6921897:pet_fonce:4207:6922716'}, {'unwanted_material': 'pet_fonce', 'main_material': 'emr', 'pht_type': 4209, 'ratio': 0.002001176734086916, 'nb_photo': 165, 'list_port_cont': '6613106,6614596,6626457,6628830,6629210,6635370,6641607,6642548,6644426,6646347,6647448,6648893,6654377,6659140,6659225,6660883,6661079,6664546,6664700,6665227,6666079,6666644,6666756,6666950,6668662,6669252,6669485,6669785,6671575,6674270,6678461,6683425,6683978,6702227,6704714,6706892,6708972,6709423,6709577,6711293,6712608,6718881,6719276,6719647,6720634,6722892,6723506,6744910,6748597,6762003,6774109,6776983,6841135,6842934,6847565,6859391', 'assoc_port': '6612572:6613106,6614336:6614596,6625827:6626457,6628455:6628830,6628736:6629210,6630577:6664546,6630578:6664700,6630581:6665227,6630822:6666079,6631384:6668662,6631618:6669785,6633545:6635370,6635651:6661079,6635653:6660883,6639123:6644426,6639695:6642548,6640928:6641607,6645791:6646347,6646682:6647448,6648217:6648893,6652800:6654377,6657819:6659140,6659025:6659225,6665067:6666950,6665718:6666644,6665719:6666756,6668655:6669252,6668656:6669485,6670886:6671575,6673850:6674270,6678032:6678461,6682633:6683425,6683289:6683978,6700555:6704714,6701501:6702227,6706262:6706892,6706760:6709423,6707163:6708972,6707499:6709577,6708643:6712608,6708644:6711293,6718520:6719276,6718521:6718881,6719441:6719647,6720202:6720634,6722573:6722892,6723192:6723506,6744086:6744910,6747584:6748597,6759349:6762003,6773386:6774109,6775574:6776983,6840554:6841135,6842390:6842934,6846972:6847565,6859123:6859391', 'assoc_mat': '6612572:pet_fonce:4209:6613106,6614336:pet_fonce:4209:6614596,6625827:pet_fonce:4209:6626457,6628455:pet_fonce:4209:6628830,6628736:pet_fonce:4209:6629210,6630577:pet_fonce:4209:6664546,6630578:pet_fonce:4209:6664700,6630581:pet_fonce:4209:6665227,6630822:pet_fonce:4209:6666079,6631384:pet_fonce:4209:6668662,6631618:pet_fonce:4209:6669785,6633545:pet_fonce:4209:6635370,6635651:pet_fonce:4209:6661079,6635653:pet_fonce:4209:6660883,6639123:pet_fonce:4209:6644426,6639695:pet_fonce:4209:6642548,6640928:pet_fonce:4209:6641607,6645791:pet_fonce:4209:6646347,6646682:pet_fonce:4209:6647448,6648217:pet_fonce:4209:6648893,6652800:pet_fonce:4209:6654377,6657819:pet_fonce:4209:6659140,6659025:pet_fonce:4209:6659225,6665067:pet_fonce:4209:6666950,6665718:pet_fonce:4209:6666644,6665719:pet_fonce:4209:6666756,6668655:pet_fonce:4209:6669252,6668656:pet_fonce:4209:6669485,6670886:pet_fonce:4209:6671575,6673850:pet_fonce:4209:6674270,6678032:pet_fonce:4209:6678461,6682633:pet_fonce:4209:6683425,6683289:pet_fonce:4209:6683978,6'}, {'unwanted_material': 'pet_fonce', 'main_material': 'gm', 'pht_type': 4209, 'ratio': 0.0009882492230258019, 'nb_photo': 2, 'list_port_cont': '6894805', 'assoc_port': '6894658:6894805', 'assoc_mat': '6894658:pet_fonce:4209:6894805'}, {'unwanted_material': 'pet_fonce', 'main_material': 'pet_fonce', 'pht_type': 4200, 'ratio': 0.9832720072705387, 'nb_photo': 21, 'list_port_cont': '6647700,6861697', 'assoc_port': '6647200:6647700,6861521:6861697', 'assoc_mat': '6647200:pet_fonce:4200:6647700,6861521:pet_fonce:4200:6861697'}, {'unwanted_material': 'pet_opaque', 'main_material': 'emr', 'pht_type': 4207, 'ratio': 0.0006428090611349251, 'nb_photo': 9, 'list_port_cont': '6866496,6868369,6869096,6869546,6878036,6904487,6905142,6905991,6922715', 'assoc_port': '6833565:6878036,6846972:6869546,6852533:6869096,6861517:6868369,6864855:6866496,6903710:6905991,6903712:6904487,6905102:6905142,6921897:6922715', 'assoc_mat': '6833565:pet_opaque:4207:6878036,6846972:pet_opaque:4207:6869546,6852533:pet_opaque:4207:6869096,6861517:pet_opaque:4207:6868369,6864855:pet_opaque:4207:6866496,6903710:pet_opaque:4207:6905991,6903712:pet_opaque:4207:6904487,6905102:pet_opaque:4207:6905142,6921897:pet_opaque:4207:6922715'}, {'unwanted_material': 'pet_opaque', 'main_material': 'emr', 'pht_type': 4209, 'ratio': 0.0005744915736568625, 'nb_photo': 214, 'list_port_cont': '6613105,6614118,6616031,6627858,6628408,6628839,6629216,6629282,6635308,6635367,6639706,6640660,6641595,6644422,6647441,6655823,6657172,6658373,6659149,6660897,6661077,6664543,6664634,6664804,6664940,6665229,6666078,6666656,6666757,6666952,6667994,6668664,6668914,6669254,6669547,6669695,6669784,6669814,6670110,6671566,6671848,6672292,6674152,6676774,6678456,6681180,6683428,6683979,6700223,6704719,6706884,6709575,6711305,6712607,6718352,6718715,6719280,6719890,6720396,6722151,6722589,6722891,6723435,6744915,6748617,6748952,6749035,6760254,6761440,6774110,6776978,6813183,6834135,6834365,6834702,6835809,6839582,6841141,6842938,6853225,6853523,6859402', 'assoc_port': '6612572:6613105,6613636:6614118,6614891:6616031,6627447:6627858,6627801:6628408,6627802:6629282,6628455:6628839,6628736:6629216,6630577:6664543,6630579:6664634,6630580:6664940,6630581:6665229,6630822:6666078,6631154:6667994,6631384:6668664,6631385:6668914,6631618:6669784,6631619:6669814,6631901:6670110,6633543:6635308,6633544:6671848,6633545:6635367,6633546:6672292,6635651:6661077,6635653:6660897,6639123:6644422,6639124:6639706,6640066:6640660,6640928:6641595,6646682:6647441,6655088:6655823,6656505:6657172,6656506:6658373,6657819:6659149,6663042:6664804,6665067:6666952,6665718:6666656,6665719:6666757,6668654:6669695,6668655:6669254,6668657:6669547,6670886:6671566,6671756:6676774,6673385:6674152,6678032:6678456,6680947:6681180,6682633:6683428,6683289:6683979,6699726:6700223,6700555:6704719,6706262:6706884,6707499:6709575,6708643:6712607,6708644:6711305,6715973:6718352,6716500:6718715,6717201:6719890,6718520:6719280,6719951:6720396,6721826:6722589,6721827:6722151,6722573:6722891,6723094:6723435,6744086:6744915,', 'assoc_mat': '6612572:pet_opaque:4209:6613105,6613636:pet_opaque:4209:6614118,6614891:pet_opaque:4209:6616031,6627447:pet_opaque:4209:6627858,6627801:pet_opaque:4209:6628408,6627802:pet_opaque:4209:6629282,6628455:pet_opaque:4209:6628839,6628736:pet_opaque:4209:6629216,6630577:pet_opaque:4209:6664543,6630579:pet_opaque:4209:6664634,6630580:pet_opaque:4209:6664940,6630581:pet_opaque:4209:6665229,6630822:pet_opaque:4209:6666078,6631154:pet_opaque:4209:6667994,6631384:pet_opaque:4209:6668664,6631385:pet_opaque:4209:6668914,6631618:pet_opaque:4209:6669784,6631619:pet_opaque:4209:6669814,6631901:pet_opaque:4209:6670110,6633543:pet_opaque:4209:6635308,6633544:pet_opaque:4209:6671848,6633545:pet_opaque:4209:6635367,6633546:pet_opaque:4209:6672292,6635651:pet_opaque:4209:6661077,6635653:pet_opaque:4209:6660897,6639123:pet_opaque:4209:6644422,6639124:pet_opaque:4209:6639706,6640066:pet_opaque:4209:6640660,6640928:pet_opaque:4209:6641595,6646682:pet_opaque:4209:6647441,6655088:pet_opaque:4209:6655823,6656505:pet_opaque:4209:6657172,'}), 'main_stat': {'nb_photos': 8000}}, 'hostname': (('jetson-2',),), 'impurety_average_per_hashtag': [(('emr', '2022-08', 0.03139712425437559),), (('jrm', '2022-08', 0.00838254816722681),), (('aluminium', '2022-08', 0.006832126052700646),), (('pet_fonce', '2022-08', 0.012910461966287217),), (('gm', '2022-08', 0.009116560536537937),)]} filepath : /home/admin/workarea/git/Velours/python/prod/memo/sla_mensuel/sla_mensuel_Romainville_Presse_2_mois_08_annee_2022.pdf Before plot_photos_and_unwanted_material_summary # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? Before organize_and_plot_unwanted_material_stats {'emr': {'barquette_opaque': ['barquette_opaque', '0.01%', 44], 'carton': ['carton', '0.78%', 1462], 'ela': ['ela', '0.01%', 3], 'etiquette': ['etiquette', '0.08%', 1049], 'film_plastique': ['film_plastique', '0.01%', 9], 'kraft': ['kraft', '0.11%', 1], 'metal': ['metal', '2.6%', 787], 'papier': ['papier', '96.86%', 148871], 'pehd': ['pehd', '0.0%', 2], 'pet_clair': ['pet_clair', '0.04%', 52], 'pet_fonce': ['pet_fonce', '0.2%', 165], 'pet_opaque': ['pet_opaque', '0.06%', 214]}, 'aluminium': {'carton': ['carton', '1.02%', 16], 'metal': ['metal', '98.97%', 54], 'papier': ['papier', '0.13%', 9]}, 'gm': {'carton': ['carton', '0.29%', 10], 'etiquette': ['etiquette', '0.08%', 16], 'metal': ['metal', '3.43%', 14], 'papier': ['papier', '99.03%', 2955], 'pet_clair': ['pet_clair', '0.04%', 1], 'pet_fonce': ['pet_fonce', '0.1%', 2]}, 'pet_fonce': {'carton': ['carton', '0.59%', 4], 'etiquette': ['etiquette', '0.11%', 5], 'papier': ['papier', '1.02%', 31], 'pet_fonce': ['pet_fonce', '98.33%', 21]}} before plot_matierial_repartition before organize_and_plot_coverage_data before organize_and_plot_impurety_average_data before organize_and_plot_quality_photo_data finish generating filepath : /home/admin/workarea/git/Velours/python/prod/memo/sla_mensuel/sla_mensuel_Romainville_Presse_2_mois_08_annee_2022.pdf hash: 9b473a9b7e6f69a2b2147971a7bf4221 for path: /home/admin/workarea/git/Velours/python/prod/memo/sla_mensuel/sla_mensuel_Romainville_Presse_2_mois_08_annee_2022.pdf voici le hostname : marlene hash: 9b473a9b7e6f69a2b2147971a7bf4221 for path: /home/admin/workarea/git/Velours/python/prod/memo/sla_mensuel/sla_mensuel_Romainville_Presse_2_mois_08_annee_2022.pdf ############################### TEST one_day ################################ TODO and TOTEST Removing /home/admin/workarea/git/Velours/python/prod/memo/sla_one_day nb_day : (3, 30) Catched exception ! Connect or reconnect ! (1114, "The table 'monitor_sys' is full") ERROR one_day FAILED ############################### TEST get_data ################################ TODO and TOTEST VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3980 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3980 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3980 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3980 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! {"input_values":[]} SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3994 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3994 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3994 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3994 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11488 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11496 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11497 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11492 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11492 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11495 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11495 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11489 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11489 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11575 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11575 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11491 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11490 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11490 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11498 send_mail_cod have less outputs used (0) than in the step definition (1) : some outputs may be not used ! Step 11499 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11491 doesn't seem to be define in the database( WARNING : type of input 3 of step 11490 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11488 doesn't seem to be define in the database( WARNING : type of input 2 of step 11492 doesn't seem to be define in the database( WARNING : output 1 of step 11488 have datatype=2 whereas input 1 of step 11495 have datatype=7 WARNING : type of output 2 of step 11495 doesn't seem to be define in the database( WARNING : type of input 1 of step 11489 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11491 have datatype=10 whereas input 3 of step 11498 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11575 doesn't seem to be define in the database( WARNING : output 1 of step 11489 have datatype=7 whereas input 2 of step 11575 have datatype=None WARNING : type of output 3 of step 11575 doesn't seem to be define in the database( WARNING : type of input 1 of step 11491 doesn't seem to be define in the database( WARNING : output 0 of step 11491 have datatype=10 whereas input 0 of step 11581 have datatype=18 WARNING : type of input 5 of step 11498 doesn't seem to be define in the database( WARNING : output 0 of step 11581 have datatype=11 whereas input 5 of step 11498 have datatype=None WARNING : type of output 1 of step 11496 doesn't seem to be define in the database( WARNING : type of input 3 of step 11492 doesn't seem to be define in the database( WARNING : type of output 1 of step 11497 doesn't seem to be define in the database( WARNING : type of input 3 of step 11492 doesn't seem to be define in the database( WARNING : output 0 of step 11495 have datatype=1 whereas input 0 of step 11489 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4209, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,metal,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'papier,background', 'hashtag_weights': {'barquette_opaque': 0.7, 'carton': 0.7, 'ela': 0.7, 'etiquette': 0.5, 'film_plastique': 0.5, 'kraft': 0.7, 'metal': 1.5, 'pehd': 0.7, 'pet_clair': 0.7, 'pet_opaque': 0.7, 'textiles_sanitaires': 0.5, 'pet_fonce': 0.7}, 'ETA': 600} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3993 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3993 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3993 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3993 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4207, 'hashtag_proportion': 'barquette_opaque,ela,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'carton,background', 'hashtag_weights': {'barquette_opaque': 1, 'ela': 1, 'etiquette': 1.0, 'film_plastique': 0.5, 'kraft': 1, 'metal': 3.0, 'papier': 1, 'pehd': 2, 'pet_clair': 2, 'pet_opaque': 2, 'textiles_sanitaires': 1.0, 'pet_fonce': 2}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3459 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3459 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3459 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3459 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3726, 'hashtag_proportion': 'Carton_brun,Carton_gris,Teint_Dans_La_Masse,autre_refus,cartonnette,kraft,metal,plastique', 'hashtag_parmi': 'papier,background', 'hashtag_weights': {'Carton_brun': 1.5, 'Carton_gris': 1.5, 'Teint_Dans_La_Masse': 1.0, 'autre_refus': 1.5, 'cartonnette': 1.0, 'kraft': 1.5, 'metal': 3, 'plastique': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3991 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3991 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3991 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3991 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11512 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11521 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11520 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11516 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11516 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11519 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11519 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11513 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11513 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11577 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11577 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11515 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11514 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11514 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11523 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11515 doesn't seem to be define in the database( WARNING : type of input 3 of step 11514 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11512 doesn't seem to be define in the database( WARNING : type of input 2 of step 11516 doesn't seem to be define in the database( WARNING : output 1 of step 11512 have datatype=2 whereas input 1 of step 11519 have datatype=7 WARNING : type of output 2 of step 11519 doesn't seem to be define in the database( WARNING : type of input 1 of step 11513 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11515 have datatype=10 whereas input 3 of step 11522 have datatype=6 WARNING : type of input 2 of step 11577 doesn't seem to be define in the database( WARNING : output 1 of step 11513 have datatype=7 whereas input 2 of step 11577 have datatype=None WARNING : type of output 3 of step 11577 doesn't seem to be define in the database( WARNING : type of input 1 of step 11515 doesn't seem to be define in the database( WARNING : output 0 of step 11515 have datatype=10 whereas input 0 of step 11583 have datatype=18 WARNING : type of input 5 of step 11522 doesn't seem to be define in the database( WARNING : output 0 of step 11583 have datatype=11 whereas input 5 of step 11522 have datatype=None WARNING : type of output 1 of step 11521 doesn't seem to be define in the database( WARNING : type of input 3 of step 11516 doesn't seem to be define in the database( WARNING : type of output 1 of step 11520 doesn't seem to be define in the database( WARNING : type of input 3 of step 11516 doesn't seem to be define in the database( WARNING : output 0 of step 11519 have datatype=1 whereas input 0 of step 11513 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4203, 'hashtag_proportion': 'barquette_opaque,carton,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'ela,background', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 1, 'etiquette': 0.5, 'film_plastique': 0.5, 'kraft': 0.8, 'metal': 2, 'papier': 0.8, 'pehd': 0.8, 'pet_clair': 0.8, 'pet_opaque': 0.8, 'textiles_sanitaires': 0.5, 'pet_fonce': 0.8}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3804 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3804 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3804 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3804 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11560 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11567 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11567 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11563 crop_condition is not consistent : 4 used against 2 in the step definition ! Step 11563 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11564 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11564 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11573 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11573 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11566 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11566 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 1 of step 11560 have datatype=2 whereas input 1 of step 11564 have datatype=7 WARNING : type of output 2 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11565 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11567 doesn't seem to be define in the database( WARNING : type of input 3 of step 11563 doesn't seem to be define in the database( WARNING : type of output 3 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11568 doesn't seem to be define in the database( WARNING : type of output 1 of step 11568 doesn't seem to be define in the database( WARNING : type of input 3 of step 11566 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11570 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11569 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11570 doesn't seem to be define in the database( WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11569 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11568 have datatype=10 whereas input 3 of step 11571 have datatype=6 WARNING : type of input 2 of step 11573 doesn't seem to be define in the database( WARNING : output 1 of step 11565 have datatype=7 whereas input 2 of step 11573 have datatype=None WARNING : type of output 3 of step 11573 doesn't seem to be define in the database( WARNING : type of input 3 of step 11568 doesn't seem to be define in the database( WARNING : output 0 of step 11568 have datatype=10 whereas input 0 of step 11587 have datatype=18 WARNING : type of input 5 of step 11571 doesn't seem to be define in the database( WARNING : output 0 of step 11587 have datatype=11 whereas input 5 of step 11571 have datatype=None WARNING : output 0 of step 11564 have datatype=1 whereas input 0 of step 11565 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3327, 'hashtag_proportion': 'autre,carton,metal,papier,pehd,pet_fonce', 'hashtag_parmi': 'pet_clair,bouchon,etiquette,barquette_avec_film,background', 'hashtag_weights': {'autre': 8.0, 'barquette_avec_film': 6, 'carton': 8.0, 'metal': 12, 'papier': 5, 'pehd': 8, 'pet_fonce': 8, 'bouchon': 8, 'etiquette': 8}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4322 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4322 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4322 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4322 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11978 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11987 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11986 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11982 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11982 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11985 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11985 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11979 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11979 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11990 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11990 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11981 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11980 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11980 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11989 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11981 doesn't seem to be define in the database( WARNING : type of input 3 of step 11980 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11978 doesn't seem to be define in the database( WARNING : type of input 2 of step 11982 doesn't seem to be define in the database( WARNING : output 1 of step 11978 have datatype=2 whereas input 1 of step 11985 have datatype=7 WARNING : type of output 2 of step 11985 doesn't seem to be define in the database( WARNING : type of input 1 of step 11979 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11981 have datatype=10 whereas input 3 of step 11988 have datatype=6 WARNING : type of input 2 of step 11990 doesn't seem to be define in the database( WARNING : output 1 of step 11979 have datatype=7 whereas input 2 of step 11990 have datatype=None WARNING : type of output 3 of step 11990 doesn't seem to be define in the database( WARNING : type of input 1 of step 11981 doesn't seem to be define in the database( WARNING : output 0 of step 11981 have datatype=10 whereas input 0 of step 11991 have datatype=18 WARNING : type of input 5 of step 11988 doesn't seem to be define in the database( WARNING : output 0 of step 11991 have datatype=11 whereas input 5 of step 11988 have datatype=None WARNING : type of output 1 of step 11987 doesn't seem to be define in the database( WARNING : type of input 3 of step 11982 doesn't seem to be define in the database( WARNING : type of output 1 of step 11986 doesn't seem to be define in the database( WARNING : type of input 3 of step 11982 doesn't seem to be define in the database( WARNING : output 0 of step 11985 have datatype=1 whereas input 0 of step 11979 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4461, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,pehd,kraft,metal,papier,pet_fonce,pet_clair,pet_opaque,textiles_sanitaires', 'hashtag_parmi': 'film_plastique', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 0.3, 'ela': 0.3, 'etiquette': 0.1, 'film_plastique': 0.1, 'kraft': 0.3, 'metal': 1.5, 'papier': 0.3, 'pet_clair': 0.3, 'pet_opaque': 0.3, 'textiles_sanitaires': 0.3, 'pet_fonce': 0.3}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3995 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3995 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3995 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3995 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11524 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11533 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11532 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11528 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11528 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11531 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11531 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11525 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11525 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11578 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11578 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11527 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11526 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11526 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11535 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11527 doesn't seem to be define in the database( WARNING : type of input 3 of step 11526 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11524 doesn't seem to be define in the database( WARNING : type of input 2 of step 11528 doesn't seem to be define in the database( WARNING : output 1 of step 11524 have datatype=2 whereas input 1 of step 11531 have datatype=7 WARNING : type of output 2 of step 11531 doesn't seem to be define in the database( WARNING : type of input 1 of step 11525 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11527 have datatype=10 whereas input 3 of step 11534 have datatype=6 WARNING : type of input 2 of step 11578 doesn't seem to be define in the database( WARNING : output 1 of step 11525 have datatype=7 whereas input 2 of step 11578 have datatype=None WARNING : type of output 3 of step 11578 doesn't seem to be define in the database( WARNING : type of input 1 of step 11527 doesn't seem to be define in the database( WARNING : output 0 of step 11527 have datatype=10 whereas input 0 of step 11584 have datatype=18 WARNING : type of input 5 of step 11534 doesn't seem to be define in the database( WARNING : output 0 of step 11584 have datatype=11 whereas input 5 of step 11534 have datatype=None WARNING : type of output 1 of step 11533 doesn't seem to be define in the database( WARNING : type of input 3 of step 11528 doesn't seem to be define in the database( WARNING : type of output 1 of step 11532 doesn't seem to be define in the database( WARNING : type of input 3 of step 11528 doesn't seem to be define in the database( WARNING : output 0 of step 11531 have datatype=1 whereas input 0 of step 11525 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4211, 'hashtag_proportion': 'barquette_opaque,carton,ela,film_plastique,kraft,metal,papier,pet_fonce,pet_clair,pet_opaque,textiles_sanitaires', 'hashtag_parmi': 'pehd,etiquette,background', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 0.3, 'ela': 0.3, 'etiquette': 0.1, 'film_plastique': 0.1, 'kraft': 0.3, 'metal': 1.5, 'papier': 0.3, 'pet_clair': 0.3, 'pet_opaque': 0.3, 'textiles_sanitaires': 0.3, 'pet_fonce': 0.3, 'background': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4153 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4153 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4153 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4153 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11548 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11556 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11557 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11552 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11552 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11555 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11555 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11580 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11580 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11551 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11550 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11550 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11559 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11551 doesn't seem to be define in the database( WARNING : type of input 3 of step 11550 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11548 doesn't seem to be define in the database( WARNING : type of input 2 of step 11552 doesn't seem to be define in the database( WARNING : output 1 of step 11548 have datatype=2 whereas input 1 of step 11555 have datatype=7 WARNING : type of output 2 of step 11555 doesn't seem to be define in the database( WARNING : type of input 1 of step 11549 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11551 have datatype=10 whereas input 3 of step 11558 have datatype=6 WARNING : type of input 2 of step 11580 doesn't seem to be define in the database( WARNING : output 1 of step 11549 have datatype=7 whereas input 2 of step 11580 have datatype=None WARNING : type of output 3 of step 11580 doesn't seem to be define in the database( WARNING : type of input 1 of step 11551 doesn't seem to be define in the database( WARNING : output 0 of step 11551 have datatype=10 whereas input 0 of step 11586 have datatype=18 WARNING : type of input 5 of step 11558 doesn't seem to be define in the database( WARNING : output 0 of step 11586 have datatype=11 whereas input 5 of step 11558 have datatype=None WARNING : type of output 1 of step 11556 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : type of output 1 of step 11557 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : output 0 of step 11555 have datatype=1 whereas input 0 of step 11549 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4200, 'hashtag_proportion': 'carton,ela,film_plastique,kraft,metal,papier,pehd,pet_opaque,textiles_sanitaires,barquette_opaque,pet_clair', 'hashtag_parmi': 'pet_fonce,etiquette,background', 'hashtag_weights': {'barquette_opaque': 1.5, 'carton': 2.5, 'ela': 1.5, 'etiquette': 1.5, 'film_plastique': 1, 'kraft': 1.5, 'metal': 3.0, 'papier': 1.2, 'pehd': 1.5, 'pet_clair': 1.5, 'pet_opaque': 1.5, 'textiles_sanitaires': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3992 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3992 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3992 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3992 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11536 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11545 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11544 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11540 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11540 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11543 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11543 merge_mask_thcl_custom have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 11537 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11579 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11579 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11539 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11538 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11538 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11547 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11539 doesn't seem to be define in the database( WARNING : type of input 3 of step 11538 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11536 doesn't seem to be define in the database( WARNING : type of input 2 of step 11540 doesn't seem to be define in the database( WARNING : output 1 of step 11536 have datatype=2 whereas input 1 of step 11543 have datatype=7 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11539 have datatype=10 whereas input 3 of step 11546 have datatype=6 WARNING : type of input 2 of step 11579 doesn't seem to be define in the database( WARNING : output 1 of step 11537 have datatype=7 whereas input 2 of step 11579 have datatype=None WARNING : type of output 3 of step 11579 doesn't seem to be define in the database( WARNING : type of input 1 of step 11539 doesn't seem to be define in the database( WARNING : output 0 of step 11539 have datatype=10 whereas input 0 of step 11585 have datatype=18 WARNING : type of input 5 of step 11546 doesn't seem to be define in the database( WARNING : output 0 of step 11585 have datatype=11 whereas input 5 of step 11546 have datatype=None WARNING : type of output 1 of step 11545 doesn't seem to be define in the database( WARNING : type of input 3 of step 11540 doesn't seem to be define in the database( WARNING : type of output 1 of step 11544 doesn't seem to be define in the database( WARNING : type of input 3 of step 11540 doesn't seem to be define in the database( WARNING : output 0 of step 11543 have datatype=1 whereas input 0 of step 11537 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4205, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'metal,background', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 1.5, 'ela': 1.5, 'etiquette': 1, 'film_plastique': 1, 'kraft': 1, 'papier': 1, 'pehd': 1.5, 'pet_clair': 1.5, 'pet_opaque': 1.5, 'textiles_sanitaires': 1.5, 'pet_fonce': 1.5}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3318 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3318 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3318 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3594, 'hashtag_proportion': 'papier,carton,metal,pet_clair,autre,pehd,pet_fonce', 'hashtag_parmi': 'refus,background', 'hashtag_weights': {'papier': 1, 'carton': 1, 'metal': 1, 'pet_clair': 1, 'autre': 1, 'pehd': 1, 'pet_fonce': 1, 'refus': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier TODO : Insert select and so on SELECT id, name, misc_info, datou_id_for_right FROM MTRPhoto.dashboard_places WHERE name="Romainville_Presse_1"; SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3980 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3980 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3980 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3980 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! {"input_values":[]} SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3994 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3994 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3994 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3994 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11488 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11496 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11497 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11492 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11492 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11495 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11495 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11489 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11489 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11575 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11575 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11491 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11490 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11490 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11498 send_mail_cod have less outputs used (0) than in the step definition (1) : some outputs may be not used ! Step 11499 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11491 doesn't seem to be define in the database( WARNING : type of input 3 of step 11490 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11488 doesn't seem to be define in the database( WARNING : type of input 2 of step 11492 doesn't seem to be define in the database( WARNING : output 1 of step 11488 have datatype=2 whereas input 1 of step 11495 have datatype=7 WARNING : type of output 2 of step 11495 doesn't seem to be define in the database( WARNING : type of input 1 of step 11489 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11491 have datatype=10 whereas input 3 of step 11498 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11575 doesn't seem to be define in the database( WARNING : output 1 of step 11489 have datatype=7 whereas input 2 of step 11575 have datatype=None WARNING : type of output 3 of step 11575 doesn't seem to be define in the database( WARNING : type of input 1 of step 11491 doesn't seem to be define in the database( WARNING : output 0 of step 11491 have datatype=10 whereas input 0 of step 11581 have datatype=18 WARNING : type of input 5 of step 11498 doesn't seem to be define in the database( WARNING : output 0 of step 11581 have datatype=11 whereas input 5 of step 11498 have datatype=None WARNING : type of output 1 of step 11496 doesn't seem to be define in the database( WARNING : type of input 3 of step 11492 doesn't seem to be define in the database( WARNING : type of output 1 of step 11497 doesn't seem to be define in the database( WARNING : type of input 3 of step 11492 doesn't seem to be define in the database( WARNING : output 0 of step 11495 have datatype=1 whereas input 0 of step 11489 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4209, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,metal,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'papier,background', 'hashtag_weights': {'barquette_opaque': 0.7, 'carton': 0.7, 'ela': 0.7, 'etiquette': 0.5, 'film_plastique': 0.5, 'kraft': 0.7, 'metal': 1.5, 'pehd': 0.7, 'pet_clair': 0.7, 'pet_opaque': 0.7, 'textiles_sanitaires': 0.5, 'pet_fonce': 0.7}, 'ETA': 600} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3993 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3993 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3993 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3993 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4207, 'hashtag_proportion': 'barquette_opaque,ela,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'carton,background', 'hashtag_weights': {'barquette_opaque': 1, 'ela': 1, 'etiquette': 1.0, 'film_plastique': 0.5, 'kraft': 1, 'metal': 3.0, 'papier': 1, 'pehd': 2, 'pet_clair': 2, 'pet_opaque': 2, 'textiles_sanitaires': 1.0, 'pet_fonce': 2}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3459 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3459 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3459 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3459 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3726, 'hashtag_proportion': 'Carton_brun,Carton_gris,Teint_Dans_La_Masse,autre_refus,cartonnette,kraft,metal,plastique', 'hashtag_parmi': 'papier,background', 'hashtag_weights': {'Carton_brun': 1.5, 'Carton_gris': 1.5, 'Teint_Dans_La_Masse': 1.0, 'autre_refus': 1.5, 'cartonnette': 1.0, 'kraft': 1.5, 'metal': 3, 'plastique': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3991 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3991 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3991 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3991 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11512 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11521 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11520 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11516 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11516 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11519 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11519 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11513 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11513 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11577 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11577 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11515 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11514 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11514 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11523 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11515 doesn't seem to be define in the database( WARNING : type of input 3 of step 11514 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11512 doesn't seem to be define in the database( WARNING : type of input 2 of step 11516 doesn't seem to be define in the database( WARNING : output 1 of step 11512 have datatype=2 whereas input 1 of step 11519 have datatype=7 WARNING : type of output 2 of step 11519 doesn't seem to be define in the database( WARNING : type of input 1 of step 11513 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11515 have datatype=10 whereas input 3 of step 11522 have datatype=6 WARNING : type of input 2 of step 11577 doesn't seem to be define in the database( WARNING : output 1 of step 11513 have datatype=7 whereas input 2 of step 11577 have datatype=None WARNING : type of output 3 of step 11577 doesn't seem to be define in the database( WARNING : type of input 1 of step 11515 doesn't seem to be define in the database( WARNING : output 0 of step 11515 have datatype=10 whereas input 0 of step 11583 have datatype=18 WARNING : type of input 5 of step 11522 doesn't seem to be define in the database( WARNING : output 0 of step 11583 have datatype=11 whereas input 5 of step 11522 have datatype=None WARNING : type of output 1 of step 11521 doesn't seem to be define in the database( WARNING : type of input 3 of step 11516 doesn't seem to be define in the database( WARNING : type of output 1 of step 11520 doesn't seem to be define in the database( WARNING : type of input 3 of step 11516 doesn't seem to be define in the database( WARNING : output 0 of step 11519 have datatype=1 whereas input 0 of step 11513 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4203, 'hashtag_proportion': 'barquette_opaque,carton,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'ela,background', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 1, 'etiquette': 0.5, 'film_plastique': 0.5, 'kraft': 0.8, 'metal': 2, 'papier': 0.8, 'pehd': 0.8, 'pet_clair': 0.8, 'pet_opaque': 0.8, 'textiles_sanitaires': 0.5, 'pet_fonce': 0.8}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3804 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3804 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3804 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3804 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11560 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11567 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11567 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11563 crop_condition is not consistent : 4 used against 2 in the step definition ! Step 11563 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11564 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11564 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11573 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11573 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11566 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11566 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 1 of step 11560 have datatype=2 whereas input 1 of step 11564 have datatype=7 WARNING : type of output 2 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11565 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11567 doesn't seem to be define in the database( WARNING : type of input 3 of step 11563 doesn't seem to be define in the database( WARNING : type of output 3 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11568 doesn't seem to be define in the database( WARNING : type of output 1 of step 11568 doesn't seem to be define in the database( WARNING : type of input 3 of step 11566 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11570 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11569 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11570 doesn't seem to be define in the database( WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11569 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11568 have datatype=10 whereas input 3 of step 11571 have datatype=6 WARNING : type of input 2 of step 11573 doesn't seem to be define in the database( WARNING : output 1 of step 11565 have datatype=7 whereas input 2 of step 11573 have datatype=None WARNING : type of output 3 of step 11573 doesn't seem to be define in the database( WARNING : type of input 3 of step 11568 doesn't seem to be define in the database( WARNING : output 0 of step 11568 have datatype=10 whereas input 0 of step 11587 have datatype=18 WARNING : type of input 5 of step 11571 doesn't seem to be define in the database( WARNING : output 0 of step 11587 have datatype=11 whereas input 5 of step 11571 have datatype=None WARNING : output 0 of step 11564 have datatype=1 whereas input 0 of step 11565 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3327, 'hashtag_proportion': 'autre,carton,metal,papier,pehd,pet_fonce', 'hashtag_parmi': 'pet_clair,bouchon,etiquette,barquette_avec_film,background', 'hashtag_weights': {'autre': 8.0, 'barquette_avec_film': 6, 'carton': 8.0, 'metal': 12, 'papier': 5, 'pehd': 8, 'pet_fonce': 8, 'bouchon': 8, 'etiquette': 8}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4322 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4322 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4322 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4322 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11978 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11987 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11986 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11982 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11982 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11985 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11985 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11979 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11979 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11990 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11990 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11981 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11980 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11980 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11989 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11981 doesn't seem to be define in the database( WARNING : type of input 3 of step 11980 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11978 doesn't seem to be define in the database( WARNING : type of input 2 of step 11982 doesn't seem to be define in the database( WARNING : output 1 of step 11978 have datatype=2 whereas input 1 of step 11985 have datatype=7 WARNING : type of output 2 of step 11985 doesn't seem to be define in the database( WARNING : type of input 1 of step 11979 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11981 have datatype=10 whereas input 3 of step 11988 have datatype=6 WARNING : type of input 2 of step 11990 doesn't seem to be define in the database( WARNING : output 1 of step 11979 have datatype=7 whereas input 2 of step 11990 have datatype=None WARNING : type of output 3 of step 11990 doesn't seem to be define in the database( WARNING : type of input 1 of step 11981 doesn't seem to be define in the database( WARNING : output 0 of step 11981 have datatype=10 whereas input 0 of step 11991 have datatype=18 WARNING : type of input 5 of step 11988 doesn't seem to be define in the database( WARNING : output 0 of step 11991 have datatype=11 whereas input 5 of step 11988 have datatype=None WARNING : type of output 1 of step 11987 doesn't seem to be define in the database( WARNING : type of input 3 of step 11982 doesn't seem to be define in the database( WARNING : type of output 1 of step 11986 doesn't seem to be define in the database( WARNING : type of input 3 of step 11982 doesn't seem to be define in the database( WARNING : output 0 of step 11985 have datatype=1 whereas input 0 of step 11979 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4461, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,pehd,kraft,metal,papier,pet_fonce,pet_clair,pet_opaque,textiles_sanitaires', 'hashtag_parmi': 'film_plastique', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 0.3, 'ela': 0.3, 'etiquette': 0.1, 'film_plastique': 0.1, 'kraft': 0.3, 'metal': 1.5, 'papier': 0.3, 'pet_clair': 0.3, 'pet_opaque': 0.3, 'textiles_sanitaires': 0.3, 'pet_fonce': 0.3}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3995 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3995 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3995 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3995 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11524 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11533 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11532 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11528 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11528 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11531 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11531 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11525 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11525 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11578 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11578 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11527 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11526 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11526 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11535 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11527 doesn't seem to be define in the database( WARNING : type of input 3 of step 11526 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11524 doesn't seem to be define in the database( WARNING : type of input 2 of step 11528 doesn't seem to be define in the database( WARNING : output 1 of step 11524 have datatype=2 whereas input 1 of step 11531 have datatype=7 WARNING : type of output 2 of step 11531 doesn't seem to be define in the database( WARNING : type of input 1 of step 11525 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11527 have datatype=10 whereas input 3 of step 11534 have datatype=6 WARNING : type of input 2 of step 11578 doesn't seem to be define in the database( WARNING : output 1 of step 11525 have datatype=7 whereas input 2 of step 11578 have datatype=None WARNING : type of output 3 of step 11578 doesn't seem to be define in the database( WARNING : type of input 1 of step 11527 doesn't seem to be define in the database( WARNING : output 0 of step 11527 have datatype=10 whereas input 0 of step 11584 have datatype=18 WARNING : type of input 5 of step 11534 doesn't seem to be define in the database( WARNING : output 0 of step 11584 have datatype=11 whereas input 5 of step 11534 have datatype=None WARNING : type of output 1 of step 11533 doesn't seem to be define in the database( WARNING : type of input 3 of step 11528 doesn't seem to be define in the database( WARNING : type of output 1 of step 11532 doesn't seem to be define in the database( WARNING : type of input 3 of step 11528 doesn't seem to be define in the database( WARNING : output 0 of step 11531 have datatype=1 whereas input 0 of step 11525 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4211, 'hashtag_proportion': 'barquette_opaque,carton,ela,film_plastique,kraft,metal,papier,pet_fonce,pet_clair,pet_opaque,textiles_sanitaires', 'hashtag_parmi': 'pehd,etiquette,background', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 0.3, 'ela': 0.3, 'etiquette': 0.1, 'film_plastique': 0.1, 'kraft': 0.3, 'metal': 1.5, 'papier': 0.3, 'pet_clair': 0.3, 'pet_opaque': 0.3, 'textiles_sanitaires': 0.3, 'pet_fonce': 0.3, 'background': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4153 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4153 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4153 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4153 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11548 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11556 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11557 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11552 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11552 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11555 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11555 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11580 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11580 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11551 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11550 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11550 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11559 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11551 doesn't seem to be define in the database( WARNING : type of input 3 of step 11550 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11548 doesn't seem to be define in the database( WARNING : type of input 2 of step 11552 doesn't seem to be define in the database( WARNING : output 1 of step 11548 have datatype=2 whereas input 1 of step 11555 have datatype=7 WARNING : type of output 2 of step 11555 doesn't seem to be define in the database( WARNING : type of input 1 of step 11549 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11551 have datatype=10 whereas input 3 of step 11558 have datatype=6 WARNING : type of input 2 of step 11580 doesn't seem to be define in the database( WARNING : output 1 of step 11549 have datatype=7 whereas input 2 of step 11580 have datatype=None WARNING : type of output 3 of step 11580 doesn't seem to be define in the database( WARNING : type of input 1 of step 11551 doesn't seem to be define in the database( WARNING : output 0 of step 11551 have datatype=10 whereas input 0 of step 11586 have datatype=18 WARNING : type of input 5 of step 11558 doesn't seem to be define in the database( WARNING : output 0 of step 11586 have datatype=11 whereas input 5 of step 11558 have datatype=None WARNING : type of output 1 of step 11556 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : type of output 1 of step 11557 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : output 0 of step 11555 have datatype=1 whereas input 0 of step 11549 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4200, 'hashtag_proportion': 'carton,ela,film_plastique,kraft,metal,papier,pehd,pet_opaque,textiles_sanitaires,barquette_opaque,pet_clair', 'hashtag_parmi': 'pet_fonce,etiquette,background', 'hashtag_weights': {'barquette_opaque': 1.5, 'carton': 2.5, 'ela': 1.5, 'etiquette': 1.5, 'film_plastique': 1, 'kraft': 1.5, 'metal': 3.0, 'papier': 1.2, 'pehd': 1.5, 'pet_clair': 1.5, 'pet_opaque': 1.5, 'textiles_sanitaires': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3992 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3992 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3992 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3992 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11536 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11545 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11544 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11540 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11540 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11543 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11543 merge_mask_thcl_custom have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 11537 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11579 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11579 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11539 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11538 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11538 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11547 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11539 doesn't seem to be define in the database( WARNING : type of input 3 of step 11538 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11536 doesn't seem to be define in the database( WARNING : type of input 2 of step 11540 doesn't seem to be define in the database( WARNING : output 1 of step 11536 have datatype=2 whereas input 1 of step 11543 have datatype=7 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11539 have datatype=10 whereas input 3 of step 11546 have datatype=6 WARNING : type of input 2 of step 11579 doesn't seem to be define in the database( WARNING : output 1 of step 11537 have datatype=7 whereas input 2 of step 11579 have datatype=None WARNING : type of output 3 of step 11579 doesn't seem to be define in the database( WARNING : type of input 1 of step 11539 doesn't seem to be define in the database( WARNING : output 0 of step 11539 have datatype=10 whereas input 0 of step 11585 have datatype=18 WARNING : type of input 5 of step 11546 doesn't seem to be define in the database( WARNING : output 0 of step 11585 have datatype=11 whereas input 5 of step 11546 have datatype=None WARNING : type of output 1 of step 11545 doesn't seem to be define in the database( WARNING : type of input 3 of step 11540 doesn't seem to be define in the database( WARNING : type of output 1 of step 11544 doesn't seem to be define in the database( WARNING : type of input 3 of step 11540 doesn't seem to be define in the database( WARNING : output 0 of step 11543 have datatype=1 whereas input 0 of step 11537 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4205, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'metal,background', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 1.5, 'ela': 1.5, 'etiquette': 1, 'film_plastique': 1, 'kraft': 1, 'papier': 1, 'pehd': 1.5, 'pet_clair': 1.5, 'pet_opaque': 1.5, 'textiles_sanitaires': 1.5, 'pet_fonce': 1.5}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3318 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3318 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3318 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3594, 'hashtag_proportion': 'papier,carton,metal,pet_clair,autre,pehd,pet_fonce', 'hashtag_parmi': 'refus,background', 'hashtag_weights': {'papier': 1, 'carton': 1, 'metal': 1, 'pet_clair': 1, 'autre': 1, 'pehd': 1, 'pet_fonce': 1, 'refus': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier nb_day : (0, 31) VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3980 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3980 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3980 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3980 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! {"input_values":[]} SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3994 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3994 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3994 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3994 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11488 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11496 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11497 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11492 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11492 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11495 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11495 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11489 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11489 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11575 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11575 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11491 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11490 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11490 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11498 send_mail_cod have less outputs used (0) than in the step definition (1) : some outputs may be not used ! Step 11499 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11491 doesn't seem to be define in the database( WARNING : type of input 3 of step 11490 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11488 doesn't seem to be define in the database( WARNING : type of input 2 of step 11492 doesn't seem to be define in the database( WARNING : output 1 of step 11488 have datatype=2 whereas input 1 of step 11495 have datatype=7 WARNING : type of output 2 of step 11495 doesn't seem to be define in the database( WARNING : type of input 1 of step 11489 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11491 have datatype=10 whereas input 3 of step 11498 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11575 doesn't seem to be define in the database( WARNING : output 1 of step 11489 have datatype=7 whereas input 2 of step 11575 have datatype=None WARNING : type of output 3 of step 11575 doesn't seem to be define in the database( WARNING : type of input 1 of step 11491 doesn't seem to be define in the database( WARNING : output 0 of step 11491 have datatype=10 whereas input 0 of step 11581 have datatype=18 WARNING : type of input 5 of step 11498 doesn't seem to be define in the database( WARNING : output 0 of step 11581 have datatype=11 whereas input 5 of step 11498 have datatype=None WARNING : type of output 1 of step 11496 doesn't seem to be define in the database( WARNING : type of input 3 of step 11492 doesn't seem to be define in the database( WARNING : type of output 1 of step 11497 doesn't seem to be define in the database( WARNING : type of input 3 of step 11492 doesn't seem to be define in the database( WARNING : output 0 of step 11495 have datatype=1 whereas input 0 of step 11489 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4209, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,metal,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'papier,background', 'hashtag_weights': {'barquette_opaque': 0.7, 'carton': 0.7, 'ela': 0.7, 'etiquette': 0.5, 'film_plastique': 0.5, 'kraft': 0.7, 'metal': 1.5, 'pehd': 0.7, 'pet_clair': 0.7, 'pet_opaque': 0.7, 'textiles_sanitaires': 0.5, 'pet_fonce': 0.7}, 'ETA': 600} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3993 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3993 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3993 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3993 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4207, 'hashtag_proportion': 'barquette_opaque,ela,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'carton,background', 'hashtag_weights': {'barquette_opaque': 1, 'ela': 1, 'etiquette': 1.0, 'film_plastique': 0.5, 'kraft': 1, 'metal': 3.0, 'papier': 1, 'pehd': 2, 'pet_clair': 2, 'pet_opaque': 2, 'textiles_sanitaires': 1.0, 'pet_fonce': 2}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3459 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3459 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3459 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3459 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3726, 'hashtag_proportion': 'Carton_brun,Carton_gris,Teint_Dans_La_Masse,autre_refus,cartonnette,kraft,metal,plastique', 'hashtag_parmi': 'papier,background', 'hashtag_weights': {'Carton_brun': 1.5, 'Carton_gris': 1.5, 'Teint_Dans_La_Masse': 1.0, 'autre_refus': 1.5, 'cartonnette': 1.0, 'kraft': 1.5, 'metal': 3, 'plastique': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3991 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3991 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3991 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3991 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11512 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11521 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11520 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11516 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11516 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11519 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11519 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11513 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11513 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11577 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11577 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11515 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11514 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11514 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11523 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11515 doesn't seem to be define in the database( WARNING : type of input 3 of step 11514 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11512 doesn't seem to be define in the database( WARNING : type of input 2 of step 11516 doesn't seem to be define in the database( WARNING : output 1 of step 11512 have datatype=2 whereas input 1 of step 11519 have datatype=7 WARNING : type of output 2 of step 11519 doesn't seem to be define in the database( WARNING : type of input 1 of step 11513 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11515 have datatype=10 whereas input 3 of step 11522 have datatype=6 WARNING : type of input 2 of step 11577 doesn't seem to be define in the database( WARNING : output 1 of step 11513 have datatype=7 whereas input 2 of step 11577 have datatype=None WARNING : type of output 3 of step 11577 doesn't seem to be define in the database( WARNING : type of input 1 of step 11515 doesn't seem to be define in the database( WARNING : output 0 of step 11515 have datatype=10 whereas input 0 of step 11583 have datatype=18 WARNING : type of input 5 of step 11522 doesn't seem to be define in the database( WARNING : output 0 of step 11583 have datatype=11 whereas input 5 of step 11522 have datatype=None WARNING : type of output 1 of step 11521 doesn't seem to be define in the database( WARNING : type of input 3 of step 11516 doesn't seem to be define in the database( WARNING : type of output 1 of step 11520 doesn't seem to be define in the database( WARNING : type of input 3 of step 11516 doesn't seem to be define in the database( WARNING : output 0 of step 11519 have datatype=1 whereas input 0 of step 11513 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4203, 'hashtag_proportion': 'barquette_opaque,carton,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'ela,background', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 1, 'etiquette': 0.5, 'film_plastique': 0.5, 'kraft': 0.8, 'metal': 2, 'papier': 0.8, 'pehd': 0.8, 'pet_clair': 0.8, 'pet_opaque': 0.8, 'textiles_sanitaires': 0.5, 'pet_fonce': 0.8}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3804 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3804 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3804 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3804 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11560 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11567 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11567 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11563 crop_condition is not consistent : 4 used against 2 in the step definition ! Step 11563 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11564 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11564 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11573 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11573 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11566 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11566 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 1 of step 11560 have datatype=2 whereas input 1 of step 11564 have datatype=7 WARNING : type of output 2 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11565 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11567 doesn't seem to be define in the database( WARNING : type of input 3 of step 11563 doesn't seem to be define in the database( WARNING : type of output 3 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11568 doesn't seem to be define in the database( WARNING : type of output 1 of step 11568 doesn't seem to be define in the database( WARNING : type of input 3 of step 11566 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11570 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11569 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11570 doesn't seem to be define in the database( WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11569 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11568 have datatype=10 whereas input 3 of step 11571 have datatype=6 WARNING : type of input 2 of step 11573 doesn't seem to be define in the database( WARNING : output 1 of step 11565 have datatype=7 whereas input 2 of step 11573 have datatype=None WARNING : type of output 3 of step 11573 doesn't seem to be define in the database( WARNING : type of input 3 of step 11568 doesn't seem to be define in the database( WARNING : output 0 of step 11568 have datatype=10 whereas input 0 of step 11587 have datatype=18 WARNING : type of input 5 of step 11571 doesn't seem to be define in the database( WARNING : output 0 of step 11587 have datatype=11 whereas input 5 of step 11571 have datatype=None WARNING : output 0 of step 11564 have datatype=1 whereas input 0 of step 11565 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3327, 'hashtag_proportion': 'autre,carton,metal,papier,pehd,pet_fonce', 'hashtag_parmi': 'pet_clair,bouchon,etiquette,barquette_avec_film,background', 'hashtag_weights': {'autre': 8.0, 'barquette_avec_film': 6, 'carton': 8.0, 'metal': 12, 'papier': 5, 'pehd': 8, 'pet_fonce': 8, 'bouchon': 8, 'etiquette': 8}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4322 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4322 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4322 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4322 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11978 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11987 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11986 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11982 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11982 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11985 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11985 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11979 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11979 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11990 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11990 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11981 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11980 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11980 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11989 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11981 doesn't seem to be define in the database( WARNING : type of input 3 of step 11980 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11978 doesn't seem to be define in the database( WARNING : type of input 2 of step 11982 doesn't seem to be define in the database( WARNING : output 1 of step 11978 have datatype=2 whereas input 1 of step 11985 have datatype=7 WARNING : type of output 2 of step 11985 doesn't seem to be define in the database( WARNING : type of input 1 of step 11979 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11981 have datatype=10 whereas input 3 of step 11988 have datatype=6 WARNING : type of input 2 of step 11990 doesn't seem to be define in the database( WARNING : output 1 of step 11979 have datatype=7 whereas input 2 of step 11990 have datatype=None WARNING : type of output 3 of step 11990 doesn't seem to be define in the database( WARNING : type of input 1 of step 11981 doesn't seem to be define in the database( WARNING : output 0 of step 11981 have datatype=10 whereas input 0 of step 11991 have datatype=18 WARNING : type of input 5 of step 11988 doesn't seem to be define in the database( WARNING : output 0 of step 11991 have datatype=11 whereas input 5 of step 11988 have datatype=None WARNING : type of output 1 of step 11987 doesn't seem to be define in the database( WARNING : type of input 3 of step 11982 doesn't seem to be define in the database( WARNING : type of output 1 of step 11986 doesn't seem to be define in the database( WARNING : type of input 3 of step 11982 doesn't seem to be define in the database( WARNING : output 0 of step 11985 have datatype=1 whereas input 0 of step 11979 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4461, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,pehd,kraft,metal,papier,pet_fonce,pet_clair,pet_opaque,textiles_sanitaires', 'hashtag_parmi': 'film_plastique', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 0.3, 'ela': 0.3, 'etiquette': 0.1, 'film_plastique': 0.1, 'kraft': 0.3, 'metal': 1.5, 'papier': 0.3, 'pet_clair': 0.3, 'pet_opaque': 0.3, 'textiles_sanitaires': 0.3, 'pet_fonce': 0.3}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3995 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3995 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3995 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3995 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11524 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11533 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11532 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11528 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11528 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11531 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11531 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11525 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11525 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11578 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11578 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11527 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11526 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11526 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11535 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11527 doesn't seem to be define in the database( WARNING : type of input 3 of step 11526 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11524 doesn't seem to be define in the database( WARNING : type of input 2 of step 11528 doesn't seem to be define in the database( WARNING : output 1 of step 11524 have datatype=2 whereas input 1 of step 11531 have datatype=7 WARNING : type of output 2 of step 11531 doesn't seem to be define in the database( WARNING : type of input 1 of step 11525 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11527 have datatype=10 whereas input 3 of step 11534 have datatype=6 WARNING : type of input 2 of step 11578 doesn't seem to be define in the database( WARNING : output 1 of step 11525 have datatype=7 whereas input 2 of step 11578 have datatype=None WARNING : type of output 3 of step 11578 doesn't seem to be define in the database( WARNING : type of input 1 of step 11527 doesn't seem to be define in the database( WARNING : output 0 of step 11527 have datatype=10 whereas input 0 of step 11584 have datatype=18 WARNING : type of input 5 of step 11534 doesn't seem to be define in the database( WARNING : output 0 of step 11584 have datatype=11 whereas input 5 of step 11534 have datatype=None WARNING : type of output 1 of step 11533 doesn't seem to be define in the database( WARNING : type of input 3 of step 11528 doesn't seem to be define in the database( WARNING : type of output 1 of step 11532 doesn't seem to be define in the database( WARNING : type of input 3 of step 11528 doesn't seem to be define in the database( WARNING : output 0 of step 11531 have datatype=1 whereas input 0 of step 11525 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4211, 'hashtag_proportion': 'barquette_opaque,carton,ela,film_plastique,kraft,metal,papier,pet_fonce,pet_clair,pet_opaque,textiles_sanitaires', 'hashtag_parmi': 'pehd,etiquette,background', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 0.3, 'ela': 0.3, 'etiquette': 0.1, 'film_plastique': 0.1, 'kraft': 0.3, 'metal': 1.5, 'papier': 0.3, 'pet_clair': 0.3, 'pet_opaque': 0.3, 'textiles_sanitaires': 0.3, 'pet_fonce': 0.3, 'background': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4153 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4153 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4153 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4153 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11548 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11556 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11557 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11552 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11552 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11555 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11555 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11580 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11580 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11551 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11550 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11550 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11559 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11551 doesn't seem to be define in the database( WARNING : type of input 3 of step 11550 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11548 doesn't seem to be define in the database( WARNING : type of input 2 of step 11552 doesn't seem to be define in the database( WARNING : output 1 of step 11548 have datatype=2 whereas input 1 of step 11555 have datatype=7 WARNING : type of output 2 of step 11555 doesn't seem to be define in the database( WARNING : type of input 1 of step 11549 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11551 have datatype=10 whereas input 3 of step 11558 have datatype=6 WARNING : type of input 2 of step 11580 doesn't seem to be define in the database( WARNING : output 1 of step 11549 have datatype=7 whereas input 2 of step 11580 have datatype=None WARNING : type of output 3 of step 11580 doesn't seem to be define in the database( WARNING : type of input 1 of step 11551 doesn't seem to be define in the database( WARNING : output 0 of step 11551 have datatype=10 whereas input 0 of step 11586 have datatype=18 WARNING : type of input 5 of step 11558 doesn't seem to be define in the database( WARNING : output 0 of step 11586 have datatype=11 whereas input 5 of step 11558 have datatype=None WARNING : type of output 1 of step 11556 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : type of output 1 of step 11557 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : output 0 of step 11555 have datatype=1 whereas input 0 of step 11549 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4200, 'hashtag_proportion': 'carton,ela,film_plastique,kraft,metal,papier,pehd,pet_opaque,textiles_sanitaires,barquette_opaque,pet_clair', 'hashtag_parmi': 'pet_fonce,etiquette,background', 'hashtag_weights': {'barquette_opaque': 1.5, 'carton': 2.5, 'ela': 1.5, 'etiquette': 1.5, 'film_plastique': 1, 'kraft': 1.5, 'metal': 3.0, 'papier': 1.2, 'pehd': 1.5, 'pet_clair': 1.5, 'pet_opaque': 1.5, 'textiles_sanitaires': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3992 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3992 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3992 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3992 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11536 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11545 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11544 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11540 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11540 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11543 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11543 merge_mask_thcl_custom have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 11537 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11579 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11579 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11539 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11538 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11538 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11547 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11539 doesn't seem to be define in the database( WARNING : type of input 3 of step 11538 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11536 doesn't seem to be define in the database( WARNING : type of input 2 of step 11540 doesn't seem to be define in the database( WARNING : output 1 of step 11536 have datatype=2 whereas input 1 of step 11543 have datatype=7 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11539 have datatype=10 whereas input 3 of step 11546 have datatype=6 WARNING : type of input 2 of step 11579 doesn't seem to be define in the database( WARNING : output 1 of step 11537 have datatype=7 whereas input 2 of step 11579 have datatype=None WARNING : type of output 3 of step 11579 doesn't seem to be define in the database( WARNING : type of input 1 of step 11539 doesn't seem to be define in the database( WARNING : output 0 of step 11539 have datatype=10 whereas input 0 of step 11585 have datatype=18 WARNING : type of input 5 of step 11546 doesn't seem to be define in the database( WARNING : output 0 of step 11585 have datatype=11 whereas input 5 of step 11546 have datatype=None WARNING : type of output 1 of step 11545 doesn't seem to be define in the database( WARNING : type of input 3 of step 11540 doesn't seem to be define in the database( WARNING : type of output 1 of step 11544 doesn't seem to be define in the database( WARNING : type of input 3 of step 11540 doesn't seem to be define in the database( WARNING : output 0 of step 11543 have datatype=1 whereas input 0 of step 11537 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4205, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'metal,background', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 1.5, 'ela': 1.5, 'etiquette': 1, 'film_plastique': 1, 'kraft': 1, 'papier': 1, 'pehd': 1.5, 'pet_clair': 1.5, 'pet_opaque': 1.5, 'textiles_sanitaires': 1.5, 'pet_fonce': 1.5}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3318 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3318 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3318 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3594, 'hashtag_proportion': 'papier,carton,metal,pet_clair,autre,pehd,pet_fonce', 'hashtag_parmi': 'refus,background', 'hashtag_weights': {'papier': 1, 'carton': 1, 'metal': 1, 'pet_clair': 1, 'autre': 1, 'pehd': 1, 'pet_fonce': 1, 'refus': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier TODO : Insert select and so on SELECT id, name, misc_info, datou_id_for_right FROM MTRPhoto.dashboard_places WHERE name="Romainville_Presse_1"; SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3980 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3980 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3980 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3980 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! {"input_values":[]} SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3994 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3994 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3994 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3994 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11488 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11496 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11497 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11492 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11492 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11495 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11495 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11489 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11489 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11575 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11575 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11491 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11490 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11490 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11498 send_mail_cod have less outputs used (0) than in the step definition (1) : some outputs may be not used ! Step 11499 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11491 doesn't seem to be define in the database( WARNING : type of input 3 of step 11490 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11488 doesn't seem to be define in the database( WARNING : type of input 2 of step 11492 doesn't seem to be define in the database( WARNING : output 1 of step 11488 have datatype=2 whereas input 1 of step 11495 have datatype=7 WARNING : type of output 2 of step 11495 doesn't seem to be define in the database( WARNING : type of input 1 of step 11489 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11491 have datatype=10 whereas input 3 of step 11498 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11575 doesn't seem to be define in the database( WARNING : output 1 of step 11489 have datatype=7 whereas input 2 of step 11575 have datatype=None WARNING : type of output 3 of step 11575 doesn't seem to be define in the database( WARNING : type of input 1 of step 11491 doesn't seem to be define in the database( WARNING : output 0 of step 11491 have datatype=10 whereas input 0 of step 11581 have datatype=18 WARNING : type of input 5 of step 11498 doesn't seem to be define in the database( WARNING : output 0 of step 11581 have datatype=11 whereas input 5 of step 11498 have datatype=None WARNING : type of output 1 of step 11496 doesn't seem to be define in the database( WARNING : type of input 3 of step 11492 doesn't seem to be define in the database( WARNING : type of output 1 of step 11497 doesn't seem to be define in the database( WARNING : type of input 3 of step 11492 doesn't seem to be define in the database( WARNING : output 0 of step 11495 have datatype=1 whereas input 0 of step 11489 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4209, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,metal,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'papier,background', 'hashtag_weights': {'barquette_opaque': 0.7, 'carton': 0.7, 'ela': 0.7, 'etiquette': 0.5, 'film_plastique': 0.5, 'kraft': 0.7, 'metal': 1.5, 'pehd': 0.7, 'pet_clair': 0.7, 'pet_opaque': 0.7, 'textiles_sanitaires': 0.5, 'pet_fonce': 0.7}, 'ETA': 600} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3993 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3993 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3993 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3993 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4207, 'hashtag_proportion': 'barquette_opaque,ela,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'carton,background', 'hashtag_weights': {'barquette_opaque': 1, 'ela': 1, 'etiquette': 1.0, 'film_plastique': 0.5, 'kraft': 1, 'metal': 3.0, 'papier': 1, 'pehd': 2, 'pet_clair': 2, 'pet_opaque': 2, 'textiles_sanitaires': 1.0, 'pet_fonce': 2}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3459 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3459 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3459 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3459 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3726, 'hashtag_proportion': 'Carton_brun,Carton_gris,Teint_Dans_La_Masse,autre_refus,cartonnette,kraft,metal,plastique', 'hashtag_parmi': 'papier,background', 'hashtag_weights': {'Carton_brun': 1.5, 'Carton_gris': 1.5, 'Teint_Dans_La_Masse': 1.0, 'autre_refus': 1.5, 'cartonnette': 1.0, 'kraft': 1.5, 'metal': 3, 'plastique': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3991 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3991 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3991 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3991 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11512 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11521 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11520 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11516 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11516 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11519 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11519 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11513 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11513 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11577 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11577 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11515 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11514 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11514 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11523 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11515 doesn't seem to be define in the database( WARNING : type of input 3 of step 11514 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11512 doesn't seem to be define in the database( WARNING : type of input 2 of step 11516 doesn't seem to be define in the database( WARNING : output 1 of step 11512 have datatype=2 whereas input 1 of step 11519 have datatype=7 WARNING : type of output 2 of step 11519 doesn't seem to be define in the database( WARNING : type of input 1 of step 11513 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11515 have datatype=10 whereas input 3 of step 11522 have datatype=6 WARNING : type of input 2 of step 11577 doesn't seem to be define in the database( WARNING : output 1 of step 11513 have datatype=7 whereas input 2 of step 11577 have datatype=None WARNING : type of output 3 of step 11577 doesn't seem to be define in the database( WARNING : type of input 1 of step 11515 doesn't seem to be define in the database( WARNING : output 0 of step 11515 have datatype=10 whereas input 0 of step 11583 have datatype=18 WARNING : type of input 5 of step 11522 doesn't seem to be define in the database( WARNING : output 0 of step 11583 have datatype=11 whereas input 5 of step 11522 have datatype=None WARNING : type of output 1 of step 11521 doesn't seem to be define in the database( WARNING : type of input 3 of step 11516 doesn't seem to be define in the database( WARNING : type of output 1 of step 11520 doesn't seem to be define in the database( WARNING : type of input 3 of step 11516 doesn't seem to be define in the database( WARNING : output 0 of step 11519 have datatype=1 whereas input 0 of step 11513 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4203, 'hashtag_proportion': 'barquette_opaque,carton,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'ela,background', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 1, 'etiquette': 0.5, 'film_plastique': 0.5, 'kraft': 0.8, 'metal': 2, 'papier': 0.8, 'pehd': 0.8, 'pet_clair': 0.8, 'pet_opaque': 0.8, 'textiles_sanitaires': 0.5, 'pet_fonce': 0.8}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3804 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3804 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3804 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3804 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11560 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11567 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11567 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11563 crop_condition is not consistent : 4 used against 2 in the step definition ! Step 11563 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11564 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11564 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11573 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11573 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11566 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11566 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 1 of step 11560 have datatype=2 whereas input 1 of step 11564 have datatype=7 WARNING : type of output 2 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11565 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11567 doesn't seem to be define in the database( WARNING : type of input 3 of step 11563 doesn't seem to be define in the database( WARNING : type of output 3 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11568 doesn't seem to be define in the database( WARNING : type of output 1 of step 11568 doesn't seem to be define in the database( WARNING : type of input 3 of step 11566 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11570 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11569 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11570 doesn't seem to be define in the database( WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11569 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11568 have datatype=10 whereas input 3 of step 11571 have datatype=6 WARNING : type of input 2 of step 11573 doesn't seem to be define in the database( WARNING : output 1 of step 11565 have datatype=7 whereas input 2 of step 11573 have datatype=None WARNING : type of output 3 of step 11573 doesn't seem to be define in the database( WARNING : type of input 3 of step 11568 doesn't seem to be define in the database( WARNING : output 0 of step 11568 have datatype=10 whereas input 0 of step 11587 have datatype=18 WARNING : type of input 5 of step 11571 doesn't seem to be define in the database( WARNING : output 0 of step 11587 have datatype=11 whereas input 5 of step 11571 have datatype=None WARNING : output 0 of step 11564 have datatype=1 whereas input 0 of step 11565 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3327, 'hashtag_proportion': 'autre,carton,metal,papier,pehd,pet_fonce', 'hashtag_parmi': 'pet_clair,bouchon,etiquette,barquette_avec_film,background', 'hashtag_weights': {'autre': 8.0, 'barquette_avec_film': 6, 'carton': 8.0, 'metal': 12, 'papier': 5, 'pehd': 8, 'pet_fonce': 8, 'bouchon': 8, 'etiquette': 8}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4322 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4322 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4322 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4322 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11978 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11987 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11986 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11982 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11982 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11985 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11985 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11979 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11979 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11990 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11990 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11981 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11980 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11980 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11989 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11981 doesn't seem to be define in the database( WARNING : type of input 3 of step 11980 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11978 doesn't seem to be define in the database( WARNING : type of input 2 of step 11982 doesn't seem to be define in the database( WARNING : output 1 of step 11978 have datatype=2 whereas input 1 of step 11985 have datatype=7 WARNING : type of output 2 of step 11985 doesn't seem to be define in the database( WARNING : type of input 1 of step 11979 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11981 have datatype=10 whereas input 3 of step 11988 have datatype=6 WARNING : type of input 2 of step 11990 doesn't seem to be define in the database( WARNING : output 1 of step 11979 have datatype=7 whereas input 2 of step 11990 have datatype=None WARNING : type of output 3 of step 11990 doesn't seem to be define in the database( WARNING : type of input 1 of step 11981 doesn't seem to be define in the database( WARNING : output 0 of step 11981 have datatype=10 whereas input 0 of step 11991 have datatype=18 WARNING : type of input 5 of step 11988 doesn't seem to be define in the database( WARNING : output 0 of step 11991 have datatype=11 whereas input 5 of step 11988 have datatype=None WARNING : type of output 1 of step 11987 doesn't seem to be define in the database( WARNING : type of input 3 of step 11982 doesn't seem to be define in the database( WARNING : type of output 1 of step 11986 doesn't seem to be define in the database( WARNING : type of input 3 of step 11982 doesn't seem to be define in the database( WARNING : output 0 of step 11985 have datatype=1 whereas input 0 of step 11979 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4461, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,pehd,kraft,metal,papier,pet_fonce,pet_clair,pet_opaque,textiles_sanitaires', 'hashtag_parmi': 'film_plastique', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 0.3, 'ela': 0.3, 'etiquette': 0.1, 'film_plastique': 0.1, 'kraft': 0.3, 'metal': 1.5, 'papier': 0.3, 'pet_clair': 0.3, 'pet_opaque': 0.3, 'textiles_sanitaires': 0.3, 'pet_fonce': 0.3}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3995 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3995 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3995 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3995 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11524 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11533 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11532 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11528 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11528 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11531 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11531 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11525 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11525 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11578 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11578 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11527 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11526 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11526 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11535 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11527 doesn't seem to be define in the database( WARNING : type of input 3 of step 11526 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11524 doesn't seem to be define in the database( WARNING : type of input 2 of step 11528 doesn't seem to be define in the database( WARNING : output 1 of step 11524 have datatype=2 whereas input 1 of step 11531 have datatype=7 WARNING : type of output 2 of step 11531 doesn't seem to be define in the database( WARNING : type of input 1 of step 11525 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11527 have datatype=10 whereas input 3 of step 11534 have datatype=6 WARNING : type of input 2 of step 11578 doesn't seem to be define in the database( WARNING : output 1 of step 11525 have datatype=7 whereas input 2 of step 11578 have datatype=None WARNING : type of output 3 of step 11578 doesn't seem to be define in the database( WARNING : type of input 1 of step 11527 doesn't seem to be define in the database( WARNING : output 0 of step 11527 have datatype=10 whereas input 0 of step 11584 have datatype=18 WARNING : type of input 5 of step 11534 doesn't seem to be define in the database( WARNING : output 0 of step 11584 have datatype=11 whereas input 5 of step 11534 have datatype=None WARNING : type of output 1 of step 11533 doesn't seem to be define in the database( WARNING : type of input 3 of step 11528 doesn't seem to be define in the database( WARNING : type of output 1 of step 11532 doesn't seem to be define in the database( WARNING : type of input 3 of step 11528 doesn't seem to be define in the database( WARNING : output 0 of step 11531 have datatype=1 whereas input 0 of step 11525 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4211, 'hashtag_proportion': 'barquette_opaque,carton,ela,film_plastique,kraft,metal,papier,pet_fonce,pet_clair,pet_opaque,textiles_sanitaires', 'hashtag_parmi': 'pehd,etiquette,background', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 0.3, 'ela': 0.3, 'etiquette': 0.1, 'film_plastique': 0.1, 'kraft': 0.3, 'metal': 1.5, 'papier': 0.3, 'pet_clair': 0.3, 'pet_opaque': 0.3, 'textiles_sanitaires': 0.3, 'pet_fonce': 0.3, 'background': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4153 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4153 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4153 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4153 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11548 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11556 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11557 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11552 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11552 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11555 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11555 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11580 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11580 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11551 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11550 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11550 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11559 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11551 doesn't seem to be define in the database( WARNING : type of input 3 of step 11550 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11548 doesn't seem to be define in the database( WARNING : type of input 2 of step 11552 doesn't seem to be define in the database( WARNING : output 1 of step 11548 have datatype=2 whereas input 1 of step 11555 have datatype=7 WARNING : type of output 2 of step 11555 doesn't seem to be define in the database( WARNING : type of input 1 of step 11549 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11551 have datatype=10 whereas input 3 of step 11558 have datatype=6 WARNING : type of input 2 of step 11580 doesn't seem to be define in the database( WARNING : output 1 of step 11549 have datatype=7 whereas input 2 of step 11580 have datatype=None WARNING : type of output 3 of step 11580 doesn't seem to be define in the database( WARNING : type of input 1 of step 11551 doesn't seem to be define in the database( WARNING : output 0 of step 11551 have datatype=10 whereas input 0 of step 11586 have datatype=18 WARNING : type of input 5 of step 11558 doesn't seem to be define in the database( WARNING : output 0 of step 11586 have datatype=11 whereas input 5 of step 11558 have datatype=None WARNING : type of output 1 of step 11556 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : type of output 1 of step 11557 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : output 0 of step 11555 have datatype=1 whereas input 0 of step 11549 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4200, 'hashtag_proportion': 'carton,ela,film_plastique,kraft,metal,papier,pehd,pet_opaque,textiles_sanitaires,barquette_opaque,pet_clair', 'hashtag_parmi': 'pet_fonce,etiquette,background', 'hashtag_weights': {'barquette_opaque': 1.5, 'carton': 2.5, 'ela': 1.5, 'etiquette': 1.5, 'film_plastique': 1, 'kraft': 1.5, 'metal': 3.0, 'papier': 1.2, 'pehd': 1.5, 'pet_clair': 1.5, 'pet_opaque': 1.5, 'textiles_sanitaires': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3992 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3992 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3992 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3992 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11536 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11545 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11544 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11540 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11540 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11543 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11543 merge_mask_thcl_custom have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 11537 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11579 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11579 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11539 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11538 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11538 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11547 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11539 doesn't seem to be define in the database( WARNING : type of input 3 of step 11538 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11536 doesn't seem to be define in the database( WARNING : type of input 2 of step 11540 doesn't seem to be define in the database( WARNING : output 1 of step 11536 have datatype=2 whereas input 1 of step 11543 have datatype=7 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11539 have datatype=10 whereas input 3 of step 11546 have datatype=6 WARNING : type of input 2 of step 11579 doesn't seem to be define in the database( WARNING : output 1 of step 11537 have datatype=7 whereas input 2 of step 11579 have datatype=None WARNING : type of output 3 of step 11579 doesn't seem to be define in the database( WARNING : type of input 1 of step 11539 doesn't seem to be define in the database( WARNING : output 0 of step 11539 have datatype=10 whereas input 0 of step 11585 have datatype=18 WARNING : type of input 5 of step 11546 doesn't seem to be define in the database( WARNING : output 0 of step 11585 have datatype=11 whereas input 5 of step 11546 have datatype=None WARNING : type of output 1 of step 11545 doesn't seem to be define in the database( WARNING : type of input 3 of step 11540 doesn't seem to be define in the database( WARNING : type of output 1 of step 11544 doesn't seem to be define in the database( WARNING : type of input 3 of step 11540 doesn't seem to be define in the database( WARNING : output 0 of step 11543 have datatype=1 whereas input 0 of step 11537 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4205, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'metal,background', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 1.5, 'ela': 1.5, 'etiquette': 1, 'film_plastique': 1, 'kraft': 1, 'papier': 1, 'pehd': 1.5, 'pet_clair': 1.5, 'pet_opaque': 1.5, 'textiles_sanitaires': 1.5, 'pet_fonce': 1.5}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3318 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3318 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3318 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3594, 'hashtag_proportion': 'papier,carton,metal,pet_clair,autre,pehd,pet_fonce', 'hashtag_parmi': 'refus,background', 'hashtag_weights': {'papier': 1, 'carton': 1, 'metal': 1, 'pet_clair': 1, 'autre': 1, 'pehd': 1, 'pet_fonce': 1, 'refus': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier place_id : 53 month : 08 mtr_id : 1038 dashboard_places : Romainville_Presse_1 date : 2022-08 year : 2022 raspi : 20064 select count(distinct mtr_photo_id) from MTRUser.mtr_portfolio_photos where mtr_portfolio_id in (select id from MTRUser.mtr_portfolios where id in (select mtr_portfolio_id from MTRPhoto.dashboard_results where dashboard_run_id in(select last_run_id from MTRPhoto.dashboard_entry_day where dashboard_place_id in (select id from MTRPhoto.dashboard_places where name = 'Romainville_Presse_1' and date like '%2022-08%') and created_at like '%2022-08%'))); nb_day : (0, 31) after unwanted_material_data nb_day : (0, 31) SQL: SELECT ms.id, ms.name, mst.name as type, ms.test_group, ms.test_name, ms.server, ms.version_code, ms.result_str, ms.result_bool, ms.result_float, ms.lien, ms.created_at FROM MTRAdmin.monitor_sys ms INNER JOIN MTRAdmin.monitor_sys_type mst on mst.id = ms.type WHERE ms.test_name like '%20064%' AND ms.result_str like '%2022/08%'ORDER BY ms.id desc LIMIT 0, 1000000; No error ? {'log_dict': {'total_nb_images': 2984, 'max_time_between_images': '0 days 1044 seconds', 'coverage_pause': '0 days 3936 seconds', 'coverage_times_pause': '0 days 6834 seconds', 'nb_photos_decision': 11774, 'nb_gray_level_ok': 4617, 'nb_dedup_ok': 11773, 'nb_two_criteria_ok': 4616, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1498, 'end_of_day_photos_pink': 20, 'end_of_day_photos_dark': 5638, 'end_of_day_photos_duplicated': 1, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 181, 'end_of_day_photos_uploaded': 4415, 'ratio_coverage': 0.06941921374274679}, 'dashboard_dict': {'nb_ptf_finished': 19, 'nb_images_finished': 1263, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 10, 'nb_images_started': 564, 'nb_selected_images': 1827, 'last_update': '2022/09/04', 'portfolio_id': 6911337, 'last_run_id': 479886, 'total_number_of_photos': 4031}} No error ? {'log_dict': {'total_nb_images': 3320, 'max_time_between_images': '0 days 466 seconds', 'coverage_pause': '0 days 3320 seconds', 'coverage_times_pause': '0 days 6640 seconds', 'nb_photos_decision': 3929, 'nb_gray_level_ok': 911, 'nb_dedup_ok': 3929, 'nb_two_criteria_ok': 911, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1660, 'end_of_day_photos_pink': 2, 'end_of_day_photos_dark': 1357, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 909, 'ratio_coverage': 0.05855482460008113}, 'dashboard_dict': {'nb_ptf_finished': 28, 'nb_images_finished': 390, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 11, 'nb_images_started': 207, 'nb_selected_images': 597, 'last_update': '2022/09/03', 'portfolio_id': 6892921, 'last_run_id': 478927, 'total_number_of_photos': 909}} No error ? {'log_dict': {'total_nb_images': 4134, 'max_time_between_images': '0 days 315 seconds', 'coverage_pause': '0 days 4134 seconds', 'coverage_times_pause': '0 days 8268 seconds', 'nb_photos_decision': 3918, 'nb_gray_level_ok': 662, 'nb_dedup_ok': 3918, 'nb_two_criteria_ok': 662, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 2067, 'end_of_day_photos_dark': 1189, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 662, 'ratio_coverage': 0.07291133882431788}, 'dashboard_dict': {'nb_ptf_finished': 26, 'nb_images_finished': 389, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 4, 'nb_images_started': 74, 'nb_selected_images': 463, 'last_update': '2022/08/30', 'portfolio_id': 6880974, 'last_run_id': 477478, 'total_number_of_photos': 646}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 3626, 'max_time_between_images': '0 days 451 seconds', 'coverage_pause': '0 days 3626 seconds', 'coverage_times_pause': '0 days 7252 seconds', 'nb_photos_decision': 3921, 'nb_gray_level_ok': 1057, 'nb_dedup_ok': 3921, 'nb_two_criteria_ok': 1057, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1813, 'end_of_day_photos_pink': 1, 'end_of_day_photos_dark': 1050, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 1056, 'ratio_coverage': 0.06395174518069102}, 'dashboard_dict': {'nb_ptf_finished': 2, 'nb_images_finished': 28, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 28, 'last_update': '2022/08/27', 'portfolio_id': 6872937, 'last_run_id': 475306, 'total_number_of_photos': 1056}} No error ? {'log_dict': {'total_nb_images': 3668, 'max_time_between_images': '0 days 517 seconds', 'coverage_pause': '0 days 3668 seconds', 'coverage_times_pause': '0 days 7336 seconds', 'nb_photos_decision': 3920, 'nb_gray_level_ok': 1069, 'nb_dedup_ok': 3920, 'nb_two_criteria_ok': 1069, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1834, 'end_of_day_photos_pink': 2, 'end_of_day_photos_dark': 1016, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 1067, 'ratio_coverage': 0.06469249898587277}, 'dashboard_dict': {'nb_ptf_finished': 31, 'nb_images_finished': 537, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 8, 'nb_images_started': 163, 'nb_selected_images': 700, 'last_update': '2022/08/29', 'portfolio_id': 6865211, 'last_run_id': 474338, 'total_number_of_photos': 1067}} No error ? {'log_dict': {'total_nb_images': 3736, 'max_time_between_images': '0 days 436 seconds', 'coverage_pause': '0 days 3736 seconds', 'coverage_times_pause': '0 days 7472 seconds', 'nb_photos_decision': 3933, 'nb_gray_level_ok': 1059, 'nb_dedup_ok': 3933, 'nb_two_criteria_ok': 1059, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1868, 'end_of_day_photos_pink': 7, 'end_of_day_photos_dark': 1005, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 429, 'end_of_day_photos_uploaded': 623, 'ratio_coverage': 0.06589181467045274}, 'dashboard_dict': {'nb_ptf_finished': 16, 'nb_images_finished': 264, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 25, 'nb_images_started': 480, 'nb_selected_images': 744, 'last_update': '2022/08/29', 'portfolio_id': 6858102, 'last_run_id': 474755, 'total_number_of_photos': 1052}} No error ? {'log_dict': {'total_nb_images': 3798, 'max_time_between_images': '0 days 511 seconds', 'coverage_pause': '0 days 3798 seconds', 'coverage_times_pause': '0 days 7596 seconds', 'nb_photos_decision': 3925, 'nb_gray_level_ok': 1034, 'nb_dedup_ok': 3925, 'nb_two_criteria_ok': 1034, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1899, 'end_of_day_photos_pink': 1, 'end_of_day_photos_dark': 991, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 1033, 'ratio_coverage': 0.0669853083828639}, 'dashboard_dict': {'nb_ptf_finished': 35, 'nb_images_finished': 576, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 7, 'nb_images_started': 137, 'nb_selected_images': 713, 'last_update': '2022/08/25', 'portfolio_id': 6845170, 'last_run_id': 472189, 'total_number_of_photos': 1033}} No error ? {'log_dict': {'total_nb_images': 4136, 'max_time_between_images': '0 days 502 seconds', 'coverage_pause': '0 days 4116 seconds', 'coverage_times_pause': '0 days 8232 seconds', 'nb_photos_decision': 3924, 'nb_gray_level_ok': 905, 'nb_dedup_ok': 3924, 'nb_two_criteria_ok': 905, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 2058, 'end_of_day_photos_pink': 7, 'end_of_day_photos_dark': 960, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 898, 'ratio_coverage': 0.07259387290781143}, 'dashboard_dict': {'nb_ptf_finished': 32, 'nb_images_finished': 494, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 8, 'nb_images_started': 156, 'nb_selected_images': 650, 'last_update': '2022/08/26', 'portfolio_id': 6830485, 'last_run_id': 470781, 'total_number_of_photos': 898}} No error ? {'log_dict': {'total_nb_images': 2568, 'max_time_between_images': '0 days 449 seconds', 'coverage_pause': '0 days 2568 seconds', 'coverage_times_pause': '0 days 5136 seconds', 'nb_photos_decision': 3916, 'nb_gray_level_ok': 2076, 'nb_dedup_ok': 3916, 'nb_two_criteria_ok': 2076, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1284, 'end_of_day_photos_pink': 5, 'end_of_day_photos_dark': 556, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 2071, 'ratio_coverage': 0.045291804088255526}, 'dashboard_dict': {'nb_ptf_finished': 45, 'nb_images_finished': 714, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 8, 'nb_images_started': 216, 'nb_selected_images': 930, 'last_update': '2022/08/23', 'portfolio_id': 6811061, 'last_run_id': 469411, 'total_number_of_photos': 2075}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 6, 'max_time_between_images': '0 days 7064 seconds', 'coverage_pause': '0 days 6 seconds', 'coverage_times_pause': '0 days 12 seconds', 'nb_photos_decision': 3931, 'nb_gray_level_ok': 3928, 'nb_dedup_ok': 3931, 'nb_two_criteria_ok': 3928, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 7, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3923, 'ratio_coverage': 0.00010582197216882132}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'last_update': '2022/08/20', 'portfolio_id': 6800521, 'last_run_id': 465870, 'total_number_of_photos': 3931}} No error ? {'log_dict': {'total_nb_images': 8, 'max_time_between_images': '0 days 22258 seconds', 'coverage_pause': '0 days 8 seconds', 'coverage_times_pause': '0 days 16 seconds', 'nb_photos_decision': 3935, 'nb_gray_level_ok': 3931, 'nb_dedup_ok': 3935, 'nb_two_criteria_ok': 3931, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 4, 'end_of_day_photos_pink': 5, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3925, 'ratio_coverage': 0.00014109596289176176}, 'dashboard_dict': {'nb_ptf_finished': 55, 'nb_images_finished': 1095, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 9, 'nb_images_started': 225, 'nb_selected_images': 1320, 'last_update': '2022/08/21', 'portfolio_id': 6785173, 'last_run_id': 464885, 'total_number_of_photos': 3940}} No error ? {'log_dict': {'total_nb_images': 6, 'max_time_between_images': '0 days 13249 seconds', 'coverage_pause': '0 days 6 seconds', 'coverage_times_pause': '0 days 12 seconds', 'nb_photos_decision': 3940, 'nb_gray_level_ok': 3937, 'nb_dedup_ok': 3940, 'nb_two_criteria_ok': 3937, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 3, 'end_of_day_photos_pink': 6, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 893, 'end_of_day_photos_uploaded': 3037, 'ratio_coverage': 0.00010582197216882132}, 'dashboard_dict': {'nb_ptf_finished': 62, 'nb_images_finished': 1227, 'nb_ptf_finished_for_older': 1, 'nb_images_finished_for_older': 101, 'nb_ptf_started': 11, 'nb_images_started': 275, 'nb_selected_images': 1603, 'last_update': '2022/08/21', 'portfolio_id': 6771154, 'last_run_id': 463490, 'total_number_of_photos': 4063}} No error ? {'log_dict': {'total_nb_images': 10, 'max_time_between_images': '0 days 21811 seconds', 'coverage_pause': '0 days 10 seconds', 'coverage_times_pause': '0 days 20 seconds', 'nb_photos_decision': 3939, 'nb_gray_level_ok': 3934, 'nb_dedup_ok': 3939, 'nb_two_criteria_ok': 3934, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 5, 'end_of_day_photos_pink': 3, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3930, 'ratio_coverage': 0.0001763699536147022}, 'dashboard_dict': {'nb_ptf_finished': 54, 'nb_images_finished': 1122, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 18, 'nb_images_started': 344, 'nb_selected_images': 1466, 'last_update': '2022/08/22', 'portfolio_id': 6756941, 'last_run_id': 462392, 'total_number_of_photos': 3931}} No error ? {'log_dict': {'total_nb_images': 3946, 'max_time_between_images': '0 days 90 seconds', 'coverage_pause': '0 days 7892 seconds', 'coverage_times_pause': '0 days 15784 seconds', 'nb_photos_decision': 3946, 'nb_gray_level_ok': 3946, 'nb_dedup_ok': 3946, 'nb_two_criteria_ok': 3946, 'nb_forced_upload': 0, 'end_of_day_photos_pink': 4, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3941, 'ratio_coverage': 0.13919116739272297}, 'dashboard_dict': {'nb_ptf_finished': 69, 'nb_images_finished': 1402, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 13, 'nb_images_started': 331, 'nb_selected_images': 1733, 'last_update': '2022/08/22', 'portfolio_id': 6738801, 'last_run_id': 461074, 'total_number_of_photos': 3942}} No error ? {'log_dict': {'total_nb_images': 4, 'max_time_between_images': '0 days 1677 seconds', 'coverage_pause': '0 days 4 seconds', 'coverage_times_pause': '0 days 8 seconds', 'nb_photos_decision': 3936, 'nb_gray_level_ok': 3934, 'nb_dedup_ok': 3935, 'nb_two_criteria_ok': 3933, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 2, 'end_of_day_photos_pink': 6, 'end_of_day_photos_duplicated': 1, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 3526, 'end_of_day_photos_uploaded': 405, 'ratio_coverage': 7.054798144588088e-05}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 4, 'nb_images_started': 127, 'nb_selected_images': 127, 'last_update': '2022/08/22', 'portfolio_id': 6736624, 'last_run_id': 459828, 'total_number_of_photos': 3932}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 2, 'max_time_between_images': '0 days 2 seconds', 'coverage_pause': '0 days 2 seconds', 'coverage_times_pause': '0 days 4 seconds', 'nb_photos_decision': 3939, 'nb_gray_level_ok': 3938, 'nb_dedup_ok': 3938, 'nb_two_criteria_ok': 3937, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1, 'end_of_day_photos_pink': 10, 'end_of_day_photos_duplicated': 1, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3926, 'ratio_coverage': 3.527399072294044e-05}, 'dashboard_dict': {'nb_ptf_finished': 62, 'nb_images_finished': 1156, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 14, 'nb_images_started': 330, 'nb_selected_images': 1486, 'last_update': '2022/08/14', 'portfolio_id': 6714370, 'last_run_id': 457640, 'total_number_of_photos': 3926}} No error ? {'log_dict': {'total_nb_images': 4, 'max_time_between_images': '0 days 3519 seconds', 'coverage_pause': '0 days 4 seconds', 'coverage_times_pause': '0 days 8 seconds', 'nb_photos_decision': 2477, 'nb_gray_level_ok': 2475, 'nb_dedup_ok': 2477, 'nb_two_criteria_ok': 2475, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 2, 'end_of_day_photos_pink': 4, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 300, 'end_of_day_photos_uploaded': 2170, 'ratio_coverage': 7.054798144588088e-05}, 'dashboard_dict': {'nb_ptf_finished': 39, 'nb_images_finished': 747, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 7, 'nb_images_started': 169, 'nb_selected_images': 916, 'last_update': '2022/08/13', 'portfolio_id': 6703539, 'last_run_id': 456478, 'total_number_of_photos': 2475}} No error ? {'log_dict': {'total_nb_images': 8, 'max_time_between_images': '0 days 28998 seconds', 'coverage_pause': '0 days 8 seconds', 'coverage_times_pause': '0 days 16 seconds', 'nb_photos_decision': 3935, 'nb_gray_level_ok': 3931, 'nb_dedup_ok': 3934, 'nb_two_criteria_ok': 3930, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 4, 'end_of_day_photos_pink': 6, 'end_of_day_photos_duplicated': 1, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3923, 'ratio_coverage': 0.00014109596289176176}, 'dashboard_dict': {'nb_ptf_finished': 56, 'nb_images_finished': 1043, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 28, 'nb_images_started': 588, 'nb_selected_images': 1631, 'last_update': '2022/08/28', 'portfolio_id': 6680169, 'last_run_id': 455185, 'total_number_of_photos': 3940}} No error ? {'log_dict': {'total_nb_images': 2, 'max_time_between_images': '0 days 2 seconds', 'coverage_pause': '0 days 2 seconds', 'coverage_times_pause': '0 days 4 seconds', 'nb_photos_decision': 3940, 'nb_gray_level_ok': 3939, 'nb_dedup_ok': 3940, 'nb_two_criteria_ok': 3939, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 2, 'end_of_day_photos_pink': 7, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3931, 'ratio_coverage': 3.527399072294044e-05}, 'dashboard_dict': {'nb_ptf_finished': 56, 'nb_images_finished': 1036, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 9, 'nb_images_started': 227, 'nb_selected_images': 1263, 'last_update': '2022/08/29', 'portfolio_id': 6662197, 'last_run_id': 468274, 'total_number_of_photos': 3932}} No error ? {'log_dict': {'total_nb_images': 2, 'max_time_between_images': '0 days 2 seconds', 'coverage_pause': '0 days 2 seconds', 'coverage_times_pause': '0 days 4 seconds', 'nb_photos_decision': 3934, 'nb_gray_level_ok': 3933, 'nb_dedup_ok': 3933, 'nb_two_criteria_ok': 3932, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1, 'end_of_day_photos_pink': 6, 'end_of_day_photos_duplicated': 1, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3925, 'ratio_coverage': 3.527399072294044e-05}, 'dashboard_dict': {'nb_ptf_finished': 48, 'nb_images_finished': 929, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 22, 'nb_images_started': 429, 'nb_selected_images': 1358, 'last_update': '2022/08/21', 'portfolio_id': 6645254, 'last_run_id': 452689, 'total_number_of_photos': 3938}} No error ? {'log_dict': {'total_nb_images': 3933, 'max_time_between_images': '0 days 84 seconds', 'coverage_pause': '0 days 7866 seconds', 'coverage_times_pause': '0 days 15732 seconds', 'nb_photos_decision': 3932, 'nb_gray_level_ok': 3932, 'nb_dedup_ok': 3931, 'nb_two_criteria_ok': 3931, 'nb_forced_upload': 0, 'end_of_day_photos_pink': 11, 'end_of_day_photos_duplicated': 1, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3920, 'ratio_coverage': 0.13873260551332475}, 'dashboard_dict': {'nb_ptf_finished': 45, 'nb_images_finished': 803, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 28, 'nb_images_started': 730, 'nb_selected_images': 1533, 'last_update': '2022/09/05', 'portfolio_id': 6633492, 'last_run_id': 451519, 'total_number_of_photos': 3925}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 3936, 'max_time_between_images': '0 days 82 seconds', 'coverage_pause': '0 days 7872 seconds', 'coverage_times_pause': '0 days 15744 seconds', 'nb_photos_decision': 3936, 'nb_gray_level_ok': 3936, 'nb_dedup_ok': 3936, 'nb_two_criteria_ok': 3936, 'nb_forced_upload': 0, 'end_of_day_photos_pink': 10, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3925, 'ratio_coverage': 0.13883842748549358}, 'dashboard_dict': {'nb_ptf_finished': 34, 'nb_images_finished': 568, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 49, 'nb_images_started': 940, 'nb_selected_images': 1508, 'last_update': '2022/08/24', 'portfolio_id': 6632462, 'last_run_id': 454424, 'total_number_of_photos': 3926}} No error ? {'log_dict': {'total_nb_images': 2, 'max_time_between_images': '0 days 2 seconds', 'coverage_pause': '0 days 2 seconds', 'coverage_times_pause': '0 days 4 seconds', 'nb_photos_decision': 3939, 'nb_gray_level_ok': 3938, 'nb_dedup_ok': 3939, 'nb_two_criteria_ok': 3938, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1, 'end_of_day_photos_pink': 11, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3926, 'ratio_coverage': 3.527399072294044e-05}, 'dashboard_dict': {'nb_ptf_finished': 66, 'nb_images_finished': 1181, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 10, 'nb_images_started': 258, 'nb_selected_images': 1439, 'last_update': '2022/08/17', 'portfolio_id': 6630409, 'last_run_id': 454399, 'total_number_of_photos': 3928}} No error ? {'log_dict': {'total_nb_images': 2, 'max_time_between_images': '0 days 2 seconds', 'coverage_pause': '0 days 2 seconds', 'coverage_times_pause': '0 days 4 seconds', 'nb_photos_decision': 3941, 'nb_gray_level_ok': 3940, 'nb_dedup_ok': 3941, 'nb_two_criteria_ok': 3940, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1, 'end_of_day_photos_pink': 9, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3930, 'ratio_coverage': 3.527399072294044e-05}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 40, 'nb_images_started': 797, 'nb_selected_images': 797, 'last_update': '2022/08/24', 'portfolio_id': 6629944, 'last_run_id': 454411, 'total_number_of_photos': 3979}} No error ? {'log_dict': {'total_nb_images': 3942, 'max_time_between_images': '0 days 83 seconds', 'coverage_pause': '0 days 7884 seconds', 'coverage_times_pause': '0 days 15768 seconds', 'nb_photos_decision': 3942, 'nb_gray_level_ok': 3942, 'nb_dedup_ok': 3942, 'nb_two_criteria_ok': 3942, 'nb_forced_upload': 0, 'end_of_day_photos_pink': 6, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3935, 'ratio_coverage': 0.13905007142983122}, 'dashboard_dict': {'nb_ptf_finished': 23, 'nb_images_finished': 521, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 32, 'nb_images_started': 658, 'nb_selected_images': 1179, 'last_update': '2022/08/28', 'portfolio_id': 6625129, 'last_run_id': 454388, 'total_number_of_photos': 3940}} No error ? {'log_dict': {'total_nb_images': 2, 'max_time_between_images': '0 days 2 seconds', 'coverage_pause': '0 days 2 seconds', 'coverage_times_pause': '0 days 4 seconds', 'nb_photos_decision': 3911, 'nb_gray_level_ok': 3910, 'nb_dedup_ok': 3911, 'nb_two_criteria_ok': 3910, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 5, 'end_of_day_photos_pink': 9, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3896, 'ratio_coverage': 3.527399072294044e-05}, 'dashboard_dict': {'nb_ptf_finished': 77, 'nb_images_finished': 1405, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 9, 'nb_images_started': 271, 'nb_selected_images': 1676, 'last_update': '2022/08/11', 'portfolio_id': 6612466, 'last_run_id': 454376, 'total_number_of_photos': 3920}} No error ? {'log_dict': {'total_nb_images': 4, 'max_time_between_images': '0 days 24740 seconds', 'coverage_pause': '0 days 4 seconds', 'coverage_times_pause': '0 days 8 seconds', 'nb_photos_decision': 3914, 'nb_gray_level_ok': 3912, 'nb_dedup_ok': 3913, 'nb_two_criteria_ok': 3911, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 2, 'end_of_day_photos_pink': 11, 'end_of_day_photos_duplicated': 1, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3899, 'ratio_coverage': 7.054798144588088e-05}, 'dashboard_dict': {'nb_ptf_finished': 66, 'nb_images_finished': 1291, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 9, 'nb_images_started': 226, 'nb_selected_images': 1517, 'last_update': '2022/08/02', 'portfolio_id': 6600066, 'last_run_id': 449271, 'total_number_of_photos': 3919}} No error ? {'log_dict': {'total_nb_images': 2984, 'max_time_between_images': '0 days 1044 seconds', 'coverage_pause': '0 days 3936 seconds', 'coverage_times_pause': '0 days 6834 seconds', 'nb_photos_decision': 11774, 'nb_gray_level_ok': 4617, 'nb_dedup_ok': 11773, 'nb_two_criteria_ok': 4616, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1498, 'end_of_day_photos_pink': 20, 'end_of_day_photos_dark': 5638, 'end_of_day_photos_duplicated': 1, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 181, 'end_of_day_photos_uploaded': 4415, 'ratio_coverage': 0.06941921374274679}, 'dashboard_dict': {'nb_ptf_finished': 19, 'nb_images_finished': 1263, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 10, 'nb_images_started': 564, 'nb_selected_images': 1827, 'last_update': '2022/09/04', 'portfolio_id': 6911337, 'last_run_id': 479886, 'total_number_of_photos': 4031}} No error ? {'log_dict': {'total_nb_images': 3320, 'max_time_between_images': '0 days 466 seconds', 'coverage_pause': '0 days 3320 seconds', 'coverage_times_pause': '0 days 6640 seconds', 'nb_photos_decision': 3929, 'nb_gray_level_ok': 911, 'nb_dedup_ok': 3929, 'nb_two_criteria_ok': 911, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1660, 'end_of_day_photos_pink': 2, 'end_of_day_photos_dark': 1357, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 909, 'ratio_coverage': 0.05855482460008113}, 'dashboard_dict': {'nb_ptf_finished': 28, 'nb_images_finished': 390, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 11, 'nb_images_started': 207, 'nb_selected_images': 597, 'last_update': '2022/09/03', 'portfolio_id': 6892921, 'last_run_id': 478927, 'total_number_of_photos': 909}} No error ? {'log_dict': {'total_nb_images': 4134, 'max_time_between_images': '0 days 315 seconds', 'coverage_pause': '0 days 4134 seconds', 'coverage_times_pause': '0 days 8268 seconds', 'nb_photos_decision': 3918, 'nb_gray_level_ok': 662, 'nb_dedup_ok': 3918, 'nb_two_criteria_ok': 662, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 2067, 'end_of_day_photos_dark': 1189, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 662, 'ratio_coverage': 0.07291133882431788}, 'dashboard_dict': {'nb_ptf_finished': 26, 'nb_images_finished': 389, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 4, 'nb_images_started': 74, 'nb_selected_images': 463, 'last_update': '2022/08/30', 'portfolio_id': 6880974, 'last_run_id': 477478, 'total_number_of_photos': 646}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 3626, 'max_time_between_images': '0 days 451 seconds', 'coverage_pause': '0 days 3626 seconds', 'coverage_times_pause': '0 days 7252 seconds', 'nb_photos_decision': 3921, 'nb_gray_level_ok': 1057, 'nb_dedup_ok': 3921, 'nb_two_criteria_ok': 1057, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1813, 'end_of_day_photos_pink': 1, 'end_of_day_photos_dark': 1050, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 1056, 'ratio_coverage': 0.06395174518069102}, 'dashboard_dict': {'nb_ptf_finished': 2, 'nb_images_finished': 28, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 28, 'last_update': '2022/08/27', 'portfolio_id': 6872937, 'last_run_id': 475306, 'total_number_of_photos': 1056}} No error ? {'log_dict': {'total_nb_images': 3668, 'max_time_between_images': '0 days 517 seconds', 'coverage_pause': '0 days 3668 seconds', 'coverage_times_pause': '0 days 7336 seconds', 'nb_photos_decision': 3920, 'nb_gray_level_ok': 1069, 'nb_dedup_ok': 3920, 'nb_two_criteria_ok': 1069, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1834, 'end_of_day_photos_pink': 2, 'end_of_day_photos_dark': 1016, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 1067, 'ratio_coverage': 0.06469249898587277}, 'dashboard_dict': {'nb_ptf_finished': 31, 'nb_images_finished': 537, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 8, 'nb_images_started': 163, 'nb_selected_images': 700, 'last_update': '2022/08/29', 'portfolio_id': 6865211, 'last_run_id': 474338, 'total_number_of_photos': 1067}} No error ? {'log_dict': {'total_nb_images': 3736, 'max_time_between_images': '0 days 436 seconds', 'coverage_pause': '0 days 3736 seconds', 'coverage_times_pause': '0 days 7472 seconds', 'nb_photos_decision': 3933, 'nb_gray_level_ok': 1059, 'nb_dedup_ok': 3933, 'nb_two_criteria_ok': 1059, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1868, 'end_of_day_photos_pink': 7, 'end_of_day_photos_dark': 1005, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 429, 'end_of_day_photos_uploaded': 623, 'ratio_coverage': 0.06589181467045274}, 'dashboard_dict': {'nb_ptf_finished': 16, 'nb_images_finished': 264, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 25, 'nb_images_started': 480, 'nb_selected_images': 744, 'last_update': '2022/08/29', 'portfolio_id': 6858102, 'last_run_id': 474755, 'total_number_of_photos': 1052}} No error ? {'log_dict': {'total_nb_images': 3798, 'max_time_between_images': '0 days 511 seconds', 'coverage_pause': '0 days 3798 seconds', 'coverage_times_pause': '0 days 7596 seconds', 'nb_photos_decision': 3925, 'nb_gray_level_ok': 1034, 'nb_dedup_ok': 3925, 'nb_two_criteria_ok': 1034, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1899, 'end_of_day_photos_pink': 1, 'end_of_day_photos_dark': 991, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 1033, 'ratio_coverage': 0.0669853083828639}, 'dashboard_dict': {'nb_ptf_finished': 35, 'nb_images_finished': 576, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 7, 'nb_images_started': 137, 'nb_selected_images': 713, 'last_update': '2022/08/25', 'portfolio_id': 6845170, 'last_run_id': 472189, 'total_number_of_photos': 1033}} No error ? {'log_dict': {'total_nb_images': 4136, 'max_time_between_images': '0 days 502 seconds', 'coverage_pause': '0 days 4116 seconds', 'coverage_times_pause': '0 days 8232 seconds', 'nb_photos_decision': 3924, 'nb_gray_level_ok': 905, 'nb_dedup_ok': 3924, 'nb_two_criteria_ok': 905, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 2058, 'end_of_day_photos_pink': 7, 'end_of_day_photos_dark': 960, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 898, 'ratio_coverage': 0.07259387290781143}, 'dashboard_dict': {'nb_ptf_finished': 32, 'nb_images_finished': 494, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 8, 'nb_images_started': 156, 'nb_selected_images': 650, 'last_update': '2022/08/26', 'portfolio_id': 6830485, 'last_run_id': 470781, 'total_number_of_photos': 898}} No error ? {'log_dict': {'total_nb_images': 2568, 'max_time_between_images': '0 days 449 seconds', 'coverage_pause': '0 days 2568 seconds', 'coverage_times_pause': '0 days 5136 seconds', 'nb_photos_decision': 3916, 'nb_gray_level_ok': 2076, 'nb_dedup_ok': 3916, 'nb_two_criteria_ok': 2076, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1284, 'end_of_day_photos_pink': 5, 'end_of_day_photos_dark': 556, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 2071, 'ratio_coverage': 0.045291804088255526}, 'dashboard_dict': {'nb_ptf_finished': 45, 'nb_images_finished': 714, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 8, 'nb_images_started': 216, 'nb_selected_images': 930, 'last_update': '2022/08/23', 'portfolio_id': 6811061, 'last_run_id': 469411, 'total_number_of_photos': 2075}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 6, 'max_time_between_images': '0 days 7064 seconds', 'coverage_pause': '0 days 6 seconds', 'coverage_times_pause': '0 days 12 seconds', 'nb_photos_decision': 3931, 'nb_gray_level_ok': 3928, 'nb_dedup_ok': 3931, 'nb_two_criteria_ok': 3928, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 7, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3923, 'ratio_coverage': 0.00010582197216882132}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'last_update': '2022/08/20', 'portfolio_id': 6800521, 'last_run_id': 465870, 'total_number_of_photos': 3931}} No error ? {'log_dict': {'total_nb_images': 8, 'max_time_between_images': '0 days 22258 seconds', 'coverage_pause': '0 days 8 seconds', 'coverage_times_pause': '0 days 16 seconds', 'nb_photos_decision': 3935, 'nb_gray_level_ok': 3931, 'nb_dedup_ok': 3935, 'nb_two_criteria_ok': 3931, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 4, 'end_of_day_photos_pink': 5, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3925, 'ratio_coverage': 0.00014109596289176176}, 'dashboard_dict': {'nb_ptf_finished': 55, 'nb_images_finished': 1095, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 9, 'nb_images_started': 225, 'nb_selected_images': 1320, 'last_update': '2022/08/21', 'portfolio_id': 6785173, 'last_run_id': 464885, 'total_number_of_photos': 3940}} No error ? {'log_dict': {'total_nb_images': 6, 'max_time_between_images': '0 days 13249 seconds', 'coverage_pause': '0 days 6 seconds', 'coverage_times_pause': '0 days 12 seconds', 'nb_photos_decision': 3940, 'nb_gray_level_ok': 3937, 'nb_dedup_ok': 3940, 'nb_two_criteria_ok': 3937, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 3, 'end_of_day_photos_pink': 6, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 893, 'end_of_day_photos_uploaded': 3037, 'ratio_coverage': 0.00010582197216882132}, 'dashboard_dict': {'nb_ptf_finished': 62, 'nb_images_finished': 1227, 'nb_ptf_finished_for_older': 1, 'nb_images_finished_for_older': 101, 'nb_ptf_started': 11, 'nb_images_started': 275, 'nb_selected_images': 1603, 'last_update': '2022/08/21', 'portfolio_id': 6771154, 'last_run_id': 463490, 'total_number_of_photos': 4063}} No error ? {'log_dict': {'total_nb_images': 10, 'max_time_between_images': '0 days 21811 seconds', 'coverage_pause': '0 days 10 seconds', 'coverage_times_pause': '0 days 20 seconds', 'nb_photos_decision': 3939, 'nb_gray_level_ok': 3934, 'nb_dedup_ok': 3939, 'nb_two_criteria_ok': 3934, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 5, 'end_of_day_photos_pink': 3, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3930, 'ratio_coverage': 0.0001763699536147022}, 'dashboard_dict': {'nb_ptf_finished': 54, 'nb_images_finished': 1122, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 18, 'nb_images_started': 344, 'nb_selected_images': 1466, 'last_update': '2022/08/22', 'portfolio_id': 6756941, 'last_run_id': 462392, 'total_number_of_photos': 3931}} No error ? {'log_dict': {'total_nb_images': 3946, 'max_time_between_images': '0 days 90 seconds', 'coverage_pause': '0 days 7892 seconds', 'coverage_times_pause': '0 days 15784 seconds', 'nb_photos_decision': 3946, 'nb_gray_level_ok': 3946, 'nb_dedup_ok': 3946, 'nb_two_criteria_ok': 3946, 'nb_forced_upload': 0, 'end_of_day_photos_pink': 4, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3941, 'ratio_coverage': 0.13919116739272297}, 'dashboard_dict': {'nb_ptf_finished': 69, 'nb_images_finished': 1402, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 13, 'nb_images_started': 331, 'nb_selected_images': 1733, 'last_update': '2022/08/22', 'portfolio_id': 6738801, 'last_run_id': 461074, 'total_number_of_photos': 3942}} No error ? {'log_dict': {'total_nb_images': 4, 'max_time_between_images': '0 days 1677 seconds', 'coverage_pause': '0 days 4 seconds', 'coverage_times_pause': '0 days 8 seconds', 'nb_photos_decision': 3936, 'nb_gray_level_ok': 3934, 'nb_dedup_ok': 3935, 'nb_two_criteria_ok': 3933, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 2, 'end_of_day_photos_pink': 6, 'end_of_day_photos_duplicated': 1, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 3526, 'end_of_day_photos_uploaded': 405, 'ratio_coverage': 7.054798144588088e-05}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 4, 'nb_images_started': 127, 'nb_selected_images': 127, 'last_update': '2022/08/22', 'portfolio_id': 6736624, 'last_run_id': 459828, 'total_number_of_photos': 3932}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 2, 'max_time_between_images': '0 days 2 seconds', 'coverage_pause': '0 days 2 seconds', 'coverage_times_pause': '0 days 4 seconds', 'nb_photos_decision': 3939, 'nb_gray_level_ok': 3938, 'nb_dedup_ok': 3938, 'nb_two_criteria_ok': 3937, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1, 'end_of_day_photos_pink': 10, 'end_of_day_photos_duplicated': 1, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3926, 'ratio_coverage': 3.527399072294044e-05}, 'dashboard_dict': {'nb_ptf_finished': 62, 'nb_images_finished': 1156, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 14, 'nb_images_started': 330, 'nb_selected_images': 1486, 'last_update': '2022/08/14', 'portfolio_id': 6714370, 'last_run_id': 457640, 'total_number_of_photos': 3926}} No error ? {'log_dict': {'total_nb_images': 4, 'max_time_between_images': '0 days 3519 seconds', 'coverage_pause': '0 days 4 seconds', 'coverage_times_pause': '0 days 8 seconds', 'nb_photos_decision': 2477, 'nb_gray_level_ok': 2475, 'nb_dedup_ok': 2477, 'nb_two_criteria_ok': 2475, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 2, 'end_of_day_photos_pink': 4, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 300, 'end_of_day_photos_uploaded': 2170, 'ratio_coverage': 7.054798144588088e-05}, 'dashboard_dict': {'nb_ptf_finished': 39, 'nb_images_finished': 747, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 7, 'nb_images_started': 169, 'nb_selected_images': 916, 'last_update': '2022/08/13', 'portfolio_id': 6703539, 'last_run_id': 456478, 'total_number_of_photos': 2475}} No error ? {'log_dict': {'total_nb_images': 8, 'max_time_between_images': '0 days 28998 seconds', 'coverage_pause': '0 days 8 seconds', 'coverage_times_pause': '0 days 16 seconds', 'nb_photos_decision': 3935, 'nb_gray_level_ok': 3931, 'nb_dedup_ok': 3934, 'nb_two_criteria_ok': 3930, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 4, 'end_of_day_photos_pink': 6, 'end_of_day_photos_duplicated': 1, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3923, 'ratio_coverage': 0.00014109596289176176}, 'dashboard_dict': {'nb_ptf_finished': 56, 'nb_images_finished': 1043, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 28, 'nb_images_started': 588, 'nb_selected_images': 1631, 'last_update': '2022/08/28', 'portfolio_id': 6680169, 'last_run_id': 455185, 'total_number_of_photos': 3940}} No error ? {'log_dict': {'total_nb_images': 2, 'max_time_between_images': '0 days 2 seconds', 'coverage_pause': '0 days 2 seconds', 'coverage_times_pause': '0 days 4 seconds', 'nb_photos_decision': 3940, 'nb_gray_level_ok': 3939, 'nb_dedup_ok': 3940, 'nb_two_criteria_ok': 3939, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 2, 'end_of_day_photos_pink': 7, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3931, 'ratio_coverage': 3.527399072294044e-05}, 'dashboard_dict': {'nb_ptf_finished': 56, 'nb_images_finished': 1036, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 9, 'nb_images_started': 227, 'nb_selected_images': 1263, 'last_update': '2022/08/29', 'portfolio_id': 6662197, 'last_run_id': 468274, 'total_number_of_photos': 3932}} No error ? {'log_dict': {'total_nb_images': 2, 'max_time_between_images': '0 days 2 seconds', 'coverage_pause': '0 days 2 seconds', 'coverage_times_pause': '0 days 4 seconds', 'nb_photos_decision': 3934, 'nb_gray_level_ok': 3933, 'nb_dedup_ok': 3933, 'nb_two_criteria_ok': 3932, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1, 'end_of_day_photos_pink': 6, 'end_of_day_photos_duplicated': 1, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3925, 'ratio_coverage': 3.527399072294044e-05}, 'dashboard_dict': {'nb_ptf_finished': 48, 'nb_images_finished': 929, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 22, 'nb_images_started': 429, 'nb_selected_images': 1358, 'last_update': '2022/08/21', 'portfolio_id': 6645254, 'last_run_id': 452689, 'total_number_of_photos': 3938}} No error ? {'log_dict': {'total_nb_images': 3933, 'max_time_between_images': '0 days 84 seconds', 'coverage_pause': '0 days 7866 seconds', 'coverage_times_pause': '0 days 15732 seconds', 'nb_photos_decision': 3932, 'nb_gray_level_ok': 3932, 'nb_dedup_ok': 3931, 'nb_two_criteria_ok': 3931, 'nb_forced_upload': 0, 'end_of_day_photos_pink': 11, 'end_of_day_photos_duplicated': 1, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3920, 'ratio_coverage': 0.13873260551332475}, 'dashboard_dict': {'nb_ptf_finished': 45, 'nb_images_finished': 803, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 28, 'nb_images_started': 730, 'nb_selected_images': 1533, 'last_update': '2022/09/05', 'portfolio_id': 6633492, 'last_run_id': 451519, 'total_number_of_photos': 3925}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 3936, 'max_time_between_images': '0 days 82 seconds', 'coverage_pause': '0 days 7872 seconds', 'coverage_times_pause': '0 days 15744 seconds', 'nb_photos_decision': 3936, 'nb_gray_level_ok': 3936, 'nb_dedup_ok': 3936, 'nb_two_criteria_ok': 3936, 'nb_forced_upload': 0, 'end_of_day_photos_pink': 10, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3925, 'ratio_coverage': 0.13883842748549358}, 'dashboard_dict': {'nb_ptf_finished': 34, 'nb_images_finished': 568, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 49, 'nb_images_started': 940, 'nb_selected_images': 1508, 'last_update': '2022/08/24', 'portfolio_id': 6632462, 'last_run_id': 454424, 'total_number_of_photos': 3926}} No error ? {'log_dict': {'total_nb_images': 2, 'max_time_between_images': '0 days 2 seconds', 'coverage_pause': '0 days 2 seconds', 'coverage_times_pause': '0 days 4 seconds', 'nb_photos_decision': 3939, 'nb_gray_level_ok': 3938, 'nb_dedup_ok': 3939, 'nb_two_criteria_ok': 3938, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1, 'end_of_day_photos_pink': 11, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3926, 'ratio_coverage': 3.527399072294044e-05}, 'dashboard_dict': {'nb_ptf_finished': 66, 'nb_images_finished': 1181, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 10, 'nb_images_started': 258, 'nb_selected_images': 1439, 'last_update': '2022/08/17', 'portfolio_id': 6630409, 'last_run_id': 454399, 'total_number_of_photos': 3928}} No error ? {'log_dict': {'total_nb_images': 2, 'max_time_between_images': '0 days 2 seconds', 'coverage_pause': '0 days 2 seconds', 'coverage_times_pause': '0 days 4 seconds', 'nb_photos_decision': 3941, 'nb_gray_level_ok': 3940, 'nb_dedup_ok': 3941, 'nb_two_criteria_ok': 3940, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1, 'end_of_day_photos_pink': 9, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3930, 'ratio_coverage': 3.527399072294044e-05}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 40, 'nb_images_started': 797, 'nb_selected_images': 797, 'last_update': '2022/08/24', 'portfolio_id': 6629944, 'last_run_id': 454411, 'total_number_of_photos': 3979}} No error ? {'log_dict': {'total_nb_images': 3942, 'max_time_between_images': '0 days 83 seconds', 'coverage_pause': '0 days 7884 seconds', 'coverage_times_pause': '0 days 15768 seconds', 'nb_photos_decision': 3942, 'nb_gray_level_ok': 3942, 'nb_dedup_ok': 3942, 'nb_two_criteria_ok': 3942, 'nb_forced_upload': 0, 'end_of_day_photos_pink': 6, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3935, 'ratio_coverage': 0.13905007142983122}, 'dashboard_dict': {'nb_ptf_finished': 23, 'nb_images_finished': 521, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 32, 'nb_images_started': 658, 'nb_selected_images': 1179, 'last_update': '2022/08/28', 'portfolio_id': 6625129, 'last_run_id': 454388, 'total_number_of_photos': 3940}} No error ? {'log_dict': {'total_nb_images': 2, 'max_time_between_images': '0 days 2 seconds', 'coverage_pause': '0 days 2 seconds', 'coverage_times_pause': '0 days 4 seconds', 'nb_photos_decision': 3911, 'nb_gray_level_ok': 3910, 'nb_dedup_ok': 3911, 'nb_two_criteria_ok': 3910, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 5, 'end_of_day_photos_pink': 9, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3896, 'ratio_coverage': 3.527399072294044e-05}, 'dashboard_dict': {'nb_ptf_finished': 77, 'nb_images_finished': 1405, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 9, 'nb_images_started': 271, 'nb_selected_images': 1676, 'last_update': '2022/08/11', 'portfolio_id': 6612466, 'last_run_id': 454376, 'total_number_of_photos': 3920}} No error ? {'log_dict': {'total_nb_images': 4, 'max_time_between_images': '0 days 24740 seconds', 'coverage_pause': '0 days 4 seconds', 'coverage_times_pause': '0 days 8 seconds', 'nb_photos_decision': 3914, 'nb_gray_level_ok': 3912, 'nb_dedup_ok': 3913, 'nb_two_criteria_ok': 3911, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 2, 'end_of_day_photos_pink': 11, 'end_of_day_photos_duplicated': 1, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3899, 'ratio_coverage': 7.054798144588088e-05}, 'dashboard_dict': {'nb_ptf_finished': 66, 'nb_images_finished': 1291, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 9, 'nb_images_started': 226, 'nb_selected_images': 1517, 'last_update': '2022/08/02', 'portfolio_id': 6600066, 'last_run_id': 449271, 'total_number_of_photos': 3919}} No error ? {'log_dict': {'total_nb_images': 2984, 'max_time_between_images': '0 days 1044 seconds', 'coverage_pause': '0 days 3936 seconds', 'coverage_times_pause': '0 days 6834 seconds', 'nb_photos_decision': 11774, 'nb_gray_level_ok': 4617, 'nb_dedup_ok': 11773, 'nb_two_criteria_ok': 4616, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1498, 'end_of_day_photos_pink': 20, 'end_of_day_photos_dark': 5638, 'end_of_day_photos_duplicated': 1, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 181, 'end_of_day_photos_uploaded': 4415, 'ratio_coverage': 0.06941921374274679}, 'dashboard_dict': {'nb_ptf_finished': 19, 'nb_images_finished': 1263, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 10, 'nb_images_started': 564, 'nb_selected_images': 1827, 'last_update': '2022/09/04', 'portfolio_id': 6911337, 'last_run_id': 479886, 'total_number_of_photos': 4031}} No error ? {'log_dict': {'total_nb_images': 3320, 'max_time_between_images': '0 days 466 seconds', 'coverage_pause': '0 days 3320 seconds', 'coverage_times_pause': '0 days 6640 seconds', 'nb_photos_decision': 3929, 'nb_gray_level_ok': 911, 'nb_dedup_ok': 3929, 'nb_two_criteria_ok': 911, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1660, 'end_of_day_photos_pink': 2, 'end_of_day_photos_dark': 1357, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 909, 'ratio_coverage': 0.05855482460008113}, 'dashboard_dict': {'nb_ptf_finished': 28, 'nb_images_finished': 390, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 11, 'nb_images_started': 207, 'nb_selected_images': 597, 'last_update': '2022/09/03', 'portfolio_id': 6892921, 'last_run_id': 478927, 'total_number_of_photos': 909}} No error ? {'log_dict': {'total_nb_images': 4134, 'max_time_between_images': '0 days 315 seconds', 'coverage_pause': '0 days 4134 seconds', 'coverage_times_pause': '0 days 8268 seconds', 'nb_photos_decision': 3918, 'nb_gray_level_ok': 662, 'nb_dedup_ok': 3918, 'nb_two_criteria_ok': 662, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 2067, 'end_of_day_photos_dark': 1189, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 662, 'ratio_coverage': 0.07291133882431788}, 'dashboard_dict': {'nb_ptf_finished': 26, 'nb_images_finished': 389, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 4, 'nb_images_started': 74, 'nb_selected_images': 463, 'last_update': '2022/08/30', 'portfolio_id': 6880974, 'last_run_id': 477478, 'total_number_of_photos': 646}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 3626, 'max_time_between_images': '0 days 451 seconds', 'coverage_pause': '0 days 3626 seconds', 'coverage_times_pause': '0 days 7252 seconds', 'nb_photos_decision': 3921, 'nb_gray_level_ok': 1057, 'nb_dedup_ok': 3921, 'nb_two_criteria_ok': 1057, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1813, 'end_of_day_photos_pink': 1, 'end_of_day_photos_dark': 1050, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 1056, 'ratio_coverage': 0.06395174518069102}, 'dashboard_dict': {'nb_ptf_finished': 2, 'nb_images_finished': 28, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 28, 'last_update': '2022/08/27', 'portfolio_id': 6872937, 'last_run_id': 475306, 'total_number_of_photos': 1056}} No error ? {'log_dict': {'total_nb_images': 3668, 'max_time_between_images': '0 days 517 seconds', 'coverage_pause': '0 days 3668 seconds', 'coverage_times_pause': '0 days 7336 seconds', 'nb_photos_decision': 3920, 'nb_gray_level_ok': 1069, 'nb_dedup_ok': 3920, 'nb_two_criteria_ok': 1069, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1834, 'end_of_day_photos_pink': 2, 'end_of_day_photos_dark': 1016, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 1067, 'ratio_coverage': 0.06469249898587277}, 'dashboard_dict': {'nb_ptf_finished': 31, 'nb_images_finished': 537, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 8, 'nb_images_started': 163, 'nb_selected_images': 700, 'last_update': '2022/08/29', 'portfolio_id': 6865211, 'last_run_id': 474338, 'total_number_of_photos': 1067}} No error ? {'log_dict': {'total_nb_images': 3736, 'max_time_between_images': '0 days 436 seconds', 'coverage_pause': '0 days 3736 seconds', 'coverage_times_pause': '0 days 7472 seconds', 'nb_photos_decision': 3933, 'nb_gray_level_ok': 1059, 'nb_dedup_ok': 3933, 'nb_two_criteria_ok': 1059, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1868, 'end_of_day_photos_pink': 7, 'end_of_day_photos_dark': 1005, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 429, 'end_of_day_photos_uploaded': 623, 'ratio_coverage': 0.06589181467045274}, 'dashboard_dict': {'nb_ptf_finished': 16, 'nb_images_finished': 264, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 25, 'nb_images_started': 480, 'nb_selected_images': 744, 'last_update': '2022/08/29', 'portfolio_id': 6858102, 'last_run_id': 474755, 'total_number_of_photos': 1052}} No error ? {'log_dict': {'total_nb_images': 3798, 'max_time_between_images': '0 days 511 seconds', 'coverage_pause': '0 days 3798 seconds', 'coverage_times_pause': '0 days 7596 seconds', 'nb_photos_decision': 3925, 'nb_gray_level_ok': 1034, 'nb_dedup_ok': 3925, 'nb_two_criteria_ok': 1034, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1899, 'end_of_day_photos_pink': 1, 'end_of_day_photos_dark': 991, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 1033, 'ratio_coverage': 0.0669853083828639}, 'dashboard_dict': {'nb_ptf_finished': 35, 'nb_images_finished': 576, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 7, 'nb_images_started': 137, 'nb_selected_images': 713, 'last_update': '2022/08/25', 'portfolio_id': 6845170, 'last_run_id': 472189, 'total_number_of_photos': 1033}} No error ? {'log_dict': {'total_nb_images': 4136, 'max_time_between_images': '0 days 502 seconds', 'coverage_pause': '0 days 4116 seconds', 'coverage_times_pause': '0 days 8232 seconds', 'nb_photos_decision': 3924, 'nb_gray_level_ok': 905, 'nb_dedup_ok': 3924, 'nb_two_criteria_ok': 905, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 2058, 'end_of_day_photos_pink': 7, 'end_of_day_photos_dark': 960, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 898, 'ratio_coverage': 0.07259387290781143}, 'dashboard_dict': {'nb_ptf_finished': 32, 'nb_images_finished': 494, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 8, 'nb_images_started': 156, 'nb_selected_images': 650, 'last_update': '2022/08/26', 'portfolio_id': 6830485, 'last_run_id': 470781, 'total_number_of_photos': 898}} No error ? {'log_dict': {'total_nb_images': 2568, 'max_time_between_images': '0 days 449 seconds', 'coverage_pause': '0 days 2568 seconds', 'coverage_times_pause': '0 days 5136 seconds', 'nb_photos_decision': 3916, 'nb_gray_level_ok': 2076, 'nb_dedup_ok': 3916, 'nb_two_criteria_ok': 2076, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1284, 'end_of_day_photos_pink': 5, 'end_of_day_photos_dark': 556, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 2071, 'ratio_coverage': 0.045291804088255526}, 'dashboard_dict': {'nb_ptf_finished': 45, 'nb_images_finished': 714, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 8, 'nb_images_started': 216, 'nb_selected_images': 930, 'last_update': '2022/08/23', 'portfolio_id': 6811061, 'last_run_id': 469411, 'total_number_of_photos': 2075}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 6, 'max_time_between_images': '0 days 7064 seconds', 'coverage_pause': '0 days 6 seconds', 'coverage_times_pause': '0 days 12 seconds', 'nb_photos_decision': 3931, 'nb_gray_level_ok': 3928, 'nb_dedup_ok': 3931, 'nb_two_criteria_ok': 3928, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 7, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3923, 'ratio_coverage': 0.00010582197216882132}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'last_update': '2022/08/20', 'portfolio_id': 6800521, 'last_run_id': 465870, 'total_number_of_photos': 3931}} No error ? {'log_dict': {'total_nb_images': 8, 'max_time_between_images': '0 days 22258 seconds', 'coverage_pause': '0 days 8 seconds', 'coverage_times_pause': '0 days 16 seconds', 'nb_photos_decision': 3935, 'nb_gray_level_ok': 3931, 'nb_dedup_ok': 3935, 'nb_two_criteria_ok': 3931, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 4, 'end_of_day_photos_pink': 5, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3925, 'ratio_coverage': 0.00014109596289176176}, 'dashboard_dict': {'nb_ptf_finished': 55, 'nb_images_finished': 1095, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 9, 'nb_images_started': 225, 'nb_selected_images': 1320, 'last_update': '2022/08/21', 'portfolio_id': 6785173, 'last_run_id': 464885, 'total_number_of_photos': 3940}} No error ? {'log_dict': {'total_nb_images': 6, 'max_time_between_images': '0 days 13249 seconds', 'coverage_pause': '0 days 6 seconds', 'coverage_times_pause': '0 days 12 seconds', 'nb_photos_decision': 3940, 'nb_gray_level_ok': 3937, 'nb_dedup_ok': 3940, 'nb_two_criteria_ok': 3937, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 3, 'end_of_day_photos_pink': 6, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 893, 'end_of_day_photos_uploaded': 3037, 'ratio_coverage': 0.00010582197216882132}, 'dashboard_dict': {'nb_ptf_finished': 62, 'nb_images_finished': 1227, 'nb_ptf_finished_for_older': 1, 'nb_images_finished_for_older': 101, 'nb_ptf_started': 11, 'nb_images_started': 275, 'nb_selected_images': 1603, 'last_update': '2022/08/21', 'portfolio_id': 6771154, 'last_run_id': 463490, 'total_number_of_photos': 4063}} No error ? {'log_dict': {'total_nb_images': 10, 'max_time_between_images': '0 days 21811 seconds', 'coverage_pause': '0 days 10 seconds', 'coverage_times_pause': '0 days 20 seconds', 'nb_photos_decision': 3939, 'nb_gray_level_ok': 3934, 'nb_dedup_ok': 3939, 'nb_two_criteria_ok': 3934, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 5, 'end_of_day_photos_pink': 3, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3930, 'ratio_coverage': 0.0001763699536147022}, 'dashboard_dict': {'nb_ptf_finished': 54, 'nb_images_finished': 1122, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 18, 'nb_images_started': 344, 'nb_selected_images': 1466, 'last_update': '2022/08/22', 'portfolio_id': 6756941, 'last_run_id': 462392, 'total_number_of_photos': 3931}} No error ? {'log_dict': {'total_nb_images': 3946, 'max_time_between_images': '0 days 90 seconds', 'coverage_pause': '0 days 7892 seconds', 'coverage_times_pause': '0 days 15784 seconds', 'nb_photos_decision': 3946, 'nb_gray_level_ok': 3946, 'nb_dedup_ok': 3946, 'nb_two_criteria_ok': 3946, 'nb_forced_upload': 0, 'end_of_day_photos_pink': 4, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3941, 'ratio_coverage': 0.13919116739272297}, 'dashboard_dict': {'nb_ptf_finished': 69, 'nb_images_finished': 1402, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 13, 'nb_images_started': 331, 'nb_selected_images': 1733, 'last_update': '2022/08/22', 'portfolio_id': 6738801, 'last_run_id': 461074, 'total_number_of_photos': 3942}} No error ? {'log_dict': {'total_nb_images': 4, 'max_time_between_images': '0 days 1677 seconds', 'coverage_pause': '0 days 4 seconds', 'coverage_times_pause': '0 days 8 seconds', 'nb_photos_decision': 3936, 'nb_gray_level_ok': 3934, 'nb_dedup_ok': 3935, 'nb_two_criteria_ok': 3933, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 2, 'end_of_day_photos_pink': 6, 'end_of_day_photos_duplicated': 1, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 3526, 'end_of_day_photos_uploaded': 405, 'ratio_coverage': 7.054798144588088e-05}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 4, 'nb_images_started': 127, 'nb_selected_images': 127, 'last_update': '2022/08/22', 'portfolio_id': 6736624, 'last_run_id': 459828, 'total_number_of_photos': 3932}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 2, 'max_time_between_images': '0 days 2 seconds', 'coverage_pause': '0 days 2 seconds', 'coverage_times_pause': '0 days 4 seconds', 'nb_photos_decision': 3939, 'nb_gray_level_ok': 3938, 'nb_dedup_ok': 3938, 'nb_two_criteria_ok': 3937, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1, 'end_of_day_photos_pink': 10, 'end_of_day_photos_duplicated': 1, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3926, 'ratio_coverage': 3.527399072294044e-05}, 'dashboard_dict': {'nb_ptf_finished': 62, 'nb_images_finished': 1156, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 14, 'nb_images_started': 330, 'nb_selected_images': 1486, 'last_update': '2022/08/14', 'portfolio_id': 6714370, 'last_run_id': 457640, 'total_number_of_photos': 3926}} No error ? {'log_dict': {'total_nb_images': 4, 'max_time_between_images': '0 days 3519 seconds', 'coverage_pause': '0 days 4 seconds', 'coverage_times_pause': '0 days 8 seconds', 'nb_photos_decision': 2477, 'nb_gray_level_ok': 2475, 'nb_dedup_ok': 2477, 'nb_two_criteria_ok': 2475, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 2, 'end_of_day_photos_pink': 4, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 300, 'end_of_day_photos_uploaded': 2170, 'ratio_coverage': 7.054798144588088e-05}, 'dashboard_dict': {'nb_ptf_finished': 39, 'nb_images_finished': 747, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 7, 'nb_images_started': 169, 'nb_selected_images': 916, 'last_update': '2022/08/13', 'portfolio_id': 6703539, 'last_run_id': 456478, 'total_number_of_photos': 2475}} No error ? {'log_dict': {'total_nb_images': 8, 'max_time_between_images': '0 days 28998 seconds', 'coverage_pause': '0 days 8 seconds', 'coverage_times_pause': '0 days 16 seconds', 'nb_photos_decision': 3935, 'nb_gray_level_ok': 3931, 'nb_dedup_ok': 3934, 'nb_two_criteria_ok': 3930, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 4, 'end_of_day_photos_pink': 6, 'end_of_day_photos_duplicated': 1, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3923, 'ratio_coverage': 0.00014109596289176176}, 'dashboard_dict': {'nb_ptf_finished': 56, 'nb_images_finished': 1043, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 28, 'nb_images_started': 588, 'nb_selected_images': 1631, 'last_update': '2022/08/28', 'portfolio_id': 6680169, 'last_run_id': 455185, 'total_number_of_photos': 3940}} No error ? {'log_dict': {'total_nb_images': 2, 'max_time_between_images': '0 days 2 seconds', 'coverage_pause': '0 days 2 seconds', 'coverage_times_pause': '0 days 4 seconds', 'nb_photos_decision': 3940, 'nb_gray_level_ok': 3939, 'nb_dedup_ok': 3940, 'nb_two_criteria_ok': 3939, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 2, 'end_of_day_photos_pink': 7, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3931, 'ratio_coverage': 3.527399072294044e-05}, 'dashboard_dict': {'nb_ptf_finished': 56, 'nb_images_finished': 1036, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 9, 'nb_images_started': 227, 'nb_selected_images': 1263, 'last_update': '2022/08/29', 'portfolio_id': 6662197, 'last_run_id': 468274, 'total_number_of_photos': 3932}} No error ? {'log_dict': {'total_nb_images': 2, 'max_time_between_images': '0 days 2 seconds', 'coverage_pause': '0 days 2 seconds', 'coverage_times_pause': '0 days 4 seconds', 'nb_photos_decision': 3934, 'nb_gray_level_ok': 3933, 'nb_dedup_ok': 3933, 'nb_two_criteria_ok': 3932, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1, 'end_of_day_photos_pink': 6, 'end_of_day_photos_duplicated': 1, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3925, 'ratio_coverage': 3.527399072294044e-05}, 'dashboard_dict': {'nb_ptf_finished': 48, 'nb_images_finished': 929, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 22, 'nb_images_started': 429, 'nb_selected_images': 1358, 'last_update': '2022/08/21', 'portfolio_id': 6645254, 'last_run_id': 452689, 'total_number_of_photos': 3938}} No error ? {'log_dict': {'total_nb_images': 3933, 'max_time_between_images': '0 days 84 seconds', 'coverage_pause': '0 days 7866 seconds', 'coverage_times_pause': '0 days 15732 seconds', 'nb_photos_decision': 3932, 'nb_gray_level_ok': 3932, 'nb_dedup_ok': 3931, 'nb_two_criteria_ok': 3931, 'nb_forced_upload': 0, 'end_of_day_photos_pink': 11, 'end_of_day_photos_duplicated': 1, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3920, 'ratio_coverage': 0.13873260551332475}, 'dashboard_dict': {'nb_ptf_finished': 45, 'nb_images_finished': 803, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 28, 'nb_images_started': 730, 'nb_selected_images': 1533, 'last_update': '2022/09/05', 'portfolio_id': 6633492, 'last_run_id': 451519, 'total_number_of_photos': 3925}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 3936, 'max_time_between_images': '0 days 82 seconds', 'coverage_pause': '0 days 7872 seconds', 'coverage_times_pause': '0 days 15744 seconds', 'nb_photos_decision': 3936, 'nb_gray_level_ok': 3936, 'nb_dedup_ok': 3936, 'nb_two_criteria_ok': 3936, 'nb_forced_upload': 0, 'end_of_day_photos_pink': 10, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3925, 'ratio_coverage': 0.13883842748549358}, 'dashboard_dict': {'nb_ptf_finished': 34, 'nb_images_finished': 568, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 49, 'nb_images_started': 940, 'nb_selected_images': 1508, 'last_update': '2022/08/24', 'portfolio_id': 6632462, 'last_run_id': 454424, 'total_number_of_photos': 3926}} No error ? {'log_dict': {'total_nb_images': 2, 'max_time_between_images': '0 days 2 seconds', 'coverage_pause': '0 days 2 seconds', 'coverage_times_pause': '0 days 4 seconds', 'nb_photos_decision': 3939, 'nb_gray_level_ok': 3938, 'nb_dedup_ok': 3939, 'nb_two_criteria_ok': 3938, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1, 'end_of_day_photos_pink': 11, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3926, 'ratio_coverage': 3.527399072294044e-05}, 'dashboard_dict': {'nb_ptf_finished': 66, 'nb_images_finished': 1181, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 10, 'nb_images_started': 258, 'nb_selected_images': 1439, 'last_update': '2022/08/17', 'portfolio_id': 6630409, 'last_run_id': 454399, 'total_number_of_photos': 3928}} No error ? {'log_dict': {'total_nb_images': 2, 'max_time_between_images': '0 days 2 seconds', 'coverage_pause': '0 days 2 seconds', 'coverage_times_pause': '0 days 4 seconds', 'nb_photos_decision': 3941, 'nb_gray_level_ok': 3940, 'nb_dedup_ok': 3941, 'nb_two_criteria_ok': 3940, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1, 'end_of_day_photos_pink': 9, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3930, 'ratio_coverage': 3.527399072294044e-05}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 40, 'nb_images_started': 797, 'nb_selected_images': 797, 'last_update': '2022/08/24', 'portfolio_id': 6629944, 'last_run_id': 454411, 'total_number_of_photos': 3979}} No error ? {'log_dict': {'total_nb_images': 3942, 'max_time_between_images': '0 days 83 seconds', 'coverage_pause': '0 days 7884 seconds', 'coverage_times_pause': '0 days 15768 seconds', 'nb_photos_decision': 3942, 'nb_gray_level_ok': 3942, 'nb_dedup_ok': 3942, 'nb_two_criteria_ok': 3942, 'nb_forced_upload': 0, 'end_of_day_photos_pink': 6, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3935, 'ratio_coverage': 0.13905007142983122}, 'dashboard_dict': {'nb_ptf_finished': 23, 'nb_images_finished': 521, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 32, 'nb_images_started': 658, 'nb_selected_images': 1179, 'last_update': '2022/08/28', 'portfolio_id': 6625129, 'last_run_id': 454388, 'total_number_of_photos': 3940}} No error ? {'log_dict': {'total_nb_images': 2, 'max_time_between_images': '0 days 2 seconds', 'coverage_pause': '0 days 2 seconds', 'coverage_times_pause': '0 days 4 seconds', 'nb_photos_decision': 3911, 'nb_gray_level_ok': 3910, 'nb_dedup_ok': 3911, 'nb_two_criteria_ok': 3910, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 5, 'end_of_day_photos_pink': 9, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3896, 'ratio_coverage': 3.527399072294044e-05}, 'dashboard_dict': {'nb_ptf_finished': 77, 'nb_images_finished': 1405, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 9, 'nb_images_started': 271, 'nb_selected_images': 1676, 'last_update': '2022/08/11', 'portfolio_id': 6612466, 'last_run_id': 454376, 'total_number_of_photos': 3920}} No error ? {'log_dict': {'total_nb_images': 4, 'max_time_between_images': '0 days 24740 seconds', 'coverage_pause': '0 days 4 seconds', 'coverage_times_pause': '0 days 8 seconds', 'nb_photos_decision': 3914, 'nb_gray_level_ok': 3912, 'nb_dedup_ok': 3913, 'nb_two_criteria_ok': 3911, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 2, 'end_of_day_photos_pink': 11, 'end_of_day_photos_duplicated': 1, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3899, 'ratio_coverage': 7.054798144588088e-05}, 'dashboard_dict': {'nb_ptf_finished': 66, 'nb_images_finished': 1291, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 9, 'nb_images_started': 226, 'nb_selected_images': 1517, 'last_update': '2022/08/02', 'portfolio_id': 6600066, 'last_run_id': 449271, 'total_number_of_photos': 3919}} No error ? {'log_dict': {'total_nb_images': 11754, 'max_time_between_images': '0 days 6397 seconds', 'coverage_pause': '0 days 26466 seconds', 'coverage_times_pause': '0 days 43831 seconds', 'nb_photos_decision': 11774, 'nb_gray_level_ok': 4617, 'nb_dedup_ok': 11773, 'nb_two_criteria_ok': 4616, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1498, 'end_of_day_photos_pink': 20, 'end_of_day_photos_dark': 5638, 'end_of_day_photos_duplicated': 1, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 181, 'end_of_day_photos_uploaded': 4415, 'ratio_coverage': 0.46678071923667086}, 'dashboard_dict': {'nb_ptf_finished': 19, 'nb_images_finished': 1263, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 10, 'nb_images_started': 564, 'nb_selected_images': 1827, 'last_update': '2022/09/04', 'portfolio_id': 6911337, 'last_run_id': 479886, 'total_number_of_photos': 4031}} No error ? {'log_dict': {'total_nb_images': 3929, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 7858 seconds', 'coverage_times_pause': '0 days 15716 seconds', 'nb_photos_decision': 3929, 'nb_gray_level_ok': 911, 'nb_dedup_ok': 3929, 'nb_two_criteria_ok': 911, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1660, 'end_of_day_photos_pink': 2, 'end_of_day_photos_dark': 1357, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 909, 'ratio_coverage': 0.13859150955043298}, 'dashboard_dict': {'nb_ptf_finished': 28, 'nb_images_finished': 390, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 11, 'nb_images_started': 207, 'nb_selected_images': 597, 'last_update': '2022/09/03', 'portfolio_id': 6892921, 'last_run_id': 478927, 'total_number_of_photos': 909}} No error ? {'log_dict': {'total_nb_images': 3919, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 7838 seconds', 'coverage_times_pause': '0 days 15676 seconds', 'nb_photos_decision': 3918, 'nb_gray_level_ok': 662, 'nb_dedup_ok': 3918, 'nb_two_criteria_ok': 662, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 2067, 'end_of_day_photos_dark': 1189, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 662, 'ratio_coverage': 0.13823876964320359}, 'dashboard_dict': {'nb_ptf_finished': 26, 'nb_images_finished': 389, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 4, 'nb_images_started': 74, 'nb_selected_images': 463, 'last_update': '2022/08/30', 'portfolio_id': 6880974, 'last_run_id': 477478, 'total_number_of_photos': 646}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 3921, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 7842 seconds', 'coverage_times_pause': '0 days 15684 seconds', 'nb_photos_decision': 3921, 'nb_gray_level_ok': 1057, 'nb_dedup_ok': 3921, 'nb_two_criteria_ok': 1057, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1813, 'end_of_day_photos_pink': 1, 'end_of_day_photos_dark': 1050, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 1056, 'ratio_coverage': 0.13830931762464946}, 'dashboard_dict': {'nb_ptf_finished': 2, 'nb_images_finished': 28, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 28, 'last_update': '2022/08/27', 'portfolio_id': 6872937, 'last_run_id': 475306, 'total_number_of_photos': 1056}} No error ? {'log_dict': {'total_nb_images': 3920, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 7840 seconds', 'coverage_times_pause': '0 days 15680 seconds', 'nb_photos_decision': 3920, 'nb_gray_level_ok': 1069, 'nb_dedup_ok': 3920, 'nb_two_criteria_ok': 1069, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1834, 'end_of_day_photos_pink': 2, 'end_of_day_photos_dark': 1016, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 1067, 'ratio_coverage': 0.13827404363392654}, 'dashboard_dict': {'nb_ptf_finished': 31, 'nb_images_finished': 537, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 8, 'nb_images_started': 163, 'nb_selected_images': 700, 'last_update': '2022/08/29', 'portfolio_id': 6865211, 'last_run_id': 474338, 'total_number_of_photos': 1067}} No error ? {'log_dict': {'total_nb_images': 3933, 'max_time_between_images': '0 days 93 seconds', 'coverage_pause': '0 days 7866 seconds', 'coverage_times_pause': '0 days 15732 seconds', 'nb_photos_decision': 3933, 'nb_gray_level_ok': 1059, 'nb_dedup_ok': 3933, 'nb_two_criteria_ok': 1059, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1868, 'end_of_day_photos_pink': 7, 'end_of_day_photos_dark': 1005, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 429, 'end_of_day_photos_uploaded': 623, 'ratio_coverage': 0.13873260551332475}, 'dashboard_dict': {'nb_ptf_finished': 16, 'nb_images_finished': 264, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 25, 'nb_images_started': 480, 'nb_selected_images': 744, 'last_update': '2022/08/29', 'portfolio_id': 6858102, 'last_run_id': 474755, 'total_number_of_photos': 1052}} No error ? {'log_dict': {'total_nb_images': 3925, 'max_time_between_images': '0 days 83 seconds', 'coverage_pause': '0 days 7850 seconds', 'coverage_times_pause': '0 days 15700 seconds', 'nb_photos_decision': 3925, 'nb_gray_level_ok': 1034, 'nb_dedup_ok': 3925, 'nb_two_criteria_ok': 1034, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1899, 'end_of_day_photos_pink': 1, 'end_of_day_photos_dark': 991, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 1033, 'ratio_coverage': 0.13845041358754123}, 'dashboard_dict': {'nb_ptf_finished': 35, 'nb_images_finished': 576, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 7, 'nb_images_started': 137, 'nb_selected_images': 713, 'last_update': '2022/08/25', 'portfolio_id': 6845170, 'last_run_id': 472189, 'total_number_of_photos': 1033}} No error ? {'log_dict': {'total_nb_images': 3924, 'max_time_between_images': '0 days 85 seconds', 'coverage_pause': '0 days 7848 seconds', 'coverage_times_pause': '0 days 15696 seconds', 'nb_photos_decision': 3924, 'nb_gray_level_ok': 905, 'nb_dedup_ok': 3924, 'nb_two_criteria_ok': 905, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 2058, 'end_of_day_photos_pink': 7, 'end_of_day_photos_dark': 960, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 898, 'ratio_coverage': 0.13841513959681828}, 'dashboard_dict': {'nb_ptf_finished': 32, 'nb_images_finished': 494, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 8, 'nb_images_started': 156, 'nb_selected_images': 650, 'last_update': '2022/08/26', 'portfolio_id': 6830485, 'last_run_id': 470781, 'total_number_of_photos': 898}} No error ? {'log_dict': {'total_nb_images': 3917, 'max_time_between_images': '0 days 83 seconds', 'coverage_pause': '0 days 7834 seconds', 'coverage_times_pause': '0 days 15668 seconds', 'nb_photos_decision': 3916, 'nb_gray_level_ok': 2076, 'nb_dedup_ok': 3916, 'nb_two_criteria_ok': 2076, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1284, 'end_of_day_photos_pink': 5, 'end_of_day_photos_dark': 556, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 2071, 'ratio_coverage': 0.1381682216617577}, 'dashboard_dict': {'nb_ptf_finished': 45, 'nb_images_finished': 714, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 8, 'nb_images_started': 216, 'nb_selected_images': 930, 'last_update': '2022/08/23', 'portfolio_id': 6811061, 'last_run_id': 469411, 'total_number_of_photos': 2075}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 3931, 'max_time_between_images': '0 days 121 seconds', 'coverage_pause': '0 days 7862 seconds', 'coverage_times_pause': '0 days 15724 seconds', 'nb_photos_decision': 3931, 'nb_gray_level_ok': 3928, 'nb_dedup_ok': 3931, 'nb_two_criteria_ok': 3928, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 7, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3923, 'ratio_coverage': 0.13866205753187888}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'last_update': '2022/08/20', 'portfolio_id': 6800521, 'last_run_id': 465870, 'total_number_of_photos': 3931}} No error ? {'log_dict': {'total_nb_images': 3935, 'max_time_between_images': '0 days 79 seconds', 'coverage_pause': '0 days 7870 seconds', 'coverage_times_pause': '0 days 15740 seconds', 'nb_photos_decision': 3935, 'nb_gray_level_ok': 3931, 'nb_dedup_ok': 3935, 'nb_two_criteria_ok': 3931, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 4, 'end_of_day_photos_pink': 5, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3925, 'ratio_coverage': 0.13880315349477063}, 'dashboard_dict': {'nb_ptf_finished': 55, 'nb_images_finished': 1095, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 9, 'nb_images_started': 225, 'nb_selected_images': 1320, 'last_update': '2022/08/21', 'portfolio_id': 6785173, 'last_run_id': 464885, 'total_number_of_photos': 3940}} No error ? {'log_dict': {'total_nb_images': 3940, 'max_time_between_images': '0 days 84 seconds', 'coverage_pause': '0 days 7880 seconds', 'coverage_times_pause': '0 days 15760 seconds', 'nb_photos_decision': 3940, 'nb_gray_level_ok': 3937, 'nb_dedup_ok': 3940, 'nb_two_criteria_ok': 3937, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 3, 'end_of_day_photos_pink': 6, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 893, 'end_of_day_photos_uploaded': 3037, 'ratio_coverage': 0.13897952344838532}, 'dashboard_dict': {'nb_ptf_finished': 62, 'nb_images_finished': 1227, 'nb_ptf_finished_for_older': 1, 'nb_images_finished_for_older': 101, 'nb_ptf_started': 11, 'nb_images_started': 275, 'nb_selected_images': 1603, 'last_update': '2022/08/21', 'portfolio_id': 6771154, 'last_run_id': 463490, 'total_number_of_photos': 4063}} No error ? {'log_dict': {'total_nb_images': 3939, 'max_time_between_images': '0 days 85 seconds', 'coverage_pause': '0 days 7878 seconds', 'coverage_times_pause': '0 days 15756 seconds', 'nb_photos_decision': 3939, 'nb_gray_level_ok': 3934, 'nb_dedup_ok': 3939, 'nb_two_criteria_ok': 3934, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 5, 'end_of_day_photos_pink': 3, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3930, 'ratio_coverage': 0.1389442494576624}, 'dashboard_dict': {'nb_ptf_finished': 54, 'nb_images_finished': 1122, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 18, 'nb_images_started': 344, 'nb_selected_images': 1466, 'last_update': '2022/08/22', 'portfolio_id': 6756941, 'last_run_id': 462392, 'total_number_of_photos': 3931}} No error ? {'log_dict': {'total_nb_images': 3946, 'max_time_between_images': '0 days 90 seconds', 'coverage_pause': '0 days 7892 seconds', 'coverage_times_pause': '0 days 15784 seconds', 'nb_photos_decision': 3946, 'nb_gray_level_ok': 3946, 'nb_dedup_ok': 3946, 'nb_two_criteria_ok': 3946, 'nb_forced_upload': 0, 'end_of_day_photos_pink': 4, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3941, 'ratio_coverage': 0.13919116739272297}, 'dashboard_dict': {'nb_ptf_finished': 69, 'nb_images_finished': 1402, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 13, 'nb_images_started': 331, 'nb_selected_images': 1733, 'last_update': '2022/08/22', 'portfolio_id': 6738801, 'last_run_id': 461074, 'total_number_of_photos': 3942}} No error ? {'log_dict': {'total_nb_images': 3941, 'max_time_between_images': '0 days 86 seconds', 'coverage_pause': '0 days 7882 seconds', 'coverage_times_pause': '0 days 15764 seconds', 'nb_photos_decision': 3936, 'nb_gray_level_ok': 3934, 'nb_dedup_ok': 3935, 'nb_two_criteria_ok': 3933, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 2, 'end_of_day_photos_pink': 6, 'end_of_day_photos_duplicated': 1, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 3526, 'end_of_day_photos_uploaded': 405, 'ratio_coverage': 0.13901479743910827}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 4, 'nb_images_started': 127, 'nb_selected_images': 127, 'last_update': '2022/08/22', 'portfolio_id': 6736624, 'last_run_id': 459828, 'total_number_of_photos': 3932}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 3939, 'max_time_between_images': '0 days 85 seconds', 'coverage_pause': '0 days 7878 seconds', 'coverage_times_pause': '0 days 15756 seconds', 'nb_photos_decision': 3939, 'nb_gray_level_ok': 3938, 'nb_dedup_ok': 3938, 'nb_two_criteria_ok': 3937, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1, 'end_of_day_photos_pink': 10, 'end_of_day_photos_duplicated': 1, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3926, 'ratio_coverage': 0.1389442494576624}, 'dashboard_dict': {'nb_ptf_finished': 62, 'nb_images_finished': 1156, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 14, 'nb_images_started': 330, 'nb_selected_images': 1486, 'last_update': '2022/08/14', 'portfolio_id': 6714370, 'last_run_id': 457640, 'total_number_of_photos': 3926}} No error ? {'log_dict': {'total_nb_images': 2477, 'max_time_between_images': '0 days 89 seconds', 'coverage_pause': '0 days 4954 seconds', 'coverage_times_pause': '0 days 9908 seconds', 'nb_photos_decision': 2477, 'nb_gray_level_ok': 2475, 'nb_dedup_ok': 2477, 'nb_two_criteria_ok': 2475, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 2, 'end_of_day_photos_pink': 4, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 300, 'end_of_day_photos_uploaded': 2170, 'ratio_coverage': 0.08737367502072348}, 'dashboard_dict': {'nb_ptf_finished': 39, 'nb_images_finished': 747, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 7, 'nb_images_started': 169, 'nb_selected_images': 916, 'last_update': '2022/08/13', 'portfolio_id': 6703539, 'last_run_id': 456478, 'total_number_of_photos': 2475}} No error ? {'log_dict': {'total_nb_images': 3935, 'max_time_between_images': '0 days 86 seconds', 'coverage_pause': '0 days 7870 seconds', 'coverage_times_pause': '0 days 15740 seconds', 'nb_photos_decision': 3935, 'nb_gray_level_ok': 3931, 'nb_dedup_ok': 3934, 'nb_two_criteria_ok': 3930, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 4, 'end_of_day_photos_pink': 6, 'end_of_day_photos_duplicated': 1, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3923, 'ratio_coverage': 0.13880315349477063}, 'dashboard_dict': {'nb_ptf_finished': 56, 'nb_images_finished': 1043, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 28, 'nb_images_started': 588, 'nb_selected_images': 1631, 'last_update': '2022/08/28', 'portfolio_id': 6680169, 'last_run_id': 455185, 'total_number_of_photos': 3940}} No error ? {'log_dict': {'total_nb_images': 3941, 'max_time_between_images': '0 days 79 seconds', 'coverage_pause': '0 days 7882 seconds', 'coverage_times_pause': '0 days 15764 seconds', 'nb_photos_decision': 3940, 'nb_gray_level_ok': 3939, 'nb_dedup_ok': 3940, 'nb_two_criteria_ok': 3939, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 2, 'end_of_day_photos_pink': 7, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3931, 'ratio_coverage': 0.13901479743910827}, 'dashboard_dict': {'nb_ptf_finished': 56, 'nb_images_finished': 1036, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 9, 'nb_images_started': 227, 'nb_selected_images': 1263, 'last_update': '2022/08/29', 'portfolio_id': 6662197, 'last_run_id': 468274, 'total_number_of_photos': 3932}} No error ? {'log_dict': {'total_nb_images': 3934, 'max_time_between_images': '0 days 85 seconds', 'coverage_pause': '0 days 7868 seconds', 'coverage_times_pause': '0 days 15736 seconds', 'nb_photos_decision': 3934, 'nb_gray_level_ok': 3933, 'nb_dedup_ok': 3933, 'nb_two_criteria_ok': 3932, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1, 'end_of_day_photos_pink': 6, 'end_of_day_photos_duplicated': 1, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3925, 'ratio_coverage': 0.1387678795040477}, 'dashboard_dict': {'nb_ptf_finished': 48, 'nb_images_finished': 929, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 22, 'nb_images_started': 429, 'nb_selected_images': 1358, 'last_update': '2022/08/21', 'portfolio_id': 6645254, 'last_run_id': 452689, 'total_number_of_photos': 3938}} No error ? {'log_dict': {'total_nb_images': 3933, 'max_time_between_images': '0 days 84 seconds', 'coverage_pause': '0 days 7866 seconds', 'coverage_times_pause': '0 days 15732 seconds', 'nb_photos_decision': 3932, 'nb_gray_level_ok': 3932, 'nb_dedup_ok': 3931, 'nb_two_criteria_ok': 3931, 'nb_forced_upload': 0, 'end_of_day_photos_pink': 11, 'end_of_day_photos_duplicated': 1, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3920, 'ratio_coverage': 0.13873260551332475}, 'dashboard_dict': {'nb_ptf_finished': 45, 'nb_images_finished': 803, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 28, 'nb_images_started': 730, 'nb_selected_images': 1533, 'last_update': '2022/09/05', 'portfolio_id': 6633492, 'last_run_id': 451519, 'total_number_of_photos': 3925}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 3936, 'max_time_between_images': '0 days 82 seconds', 'coverage_pause': '0 days 7872 seconds', 'coverage_times_pause': '0 days 15744 seconds', 'nb_photos_decision': 3936, 'nb_gray_level_ok': 3936, 'nb_dedup_ok': 3936, 'nb_two_criteria_ok': 3936, 'nb_forced_upload': 0, 'end_of_day_photos_pink': 10, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3925, 'ratio_coverage': 0.13883842748549358}, 'dashboard_dict': {'nb_ptf_finished': 34, 'nb_images_finished': 568, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 49, 'nb_images_started': 940, 'nb_selected_images': 1508, 'last_update': '2022/08/24', 'portfolio_id': 6632462, 'last_run_id': 454424, 'total_number_of_photos': 3926}} No error ? {'log_dict': {'total_nb_images': 3939, 'max_time_between_images': '0 days 85 seconds', 'coverage_pause': '0 days 7878 seconds', 'coverage_times_pause': '0 days 15756 seconds', 'nb_photos_decision': 3939, 'nb_gray_level_ok': 3938, 'nb_dedup_ok': 3939, 'nb_two_criteria_ok': 3938, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1, 'end_of_day_photos_pink': 11, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3926, 'ratio_coverage': 0.1389442494576624}, 'dashboard_dict': {'nb_ptf_finished': 66, 'nb_images_finished': 1181, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 10, 'nb_images_started': 258, 'nb_selected_images': 1439, 'last_update': '2022/08/17', 'portfolio_id': 6630409, 'last_run_id': 454399, 'total_number_of_photos': 3928}} No error ? {'log_dict': {'total_nb_images': 3941, 'max_time_between_images': '0 days 88 seconds', 'coverage_pause': '0 days 7882 seconds', 'coverage_times_pause': '0 days 15764 seconds', 'nb_photos_decision': 3941, 'nb_gray_level_ok': 3940, 'nb_dedup_ok': 3941, 'nb_two_criteria_ok': 3940, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1, 'end_of_day_photos_pink': 9, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3930, 'ratio_coverage': 0.13901479743910827}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 40, 'nb_images_started': 797, 'nb_selected_images': 797, 'last_update': '2022/08/24', 'portfolio_id': 6629944, 'last_run_id': 454411, 'total_number_of_photos': 3979}} No error ? {'log_dict': {'total_nb_images': 3942, 'max_time_between_images': '0 days 83 seconds', 'coverage_pause': '0 days 7884 seconds', 'coverage_times_pause': '0 days 15768 seconds', 'nb_photos_decision': 3942, 'nb_gray_level_ok': 3942, 'nb_dedup_ok': 3942, 'nb_two_criteria_ok': 3942, 'nb_forced_upload': 0, 'end_of_day_photos_pink': 6, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3935, 'ratio_coverage': 0.13905007142983122}, 'dashboard_dict': {'nb_ptf_finished': 23, 'nb_images_finished': 521, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 32, 'nb_images_started': 658, 'nb_selected_images': 1179, 'last_update': '2022/08/28', 'portfolio_id': 6625129, 'last_run_id': 454388, 'total_number_of_photos': 3940}} No error ? {'log_dict': {'total_nb_images': 3911, 'max_time_between_images': '0 days 87 seconds', 'coverage_pause': '0 days 7822 seconds', 'coverage_times_pause': '0 days 15644 seconds', 'nb_photos_decision': 3911, 'nb_gray_level_ok': 3910, 'nb_dedup_ok': 3911, 'nb_two_criteria_ok': 3910, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 5, 'end_of_day_photos_pink': 9, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3896, 'ratio_coverage': 0.13795657771742006}, 'dashboard_dict': {'nb_ptf_finished': 77, 'nb_images_finished': 1405, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 9, 'nb_images_started': 271, 'nb_selected_images': 1676, 'last_update': '2022/08/11', 'portfolio_id': 6612466, 'last_run_id': 454376, 'total_number_of_photos': 3920}} No error ? {'log_dict': {'total_nb_images': 3914, 'max_time_between_images': '0 days 89 seconds', 'coverage_pause': '0 days 7828 seconds', 'coverage_times_pause': '0 days 15656 seconds', 'nb_photos_decision': 3914, 'nb_gray_level_ok': 3912, 'nb_dedup_ok': 3913, 'nb_two_criteria_ok': 3911, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 2, 'end_of_day_photos_pink': 11, 'end_of_day_photos_duplicated': 1, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3899, 'ratio_coverage': 0.1380623996895889}, 'dashboard_dict': {'nb_ptf_finished': 66, 'nb_images_finished': 1291, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 9, 'nb_images_started': 226, 'nb_selected_images': 1517, 'last_update': '2022/08/02', 'portfolio_id': 6600066, 'last_run_id': 449271, 'total_number_of_photos': 3919}} No error ? {'log_dict': {'total_nb_images': 3914, 'max_time_between_images': '0 days 89 seconds', 'coverage_pause': '0 days 7828 seconds', 'coverage_times_pause': '0 days 15656 seconds', 'nb_photos_decision': 3914, 'nb_gray_level_ok': 3912, 'nb_dedup_ok': 3913, 'nb_two_criteria_ok': 3911, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 2, 'end_of_day_photos_pink': 11, 'end_of_day_photos_duplicated': 1, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3899, 'ratio_coverage': 0.1380623996895889}, 'dashboard_dict': {'nb_ptf_finished': 66, 'nb_images_finished': 1291, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 9, 'nb_images_started': 226, 'nb_selected_images': 1517, 'last_update': '2022/08/02', 'portfolio_id': 6600066, 'last_run_id': 449271, 'total_number_of_photos': 3919}} No error ? {'log_dict': {'total_nb_images': 3914, 'max_time_between_images': '0 days 89 seconds', 'coverage_pause': '0 days 7828 seconds', 'coverage_times_pause': '0 days 15656 seconds', 'nb_photos_decision': 3914, 'nb_gray_level_ok': 3912, 'nb_dedup_ok': 3913, 'nb_two_criteria_ok': 3911, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 2, 'end_of_day_photos_pink': 11, 'end_of_day_photos_duplicated': 1, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3899, 'ratio_coverage': 0.1380623996895889}, 'dashboard_dict': {'nb_ptf_finished': 66, 'nb_images_finished': 1291, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 9, 'nb_images_started': 226, 'nb_selected_images': 1517, 'last_update': '2022/08/02', 'portfolio_id': 6600066, 'last_run_id': 449271, 'total_number_of_photos': 3919}} No error ? {'log_dict': {'total_nb_images': 11754, 'max_time_between_images': '0 days 6397 seconds', 'coverage_pause': '0 days 26466 seconds', 'coverage_times_pause': '0 days 43831 seconds', 'nb_photos_decision': 11774, 'nb_gray_level_ok': 4617, 'nb_dedup_ok': 11773, 'nb_two_criteria_ok': 4616, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1498, 'end_of_day_photos_pink': 20, 'end_of_day_photos_dark': 5638, 'end_of_day_photos_duplicated': 1, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 181, 'end_of_day_photos_uploaded': 4415, 'ratio_coverage': 0.46678071923667086}, 'dashboard_dict': {'nb_ptf_finished': 19, 'nb_images_finished': 1263, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 10, 'nb_images_started': 564, 'nb_selected_images': 1827, 'last_update': '2022/09/04', 'portfolio_id': 6911337, 'last_run_id': 479886, 'total_number_of_photos': 4031}} No error ? {'log_dict': {'total_nb_images': 3929, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 7858 seconds', 'coverage_times_pause': '0 days 15716 seconds', 'nb_photos_decision': 3929, 'nb_gray_level_ok': 911, 'nb_dedup_ok': 3929, 'nb_two_criteria_ok': 911, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1660, 'end_of_day_photos_pink': 2, 'end_of_day_photos_dark': 1357, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 909, 'ratio_coverage': 0.13859150955043298}, 'dashboard_dict': {'nb_ptf_finished': 28, 'nb_images_finished': 390, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 11, 'nb_images_started': 207, 'nb_selected_images': 597, 'last_update': '2022/09/03', 'portfolio_id': 6892921, 'last_run_id': 478927, 'total_number_of_photos': 909}} No error ? {'log_dict': {'total_nb_images': 3919, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 7838 seconds', 'coverage_times_pause': '0 days 15676 seconds', 'nb_photos_decision': 3918, 'nb_gray_level_ok': 662, 'nb_dedup_ok': 3918, 'nb_two_criteria_ok': 662, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 2067, 'end_of_day_photos_dark': 1189, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 662, 'ratio_coverage': 0.13823876964320359}, 'dashboard_dict': {'nb_ptf_finished': 26, 'nb_images_finished': 389, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 4, 'nb_images_started': 74, 'nb_selected_images': 463, 'last_update': '2022/08/30', 'portfolio_id': 6880974, 'last_run_id': 477478, 'total_number_of_photos': 646}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 3921, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 7842 seconds', 'coverage_times_pause': '0 days 15684 seconds', 'nb_photos_decision': 3921, 'nb_gray_level_ok': 1057, 'nb_dedup_ok': 3921, 'nb_two_criteria_ok': 1057, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1813, 'end_of_day_photos_pink': 1, 'end_of_day_photos_dark': 1050, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 1056, 'ratio_coverage': 0.13830931762464946}, 'dashboard_dict': {'nb_ptf_finished': 2, 'nb_images_finished': 28, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 28, 'last_update': '2022/08/27', 'portfolio_id': 6872937, 'last_run_id': 475306, 'total_number_of_photos': 1056}} No error ? {'log_dict': {'total_nb_images': 3920, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 7840 seconds', 'coverage_times_pause': '0 days 15680 seconds', 'nb_photos_decision': 3920, 'nb_gray_level_ok': 1069, 'nb_dedup_ok': 3920, 'nb_two_criteria_ok': 1069, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1834, 'end_of_day_photos_pink': 2, 'end_of_day_photos_dark': 1016, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 1067, 'ratio_coverage': 0.13827404363392654}, 'dashboard_dict': {'nb_ptf_finished': 31, 'nb_images_finished': 537, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 8, 'nb_images_started': 163, 'nb_selected_images': 700, 'last_update': '2022/08/29', 'portfolio_id': 6865211, 'last_run_id': 474338, 'total_number_of_photos': 1067}} No error ? {'log_dict': {'total_nb_images': 3933, 'max_time_between_images': '0 days 93 seconds', 'coverage_pause': '0 days 7866 seconds', 'coverage_times_pause': '0 days 15732 seconds', 'nb_photos_decision': 3933, 'nb_gray_level_ok': 1059, 'nb_dedup_ok': 3933, 'nb_two_criteria_ok': 1059, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1868, 'end_of_day_photos_pink': 7, 'end_of_day_photos_dark': 1005, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 429, 'end_of_day_photos_uploaded': 623, 'ratio_coverage': 0.13873260551332475}, 'dashboard_dict': {'nb_ptf_finished': 16, 'nb_images_finished': 264, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 25, 'nb_images_started': 480, 'nb_selected_images': 744, 'last_update': '2022/08/29', 'portfolio_id': 6858102, 'last_run_id': 474755, 'total_number_of_photos': 1052}} No error ? {'log_dict': {'total_nb_images': 3925, 'max_time_between_images': '0 days 83 seconds', 'coverage_pause': '0 days 7850 seconds', 'coverage_times_pause': '0 days 15700 seconds', 'nb_photos_decision': 3925, 'nb_gray_level_ok': 1034, 'nb_dedup_ok': 3925, 'nb_two_criteria_ok': 1034, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1899, 'end_of_day_photos_pink': 1, 'end_of_day_photos_dark': 991, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 1033, 'ratio_coverage': 0.13845041358754123}, 'dashboard_dict': {'nb_ptf_finished': 35, 'nb_images_finished': 576, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 7, 'nb_images_started': 137, 'nb_selected_images': 713, 'last_update': '2022/08/25', 'portfolio_id': 6845170, 'last_run_id': 472189, 'total_number_of_photos': 1033}} No error ? {'log_dict': {'total_nb_images': 3924, 'max_time_between_images': '0 days 85 seconds', 'coverage_pause': '0 days 7848 seconds', 'coverage_times_pause': '0 days 15696 seconds', 'nb_photos_decision': 3924, 'nb_gray_level_ok': 905, 'nb_dedup_ok': 3924, 'nb_two_criteria_ok': 905, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 2058, 'end_of_day_photos_pink': 7, 'end_of_day_photos_dark': 960, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 898, 'ratio_coverage': 0.13841513959681828}, 'dashboard_dict': {'nb_ptf_finished': 32, 'nb_images_finished': 494, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 8, 'nb_images_started': 156, 'nb_selected_images': 650, 'last_update': '2022/08/26', 'portfolio_id': 6830485, 'last_run_id': 470781, 'total_number_of_photos': 898}} No error ? {'log_dict': {'total_nb_images': 3917, 'max_time_between_images': '0 days 83 seconds', 'coverage_pause': '0 days 7834 seconds', 'coverage_times_pause': '0 days 15668 seconds', 'nb_photos_decision': 3916, 'nb_gray_level_ok': 2076, 'nb_dedup_ok': 3916, 'nb_two_criteria_ok': 2076, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1284, 'end_of_day_photos_pink': 5, 'end_of_day_photos_dark': 556, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 2071, 'ratio_coverage': 0.1381682216617577}, 'dashboard_dict': {'nb_ptf_finished': 45, 'nb_images_finished': 714, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 8, 'nb_images_started': 216, 'nb_selected_images': 930, 'last_update': '2022/08/23', 'portfolio_id': 6811061, 'last_run_id': 469411, 'total_number_of_photos': 2075}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 3931, 'max_time_between_images': '0 days 121 seconds', 'coverage_pause': '0 days 7862 seconds', 'coverage_times_pause': '0 days 15724 seconds', 'nb_photos_decision': 3931, 'nb_gray_level_ok': 3928, 'nb_dedup_ok': 3931, 'nb_two_criteria_ok': 3928, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 7, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3923, 'ratio_coverage': 0.13866205753187888}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'last_update': '2022/08/20', 'portfolio_id': 6800521, 'last_run_id': 465870, 'total_number_of_photos': 3931}} No error ? {'log_dict': {'total_nb_images': 3935, 'max_time_between_images': '0 days 79 seconds', 'coverage_pause': '0 days 7870 seconds', 'coverage_times_pause': '0 days 15740 seconds', 'nb_photos_decision': 3935, 'nb_gray_level_ok': 3931, 'nb_dedup_ok': 3935, 'nb_two_criteria_ok': 3931, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 4, 'end_of_day_photos_pink': 5, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3925, 'ratio_coverage': 0.13880315349477063}, 'dashboard_dict': {'nb_ptf_finished': 55, 'nb_images_finished': 1095, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 9, 'nb_images_started': 225, 'nb_selected_images': 1320, 'last_update': '2022/08/21', 'portfolio_id': 6785173, 'last_run_id': 464885, 'total_number_of_photos': 3940}} No error ? {'log_dict': {'total_nb_images': 3940, 'max_time_between_images': '0 days 84 seconds', 'coverage_pause': '0 days 7880 seconds', 'coverage_times_pause': '0 days 15760 seconds', 'nb_photos_decision': 3940, 'nb_gray_level_ok': 3937, 'nb_dedup_ok': 3940, 'nb_two_criteria_ok': 3937, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 3, 'end_of_day_photos_pink': 6, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 893, 'end_of_day_photos_uploaded': 3037, 'ratio_coverage': 0.13897952344838532}, 'dashboard_dict': {'nb_ptf_finished': 62, 'nb_images_finished': 1227, 'nb_ptf_finished_for_older': 1, 'nb_images_finished_for_older': 101, 'nb_ptf_started': 11, 'nb_images_started': 275, 'nb_selected_images': 1603, 'last_update': '2022/08/21', 'portfolio_id': 6771154, 'last_run_id': 463490, 'total_number_of_photos': 4063}} No error ? {'log_dict': {'total_nb_images': 3939, 'max_time_between_images': '0 days 85 seconds', 'coverage_pause': '0 days 7878 seconds', 'coverage_times_pause': '0 days 15756 seconds', 'nb_photos_decision': 3939, 'nb_gray_level_ok': 3934, 'nb_dedup_ok': 3939, 'nb_two_criteria_ok': 3934, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 5, 'end_of_day_photos_pink': 3, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3930, 'ratio_coverage': 0.1389442494576624}, 'dashboard_dict': {'nb_ptf_finished': 54, 'nb_images_finished': 1122, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 18, 'nb_images_started': 344, 'nb_selected_images': 1466, 'last_update': '2022/08/22', 'portfolio_id': 6756941, 'last_run_id': 462392, 'total_number_of_photos': 3931}} No error ? {'log_dict': {'total_nb_images': 3946, 'max_time_between_images': '0 days 90 seconds', 'coverage_pause': '0 days 7892 seconds', 'coverage_times_pause': '0 days 15784 seconds', 'nb_photos_decision': 3946, 'nb_gray_level_ok': 3946, 'nb_dedup_ok': 3946, 'nb_two_criteria_ok': 3946, 'nb_forced_upload': 0, 'end_of_day_photos_pink': 4, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3941, 'ratio_coverage': 0.13919116739272297}, 'dashboard_dict': {'nb_ptf_finished': 69, 'nb_images_finished': 1402, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 13, 'nb_images_started': 331, 'nb_selected_images': 1733, 'last_update': '2022/08/22', 'portfolio_id': 6738801, 'last_run_id': 461074, 'total_number_of_photos': 3942}} No error ? {'log_dict': {'total_nb_images': 3941, 'max_time_between_images': '0 days 86 seconds', 'coverage_pause': '0 days 7882 seconds', 'coverage_times_pause': '0 days 15764 seconds', 'nb_photos_decision': 3936, 'nb_gray_level_ok': 3934, 'nb_dedup_ok': 3935, 'nb_two_criteria_ok': 3933, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 2, 'end_of_day_photos_pink': 6, 'end_of_day_photos_duplicated': 1, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 3526, 'end_of_day_photos_uploaded': 405, 'ratio_coverage': 0.13901479743910827}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 4, 'nb_images_started': 127, 'nb_selected_images': 127, 'last_update': '2022/08/22', 'portfolio_id': 6736624, 'last_run_id': 459828, 'total_number_of_photos': 3932}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 3939, 'max_time_between_images': '0 days 85 seconds', 'coverage_pause': '0 days 7878 seconds', 'coverage_times_pause': '0 days 15756 seconds', 'nb_photos_decision': 3939, 'nb_gray_level_ok': 3938, 'nb_dedup_ok': 3938, 'nb_two_criteria_ok': 3937, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1, 'end_of_day_photos_pink': 10, 'end_of_day_photos_duplicated': 1, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3926, 'ratio_coverage': 0.1389442494576624}, 'dashboard_dict': {'nb_ptf_finished': 62, 'nb_images_finished': 1156, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 14, 'nb_images_started': 330, 'nb_selected_images': 1486, 'last_update': '2022/08/14', 'portfolio_id': 6714370, 'last_run_id': 457640, 'total_number_of_photos': 3926}} No error ? {'log_dict': {'total_nb_images': 2477, 'max_time_between_images': '0 days 89 seconds', 'coverage_pause': '0 days 4954 seconds', 'coverage_times_pause': '0 days 9908 seconds', 'nb_photos_decision': 2477, 'nb_gray_level_ok': 2475, 'nb_dedup_ok': 2477, 'nb_two_criteria_ok': 2475, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 2, 'end_of_day_photos_pink': 4, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 300, 'end_of_day_photos_uploaded': 2170, 'ratio_coverage': 0.08737367502072348}, 'dashboard_dict': {'nb_ptf_finished': 39, 'nb_images_finished': 747, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 7, 'nb_images_started': 169, 'nb_selected_images': 916, 'last_update': '2022/08/13', 'portfolio_id': 6703539, 'last_run_id': 456478, 'total_number_of_photos': 2475}} No error ? {'log_dict': {'total_nb_images': 3935, 'max_time_between_images': '0 days 86 seconds', 'coverage_pause': '0 days 7870 seconds', 'coverage_times_pause': '0 days 15740 seconds', 'nb_photos_decision': 3935, 'nb_gray_level_ok': 3931, 'nb_dedup_ok': 3934, 'nb_two_criteria_ok': 3930, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 4, 'end_of_day_photos_pink': 6, 'end_of_day_photos_duplicated': 1, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3923, 'ratio_coverage': 0.13880315349477063}, 'dashboard_dict': {'nb_ptf_finished': 56, 'nb_images_finished': 1043, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 28, 'nb_images_started': 588, 'nb_selected_images': 1631, 'last_update': '2022/08/28', 'portfolio_id': 6680169, 'last_run_id': 455185, 'total_number_of_photos': 3940}} No error ? {'log_dict': {'total_nb_images': 3941, 'max_time_between_images': '0 days 79 seconds', 'coverage_pause': '0 days 7882 seconds', 'coverage_times_pause': '0 days 15764 seconds', 'nb_photos_decision': 3940, 'nb_gray_level_ok': 3939, 'nb_dedup_ok': 3940, 'nb_two_criteria_ok': 3939, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 2, 'end_of_day_photos_pink': 7, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3931, 'ratio_coverage': 0.13901479743910827}, 'dashboard_dict': {'nb_ptf_finished': 56, 'nb_images_finished': 1036, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 9, 'nb_images_started': 227, 'nb_selected_images': 1263, 'last_update': '2022/08/29', 'portfolio_id': 6662197, 'last_run_id': 468274, 'total_number_of_photos': 3932}} No error ? {'log_dict': {'total_nb_images': 3934, 'max_time_between_images': '0 days 85 seconds', 'coverage_pause': '0 days 7868 seconds', 'coverage_times_pause': '0 days 15736 seconds', 'nb_photos_decision': 3934, 'nb_gray_level_ok': 3933, 'nb_dedup_ok': 3933, 'nb_two_criteria_ok': 3932, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1, 'end_of_day_photos_pink': 6, 'end_of_day_photos_duplicated': 1, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3925, 'ratio_coverage': 0.1387678795040477}, 'dashboard_dict': {'nb_ptf_finished': 48, 'nb_images_finished': 929, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 22, 'nb_images_started': 429, 'nb_selected_images': 1358, 'last_update': '2022/08/21', 'portfolio_id': 6645254, 'last_run_id': 452689, 'total_number_of_photos': 3938}} No error ? {'log_dict': {'total_nb_images': 3933, 'max_time_between_images': '0 days 84 seconds', 'coverage_pause': '0 days 7866 seconds', 'coverage_times_pause': '0 days 15732 seconds', 'nb_photos_decision': 3932, 'nb_gray_level_ok': 3932, 'nb_dedup_ok': 3931, 'nb_two_criteria_ok': 3931, 'nb_forced_upload': 0, 'end_of_day_photos_pink': 11, 'end_of_day_photos_duplicated': 1, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3920, 'ratio_coverage': 0.13873260551332475}, 'dashboard_dict': {'nb_ptf_finished': 45, 'nb_images_finished': 803, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 28, 'nb_images_started': 730, 'nb_selected_images': 1533, 'last_update': '2022/09/05', 'portfolio_id': 6633492, 'last_run_id': 451519, 'total_number_of_photos': 3925}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 3936, 'max_time_between_images': '0 days 82 seconds', 'coverage_pause': '0 days 7872 seconds', 'coverage_times_pause': '0 days 15744 seconds', 'nb_photos_decision': 3936, 'nb_gray_level_ok': 3936, 'nb_dedup_ok': 3936, 'nb_two_criteria_ok': 3936, 'nb_forced_upload': 0, 'end_of_day_photos_pink': 10, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3925, 'ratio_coverage': 0.13883842748549358}, 'dashboard_dict': {'nb_ptf_finished': 34, 'nb_images_finished': 568, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 49, 'nb_images_started': 940, 'nb_selected_images': 1508, 'last_update': '2022/08/24', 'portfolio_id': 6632462, 'last_run_id': 454424, 'total_number_of_photos': 3926}} No error ? {'log_dict': {'total_nb_images': 3939, 'max_time_between_images': '0 days 85 seconds', 'coverage_pause': '0 days 7878 seconds', 'coverage_times_pause': '0 days 15756 seconds', 'nb_photos_decision': 3939, 'nb_gray_level_ok': 3938, 'nb_dedup_ok': 3939, 'nb_two_criteria_ok': 3938, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1, 'end_of_day_photos_pink': 11, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3926, 'ratio_coverage': 0.1389442494576624}, 'dashboard_dict': {'nb_ptf_finished': 66, 'nb_images_finished': 1181, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 10, 'nb_images_started': 258, 'nb_selected_images': 1439, 'last_update': '2022/08/17', 'portfolio_id': 6630409, 'last_run_id': 454399, 'total_number_of_photos': 3928}} No error ? {'log_dict': {'total_nb_images': 3941, 'max_time_between_images': '0 days 88 seconds', 'coverage_pause': '0 days 7882 seconds', 'coverage_times_pause': '0 days 15764 seconds', 'nb_photos_decision': 3941, 'nb_gray_level_ok': 3940, 'nb_dedup_ok': 3941, 'nb_two_criteria_ok': 3940, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1, 'end_of_day_photos_pink': 9, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3930, 'ratio_coverage': 0.13901479743910827}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 40, 'nb_images_started': 797, 'nb_selected_images': 797, 'last_update': '2022/08/24', 'portfolio_id': 6629944, 'last_run_id': 454411, 'total_number_of_photos': 3979}} No error ? {'log_dict': {'total_nb_images': 3942, 'max_time_between_images': '0 days 83 seconds', 'coverage_pause': '0 days 7884 seconds', 'coverage_times_pause': '0 days 15768 seconds', 'nb_photos_decision': 3942, 'nb_gray_level_ok': 3942, 'nb_dedup_ok': 3942, 'nb_two_criteria_ok': 3942, 'nb_forced_upload': 0, 'end_of_day_photos_pink': 6, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3935, 'ratio_coverage': 0.13905007142983122}, 'dashboard_dict': {'nb_ptf_finished': 23, 'nb_images_finished': 521, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 32, 'nb_images_started': 658, 'nb_selected_images': 1179, 'last_update': '2022/08/28', 'portfolio_id': 6625129, 'last_run_id': 454388, 'total_number_of_photos': 3940}} No error ? {'log_dict': {'total_nb_images': 3911, 'max_time_between_images': '0 days 87 seconds', 'coverage_pause': '0 days 7822 seconds', 'coverage_times_pause': '0 days 15644 seconds', 'nb_photos_decision': 3911, 'nb_gray_level_ok': 3910, 'nb_dedup_ok': 3911, 'nb_two_criteria_ok': 3910, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 5, 'end_of_day_photos_pink': 9, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3896, 'ratio_coverage': 0.13795657771742006}, 'dashboard_dict': {'nb_ptf_finished': 77, 'nb_images_finished': 1405, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 9, 'nb_images_started': 271, 'nb_selected_images': 1676, 'last_update': '2022/08/11', 'portfolio_id': 6612466, 'last_run_id': 454376, 'total_number_of_photos': 3920}} No error ? {'log_dict': {'total_nb_images': 3914, 'max_time_between_images': '0 days 89 seconds', 'coverage_pause': '0 days 7828 seconds', 'coverage_times_pause': '0 days 15656 seconds', 'nb_photos_decision': 3914, 'nb_gray_level_ok': 3912, 'nb_dedup_ok': 3913, 'nb_two_criteria_ok': 3911, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 2, 'end_of_day_photos_pink': 11, 'end_of_day_photos_duplicated': 1, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3899, 'ratio_coverage': 0.1380623996895889}, 'dashboard_dict': {'nb_ptf_finished': 66, 'nb_images_finished': 1291, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 9, 'nb_images_started': 226, 'nb_selected_images': 1517, 'last_update': '2022/08/02', 'portfolio_id': 6600066, 'last_run_id': 449271, 'total_number_of_photos': 3919}} No error ? {'log_dict': {'total_nb_images': 3914, 'max_time_between_images': '0 days 89 seconds', 'coverage_pause': '0 days 7828 seconds', 'coverage_times_pause': '0 days 15656 seconds', 'nb_photos_decision': 3914, 'nb_gray_level_ok': 3912, 'nb_dedup_ok': 3913, 'nb_two_criteria_ok': 3911, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 2, 'end_of_day_photos_pink': 11, 'end_of_day_photos_duplicated': 1, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3899, 'ratio_coverage': 0.1380623996895889}, 'dashboard_dict': {'nb_ptf_finished': 66, 'nb_images_finished': 1291, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 9, 'nb_images_started': 226, 'nb_selected_images': 1517, 'last_update': '2022/08/02', 'portfolio_id': 6600066, 'last_run_id': 449271, 'total_number_of_photos': 3919}} No error ? {'log_dict': {'total_nb_images': 11754, 'max_time_between_images': '0 days 6397 seconds', 'coverage_pause': '0 days 26466 seconds', 'coverage_times_pause': '0 days 43831 seconds', 'nb_photos_decision': 11774, 'nb_gray_level_ok': 4617, 'nb_dedup_ok': 11773, 'nb_two_criteria_ok': 4616, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1498, 'end_of_day_photos_pink': 20, 'end_of_day_photos_dark': 5638, 'end_of_day_photos_duplicated': 1, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 181, 'end_of_day_photos_uploaded': 4415, 'ratio_coverage': 0.46678071923667086}, 'dashboard_dict': {'nb_ptf_finished': 19, 'nb_images_finished': 1263, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 10, 'nb_images_started': 564, 'nb_selected_images': 1827, 'last_update': '2022/09/04', 'portfolio_id': 6911337, 'last_run_id': 479886, 'total_number_of_photos': 4031}} No error ? {'log_dict': {'total_nb_images': 3929, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 7858 seconds', 'coverage_times_pause': '0 days 15716 seconds', 'nb_photos_decision': 3929, 'nb_gray_level_ok': 911, 'nb_dedup_ok': 3929, 'nb_two_criteria_ok': 911, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1660, 'end_of_day_photos_pink': 2, 'end_of_day_photos_dark': 1357, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 909, 'ratio_coverage': 0.13859150955043298}, 'dashboard_dict': {'nb_ptf_finished': 28, 'nb_images_finished': 390, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 11, 'nb_images_started': 207, 'nb_selected_images': 597, 'last_update': '2022/09/03', 'portfolio_id': 6892921, 'last_run_id': 478927, 'total_number_of_photos': 909}} No error ? {'log_dict': {'total_nb_images': 3919, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 7838 seconds', 'coverage_times_pause': '0 days 15676 seconds', 'nb_photos_decision': 3918, 'nb_gray_level_ok': 662, 'nb_dedup_ok': 3918, 'nb_two_criteria_ok': 662, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 2067, 'end_of_day_photos_dark': 1189, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 662, 'ratio_coverage': 0.13823876964320359}, 'dashboard_dict': {'nb_ptf_finished': 26, 'nb_images_finished': 389, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 4, 'nb_images_started': 74, 'nb_selected_images': 463, 'last_update': '2022/08/30', 'portfolio_id': 6880974, 'last_run_id': 477478, 'total_number_of_photos': 646}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 3921, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 7842 seconds', 'coverage_times_pause': '0 days 15684 seconds', 'nb_photos_decision': 3921, 'nb_gray_level_ok': 1057, 'nb_dedup_ok': 3921, 'nb_two_criteria_ok': 1057, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1813, 'end_of_day_photos_pink': 1, 'end_of_day_photos_dark': 1050, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 1056, 'ratio_coverage': 0.13830931762464946}, 'dashboard_dict': {'nb_ptf_finished': 2, 'nb_images_finished': 28, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 28, 'last_update': '2022/08/27', 'portfolio_id': 6872937, 'last_run_id': 475306, 'total_number_of_photos': 1056}} No error ? {'log_dict': {'total_nb_images': 3920, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 7840 seconds', 'coverage_times_pause': '0 days 15680 seconds', 'nb_photos_decision': 3920, 'nb_gray_level_ok': 1069, 'nb_dedup_ok': 3920, 'nb_two_criteria_ok': 1069, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1834, 'end_of_day_photos_pink': 2, 'end_of_day_photos_dark': 1016, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 1067, 'ratio_coverage': 0.13827404363392654}, 'dashboard_dict': {'nb_ptf_finished': 31, 'nb_images_finished': 537, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 8, 'nb_images_started': 163, 'nb_selected_images': 700, 'last_update': '2022/08/29', 'portfolio_id': 6865211, 'last_run_id': 474338, 'total_number_of_photos': 1067}} No error ? {'log_dict': {'total_nb_images': 3933, 'max_time_between_images': '0 days 93 seconds', 'coverage_pause': '0 days 7866 seconds', 'coverage_times_pause': '0 days 15732 seconds', 'nb_photos_decision': 3933, 'nb_gray_level_ok': 1059, 'nb_dedup_ok': 3933, 'nb_two_criteria_ok': 1059, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1868, 'end_of_day_photos_pink': 7, 'end_of_day_photos_dark': 1005, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 429, 'end_of_day_photos_uploaded': 623, 'ratio_coverage': 0.13873260551332475}, 'dashboard_dict': {'nb_ptf_finished': 16, 'nb_images_finished': 264, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 25, 'nb_images_started': 480, 'nb_selected_images': 744, 'last_update': '2022/08/29', 'portfolio_id': 6858102, 'last_run_id': 474755, 'total_number_of_photos': 1052}} No error ? {'log_dict': {'total_nb_images': 3925, 'max_time_between_images': '0 days 83 seconds', 'coverage_pause': '0 days 7850 seconds', 'coverage_times_pause': '0 days 15700 seconds', 'nb_photos_decision': 3925, 'nb_gray_level_ok': 1034, 'nb_dedup_ok': 3925, 'nb_two_criteria_ok': 1034, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1899, 'end_of_day_photos_pink': 1, 'end_of_day_photos_dark': 991, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 1033, 'ratio_coverage': 0.13845041358754123}, 'dashboard_dict': {'nb_ptf_finished': 35, 'nb_images_finished': 576, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 7, 'nb_images_started': 137, 'nb_selected_images': 713, 'last_update': '2022/08/25', 'portfolio_id': 6845170, 'last_run_id': 472189, 'total_number_of_photos': 1033}} No error ? {'log_dict': {'total_nb_images': 3924, 'max_time_between_images': '0 days 85 seconds', 'coverage_pause': '0 days 7848 seconds', 'coverage_times_pause': '0 days 15696 seconds', 'nb_photos_decision': 3924, 'nb_gray_level_ok': 905, 'nb_dedup_ok': 3924, 'nb_two_criteria_ok': 905, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 2058, 'end_of_day_photos_pink': 7, 'end_of_day_photos_dark': 960, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 898, 'ratio_coverage': 0.13841513959681828}, 'dashboard_dict': {'nb_ptf_finished': 32, 'nb_images_finished': 494, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 8, 'nb_images_started': 156, 'nb_selected_images': 650, 'last_update': '2022/08/26', 'portfolio_id': 6830485, 'last_run_id': 470781, 'total_number_of_photos': 898}} No error ? {'log_dict': {'total_nb_images': 3917, 'max_time_between_images': '0 days 83 seconds', 'coverage_pause': '0 days 7834 seconds', 'coverage_times_pause': '0 days 15668 seconds', 'nb_photos_decision': 3916, 'nb_gray_level_ok': 2076, 'nb_dedup_ok': 3916, 'nb_two_criteria_ok': 2076, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1284, 'end_of_day_photos_pink': 5, 'end_of_day_photos_dark': 556, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 2071, 'ratio_coverage': 0.1381682216617577}, 'dashboard_dict': {'nb_ptf_finished': 45, 'nb_images_finished': 714, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 8, 'nb_images_started': 216, 'nb_selected_images': 930, 'last_update': '2022/08/23', 'portfolio_id': 6811061, 'last_run_id': 469411, 'total_number_of_photos': 2075}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 3931, 'max_time_between_images': '0 days 121 seconds', 'coverage_pause': '0 days 7862 seconds', 'coverage_times_pause': '0 days 15724 seconds', 'nb_photos_decision': 3931, 'nb_gray_level_ok': 3928, 'nb_dedup_ok': 3931, 'nb_two_criteria_ok': 3928, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 7, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3923, 'ratio_coverage': 0.13866205753187888}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'last_update': '2022/08/20', 'portfolio_id': 6800521, 'last_run_id': 465870, 'total_number_of_photos': 3931}} No error ? {'log_dict': {'total_nb_images': 3935, 'max_time_between_images': '0 days 79 seconds', 'coverage_pause': '0 days 7870 seconds', 'coverage_times_pause': '0 days 15740 seconds', 'nb_photos_decision': 3935, 'nb_gray_level_ok': 3931, 'nb_dedup_ok': 3935, 'nb_two_criteria_ok': 3931, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 4, 'end_of_day_photos_pink': 5, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3925, 'ratio_coverage': 0.13880315349477063}, 'dashboard_dict': {'nb_ptf_finished': 55, 'nb_images_finished': 1095, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 9, 'nb_images_started': 225, 'nb_selected_images': 1320, 'last_update': '2022/08/21', 'portfolio_id': 6785173, 'last_run_id': 464885, 'total_number_of_photos': 3940}} No error ? {'log_dict': {'total_nb_images': 3940, 'max_time_between_images': '0 days 84 seconds', 'coverage_pause': '0 days 7880 seconds', 'coverage_times_pause': '0 days 15760 seconds', 'nb_photos_decision': 3940, 'nb_gray_level_ok': 3937, 'nb_dedup_ok': 3940, 'nb_two_criteria_ok': 3937, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 3, 'end_of_day_photos_pink': 6, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 893, 'end_of_day_photos_uploaded': 3037, 'ratio_coverage': 0.13897952344838532}, 'dashboard_dict': {'nb_ptf_finished': 62, 'nb_images_finished': 1227, 'nb_ptf_finished_for_older': 1, 'nb_images_finished_for_older': 101, 'nb_ptf_started': 11, 'nb_images_started': 275, 'nb_selected_images': 1603, 'last_update': '2022/08/21', 'portfolio_id': 6771154, 'last_run_id': 463490, 'total_number_of_photos': 4063}} No error ? {'log_dict': {'total_nb_images': 3939, 'max_time_between_images': '0 days 85 seconds', 'coverage_pause': '0 days 7878 seconds', 'coverage_times_pause': '0 days 15756 seconds', 'nb_photos_decision': 3939, 'nb_gray_level_ok': 3934, 'nb_dedup_ok': 3939, 'nb_two_criteria_ok': 3934, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 5, 'end_of_day_photos_pink': 3, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3930, 'ratio_coverage': 0.1389442494576624}, 'dashboard_dict': {'nb_ptf_finished': 54, 'nb_images_finished': 1122, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 18, 'nb_images_started': 344, 'nb_selected_images': 1466, 'last_update': '2022/08/22', 'portfolio_id': 6756941, 'last_run_id': 462392, 'total_number_of_photos': 3931}} No error ? {'log_dict': {'total_nb_images': 3946, 'max_time_between_images': '0 days 90 seconds', 'coverage_pause': '0 days 7892 seconds', 'coverage_times_pause': '0 days 15784 seconds', 'nb_photos_decision': 3946, 'nb_gray_level_ok': 3946, 'nb_dedup_ok': 3946, 'nb_two_criteria_ok': 3946, 'nb_forced_upload': 0, 'end_of_day_photos_pink': 4, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3941, 'ratio_coverage': 0.13919116739272297}, 'dashboard_dict': {'nb_ptf_finished': 69, 'nb_images_finished': 1402, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 13, 'nb_images_started': 331, 'nb_selected_images': 1733, 'last_update': '2022/08/22', 'portfolio_id': 6738801, 'last_run_id': 461074, 'total_number_of_photos': 3942}} No error ? {'log_dict': {'total_nb_images': 3941, 'max_time_between_images': '0 days 86 seconds', 'coverage_pause': '0 days 7882 seconds', 'coverage_times_pause': '0 days 15764 seconds', 'nb_photos_decision': 3936, 'nb_gray_level_ok': 3934, 'nb_dedup_ok': 3935, 'nb_two_criteria_ok': 3933, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 2, 'end_of_day_photos_pink': 6, 'end_of_day_photos_duplicated': 1, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 3526, 'end_of_day_photos_uploaded': 405, 'ratio_coverage': 0.13901479743910827}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 4, 'nb_images_started': 127, 'nb_selected_images': 127, 'last_update': '2022/08/22', 'portfolio_id': 6736624, 'last_run_id': 459828, 'total_number_of_photos': 3932}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 3939, 'max_time_between_images': '0 days 85 seconds', 'coverage_pause': '0 days 7878 seconds', 'coverage_times_pause': '0 days 15756 seconds', 'nb_photos_decision': 3939, 'nb_gray_level_ok': 3938, 'nb_dedup_ok': 3938, 'nb_two_criteria_ok': 3937, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1, 'end_of_day_photos_pink': 10, 'end_of_day_photos_duplicated': 1, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3926, 'ratio_coverage': 0.1389442494576624}, 'dashboard_dict': {'nb_ptf_finished': 62, 'nb_images_finished': 1156, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 14, 'nb_images_started': 330, 'nb_selected_images': 1486, 'last_update': '2022/08/14', 'portfolio_id': 6714370, 'last_run_id': 457640, 'total_number_of_photos': 3926}} No error ? {'log_dict': {'total_nb_images': 2477, 'max_time_between_images': '0 days 89 seconds', 'coverage_pause': '0 days 4954 seconds', 'coverage_times_pause': '0 days 9908 seconds', 'nb_photos_decision': 2477, 'nb_gray_level_ok': 2475, 'nb_dedup_ok': 2477, 'nb_two_criteria_ok': 2475, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 2, 'end_of_day_photos_pink': 4, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 300, 'end_of_day_photos_uploaded': 2170, 'ratio_coverage': 0.08737367502072348}, 'dashboard_dict': {'nb_ptf_finished': 39, 'nb_images_finished': 747, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 7, 'nb_images_started': 169, 'nb_selected_images': 916, 'last_update': '2022/08/13', 'portfolio_id': 6703539, 'last_run_id': 456478, 'total_number_of_photos': 2475}} No error ? {'log_dict': {'total_nb_images': 3935, 'max_time_between_images': '0 days 86 seconds', 'coverage_pause': '0 days 7870 seconds', 'coverage_times_pause': '0 days 15740 seconds', 'nb_photos_decision': 3935, 'nb_gray_level_ok': 3931, 'nb_dedup_ok': 3934, 'nb_two_criteria_ok': 3930, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 4, 'end_of_day_photos_pink': 6, 'end_of_day_photos_duplicated': 1, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3923, 'ratio_coverage': 0.13880315349477063}, 'dashboard_dict': {'nb_ptf_finished': 56, 'nb_images_finished': 1043, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 28, 'nb_images_started': 588, 'nb_selected_images': 1631, 'last_update': '2022/08/28', 'portfolio_id': 6680169, 'last_run_id': 455185, 'total_number_of_photos': 3940}} No error ? {'log_dict': {'total_nb_images': 3941, 'max_time_between_images': '0 days 79 seconds', 'coverage_pause': '0 days 7882 seconds', 'coverage_times_pause': '0 days 15764 seconds', 'nb_photos_decision': 3940, 'nb_gray_level_ok': 3939, 'nb_dedup_ok': 3940, 'nb_two_criteria_ok': 3939, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 2, 'end_of_day_photos_pink': 7, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3931, 'ratio_coverage': 0.13901479743910827}, 'dashboard_dict': {'nb_ptf_finished': 56, 'nb_images_finished': 1036, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 9, 'nb_images_started': 227, 'nb_selected_images': 1263, 'last_update': '2022/08/29', 'portfolio_id': 6662197, 'last_run_id': 468274, 'total_number_of_photos': 3932}} No error ? {'log_dict': {'total_nb_images': 3934, 'max_time_between_images': '0 days 85 seconds', 'coverage_pause': '0 days 7868 seconds', 'coverage_times_pause': '0 days 15736 seconds', 'nb_photos_decision': 3934, 'nb_gray_level_ok': 3933, 'nb_dedup_ok': 3933, 'nb_two_criteria_ok': 3932, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1, 'end_of_day_photos_pink': 6, 'end_of_day_photos_duplicated': 1, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3925, 'ratio_coverage': 0.1387678795040477}, 'dashboard_dict': {'nb_ptf_finished': 48, 'nb_images_finished': 929, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 22, 'nb_images_started': 429, 'nb_selected_images': 1358, 'last_update': '2022/08/21', 'portfolio_id': 6645254, 'last_run_id': 452689, 'total_number_of_photos': 3938}} No error ? {'log_dict': {'total_nb_images': 3933, 'max_time_between_images': '0 days 84 seconds', 'coverage_pause': '0 days 7866 seconds', 'coverage_times_pause': '0 days 15732 seconds', 'nb_photos_decision': 3932, 'nb_gray_level_ok': 3932, 'nb_dedup_ok': 3931, 'nb_two_criteria_ok': 3931, 'nb_forced_upload': 0, 'end_of_day_photos_pink': 11, 'end_of_day_photos_duplicated': 1, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3920, 'ratio_coverage': 0.13873260551332475}, 'dashboard_dict': {'nb_ptf_finished': 45, 'nb_images_finished': 803, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 28, 'nb_images_started': 730, 'nb_selected_images': 1533, 'last_update': '2022/09/05', 'portfolio_id': 6633492, 'last_run_id': 451519, 'total_number_of_photos': 3925}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 3936, 'max_time_between_images': '0 days 82 seconds', 'coverage_pause': '0 days 7872 seconds', 'coverage_times_pause': '0 days 15744 seconds', 'nb_photos_decision': 3936, 'nb_gray_level_ok': 3936, 'nb_dedup_ok': 3936, 'nb_two_criteria_ok': 3936, 'nb_forced_upload': 0, 'end_of_day_photos_pink': 10, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3925, 'ratio_coverage': 0.13883842748549358}, 'dashboard_dict': {'nb_ptf_finished': 34, 'nb_images_finished': 568, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 49, 'nb_images_started': 940, 'nb_selected_images': 1508, 'last_update': '2022/08/24', 'portfolio_id': 6632462, 'last_run_id': 454424, 'total_number_of_photos': 3926}} No error ? {'log_dict': {'total_nb_images': 3939, 'max_time_between_images': '0 days 85 seconds', 'coverage_pause': '0 days 7878 seconds', 'coverage_times_pause': '0 days 15756 seconds', 'nb_photos_decision': 3939, 'nb_gray_level_ok': 3938, 'nb_dedup_ok': 3939, 'nb_two_criteria_ok': 3938, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1, 'end_of_day_photos_pink': 11, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3926, 'ratio_coverage': 0.1389442494576624}, 'dashboard_dict': {'nb_ptf_finished': 66, 'nb_images_finished': 1181, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 10, 'nb_images_started': 258, 'nb_selected_images': 1439, 'last_update': '2022/08/17', 'portfolio_id': 6630409, 'last_run_id': 454399, 'total_number_of_photos': 3928}} No error ? {'log_dict': {'total_nb_images': 3941, 'max_time_between_images': '0 days 88 seconds', 'coverage_pause': '0 days 7882 seconds', 'coverage_times_pause': '0 days 15764 seconds', 'nb_photos_decision': 3941, 'nb_gray_level_ok': 3940, 'nb_dedup_ok': 3941, 'nb_two_criteria_ok': 3940, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1, 'end_of_day_photos_pink': 9, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3930, 'ratio_coverage': 0.13901479743910827}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 40, 'nb_images_started': 797, 'nb_selected_images': 797, 'last_update': '2022/08/24', 'portfolio_id': 6629944, 'last_run_id': 454411, 'total_number_of_photos': 3979}} No error ? {'log_dict': {'total_nb_images': 3942, 'max_time_between_images': '0 days 83 seconds', 'coverage_pause': '0 days 7884 seconds', 'coverage_times_pause': '0 days 15768 seconds', 'nb_photos_decision': 3942, 'nb_gray_level_ok': 3942, 'nb_dedup_ok': 3942, 'nb_two_criteria_ok': 3942, 'nb_forced_upload': 0, 'end_of_day_photos_pink': 6, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3935, 'ratio_coverage': 0.13905007142983122}, 'dashboard_dict': {'nb_ptf_finished': 23, 'nb_images_finished': 521, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 32, 'nb_images_started': 658, 'nb_selected_images': 1179, 'last_update': '2022/08/28', 'portfolio_id': 6625129, 'last_run_id': 454388, 'total_number_of_photos': 3940}} No error ? {'log_dict': {'total_nb_images': 3911, 'max_time_between_images': '0 days 87 seconds', 'coverage_pause': '0 days 7822 seconds', 'coverage_times_pause': '0 days 15644 seconds', 'nb_photos_decision': 3911, 'nb_gray_level_ok': 3910, 'nb_dedup_ok': 3911, 'nb_two_criteria_ok': 3910, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 5, 'end_of_day_photos_pink': 9, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3896, 'ratio_coverage': 0.13795657771742006}, 'dashboard_dict': {'nb_ptf_finished': 77, 'nb_images_finished': 1405, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 9, 'nb_images_started': 271, 'nb_selected_images': 1676, 'last_update': '2022/08/11', 'portfolio_id': 6612466, 'last_run_id': 454376, 'total_number_of_photos': 3920}} No error ? {'log_dict': {'total_nb_images': 3914, 'max_time_between_images': '0 days 89 seconds', 'coverage_pause': '0 days 7828 seconds', 'coverage_times_pause': '0 days 15656 seconds', 'nb_photos_decision': 3914, 'nb_gray_level_ok': 3912, 'nb_dedup_ok': 3913, 'nb_two_criteria_ok': 3911, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 2, 'end_of_day_photos_pink': 11, 'end_of_day_photos_duplicated': 1, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3899, 'ratio_coverage': 0.1380623996895889}, 'dashboard_dict': {'nb_ptf_finished': 66, 'nb_images_finished': 1291, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 9, 'nb_images_started': 226, 'nb_selected_images': 1517, 'last_update': '2022/08/02', 'portfolio_id': 6600066, 'last_run_id': 449271, 'total_number_of_photos': 3919}} No error ? {'log_dict': {'total_nb_images': 11754, 'max_time_between_images': '0 days 6397 seconds', 'coverage_pause': '0 days 26466 seconds', 'coverage_times_pause': '0 days 43831 seconds', 'nb_photos_decision': 11774, 'nb_gray_level_ok': 4617, 'nb_dedup_ok': 11773, 'nb_two_criteria_ok': 4616, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1498, 'end_of_day_photos_pink': 20, 'end_of_day_photos_dark': 5638, 'end_of_day_photos_duplicated': 1, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 181, 'end_of_day_photos_uploaded': 4415, 'ratio_coverage': 0.46678071923667086}, 'dashboard_dict': {'nb_ptf_finished': 19, 'nb_images_finished': 1263, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 10, 'nb_images_started': 564, 'nb_selected_images': 1827, 'last_update': '2022/09/04', 'portfolio_id': 6911337, 'last_run_id': 479886, 'total_number_of_photos': 4031}} No error ? {'log_dict': {'total_nb_images': 3929, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 7858 seconds', 'coverage_times_pause': '0 days 15716 seconds', 'nb_photos_decision': 3929, 'nb_gray_level_ok': 911, 'nb_dedup_ok': 3929, 'nb_two_criteria_ok': 911, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1660, 'end_of_day_photos_pink': 2, 'end_of_day_photos_dark': 1357, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 909, 'ratio_coverage': 0.13859150955043298}, 'dashboard_dict': {'nb_ptf_finished': 28, 'nb_images_finished': 390, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 11, 'nb_images_started': 207, 'nb_selected_images': 597, 'last_update': '2022/09/03', 'portfolio_id': 6892921, 'last_run_id': 478927, 'total_number_of_photos': 909}} No error ? {'log_dict': {'total_nb_images': 3919, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 7838 seconds', 'coverage_times_pause': '0 days 15676 seconds', 'nb_photos_decision': 3918, 'nb_gray_level_ok': 662, 'nb_dedup_ok': 3918, 'nb_two_criteria_ok': 662, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 2067, 'end_of_day_photos_dark': 1189, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 662, 'ratio_coverage': 0.13823876964320359}, 'dashboard_dict': {'nb_ptf_finished': 26, 'nb_images_finished': 389, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 4, 'nb_images_started': 74, 'nb_selected_images': 463, 'last_update': '2022/08/30', 'portfolio_id': 6880974, 'last_run_id': 477478, 'total_number_of_photos': 646}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 3921, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 7842 seconds', 'coverage_times_pause': '0 days 15684 seconds', 'nb_photos_decision': 3921, 'nb_gray_level_ok': 1057, 'nb_dedup_ok': 3921, 'nb_two_criteria_ok': 1057, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1813, 'end_of_day_photos_pink': 1, 'end_of_day_photos_dark': 1050, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 1056, 'ratio_coverage': 0.13830931762464946}, 'dashboard_dict': {'nb_ptf_finished': 2, 'nb_images_finished': 28, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 28, 'last_update': '2022/08/27', 'portfolio_id': 6872937, 'last_run_id': 475306, 'total_number_of_photos': 1056}} No error ? {'log_dict': {'total_nb_images': 3920, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 7840 seconds', 'coverage_times_pause': '0 days 15680 seconds', 'nb_photos_decision': 3920, 'nb_gray_level_ok': 1069, 'nb_dedup_ok': 3920, 'nb_two_criteria_ok': 1069, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1834, 'end_of_day_photos_pink': 2, 'end_of_day_photos_dark': 1016, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 1067, 'ratio_coverage': 0.13827404363392654}, 'dashboard_dict': {'nb_ptf_finished': 31, 'nb_images_finished': 537, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 8, 'nb_images_started': 163, 'nb_selected_images': 700, 'last_update': '2022/08/29', 'portfolio_id': 6865211, 'last_run_id': 474338, 'total_number_of_photos': 1067}} No error ? {'log_dict': {'total_nb_images': 3933, 'max_time_between_images': '0 days 93 seconds', 'coverage_pause': '0 days 7866 seconds', 'coverage_times_pause': '0 days 15732 seconds', 'nb_photos_decision': 3933, 'nb_gray_level_ok': 1059, 'nb_dedup_ok': 3933, 'nb_two_criteria_ok': 1059, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1868, 'end_of_day_photos_pink': 7, 'end_of_day_photos_dark': 1005, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 429, 'end_of_day_photos_uploaded': 623, 'ratio_coverage': 0.13873260551332475}, 'dashboard_dict': {'nb_ptf_finished': 16, 'nb_images_finished': 264, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 25, 'nb_images_started': 480, 'nb_selected_images': 744, 'last_update': '2022/08/29', 'portfolio_id': 6858102, 'last_run_id': 474755, 'total_number_of_photos': 1052}} No error ? {'log_dict': {'total_nb_images': 3925, 'max_time_between_images': '0 days 83 seconds', 'coverage_pause': '0 days 7850 seconds', 'coverage_times_pause': '0 days 15700 seconds', 'nb_photos_decision': 3925, 'nb_gray_level_ok': 1034, 'nb_dedup_ok': 3925, 'nb_two_criteria_ok': 1034, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1899, 'end_of_day_photos_pink': 1, 'end_of_day_photos_dark': 991, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 1033, 'ratio_coverage': 0.13845041358754123}, 'dashboard_dict': {'nb_ptf_finished': 35, 'nb_images_finished': 576, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 7, 'nb_images_started': 137, 'nb_selected_images': 713, 'last_update': '2022/08/25', 'portfolio_id': 6845170, 'last_run_id': 472189, 'total_number_of_photos': 1033}} No error ? {'log_dict': {'total_nb_images': 3924, 'max_time_between_images': '0 days 85 seconds', 'coverage_pause': '0 days 7848 seconds', 'coverage_times_pause': '0 days 15696 seconds', 'nb_photos_decision': 3924, 'nb_gray_level_ok': 905, 'nb_dedup_ok': 3924, 'nb_two_criteria_ok': 905, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 2058, 'end_of_day_photos_pink': 7, 'end_of_day_photos_dark': 960, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 898, 'ratio_coverage': 0.13841513959681828}, 'dashboard_dict': {'nb_ptf_finished': 32, 'nb_images_finished': 494, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 8, 'nb_images_started': 156, 'nb_selected_images': 650, 'last_update': '2022/08/26', 'portfolio_id': 6830485, 'last_run_id': 470781, 'total_number_of_photos': 898}} No error ? {'log_dict': {'total_nb_images': 3917, 'max_time_between_images': '0 days 83 seconds', 'coverage_pause': '0 days 7834 seconds', 'coverage_times_pause': '0 days 15668 seconds', 'nb_photos_decision': 3916, 'nb_gray_level_ok': 2076, 'nb_dedup_ok': 3916, 'nb_two_criteria_ok': 2076, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1284, 'end_of_day_photos_pink': 5, 'end_of_day_photos_dark': 556, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 2071, 'ratio_coverage': 0.1381682216617577}, 'dashboard_dict': {'nb_ptf_finished': 45, 'nb_images_finished': 714, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 8, 'nb_images_started': 216, 'nb_selected_images': 930, 'last_update': '2022/08/23', 'portfolio_id': 6811061, 'last_run_id': 469411, 'total_number_of_photos': 2075}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 3931, 'max_time_between_images': '0 days 121 seconds', 'coverage_pause': '0 days 7862 seconds', 'coverage_times_pause': '0 days 15724 seconds', 'nb_photos_decision': 3931, 'nb_gray_level_ok': 3928, 'nb_dedup_ok': 3931, 'nb_two_criteria_ok': 3928, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 7, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3923, 'ratio_coverage': 0.13866205753187888}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'last_update': '2022/08/20', 'portfolio_id': 6800521, 'last_run_id': 465870, 'total_number_of_photos': 3931}} No error ? {'log_dict': {'total_nb_images': 3935, 'max_time_between_images': '0 days 79 seconds', 'coverage_pause': '0 days 7870 seconds', 'coverage_times_pause': '0 days 15740 seconds', 'nb_photos_decision': 3935, 'nb_gray_level_ok': 3931, 'nb_dedup_ok': 3935, 'nb_two_criteria_ok': 3931, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 4, 'end_of_day_photos_pink': 5, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3925, 'ratio_coverage': 0.13880315349477063}, 'dashboard_dict': {'nb_ptf_finished': 55, 'nb_images_finished': 1095, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 9, 'nb_images_started': 225, 'nb_selected_images': 1320, 'last_update': '2022/08/21', 'portfolio_id': 6785173, 'last_run_id': 464885, 'total_number_of_photos': 3940}} No error ? {'log_dict': {'total_nb_images': 3940, 'max_time_between_images': '0 days 84 seconds', 'coverage_pause': '0 days 7880 seconds', 'coverage_times_pause': '0 days 15760 seconds', 'nb_photos_decision': 3940, 'nb_gray_level_ok': 3937, 'nb_dedup_ok': 3940, 'nb_two_criteria_ok': 3937, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 3, 'end_of_day_photos_pink': 6, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 893, 'end_of_day_photos_uploaded': 3037, 'ratio_coverage': 0.13897952344838532}, 'dashboard_dict': {'nb_ptf_finished': 62, 'nb_images_finished': 1227, 'nb_ptf_finished_for_older': 1, 'nb_images_finished_for_older': 101, 'nb_ptf_started': 11, 'nb_images_started': 275, 'nb_selected_images': 1603, 'last_update': '2022/08/21', 'portfolio_id': 6771154, 'last_run_id': 463490, 'total_number_of_photos': 4063}} No error ? {'log_dict': {'total_nb_images': 3939, 'max_time_between_images': '0 days 85 seconds', 'coverage_pause': '0 days 7878 seconds', 'coverage_times_pause': '0 days 15756 seconds', 'nb_photos_decision': 3939, 'nb_gray_level_ok': 3934, 'nb_dedup_ok': 3939, 'nb_two_criteria_ok': 3934, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 5, 'end_of_day_photos_pink': 3, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3930, 'ratio_coverage': 0.1389442494576624}, 'dashboard_dict': {'nb_ptf_finished': 54, 'nb_images_finished': 1122, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 18, 'nb_images_started': 344, 'nb_selected_images': 1466, 'last_update': '2022/08/22', 'portfolio_id': 6756941, 'last_run_id': 462392, 'total_number_of_photos': 3931}} No error ? {'log_dict': {'total_nb_images': 3946, 'max_time_between_images': '0 days 90 seconds', 'coverage_pause': '0 days 7892 seconds', 'coverage_times_pause': '0 days 15784 seconds', 'nb_photos_decision': 3946, 'nb_gray_level_ok': 3946, 'nb_dedup_ok': 3946, 'nb_two_criteria_ok': 3946, 'nb_forced_upload': 0, 'end_of_day_photos_pink': 4, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3941, 'ratio_coverage': 0.13919116739272297}, 'dashboard_dict': {'nb_ptf_finished': 69, 'nb_images_finished': 1402, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 13, 'nb_images_started': 331, 'nb_selected_images': 1733, 'last_update': '2022/08/22', 'portfolio_id': 6738801, 'last_run_id': 461074, 'total_number_of_photos': 3942}} No error ? {'log_dict': {'total_nb_images': 3941, 'max_time_between_images': '0 days 86 seconds', 'coverage_pause': '0 days 7882 seconds', 'coverage_times_pause': '0 days 15764 seconds', 'nb_photos_decision': 3936, 'nb_gray_level_ok': 3934, 'nb_dedup_ok': 3935, 'nb_two_criteria_ok': 3933, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 2, 'end_of_day_photos_pink': 6, 'end_of_day_photos_duplicated': 1, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 3526, 'end_of_day_photos_uploaded': 405, 'ratio_coverage': 0.13901479743910827}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 4, 'nb_images_started': 127, 'nb_selected_images': 127, 'last_update': '2022/08/22', 'portfolio_id': 6736624, 'last_run_id': 459828, 'total_number_of_photos': 3932}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 3939, 'max_time_between_images': '0 days 85 seconds', 'coverage_pause': '0 days 7878 seconds', 'coverage_times_pause': '0 days 15756 seconds', 'nb_photos_decision': 3939, 'nb_gray_level_ok': 3938, 'nb_dedup_ok': 3938, 'nb_two_criteria_ok': 3937, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1, 'end_of_day_photos_pink': 10, 'end_of_day_photos_duplicated': 1, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3926, 'ratio_coverage': 0.1389442494576624}, 'dashboard_dict': {'nb_ptf_finished': 62, 'nb_images_finished': 1156, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 14, 'nb_images_started': 330, 'nb_selected_images': 1486, 'last_update': '2022/08/14', 'portfolio_id': 6714370, 'last_run_id': 457640, 'total_number_of_photos': 3926}} No error ? {'log_dict': {'total_nb_images': 2477, 'max_time_between_images': '0 days 89 seconds', 'coverage_pause': '0 days 4954 seconds', 'coverage_times_pause': '0 days 9908 seconds', 'nb_photos_decision': 2477, 'nb_gray_level_ok': 2475, 'nb_dedup_ok': 2477, 'nb_two_criteria_ok': 2475, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 2, 'end_of_day_photos_pink': 4, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 300, 'end_of_day_photos_uploaded': 2170, 'ratio_coverage': 0.08737367502072348}, 'dashboard_dict': {'nb_ptf_finished': 39, 'nb_images_finished': 747, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 7, 'nb_images_started': 169, 'nb_selected_images': 916, 'last_update': '2022/08/13', 'portfolio_id': 6703539, 'last_run_id': 456478, 'total_number_of_photos': 2475}} No error ? {'log_dict': {'total_nb_images': 3935, 'max_time_between_images': '0 days 86 seconds', 'coverage_pause': '0 days 7870 seconds', 'coverage_times_pause': '0 days 15740 seconds', 'nb_photos_decision': 3935, 'nb_gray_level_ok': 3931, 'nb_dedup_ok': 3934, 'nb_two_criteria_ok': 3930, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 4, 'end_of_day_photos_pink': 6, 'end_of_day_photos_duplicated': 1, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3923, 'ratio_coverage': 0.13880315349477063}, 'dashboard_dict': {'nb_ptf_finished': 56, 'nb_images_finished': 1043, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 28, 'nb_images_started': 588, 'nb_selected_images': 1631, 'last_update': '2022/08/28', 'portfolio_id': 6680169, 'last_run_id': 455185, 'total_number_of_photos': 3940}} No error ? {'log_dict': {'total_nb_images': 3941, 'max_time_between_images': '0 days 79 seconds', 'coverage_pause': '0 days 7882 seconds', 'coverage_times_pause': '0 days 15764 seconds', 'nb_photos_decision': 3940, 'nb_gray_level_ok': 3939, 'nb_dedup_ok': 3940, 'nb_two_criteria_ok': 3939, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 2, 'end_of_day_photos_pink': 7, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3931, 'ratio_coverage': 0.13901479743910827}, 'dashboard_dict': {'nb_ptf_finished': 56, 'nb_images_finished': 1036, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 9, 'nb_images_started': 227, 'nb_selected_images': 1263, 'last_update': '2022/08/29', 'portfolio_id': 6662197, 'last_run_id': 468274, 'total_number_of_photos': 3932}} No error ? {'log_dict': {'total_nb_images': 3934, 'max_time_between_images': '0 days 85 seconds', 'coverage_pause': '0 days 7868 seconds', 'coverage_times_pause': '0 days 15736 seconds', 'nb_photos_decision': 3934, 'nb_gray_level_ok': 3933, 'nb_dedup_ok': 3933, 'nb_two_criteria_ok': 3932, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1, 'end_of_day_photos_pink': 6, 'end_of_day_photos_duplicated': 1, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3925, 'ratio_coverage': 0.1387678795040477}, 'dashboard_dict': {'nb_ptf_finished': 48, 'nb_images_finished': 929, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 22, 'nb_images_started': 429, 'nb_selected_images': 1358, 'last_update': '2022/08/21', 'portfolio_id': 6645254, 'last_run_id': 452689, 'total_number_of_photos': 3938}} No error ? {'log_dict': {'total_nb_images': 3933, 'max_time_between_images': '0 days 84 seconds', 'coverage_pause': '0 days 7866 seconds', 'coverage_times_pause': '0 days 15732 seconds', 'nb_photos_decision': 3932, 'nb_gray_level_ok': 3932, 'nb_dedup_ok': 3931, 'nb_two_criteria_ok': 3931, 'nb_forced_upload': 0, 'end_of_day_photos_pink': 11, 'end_of_day_photos_duplicated': 1, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3920, 'ratio_coverage': 0.13873260551332475}, 'dashboard_dict': {'nb_ptf_finished': 45, 'nb_images_finished': 803, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 28, 'nb_images_started': 730, 'nb_selected_images': 1533, 'last_update': '2022/09/05', 'portfolio_id': 6633492, 'last_run_id': 451519, 'total_number_of_photos': 3925}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 3936, 'max_time_between_images': '0 days 82 seconds', 'coverage_pause': '0 days 7872 seconds', 'coverage_times_pause': '0 days 15744 seconds', 'nb_photos_decision': 3936, 'nb_gray_level_ok': 3936, 'nb_dedup_ok': 3936, 'nb_two_criteria_ok': 3936, 'nb_forced_upload': 0, 'end_of_day_photos_pink': 10, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3925, 'ratio_coverage': 0.13883842748549358}, 'dashboard_dict': {'nb_ptf_finished': 34, 'nb_images_finished': 568, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 49, 'nb_images_started': 940, 'nb_selected_images': 1508, 'last_update': '2022/08/24', 'portfolio_id': 6632462, 'last_run_id': 454424, 'total_number_of_photos': 3926}} No error ? {'log_dict': {'total_nb_images': 3939, 'max_time_between_images': '0 days 85 seconds', 'coverage_pause': '0 days 7878 seconds', 'coverage_times_pause': '0 days 15756 seconds', 'nb_photos_decision': 3939, 'nb_gray_level_ok': 3938, 'nb_dedup_ok': 3939, 'nb_two_criteria_ok': 3938, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1, 'end_of_day_photos_pink': 11, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3926, 'ratio_coverage': 0.1389442494576624}, 'dashboard_dict': {'nb_ptf_finished': 66, 'nb_images_finished': 1181, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 10, 'nb_images_started': 258, 'nb_selected_images': 1439, 'last_update': '2022/08/17', 'portfolio_id': 6630409, 'last_run_id': 454399, 'total_number_of_photos': 3928}} No error ? {'log_dict': {'total_nb_images': 3941, 'max_time_between_images': '0 days 88 seconds', 'coverage_pause': '0 days 7882 seconds', 'coverage_times_pause': '0 days 15764 seconds', 'nb_photos_decision': 3941, 'nb_gray_level_ok': 3940, 'nb_dedup_ok': 3941, 'nb_two_criteria_ok': 3940, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1, 'end_of_day_photos_pink': 9, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3930, 'ratio_coverage': 0.13901479743910827}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 40, 'nb_images_started': 797, 'nb_selected_images': 797, 'last_update': '2022/08/24', 'portfolio_id': 6629944, 'last_run_id': 454411, 'total_number_of_photos': 3979}} No error ? {'log_dict': {'total_nb_images': 3942, 'max_time_between_images': '0 days 83 seconds', 'coverage_pause': '0 days 7884 seconds', 'coverage_times_pause': '0 days 15768 seconds', 'nb_photos_decision': 3942, 'nb_gray_level_ok': 3942, 'nb_dedup_ok': 3942, 'nb_two_criteria_ok': 3942, 'nb_forced_upload': 0, 'end_of_day_photos_pink': 6, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3935, 'ratio_coverage': 0.13905007142983122}, 'dashboard_dict': {'nb_ptf_finished': 23, 'nb_images_finished': 521, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 32, 'nb_images_started': 658, 'nb_selected_images': 1179, 'last_update': '2022/08/28', 'portfolio_id': 6625129, 'last_run_id': 454388, 'total_number_of_photos': 3940}} No error ? {'log_dict': {'total_nb_images': 3911, 'max_time_between_images': '0 days 87 seconds', 'coverage_pause': '0 days 7822 seconds', 'coverage_times_pause': '0 days 15644 seconds', 'nb_photos_decision': 3911, 'nb_gray_level_ok': 3910, 'nb_dedup_ok': 3911, 'nb_two_criteria_ok': 3910, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 5, 'end_of_day_photos_pink': 9, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3896, 'ratio_coverage': 0.13795657771742006}, 'dashboard_dict': {'nb_ptf_finished': 77, 'nb_images_finished': 1405, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 9, 'nb_images_started': 271, 'nb_selected_images': 1676, 'last_update': '2022/08/11', 'portfolio_id': 6612466, 'last_run_id': 454376, 'total_number_of_photos': 3920}} No error ? {'log_dict': {'total_nb_images': 3914, 'max_time_between_images': '0 days 89 seconds', 'coverage_pause': '0 days 7828 seconds', 'coverage_times_pause': '0 days 15656 seconds', 'nb_photos_decision': 3914, 'nb_gray_level_ok': 3912, 'nb_dedup_ok': 3913, 'nb_two_criteria_ok': 3911, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 2, 'end_of_day_photos_pink': 11, 'end_of_day_photos_duplicated': 1, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3899, 'ratio_coverage': 0.1380623996895889}, 'dashboard_dict': {'nb_ptf_finished': 66, 'nb_images_finished': 1291, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 9, 'nb_images_started': 226, 'nb_selected_images': 1517, 'last_update': '2022/08/02', 'portfolio_id': 6600066, 'last_run_id': 449271, 'total_number_of_photos': 3919}} No error ? {'log_dict': {'total_nb_images': 2984, 'max_time_between_images': '0 days 1044 seconds', 'coverage_pause': '0 days 3936 seconds', 'coverage_times_pause': '0 days 6834 seconds', 'nb_photos_decision': 11774, 'nb_gray_level_ok': 4617, 'nb_dedup_ok': 11773, 'nb_two_criteria_ok': 4616, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1498, 'end_of_day_photos_pink': 20, 'end_of_day_photos_dark': 5638, 'end_of_day_photos_duplicated': 1, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 181, 'end_of_day_photos_uploaded': 4415, 'ratio_coverage': 0.06941921374274679}, 'dashboard_dict': {'nb_ptf_finished': 19, 'nb_images_finished': 1263, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 10, 'nb_images_started': 564, 'nb_selected_images': 1827, 'last_update': '2022/09/04', 'portfolio_id': 6911337, 'last_run_id': 479886, 'total_number_of_photos': 4031}} No error ? {'log_dict': {'total_nb_images': 3320, 'max_time_between_images': '0 days 466 seconds', 'coverage_pause': '0 days 3320 seconds', 'coverage_times_pause': '0 days 6640 seconds', 'nb_photos_decision': 3929, 'nb_gray_level_ok': 911, 'nb_dedup_ok': 3929, 'nb_two_criteria_ok': 911, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1660, 'end_of_day_photos_pink': 2, 'end_of_day_photos_dark': 1357, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 909, 'ratio_coverage': 0.05855482460008113}, 'dashboard_dict': {'nb_ptf_finished': 28, 'nb_images_finished': 390, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 11, 'nb_images_started': 207, 'nb_selected_images': 597, 'last_update': '2022/09/03', 'portfolio_id': 6892921, 'last_run_id': 478927, 'total_number_of_photos': 909}} No error ? {'log_dict': {'total_nb_images': 4134, 'max_time_between_images': '0 days 315 seconds', 'coverage_pause': '0 days 4134 seconds', 'coverage_times_pause': '0 days 8268 seconds', 'nb_photos_decision': 3918, 'nb_gray_level_ok': 662, 'nb_dedup_ok': 3918, 'nb_two_criteria_ok': 662, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 2067, 'end_of_day_photos_dark': 1189, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 662, 'ratio_coverage': 0.07291133882431788}, 'dashboard_dict': {'nb_ptf_finished': 26, 'nb_images_finished': 389, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 4, 'nb_images_started': 74, 'nb_selected_images': 463, 'last_update': '2022/08/30', 'portfolio_id': 6880974, 'last_run_id': 477478, 'total_number_of_photos': 646}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 3626, 'max_time_between_images': '0 days 451 seconds', 'coverage_pause': '0 days 3626 seconds', 'coverage_times_pause': '0 days 7252 seconds', 'nb_photos_decision': 3921, 'nb_gray_level_ok': 1057, 'nb_dedup_ok': 3921, 'nb_two_criteria_ok': 1057, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1813, 'end_of_day_photos_pink': 1, 'end_of_day_photos_dark': 1050, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 1056, 'ratio_coverage': 0.06395174518069102}, 'dashboard_dict': {'nb_ptf_finished': 2, 'nb_images_finished': 28, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 28, 'last_update': '2022/08/27', 'portfolio_id': 6872937, 'last_run_id': 475306, 'total_number_of_photos': 1056}} No error ? {'log_dict': {'total_nb_images': 3668, 'max_time_between_images': '0 days 517 seconds', 'coverage_pause': '0 days 3668 seconds', 'coverage_times_pause': '0 days 7336 seconds', 'nb_photos_decision': 3920, 'nb_gray_level_ok': 1069, 'nb_dedup_ok': 3920, 'nb_two_criteria_ok': 1069, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1834, 'end_of_day_photos_pink': 2, 'end_of_day_photos_dark': 1016, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 1067, 'ratio_coverage': 0.06469249898587277}, 'dashboard_dict': {'nb_ptf_finished': 31, 'nb_images_finished': 537, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 8, 'nb_images_started': 163, 'nb_selected_images': 700, 'last_update': '2022/08/29', 'portfolio_id': 6865211, 'last_run_id': 474338, 'total_number_of_photos': 1067}} No error ? {'log_dict': {'total_nb_images': 3736, 'max_time_between_images': '0 days 436 seconds', 'coverage_pause': '0 days 3736 seconds', 'coverage_times_pause': '0 days 7472 seconds', 'nb_photos_decision': 3933, 'nb_gray_level_ok': 1059, 'nb_dedup_ok': 3933, 'nb_two_criteria_ok': 1059, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1868, 'end_of_day_photos_pink': 7, 'end_of_day_photos_dark': 1005, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 429, 'end_of_day_photos_uploaded': 623, 'ratio_coverage': 0.06589181467045274}, 'dashboard_dict': {'nb_ptf_finished': 16, 'nb_images_finished': 264, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 25, 'nb_images_started': 480, 'nb_selected_images': 744, 'last_update': '2022/08/29', 'portfolio_id': 6858102, 'last_run_id': 474755, 'total_number_of_photos': 1052}} No error ? {'log_dict': {'total_nb_images': 3798, 'max_time_between_images': '0 days 511 seconds', 'coverage_pause': '0 days 3798 seconds', 'coverage_times_pause': '0 days 7596 seconds', 'nb_photos_decision': 3925, 'nb_gray_level_ok': 1034, 'nb_dedup_ok': 3925, 'nb_two_criteria_ok': 1034, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1899, 'end_of_day_photos_pink': 1, 'end_of_day_photos_dark': 991, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 1033, 'ratio_coverage': 0.0669853083828639}, 'dashboard_dict': {'nb_ptf_finished': 35, 'nb_images_finished': 576, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 7, 'nb_images_started': 137, 'nb_selected_images': 713, 'last_update': '2022/08/25', 'portfolio_id': 6845170, 'last_run_id': 472189, 'total_number_of_photos': 1033}} No error ? {'log_dict': {'total_nb_images': 4136, 'max_time_between_images': '0 days 502 seconds', 'coverage_pause': '0 days 4116 seconds', 'coverage_times_pause': '0 days 8232 seconds', 'nb_photos_decision': 3924, 'nb_gray_level_ok': 905, 'nb_dedup_ok': 3924, 'nb_two_criteria_ok': 905, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 2058, 'end_of_day_photos_pink': 7, 'end_of_day_photos_dark': 960, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 898, 'ratio_coverage': 0.07259387290781143}, 'dashboard_dict': {'nb_ptf_finished': 32, 'nb_images_finished': 494, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 8, 'nb_images_started': 156, 'nb_selected_images': 650, 'last_update': '2022/08/26', 'portfolio_id': 6830485, 'last_run_id': 470781, 'total_number_of_photos': 898}} No error ? {'log_dict': {'total_nb_images': 2568, 'max_time_between_images': '0 days 449 seconds', 'coverage_pause': '0 days 2568 seconds', 'coverage_times_pause': '0 days 5136 seconds', 'nb_photos_decision': 3916, 'nb_gray_level_ok': 2076, 'nb_dedup_ok': 3916, 'nb_two_criteria_ok': 2076, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1284, 'end_of_day_photos_pink': 5, 'end_of_day_photos_dark': 556, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 2071, 'ratio_coverage': 0.045291804088255526}, 'dashboard_dict': {'nb_ptf_finished': 45, 'nb_images_finished': 714, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 8, 'nb_images_started': 216, 'nb_selected_images': 930, 'last_update': '2022/08/23', 'portfolio_id': 6811061, 'last_run_id': 469411, 'total_number_of_photos': 2075}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 6, 'max_time_between_images': '0 days 7064 seconds', 'coverage_pause': '0 days 6 seconds', 'coverage_times_pause': '0 days 12 seconds', 'nb_photos_decision': 3931, 'nb_gray_level_ok': 3928, 'nb_dedup_ok': 3931, 'nb_two_criteria_ok': 3928, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 7, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3923, 'ratio_coverage': 0.00010582197216882132}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'last_update': '2022/08/20', 'portfolio_id': 6800521, 'last_run_id': 465870, 'total_number_of_photos': 3931}} No error ? {'log_dict': {'total_nb_images': 8, 'max_time_between_images': '0 days 22258 seconds', 'coverage_pause': '0 days 8 seconds', 'coverage_times_pause': '0 days 16 seconds', 'nb_photos_decision': 3935, 'nb_gray_level_ok': 3931, 'nb_dedup_ok': 3935, 'nb_two_criteria_ok': 3931, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 4, 'end_of_day_photos_pink': 5, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3925, 'ratio_coverage': 0.00014109596289176176}, 'dashboard_dict': {'nb_ptf_finished': 55, 'nb_images_finished': 1095, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 9, 'nb_images_started': 225, 'nb_selected_images': 1320, 'last_update': '2022/08/21', 'portfolio_id': 6785173, 'last_run_id': 464885, 'total_number_of_photos': 3940}} No error ? {'log_dict': {'total_nb_images': 6, 'max_time_between_images': '0 days 13249 seconds', 'coverage_pause': '0 days 6 seconds', 'coverage_times_pause': '0 days 12 seconds', 'nb_photos_decision': 3940, 'nb_gray_level_ok': 3937, 'nb_dedup_ok': 3940, 'nb_two_criteria_ok': 3937, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 3, 'end_of_day_photos_pink': 6, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 893, 'end_of_day_photos_uploaded': 3037, 'ratio_coverage': 0.00010582197216882132}, 'dashboard_dict': {'nb_ptf_finished': 62, 'nb_images_finished': 1227, 'nb_ptf_finished_for_older': 1, 'nb_images_finished_for_older': 101, 'nb_ptf_started': 11, 'nb_images_started': 275, 'nb_selected_images': 1603, 'last_update': '2022/08/21', 'portfolio_id': 6771154, 'last_run_id': 463490, 'total_number_of_photos': 4063}} No error ? {'log_dict': {'total_nb_images': 10, 'max_time_between_images': '0 days 21811 seconds', 'coverage_pause': '0 days 10 seconds', 'coverage_times_pause': '0 days 20 seconds', 'nb_photos_decision': 3939, 'nb_gray_level_ok': 3934, 'nb_dedup_ok': 3939, 'nb_two_criteria_ok': 3934, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 5, 'end_of_day_photos_pink': 3, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3930, 'ratio_coverage': 0.0001763699536147022}, 'dashboard_dict': {'nb_ptf_finished': 54, 'nb_images_finished': 1122, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 18, 'nb_images_started': 344, 'nb_selected_images': 1466, 'last_update': '2022/08/22', 'portfolio_id': 6756941, 'last_run_id': 462392, 'total_number_of_photos': 3931}} No error ? {'log_dict': {'total_nb_images': 3946, 'max_time_between_images': '0 days 90 seconds', 'coverage_pause': '0 days 7892 seconds', 'coverage_times_pause': '0 days 15784 seconds', 'nb_photos_decision': 3946, 'nb_gray_level_ok': 3946, 'nb_dedup_ok': 3946, 'nb_two_criteria_ok': 3946, 'nb_forced_upload': 0, 'end_of_day_photos_pink': 4, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3941, 'ratio_coverage': 0.13919116739272297}, 'dashboard_dict': {'nb_ptf_finished': 69, 'nb_images_finished': 1402, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 13, 'nb_images_started': 331, 'nb_selected_images': 1733, 'last_update': '2022/08/22', 'portfolio_id': 6738801, 'last_run_id': 461074, 'total_number_of_photos': 3942}} No error ? {'log_dict': {'total_nb_images': 4, 'max_time_between_images': '0 days 1677 seconds', 'coverage_pause': '0 days 4 seconds', 'coverage_times_pause': '0 days 8 seconds', 'nb_photos_decision': 3936, 'nb_gray_level_ok': 3934, 'nb_dedup_ok': 3935, 'nb_two_criteria_ok': 3933, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 2, 'end_of_day_photos_pink': 6, 'end_of_day_photos_duplicated': 1, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 3526, 'end_of_day_photos_uploaded': 405, 'ratio_coverage': 7.054798144588088e-05}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 4, 'nb_images_started': 127, 'nb_selected_images': 127, 'last_update': '2022/08/22', 'portfolio_id': 6736624, 'last_run_id': 459828, 'total_number_of_photos': 3932}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 2, 'max_time_between_images': '0 days 2 seconds', 'coverage_pause': '0 days 2 seconds', 'coverage_times_pause': '0 days 4 seconds', 'nb_photos_decision': 3939, 'nb_gray_level_ok': 3938, 'nb_dedup_ok': 3938, 'nb_two_criteria_ok': 3937, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1, 'end_of_day_photos_pink': 10, 'end_of_day_photos_duplicated': 1, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3926, 'ratio_coverage': 3.527399072294044e-05}, 'dashboard_dict': {'nb_ptf_finished': 62, 'nb_images_finished': 1156, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 14, 'nb_images_started': 330, 'nb_selected_images': 1486, 'last_update': '2022/08/14', 'portfolio_id': 6714370, 'last_run_id': 457640, 'total_number_of_photos': 3926}} No error ? {'log_dict': {'total_nb_images': 4, 'max_time_between_images': '0 days 3519 seconds', 'coverage_pause': '0 days 4 seconds', 'coverage_times_pause': '0 days 8 seconds', 'nb_photos_decision': 2477, 'nb_gray_level_ok': 2475, 'nb_dedup_ok': 2477, 'nb_two_criteria_ok': 2475, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 2, 'end_of_day_photos_pink': 4, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 300, 'end_of_day_photos_uploaded': 2170, 'ratio_coverage': 7.054798144588088e-05}, 'dashboard_dict': {'nb_ptf_finished': 39, 'nb_images_finished': 747, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 7, 'nb_images_started': 169, 'nb_selected_images': 916, 'last_update': '2022/08/13', 'portfolio_id': 6703539, 'last_run_id': 456478, 'total_number_of_photos': 2475}} No error ? {'log_dict': {'total_nb_images': 8, 'max_time_between_images': '0 days 28998 seconds', 'coverage_pause': '0 days 8 seconds', 'coverage_times_pause': '0 days 16 seconds', 'nb_photos_decision': 3935, 'nb_gray_level_ok': 3931, 'nb_dedup_ok': 3934, 'nb_two_criteria_ok': 3930, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 4, 'end_of_day_photos_pink': 6, 'end_of_day_photos_duplicated': 1, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3923, 'ratio_coverage': 0.00014109596289176176}, 'dashboard_dict': {'nb_ptf_finished': 56, 'nb_images_finished': 1043, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 28, 'nb_images_started': 588, 'nb_selected_images': 1631, 'last_update': '2022/08/28', 'portfolio_id': 6680169, 'last_run_id': 455185, 'total_number_of_photos': 3940}} No error ? {'log_dict': {'total_nb_images': 2, 'max_time_between_images': '0 days 2 seconds', 'coverage_pause': '0 days 2 seconds', 'coverage_times_pause': '0 days 4 seconds', 'nb_photos_decision': 3940, 'nb_gray_level_ok': 3939, 'nb_dedup_ok': 3940, 'nb_two_criteria_ok': 3939, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 2, 'end_of_day_photos_pink': 7, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3931, 'ratio_coverage': 3.527399072294044e-05}, 'dashboard_dict': {'nb_ptf_finished': 56, 'nb_images_finished': 1036, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 9, 'nb_images_started': 227, 'nb_selected_images': 1263, 'last_update': '2022/08/29', 'portfolio_id': 6662197, 'last_run_id': 468274, 'total_number_of_photos': 3932}} No error ? {'log_dict': {'total_nb_images': 2, 'max_time_between_images': '0 days 2 seconds', 'coverage_pause': '0 days 2 seconds', 'coverage_times_pause': '0 days 4 seconds', 'nb_photos_decision': 3934, 'nb_gray_level_ok': 3933, 'nb_dedup_ok': 3933, 'nb_two_criteria_ok': 3932, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1, 'end_of_day_photos_pink': 6, 'end_of_day_photos_duplicated': 1, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3925, 'ratio_coverage': 3.527399072294044e-05}, 'dashboard_dict': {'nb_ptf_finished': 48, 'nb_images_finished': 929, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 22, 'nb_images_started': 429, 'nb_selected_images': 1358, 'last_update': '2022/08/21', 'portfolio_id': 6645254, 'last_run_id': 452689, 'total_number_of_photos': 3938}} No error ? {'log_dict': {'total_nb_images': 3933, 'max_time_between_images': '0 days 84 seconds', 'coverage_pause': '0 days 7866 seconds', 'coverage_times_pause': '0 days 15732 seconds', 'nb_photos_decision': 3932, 'nb_gray_level_ok': 3932, 'nb_dedup_ok': 3931, 'nb_two_criteria_ok': 3931, 'nb_forced_upload': 0, 'end_of_day_photos_pink': 11, 'end_of_day_photos_duplicated': 1, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3920, 'ratio_coverage': 0.13873260551332475}, 'dashboard_dict': {'nb_ptf_finished': 45, 'nb_images_finished': 803, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 28, 'nb_images_started': 730, 'nb_selected_images': 1533, 'last_update': '2022/09/05', 'portfolio_id': 6633492, 'last_run_id': 451519, 'total_number_of_photos': 3925}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 3936, 'max_time_between_images': '0 days 82 seconds', 'coverage_pause': '0 days 7872 seconds', 'coverage_times_pause': '0 days 15744 seconds', 'nb_photos_decision': 3936, 'nb_gray_level_ok': 3936, 'nb_dedup_ok': 3936, 'nb_two_criteria_ok': 3936, 'nb_forced_upload': 0, 'end_of_day_photos_pink': 10, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3925, 'ratio_coverage': 0.13883842748549358}, 'dashboard_dict': {'nb_ptf_finished': 34, 'nb_images_finished': 568, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 49, 'nb_images_started': 940, 'nb_selected_images': 1508, 'last_update': '2022/08/24', 'portfolio_id': 6632462, 'last_run_id': 454424, 'total_number_of_photos': 3926}} No error ? {'log_dict': {'total_nb_images': 2, 'max_time_between_images': '0 days 2 seconds', 'coverage_pause': '0 days 2 seconds', 'coverage_times_pause': '0 days 4 seconds', 'nb_photos_decision': 3939, 'nb_gray_level_ok': 3938, 'nb_dedup_ok': 3939, 'nb_two_criteria_ok': 3938, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1, 'end_of_day_photos_pink': 11, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3926, 'ratio_coverage': 3.527399072294044e-05}, 'dashboard_dict': {'nb_ptf_finished': 66, 'nb_images_finished': 1181, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 10, 'nb_images_started': 258, 'nb_selected_images': 1439, 'last_update': '2022/08/17', 'portfolio_id': 6630409, 'last_run_id': 454399, 'total_number_of_photos': 3928}} No error ? {'log_dict': {'total_nb_images': 2, 'max_time_between_images': '0 days 2 seconds', 'coverage_pause': '0 days 2 seconds', 'coverage_times_pause': '0 days 4 seconds', 'nb_photos_decision': 3941, 'nb_gray_level_ok': 3940, 'nb_dedup_ok': 3941, 'nb_two_criteria_ok': 3940, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1, 'end_of_day_photos_pink': 9, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3930, 'ratio_coverage': 3.527399072294044e-05}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 40, 'nb_images_started': 797, 'nb_selected_images': 797, 'last_update': '2022/08/24', 'portfolio_id': 6629944, 'last_run_id': 454411, 'total_number_of_photos': 3979}} No error ? {'log_dict': {'total_nb_images': 3942, 'max_time_between_images': '0 days 83 seconds', 'coverage_pause': '0 days 7884 seconds', 'coverage_times_pause': '0 days 15768 seconds', 'nb_photos_decision': 3942, 'nb_gray_level_ok': 3942, 'nb_dedup_ok': 3942, 'nb_two_criteria_ok': 3942, 'nb_forced_upload': 0, 'end_of_day_photos_pink': 6, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3935, 'ratio_coverage': 0.13905007142983122}, 'dashboard_dict': {'nb_ptf_finished': 23, 'nb_images_finished': 521, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 32, 'nb_images_started': 658, 'nb_selected_images': 1179, 'last_update': '2022/08/28', 'portfolio_id': 6625129, 'last_run_id': 454388, 'total_number_of_photos': 3940}} No error ? {'log_dict': {'total_nb_images': 2, 'max_time_between_images': '0 days 2 seconds', 'coverage_pause': '0 days 2 seconds', 'coverage_times_pause': '0 days 4 seconds', 'nb_photos_decision': 3911, 'nb_gray_level_ok': 3910, 'nb_dedup_ok': 3911, 'nb_two_criteria_ok': 3910, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 5, 'end_of_day_photos_pink': 9, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3896, 'ratio_coverage': 3.527399072294044e-05}, 'dashboard_dict': {'nb_ptf_finished': 77, 'nb_images_finished': 1405, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 9, 'nb_images_started': 271, 'nb_selected_images': 1676, 'last_update': '2022/08/11', 'portfolio_id': 6612466, 'last_run_id': 454376, 'total_number_of_photos': 3920}} No error ? {'log_dict': {'total_nb_images': 4, 'max_time_between_images': '0 days 24740 seconds', 'coverage_pause': '0 days 4 seconds', 'coverage_times_pause': '0 days 8 seconds', 'nb_photos_decision': 3914, 'nb_gray_level_ok': 3912, 'nb_dedup_ok': 3913, 'nb_two_criteria_ok': 3911, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 2, 'end_of_day_photos_pink': 11, 'end_of_day_photos_duplicated': 1, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3899, 'ratio_coverage': 7.054798144588088e-05}, 'dashboard_dict': {'nb_ptf_finished': 66, 'nb_images_finished': 1291, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 9, 'nb_images_started': 226, 'nb_selected_images': 1517, 'last_update': '2022/08/02', 'portfolio_id': 6600066, 'last_run_id': 449271, 'total_number_of_photos': 3919}} No error ? {'log_dict': {'total_nb_images': 11754, 'max_time_between_images': '0 days 6397 seconds', 'coverage_pause': '0 days 52510 seconds', 'coverage_times_pause': '0 days 52816 seconds', 'nb_photos_decision': 11774, 'nb_gray_level_ok': 11774, 'nb_dedup_ok': 11774, 'nb_two_criteria_ok': 11774, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1498, 'end_of_day_photos_pink': 20, 'end_of_day_photos_dark': 5638, 'end_of_day_photos_duplicated': 1, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 181, 'end_of_day_photos_uploaded': 4415, 'ratio_coverage': 0.9261186264308012}, 'dashboard_dict': {'nb_ptf_finished': 19, 'nb_images_finished': 1263, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 10, 'nb_images_started': 564, 'nb_selected_images': 1827, 'last_update': '2022/09/04', 'portfolio_id': 6911337, 'last_run_id': 479886, 'total_number_of_photos': 4031}} No error ? {'log_dict': {'total_nb_images': 3929, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 58927 seconds', 'coverage_times_pause': '0 days 59361 seconds', 'nb_photos_decision': 3929, 'nb_gray_level_ok': 3929, 'nb_dedup_ok': 3929, 'nb_two_criteria_ok': 3929, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1660, 'end_of_day_photos_pink': 2, 'end_of_day_photos_dark': 1357, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 909, 'ratio_coverage': 1.0}, 'dashboard_dict': {'nb_ptf_finished': 28, 'nb_images_finished': 390, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 11, 'nb_images_started': 207, 'nb_selected_images': 597, 'last_update': '2022/09/03', 'portfolio_id': 6892921, 'last_run_id': 478927, 'total_number_of_photos': 909}} No error ? {'log_dict': {'total_nb_images': 3919, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 58785 seconds', 'coverage_times_pause': '0 days 59249 seconds', 'nb_photos_decision': 3918, 'nb_gray_level_ok': 3918, 'nb_dedup_ok': 3918, 'nb_two_criteria_ok': 3918, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 2067, 'end_of_day_photos_dark': 1189, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 662, 'ratio_coverage': 1.0}, 'dashboard_dict': {'nb_ptf_finished': 26, 'nb_images_finished': 389, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 4, 'nb_images_started': 74, 'nb_selected_images': 463, 'last_update': '2022/08/30', 'portfolio_id': 6880974, 'last_run_id': 477478, 'total_number_of_photos': 646}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 3921, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 58815 seconds', 'coverage_times_pause': '0 days 59311 seconds', 'nb_photos_decision': 3921, 'nb_gray_level_ok': 3921, 'nb_dedup_ok': 3921, 'nb_two_criteria_ok': 3921, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1813, 'end_of_day_photos_pink': 1, 'end_of_day_photos_dark': 1050, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 1056, 'ratio_coverage': 1.0}, 'dashboard_dict': {'nb_ptf_finished': 2, 'nb_images_finished': 28, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 28, 'last_update': '2022/08/27', 'portfolio_id': 6872937, 'last_run_id': 475306, 'total_number_of_photos': 1056}} No error ? {'log_dict': {'total_nb_images': 3920, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 58800 seconds', 'coverage_times_pause': '0 days 59301 seconds', 'nb_photos_decision': 3920, 'nb_gray_level_ok': 3920, 'nb_dedup_ok': 3920, 'nb_two_criteria_ok': 3920, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1834, 'end_of_day_photos_pink': 2, 'end_of_day_photos_dark': 1016, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 1067, 'ratio_coverage': 1.0}, 'dashboard_dict': {'nb_ptf_finished': 31, 'nb_images_finished': 537, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 8, 'nb_images_started': 163, 'nb_selected_images': 700, 'last_update': '2022/08/29', 'portfolio_id': 6865211, 'last_run_id': 474338, 'total_number_of_photos': 1067}} No error ? {'log_dict': {'total_nb_images': 3933, 'max_time_between_images': '0 days 93 seconds', 'coverage_pause': '0 days 58993 seconds', 'coverage_times_pause': '0 days 59362 seconds', 'nb_photos_decision': 3933, 'nb_gray_level_ok': 3933, 'nb_dedup_ok': 3933, 'nb_two_criteria_ok': 3933, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1868, 'end_of_day_photos_pink': 7, 'end_of_day_photos_dark': 1005, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 429, 'end_of_day_photos_uploaded': 623, 'ratio_coverage': 1.0}, 'dashboard_dict': {'nb_ptf_finished': 16, 'nb_images_finished': 264, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 25, 'nb_images_started': 480, 'nb_selected_images': 744, 'last_update': '2022/08/29', 'portfolio_id': 6858102, 'last_run_id': 474755, 'total_number_of_photos': 1052}} No error ? {'log_dict': {'total_nb_images': 3925, 'max_time_between_images': '0 days 83 seconds', 'coverage_pause': '0 days 58875 seconds', 'coverage_times_pause': '0 days 59301 seconds', 'nb_photos_decision': 3925, 'nb_gray_level_ok': 3925, 'nb_dedup_ok': 3925, 'nb_two_criteria_ok': 3925, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1899, 'end_of_day_photos_pink': 1, 'end_of_day_photos_dark': 991, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 1033, 'ratio_coverage': 1.0}, 'dashboard_dict': {'nb_ptf_finished': 35, 'nb_images_finished': 576, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 7, 'nb_images_started': 137, 'nb_selected_images': 713, 'last_update': '2022/08/25', 'portfolio_id': 6845170, 'last_run_id': 472189, 'total_number_of_photos': 1033}} No error ? {'log_dict': {'total_nb_images': 3924, 'max_time_between_images': '0 days 85 seconds', 'coverage_pause': '0 days 58860 seconds', 'coverage_times_pause': '0 days 59362 seconds', 'nb_photos_decision': 3924, 'nb_gray_level_ok': 3924, 'nb_dedup_ok': 3924, 'nb_two_criteria_ok': 3924, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 2058, 'end_of_day_photos_pink': 7, 'end_of_day_photos_dark': 960, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 898, 'ratio_coverage': 1.0}, 'dashboard_dict': {'nb_ptf_finished': 32, 'nb_images_finished': 494, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 8, 'nb_images_started': 156, 'nb_selected_images': 650, 'last_update': '2022/08/26', 'portfolio_id': 6830485, 'last_run_id': 470781, 'total_number_of_photos': 898}} No error ? {'log_dict': {'total_nb_images': 3917, 'max_time_between_images': '0 days 83 seconds', 'coverage_pause': '0 days 58755 seconds', 'coverage_times_pause': '0 days 59354 seconds', 'nb_photos_decision': 3916, 'nb_gray_level_ok': 3916, 'nb_dedup_ok': 3916, 'nb_two_criteria_ok': 3916, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1284, 'end_of_day_photos_pink': 5, 'end_of_day_photos_dark': 556, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 2071, 'ratio_coverage': 1.0}, 'dashboard_dict': {'nb_ptf_finished': 45, 'nb_images_finished': 714, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 8, 'nb_images_started': 216, 'nb_selected_images': 930, 'last_update': '2022/08/23', 'portfolio_id': 6811061, 'last_run_id': 469411, 'total_number_of_photos': 2075}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 3931, 'max_time_between_images': '0 days 121 seconds', 'coverage_pause': '0 days 58965 seconds', 'coverage_times_pause': '0 days 59198 seconds', 'nb_photos_decision': 3931, 'nb_gray_level_ok': 3931, 'nb_dedup_ok': 3931, 'nb_two_criteria_ok': 3931, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 7, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3923, 'ratio_coverage': 1.0}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'last_update': '2022/08/20', 'portfolio_id': 6800521, 'last_run_id': 465870, 'total_number_of_photos': 3931}} No error ? {'log_dict': {'total_nb_images': 3935, 'max_time_between_images': '0 days 79 seconds', 'coverage_pause': '0 days 59025 seconds', 'coverage_times_pause': '0 days 59367 seconds', 'nb_photos_decision': 3935, 'nb_gray_level_ok': 3935, 'nb_dedup_ok': 3935, 'nb_two_criteria_ok': 3935, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 4, 'end_of_day_photos_pink': 5, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3925, 'ratio_coverage': 1.0}, 'dashboard_dict': {'nb_ptf_finished': 55, 'nb_images_finished': 1095, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 9, 'nb_images_started': 225, 'nb_selected_images': 1320, 'last_update': '2022/08/21', 'portfolio_id': 6785173, 'last_run_id': 464885, 'total_number_of_photos': 3940}} No error ? {'log_dict': {'total_nb_images': 3940, 'max_time_between_images': '0 days 84 seconds', 'coverage_pause': '0 days 59100 seconds', 'coverage_times_pause': '0 days 59297 seconds', 'nb_photos_decision': 3940, 'nb_gray_level_ok': 3940, 'nb_dedup_ok': 3940, 'nb_two_criteria_ok': 3940, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 3, 'end_of_day_photos_pink': 6, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 893, 'end_of_day_photos_uploaded': 3037, 'ratio_coverage': 1.0}, 'dashboard_dict': {'nb_ptf_finished': 62, 'nb_images_finished': 1227, 'nb_ptf_finished_for_older': 1, 'nb_images_finished_for_older': 101, 'nb_ptf_started': 11, 'nb_images_started': 275, 'nb_selected_images': 1603, 'last_update': '2022/08/21', 'portfolio_id': 6771154, 'last_run_id': 463490, 'total_number_of_photos': 4063}} No error ? {'log_dict': {'total_nb_images': 3939, 'max_time_between_images': '0 days 85 seconds', 'coverage_pause': '0 days 59085 seconds', 'coverage_times_pause': '0 days 59309 seconds', 'nb_photos_decision': 3939, 'nb_gray_level_ok': 3939, 'nb_dedup_ok': 3939, 'nb_two_criteria_ok': 3939, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 5, 'end_of_day_photos_pink': 3, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3930, 'ratio_coverage': 1.0}, 'dashboard_dict': {'nb_ptf_finished': 54, 'nb_images_finished': 1122, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 18, 'nb_images_started': 344, 'nb_selected_images': 1466, 'last_update': '2022/08/22', 'portfolio_id': 6756941, 'last_run_id': 462392, 'total_number_of_photos': 3931}} No error ? {'log_dict': {'total_nb_images': 3946, 'max_time_between_images': '0 days 90 seconds', 'coverage_pause': '0 days 59186 seconds', 'coverage_times_pause': '0 days 59365 seconds', 'nb_photos_decision': 3946, 'nb_gray_level_ok': 3946, 'nb_dedup_ok': 3946, 'nb_two_criteria_ok': 3946, 'nb_forced_upload': 0, 'end_of_day_photos_pink': 4, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3941, 'ratio_coverage': 1.0}, 'dashboard_dict': {'nb_ptf_finished': 69, 'nb_images_finished': 1402, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 13, 'nb_images_started': 331, 'nb_selected_images': 1733, 'last_update': '2022/08/22', 'portfolio_id': 6738801, 'last_run_id': 461074, 'total_number_of_photos': 3942}} No error ? {'log_dict': {'total_nb_images': 3941, 'max_time_between_images': '0 days 86 seconds', 'coverage_pause': '0 days 59111 seconds', 'coverage_times_pause': '0 days 59355 seconds', 'nb_photos_decision': 3936, 'nb_gray_level_ok': 3936, 'nb_dedup_ok': 3936, 'nb_two_criteria_ok': 3936, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 2, 'end_of_day_photos_pink': 6, 'end_of_day_photos_duplicated': 1, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 3526, 'end_of_day_photos_uploaded': 405, 'ratio_coverage': 1.0}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 4, 'nb_images_started': 127, 'nb_selected_images': 127, 'last_update': '2022/08/22', 'portfolio_id': 6736624, 'last_run_id': 459828, 'total_number_of_photos': 3932}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 3939, 'max_time_between_images': '0 days 85 seconds', 'coverage_pause': '0 days 59085 seconds', 'coverage_times_pause': '0 days 59308 seconds', 'nb_photos_decision': 3939, 'nb_gray_level_ok': 3939, 'nb_dedup_ok': 3939, 'nb_two_criteria_ok': 3939, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1, 'end_of_day_photos_pink': 10, 'end_of_day_photos_duplicated': 1, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3926, 'ratio_coverage': 1.0}, 'dashboard_dict': {'nb_ptf_finished': 62, 'nb_images_finished': 1156, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 14, 'nb_images_started': 330, 'nb_selected_images': 1486, 'last_update': '2022/08/14', 'portfolio_id': 6714370, 'last_run_id': 457640, 'total_number_of_photos': 3926}} No error ? {'log_dict': {'total_nb_images': 2477, 'max_time_between_images': '0 days 89 seconds', 'coverage_pause': '0 days 37154 seconds', 'coverage_times_pause': '0 days 37372 seconds', 'nb_photos_decision': 2477, 'nb_gray_level_ok': 2477, 'nb_dedup_ok': 2477, 'nb_two_criteria_ok': 2477, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 2, 'end_of_day_photos_pink': 4, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 300, 'end_of_day_photos_uploaded': 2170, 'ratio_coverage': 0.6552849256600646}, 'dashboard_dict': {'nb_ptf_finished': 39, 'nb_images_finished': 747, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 7, 'nb_images_started': 169, 'nb_selected_images': 916, 'last_update': '2022/08/13', 'portfolio_id': 6703539, 'last_run_id': 456478, 'total_number_of_photos': 2475}} No error ? {'log_dict': {'total_nb_images': 3935, 'max_time_between_images': '0 days 86 seconds', 'coverage_pause': '0 days 59024 seconds', 'coverage_times_pause': '0 days 59304 seconds', 'nb_photos_decision': 3935, 'nb_gray_level_ok': 3935, 'nb_dedup_ok': 3935, 'nb_two_criteria_ok': 3935, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 4, 'end_of_day_photos_pink': 6, 'end_of_day_photos_duplicated': 1, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3923, 'ratio_coverage': 1.0}, 'dashboard_dict': {'nb_ptf_finished': 56, 'nb_images_finished': 1043, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 28, 'nb_images_started': 588, 'nb_selected_images': 1631, 'last_update': '2022/08/28', 'portfolio_id': 6680169, 'last_run_id': 455185, 'total_number_of_photos': 3940}} No error ? {'log_dict': {'total_nb_images': 3941, 'max_time_between_images': '0 days 79 seconds', 'coverage_pause': '0 days 59115 seconds', 'coverage_times_pause': '0 days 59374 seconds', 'nb_photos_decision': 3940, 'nb_gray_level_ok': 3940, 'nb_dedup_ok': 3940, 'nb_two_criteria_ok': 3940, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 2, 'end_of_day_photos_pink': 7, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3931, 'ratio_coverage': 1.0}, 'dashboard_dict': {'nb_ptf_finished': 56, 'nb_images_finished': 1036, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 9, 'nb_images_started': 227, 'nb_selected_images': 1263, 'last_update': '2022/08/29', 'portfolio_id': 6662197, 'last_run_id': 468274, 'total_number_of_photos': 3932}} No error ? {'log_dict': {'total_nb_images': 3934, 'max_time_between_images': '0 days 85 seconds', 'coverage_pause': '0 days 59010 seconds', 'coverage_times_pause': '0 days 59242 seconds', 'nb_photos_decision': 3934, 'nb_gray_level_ok': 3934, 'nb_dedup_ok': 3934, 'nb_two_criteria_ok': 3934, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1, 'end_of_day_photos_pink': 6, 'end_of_day_photos_duplicated': 1, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3925, 'ratio_coverage': 1.0}, 'dashboard_dict': {'nb_ptf_finished': 48, 'nb_images_finished': 929, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 22, 'nb_images_started': 429, 'nb_selected_images': 1358, 'last_update': '2022/08/21', 'portfolio_id': 6645254, 'last_run_id': 452689, 'total_number_of_photos': 3938}} No error ? {'log_dict': {'total_nb_images': 3933, 'max_time_between_images': '0 days 84 seconds', 'coverage_pause': '0 days 58993 seconds', 'coverage_times_pause': '0 days 59366 seconds', 'nb_photos_decision': 3932, 'nb_gray_level_ok': 3932, 'nb_dedup_ok': 3932, 'nb_two_criteria_ok': 3932, 'nb_forced_upload': 0, 'end_of_day_photos_pink': 11, 'end_of_day_photos_duplicated': 1, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3920, 'ratio_coverage': 1.0}, 'dashboard_dict': {'nb_ptf_finished': 45, 'nb_images_finished': 803, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 28, 'nb_images_started': 730, 'nb_selected_images': 1533, 'last_update': '2022/09/05', 'portfolio_id': 6633492, 'last_run_id': 451519, 'total_number_of_photos': 3925}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 3936, 'max_time_between_images': '0 days 82 seconds', 'coverage_pause': '0 days 59040 seconds', 'coverage_times_pause': '0 days 59363 seconds', 'nb_photos_decision': 3936, 'nb_gray_level_ok': 3936, 'nb_dedup_ok': 3936, 'nb_two_criteria_ok': 3936, 'nb_forced_upload': 0, 'end_of_day_photos_pink': 10, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3925, 'ratio_coverage': 1.0}, 'dashboard_dict': {'nb_ptf_finished': 34, 'nb_images_finished': 568, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 49, 'nb_images_started': 940, 'nb_selected_images': 1508, 'last_update': '2022/08/24', 'portfolio_id': 6632462, 'last_run_id': 454424, 'total_number_of_photos': 3926}} No error ? {'log_dict': {'total_nb_images': 3939, 'max_time_between_images': '0 days 85 seconds', 'coverage_pause': '0 days 59085 seconds', 'coverage_times_pause': '0 days 59369 seconds', 'nb_photos_decision': 3939, 'nb_gray_level_ok': 3939, 'nb_dedup_ok': 3939, 'nb_two_criteria_ok': 3939, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1, 'end_of_day_photos_pink': 11, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3926, 'ratio_coverage': 1.0}, 'dashboard_dict': {'nb_ptf_finished': 66, 'nb_images_finished': 1181, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 10, 'nb_images_started': 258, 'nb_selected_images': 1439, 'last_update': '2022/08/17', 'portfolio_id': 6630409, 'last_run_id': 454399, 'total_number_of_photos': 3928}} No error ? {'log_dict': {'total_nb_images': 3941, 'max_time_between_images': '0 days 88 seconds', 'coverage_pause': '0 days 59112 seconds', 'coverage_times_pause': '0 days 59367 seconds', 'nb_photos_decision': 3941, 'nb_gray_level_ok': 3941, 'nb_dedup_ok': 3941, 'nb_two_criteria_ok': 3941, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1, 'end_of_day_photos_pink': 9, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3930, 'ratio_coverage': 1.0}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 40, 'nb_images_started': 797, 'nb_selected_images': 797, 'last_update': '2022/08/24', 'portfolio_id': 6629944, 'last_run_id': 454411, 'total_number_of_photos': 3979}} No error ? {'log_dict': {'total_nb_images': 3942, 'max_time_between_images': '0 days 83 seconds', 'coverage_pause': '0 days 59130 seconds', 'coverage_times_pause': '0 days 59372 seconds', 'nb_photos_decision': 3942, 'nb_gray_level_ok': 3942, 'nb_dedup_ok': 3942, 'nb_two_criteria_ok': 3942, 'nb_forced_upload': 0, 'end_of_day_photos_pink': 6, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3935, 'ratio_coverage': 1.0}, 'dashboard_dict': {'nb_ptf_finished': 23, 'nb_images_finished': 521, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 32, 'nb_images_started': 658, 'nb_selected_images': 1179, 'last_update': '2022/08/28', 'portfolio_id': 6625129, 'last_run_id': 454388, 'total_number_of_photos': 3940}} No error ? {'log_dict': {'total_nb_images': 3911, 'max_time_between_images': '0 days 87 seconds', 'coverage_pause': '0 days 58663 seconds', 'coverage_times_pause': '0 days 59355 seconds', 'nb_photos_decision': 3911, 'nb_gray_level_ok': 3911, 'nb_dedup_ok': 3911, 'nb_two_criteria_ok': 3911, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 5, 'end_of_day_photos_pink': 9, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3896, 'ratio_coverage': 1.0}, 'dashboard_dict': {'nb_ptf_finished': 77, 'nb_images_finished': 1405, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 9, 'nb_images_started': 271, 'nb_selected_images': 1676, 'last_update': '2022/08/11', 'portfolio_id': 6612466, 'last_run_id': 454376, 'total_number_of_photos': 3920}} No error ? {'log_dict': {'total_nb_images': 3914, 'max_time_between_images': '0 days 89 seconds', 'coverage_pause': '0 days 58692 seconds', 'coverage_times_pause': '0 days 59285 seconds', 'nb_photos_decision': 3914, 'nb_gray_level_ok': 3914, 'nb_dedup_ok': 3914, 'nb_two_criteria_ok': 3914, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 2, 'end_of_day_photos_pink': 11, 'end_of_day_photos_duplicated': 1, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3899, 'ratio_coverage': 1.0}, 'dashboard_dict': {'nb_ptf_finished': 66, 'nb_images_finished': 1291, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 9, 'nb_images_started': 226, 'nb_selected_images': 1517, 'last_update': '2022/08/02', 'portfolio_id': 6600066, 'last_run_id': 449271, 'total_number_of_photos': 3919}} No error ? {'log_dict': {'total_nb_images': 11754, 'max_time_between_images': '0 days 6397 seconds', 'coverage_pause': '0 days 52510 seconds', 'coverage_times_pause': '0 days 52816 seconds', 'nb_photos_decision': 11774, 'nb_gray_level_ok': 11774, 'nb_dedup_ok': 11774, 'nb_two_criteria_ok': 11774, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1498, 'end_of_day_photos_pink': 20, 'end_of_day_photos_dark': 5638, 'end_of_day_photos_duplicated': 1, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 181, 'end_of_day_photos_uploaded': 4415, 'ratio_coverage': 0.9261186264308012}, 'dashboard_dict': {'nb_ptf_finished': 19, 'nb_images_finished': 1263, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 10, 'nb_images_started': 564, 'nb_selected_images': 1827, 'last_update': '2022/09/04', 'portfolio_id': 6911337, 'last_run_id': 479886, 'total_number_of_photos': 4031}} No error ? {'log_dict': {'total_nb_images': 3929, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 58927 seconds', 'coverage_times_pause': '0 days 59361 seconds', 'nb_photos_decision': 3929, 'nb_gray_level_ok': 3929, 'nb_dedup_ok': 3929, 'nb_two_criteria_ok': 3929, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1660, 'end_of_day_photos_pink': 2, 'end_of_day_photos_dark': 1357, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 909, 'ratio_coverage': 1.0}, 'dashboard_dict': {'nb_ptf_finished': 28, 'nb_images_finished': 390, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 11, 'nb_images_started': 207, 'nb_selected_images': 597, 'last_update': '2022/09/03', 'portfolio_id': 6892921, 'last_run_id': 478927, 'total_number_of_photos': 909}} No error ? {'log_dict': {'total_nb_images': 3919, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 58785 seconds', 'coverage_times_pause': '0 days 59249 seconds', 'nb_photos_decision': 3918, 'nb_gray_level_ok': 3918, 'nb_dedup_ok': 3918, 'nb_two_criteria_ok': 3918, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 2067, 'end_of_day_photos_dark': 1189, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 662, 'ratio_coverage': 1.0}, 'dashboard_dict': {'nb_ptf_finished': 26, 'nb_images_finished': 389, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 4, 'nb_images_started': 74, 'nb_selected_images': 463, 'last_update': '2022/08/30', 'portfolio_id': 6880974, 'last_run_id': 477478, 'total_number_of_photos': 646}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 3921, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 58815 seconds', 'coverage_times_pause': '0 days 59311 seconds', 'nb_photos_decision': 3921, 'nb_gray_level_ok': 3921, 'nb_dedup_ok': 3921, 'nb_two_criteria_ok': 3921, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1813, 'end_of_day_photos_pink': 1, 'end_of_day_photos_dark': 1050, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 1056, 'ratio_coverage': 1.0}, 'dashboard_dict': {'nb_ptf_finished': 2, 'nb_images_finished': 28, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 28, 'last_update': '2022/08/27', 'portfolio_id': 6872937, 'last_run_id': 475306, 'total_number_of_photos': 1056}} No error ? {'log_dict': {'total_nb_images': 3920, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 58800 seconds', 'coverage_times_pause': '0 days 59301 seconds', 'nb_photos_decision': 3920, 'nb_gray_level_ok': 3920, 'nb_dedup_ok': 3920, 'nb_two_criteria_ok': 3920, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1834, 'end_of_day_photos_pink': 2, 'end_of_day_photos_dark': 1016, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 1067, 'ratio_coverage': 1.0}, 'dashboard_dict': {'nb_ptf_finished': 31, 'nb_images_finished': 537, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 8, 'nb_images_started': 163, 'nb_selected_images': 700, 'last_update': '2022/08/29', 'portfolio_id': 6865211, 'last_run_id': 474338, 'total_number_of_photos': 1067}} No error ? {'log_dict': {'total_nb_images': 3933, 'max_time_between_images': '0 days 93 seconds', 'coverage_pause': '0 days 58993 seconds', 'coverage_times_pause': '0 days 59362 seconds', 'nb_photos_decision': 3933, 'nb_gray_level_ok': 3933, 'nb_dedup_ok': 3933, 'nb_two_criteria_ok': 3933, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1868, 'end_of_day_photos_pink': 7, 'end_of_day_photos_dark': 1005, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 429, 'end_of_day_photos_uploaded': 623, 'ratio_coverage': 1.0}, 'dashboard_dict': {'nb_ptf_finished': 16, 'nb_images_finished': 264, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 25, 'nb_images_started': 480, 'nb_selected_images': 744, 'last_update': '2022/08/29', 'portfolio_id': 6858102, 'last_run_id': 474755, 'total_number_of_photos': 1052}} No error ? {'log_dict': {'total_nb_images': 3925, 'max_time_between_images': '0 days 83 seconds', 'coverage_pause': '0 days 58875 seconds', 'coverage_times_pause': '0 days 59301 seconds', 'nb_photos_decision': 3925, 'nb_gray_level_ok': 3925, 'nb_dedup_ok': 3925, 'nb_two_criteria_ok': 3925, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1899, 'end_of_day_photos_pink': 1, 'end_of_day_photos_dark': 991, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 1033, 'ratio_coverage': 1.0}, 'dashboard_dict': {'nb_ptf_finished': 35, 'nb_images_finished': 576, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 7, 'nb_images_started': 137, 'nb_selected_images': 713, 'last_update': '2022/08/25', 'portfolio_id': 6845170, 'last_run_id': 472189, 'total_number_of_photos': 1033}} No error ? {'log_dict': {'total_nb_images': 3924, 'max_time_between_images': '0 days 85 seconds', 'coverage_pause': '0 days 58860 seconds', 'coverage_times_pause': '0 days 59362 seconds', 'nb_photos_decision': 3924, 'nb_gray_level_ok': 3924, 'nb_dedup_ok': 3924, 'nb_two_criteria_ok': 3924, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 2058, 'end_of_day_photos_pink': 7, 'end_of_day_photos_dark': 960, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 898, 'ratio_coverage': 1.0}, 'dashboard_dict': {'nb_ptf_finished': 32, 'nb_images_finished': 494, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 8, 'nb_images_started': 156, 'nb_selected_images': 650, 'last_update': '2022/08/26', 'portfolio_id': 6830485, 'last_run_id': 470781, 'total_number_of_photos': 898}} No error ? {'log_dict': {'total_nb_images': 3917, 'max_time_between_images': '0 days 83 seconds', 'coverage_pause': '0 days 58755 seconds', 'coverage_times_pause': '0 days 59354 seconds', 'nb_photos_decision': 3916, 'nb_gray_level_ok': 3916, 'nb_dedup_ok': 3916, 'nb_two_criteria_ok': 3916, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1284, 'end_of_day_photos_pink': 5, 'end_of_day_photos_dark': 556, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 2071, 'ratio_coverage': 1.0}, 'dashboard_dict': {'nb_ptf_finished': 45, 'nb_images_finished': 714, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 8, 'nb_images_started': 216, 'nb_selected_images': 930, 'last_update': '2022/08/23', 'portfolio_id': 6811061, 'last_run_id': 469411, 'total_number_of_photos': 2075}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 3931, 'max_time_between_images': '0 days 121 seconds', 'coverage_pause': '0 days 58965 seconds', 'coverage_times_pause': '0 days 59198 seconds', 'nb_photos_decision': 3931, 'nb_gray_level_ok': 3931, 'nb_dedup_ok': 3931, 'nb_two_criteria_ok': 3931, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 7, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3923, 'ratio_coverage': 1.0}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'last_update': '2022/08/20', 'portfolio_id': 6800521, 'last_run_id': 465870, 'total_number_of_photos': 3931}} No error ? {'log_dict': {'total_nb_images': 3935, 'max_time_between_images': '0 days 79 seconds', 'coverage_pause': '0 days 59025 seconds', 'coverage_times_pause': '0 days 59367 seconds', 'nb_photos_decision': 3935, 'nb_gray_level_ok': 3935, 'nb_dedup_ok': 3935, 'nb_two_criteria_ok': 3935, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 4, 'end_of_day_photos_pink': 5, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3925, 'ratio_coverage': 1.0}, 'dashboard_dict': {'nb_ptf_finished': 55, 'nb_images_finished': 1095, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 9, 'nb_images_started': 225, 'nb_selected_images': 1320, 'last_update': '2022/08/21', 'portfolio_id': 6785173, 'last_run_id': 464885, 'total_number_of_photos': 3940}} No error ? {'log_dict': {'total_nb_images': 3940, 'max_time_between_images': '0 days 84 seconds', 'coverage_pause': '0 days 59100 seconds', 'coverage_times_pause': '0 days 59297 seconds', 'nb_photos_decision': 3940, 'nb_gray_level_ok': 3940, 'nb_dedup_ok': 3940, 'nb_two_criteria_ok': 3940, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 3, 'end_of_day_photos_pink': 6, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 893, 'end_of_day_photos_uploaded': 3037, 'ratio_coverage': 1.0}, 'dashboard_dict': {'nb_ptf_finished': 62, 'nb_images_finished': 1227, 'nb_ptf_finished_for_older': 1, 'nb_images_finished_for_older': 101, 'nb_ptf_started': 11, 'nb_images_started': 275, 'nb_selected_images': 1603, 'last_update': '2022/08/21', 'portfolio_id': 6771154, 'last_run_id': 463490, 'total_number_of_photos': 4063}} No error ? {'log_dict': {'total_nb_images': 3939, 'max_time_between_images': '0 days 85 seconds', 'coverage_pause': '0 days 59085 seconds', 'coverage_times_pause': '0 days 59309 seconds', 'nb_photos_decision': 3939, 'nb_gray_level_ok': 3939, 'nb_dedup_ok': 3939, 'nb_two_criteria_ok': 3939, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 5, 'end_of_day_photos_pink': 3, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3930, 'ratio_coverage': 1.0}, 'dashboard_dict': {'nb_ptf_finished': 54, 'nb_images_finished': 1122, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 18, 'nb_images_started': 344, 'nb_selected_images': 1466, 'last_update': '2022/08/22', 'portfolio_id': 6756941, 'last_run_id': 462392, 'total_number_of_photos': 3931}} No error ? {'log_dict': {'total_nb_images': 3946, 'max_time_between_images': '0 days 90 seconds', 'coverage_pause': '0 days 59186 seconds', 'coverage_times_pause': '0 days 59365 seconds', 'nb_photos_decision': 3946, 'nb_gray_level_ok': 3946, 'nb_dedup_ok': 3946, 'nb_two_criteria_ok': 3946, 'nb_forced_upload': 0, 'end_of_day_photos_pink': 4, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3941, 'ratio_coverage': 1.0}, 'dashboard_dict': {'nb_ptf_finished': 69, 'nb_images_finished': 1402, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 13, 'nb_images_started': 331, 'nb_selected_images': 1733, 'last_update': '2022/08/22', 'portfolio_id': 6738801, 'last_run_id': 461074, 'total_number_of_photos': 3942}} No error ? {'log_dict': {'total_nb_images': 3941, 'max_time_between_images': '0 days 86 seconds', 'coverage_pause': '0 days 59111 seconds', 'coverage_times_pause': '0 days 59355 seconds', 'nb_photos_decision': 3936, 'nb_gray_level_ok': 3936, 'nb_dedup_ok': 3936, 'nb_two_criteria_ok': 3936, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 2, 'end_of_day_photos_pink': 6, 'end_of_day_photos_duplicated': 1, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 3526, 'end_of_day_photos_uploaded': 405, 'ratio_coverage': 1.0}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 4, 'nb_images_started': 127, 'nb_selected_images': 127, 'last_update': '2022/08/22', 'portfolio_id': 6736624, 'last_run_id': 459828, 'total_number_of_photos': 3932}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 3939, 'max_time_between_images': '0 days 85 seconds', 'coverage_pause': '0 days 59085 seconds', 'coverage_times_pause': '0 days 59308 seconds', 'nb_photos_decision': 3939, 'nb_gray_level_ok': 3939, 'nb_dedup_ok': 3939, 'nb_two_criteria_ok': 3939, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1, 'end_of_day_photos_pink': 10, 'end_of_day_photos_duplicated': 1, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3926, 'ratio_coverage': 1.0}, 'dashboard_dict': {'nb_ptf_finished': 62, 'nb_images_finished': 1156, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 14, 'nb_images_started': 330, 'nb_selected_images': 1486, 'last_update': '2022/08/14', 'portfolio_id': 6714370, 'last_run_id': 457640, 'total_number_of_photos': 3926}} No error ? {'log_dict': {'total_nb_images': 2477, 'max_time_between_images': '0 days 89 seconds', 'coverage_pause': '0 days 37154 seconds', 'coverage_times_pause': '0 days 37372 seconds', 'nb_photos_decision': 2477, 'nb_gray_level_ok': 2477, 'nb_dedup_ok': 2477, 'nb_two_criteria_ok': 2477, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 2, 'end_of_day_photos_pink': 4, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 300, 'end_of_day_photos_uploaded': 2170, 'ratio_coverage': 0.6552849256600646}, 'dashboard_dict': {'nb_ptf_finished': 39, 'nb_images_finished': 747, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 7, 'nb_images_started': 169, 'nb_selected_images': 916, 'last_update': '2022/08/13', 'portfolio_id': 6703539, 'last_run_id': 456478, 'total_number_of_photos': 2475}} No error ? {'log_dict': {'total_nb_images': 3935, 'max_time_between_images': '0 days 86 seconds', 'coverage_pause': '0 days 59024 seconds', 'coverage_times_pause': '0 days 59304 seconds', 'nb_photos_decision': 3935, 'nb_gray_level_ok': 3935, 'nb_dedup_ok': 3935, 'nb_two_criteria_ok': 3935, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 4, 'end_of_day_photos_pink': 6, 'end_of_day_photos_duplicated': 1, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3923, 'ratio_coverage': 1.0}, 'dashboard_dict': {'nb_ptf_finished': 56, 'nb_images_finished': 1043, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 28, 'nb_images_started': 588, 'nb_selected_images': 1631, 'last_update': '2022/08/28', 'portfolio_id': 6680169, 'last_run_id': 455185, 'total_number_of_photos': 3940}} No error ? {'log_dict': {'total_nb_images': 3941, 'max_time_between_images': '0 days 79 seconds', 'coverage_pause': '0 days 59115 seconds', 'coverage_times_pause': '0 days 59374 seconds', 'nb_photos_decision': 3940, 'nb_gray_level_ok': 3940, 'nb_dedup_ok': 3940, 'nb_two_criteria_ok': 3940, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 2, 'end_of_day_photos_pink': 7, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3931, 'ratio_coverage': 1.0}, 'dashboard_dict': {'nb_ptf_finished': 56, 'nb_images_finished': 1036, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 9, 'nb_images_started': 227, 'nb_selected_images': 1263, 'last_update': '2022/08/29', 'portfolio_id': 6662197, 'last_run_id': 468274, 'total_number_of_photos': 3932}} No error ? {'log_dict': {'total_nb_images': 3934, 'max_time_between_images': '0 days 85 seconds', 'coverage_pause': '0 days 59010 seconds', 'coverage_times_pause': '0 days 59242 seconds', 'nb_photos_decision': 3934, 'nb_gray_level_ok': 3934, 'nb_dedup_ok': 3934, 'nb_two_criteria_ok': 3934, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1, 'end_of_day_photos_pink': 6, 'end_of_day_photos_duplicated': 1, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3925, 'ratio_coverage': 1.0}, 'dashboard_dict': {'nb_ptf_finished': 48, 'nb_images_finished': 929, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 22, 'nb_images_started': 429, 'nb_selected_images': 1358, 'last_update': '2022/08/21', 'portfolio_id': 6645254, 'last_run_id': 452689, 'total_number_of_photos': 3938}} No error ? {'log_dict': {'total_nb_images': 3933, 'max_time_between_images': '0 days 84 seconds', 'coverage_pause': '0 days 58993 seconds', 'coverage_times_pause': '0 days 59366 seconds', 'nb_photos_decision': 3932, 'nb_gray_level_ok': 3932, 'nb_dedup_ok': 3932, 'nb_two_criteria_ok': 3932, 'nb_forced_upload': 0, 'end_of_day_photos_pink': 11, 'end_of_day_photos_duplicated': 1, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3920, 'ratio_coverage': 1.0}, 'dashboard_dict': {'nb_ptf_finished': 45, 'nb_images_finished': 803, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 28, 'nb_images_started': 730, 'nb_selected_images': 1533, 'last_update': '2022/09/05', 'portfolio_id': 6633492, 'last_run_id': 451519, 'total_number_of_photos': 3925}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 3936, 'max_time_between_images': '0 days 82 seconds', 'coverage_pause': '0 days 59040 seconds', 'coverage_times_pause': '0 days 59363 seconds', 'nb_photos_decision': 3936, 'nb_gray_level_ok': 3936, 'nb_dedup_ok': 3936, 'nb_two_criteria_ok': 3936, 'nb_forced_upload': 0, 'end_of_day_photos_pink': 10, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3925, 'ratio_coverage': 1.0}, 'dashboard_dict': {'nb_ptf_finished': 34, 'nb_images_finished': 568, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 49, 'nb_images_started': 940, 'nb_selected_images': 1508, 'last_update': '2022/08/24', 'portfolio_id': 6632462, 'last_run_id': 454424, 'total_number_of_photos': 3926}} No error ? {'log_dict': {'total_nb_images': 3939, 'max_time_between_images': '0 days 85 seconds', 'coverage_pause': '0 days 59085 seconds', 'coverage_times_pause': '0 days 59369 seconds', 'nb_photos_decision': 3939, 'nb_gray_level_ok': 3939, 'nb_dedup_ok': 3939, 'nb_two_criteria_ok': 3939, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1, 'end_of_day_photos_pink': 11, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3926, 'ratio_coverage': 1.0}, 'dashboard_dict': {'nb_ptf_finished': 66, 'nb_images_finished': 1181, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 10, 'nb_images_started': 258, 'nb_selected_images': 1439, 'last_update': '2022/08/17', 'portfolio_id': 6630409, 'last_run_id': 454399, 'total_number_of_photos': 3928}} No error ? {'log_dict': {'total_nb_images': 3941, 'max_time_between_images': '0 days 88 seconds', 'coverage_pause': '0 days 59112 seconds', 'coverage_times_pause': '0 days 59367 seconds', 'nb_photos_decision': 3941, 'nb_gray_level_ok': 3941, 'nb_dedup_ok': 3941, 'nb_two_criteria_ok': 3941, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1, 'end_of_day_photos_pink': 9, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3930, 'ratio_coverage': 1.0}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 40, 'nb_images_started': 797, 'nb_selected_images': 797, 'last_update': '2022/08/24', 'portfolio_id': 6629944, 'last_run_id': 454411, 'total_number_of_photos': 3979}} No error ? {'log_dict': {'total_nb_images': 3942, 'max_time_between_images': '0 days 83 seconds', 'coverage_pause': '0 days 59130 seconds', 'coverage_times_pause': '0 days 59372 seconds', 'nb_photos_decision': 3942, 'nb_gray_level_ok': 3942, 'nb_dedup_ok': 3942, 'nb_two_criteria_ok': 3942, 'nb_forced_upload': 0, 'end_of_day_photos_pink': 6, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3935, 'ratio_coverage': 1.0}, 'dashboard_dict': {'nb_ptf_finished': 23, 'nb_images_finished': 521, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 32, 'nb_images_started': 658, 'nb_selected_images': 1179, 'last_update': '2022/08/28', 'portfolio_id': 6625129, 'last_run_id': 454388, 'total_number_of_photos': 3940}} No error ? {'log_dict': {'total_nb_images': 3911, 'max_time_between_images': '0 days 87 seconds', 'coverage_pause': '0 days 58663 seconds', 'coverage_times_pause': '0 days 59355 seconds', 'nb_photos_decision': 3911, 'nb_gray_level_ok': 3911, 'nb_dedup_ok': 3911, 'nb_two_criteria_ok': 3911, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 5, 'end_of_day_photos_pink': 9, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3896, 'ratio_coverage': 1.0}, 'dashboard_dict': {'nb_ptf_finished': 77, 'nb_images_finished': 1405, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 9, 'nb_images_started': 271, 'nb_selected_images': 1676, 'last_update': '2022/08/11', 'portfolio_id': 6612466, 'last_run_id': 454376, 'total_number_of_photos': 3920}} No error ? {'log_dict': {'total_nb_images': 3914, 'max_time_between_images': '0 days 89 seconds', 'coverage_pause': '0 days 58692 seconds', 'coverage_times_pause': '0 days 59285 seconds', 'nb_photos_decision': 3914, 'nb_gray_level_ok': 3914, 'nb_dedup_ok': 3914, 'nb_two_criteria_ok': 3914, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 2, 'end_of_day_photos_pink': 11, 'end_of_day_photos_duplicated': 1, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3899, 'ratio_coverage': 1.0}, 'dashboard_dict': {'nb_ptf_finished': 66, 'nb_images_finished': 1291, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 9, 'nb_images_started': 226, 'nb_selected_images': 1517, 'last_update': '2022/08/02', 'portfolio_id': 6600066, 'last_run_id': 449271, 'total_number_of_photos': 3919}} No error ? {'log_dict': {'total_nb_images': 11754, 'max_time_between_images': '0 days 6397 seconds', 'coverage_pause': '0 days 52510 seconds', 'coverage_times_pause': '0 days 52816 seconds', 'nb_photos_decision': 11774, 'nb_gray_level_ok': 11774, 'nb_dedup_ok': 11774, 'nb_two_criteria_ok': 11774, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1498, 'end_of_day_photos_pink': 20, 'end_of_day_photos_dark': 5638, 'end_of_day_photos_duplicated': 1, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 181, 'end_of_day_photos_uploaded': 4415, 'ratio_coverage': 0.9261186264308012}, 'dashboard_dict': {'nb_ptf_finished': 19, 'nb_images_finished': 1263, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 10, 'nb_images_started': 564, 'nb_selected_images': 1827, 'last_update': '2022/09/04', 'portfolio_id': 6911337, 'last_run_id': 479886, 'total_number_of_photos': 4031}} No error ? {'log_dict': {'total_nb_images': 3929, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 58927 seconds', 'coverage_times_pause': '0 days 59361 seconds', 'nb_photos_decision': 3929, 'nb_gray_level_ok': 3929, 'nb_dedup_ok': 3929, 'nb_two_criteria_ok': 3929, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1660, 'end_of_day_photos_pink': 2, 'end_of_day_photos_dark': 1357, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 909, 'ratio_coverage': 1.0}, 'dashboard_dict': {'nb_ptf_finished': 28, 'nb_images_finished': 390, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 11, 'nb_images_started': 207, 'nb_selected_images': 597, 'last_update': '2022/09/03', 'portfolio_id': 6892921, 'last_run_id': 478927, 'total_number_of_photos': 909}} No error ? {'log_dict': {'total_nb_images': 3919, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 58785 seconds', 'coverage_times_pause': '0 days 59249 seconds', 'nb_photos_decision': 3918, 'nb_gray_level_ok': 3918, 'nb_dedup_ok': 3918, 'nb_two_criteria_ok': 3918, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 2067, 'end_of_day_photos_dark': 1189, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 662, 'ratio_coverage': 1.0}, 'dashboard_dict': {'nb_ptf_finished': 26, 'nb_images_finished': 389, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 4, 'nb_images_started': 74, 'nb_selected_images': 463, 'last_update': '2022/08/30', 'portfolio_id': 6880974, 'last_run_id': 477478, 'total_number_of_photos': 646}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 3921, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 58815 seconds', 'coverage_times_pause': '0 days 59311 seconds', 'nb_photos_decision': 3921, 'nb_gray_level_ok': 3921, 'nb_dedup_ok': 3921, 'nb_two_criteria_ok': 3921, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1813, 'end_of_day_photos_pink': 1, 'end_of_day_photos_dark': 1050, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 1056, 'ratio_coverage': 1.0}, 'dashboard_dict': {'nb_ptf_finished': 2, 'nb_images_finished': 28, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 28, 'last_update': '2022/08/27', 'portfolio_id': 6872937, 'last_run_id': 475306, 'total_number_of_photos': 1056}} No error ? {'log_dict': {'total_nb_images': 3920, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 58800 seconds', 'coverage_times_pause': '0 days 59301 seconds', 'nb_photos_decision': 3920, 'nb_gray_level_ok': 3920, 'nb_dedup_ok': 3920, 'nb_two_criteria_ok': 3920, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1834, 'end_of_day_photos_pink': 2, 'end_of_day_photos_dark': 1016, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 1067, 'ratio_coverage': 1.0}, 'dashboard_dict': {'nb_ptf_finished': 31, 'nb_images_finished': 537, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 8, 'nb_images_started': 163, 'nb_selected_images': 700, 'last_update': '2022/08/29', 'portfolio_id': 6865211, 'last_run_id': 474338, 'total_number_of_photos': 1067}} No error ? {'log_dict': {'total_nb_images': 3933, 'max_time_between_images': '0 days 93 seconds', 'coverage_pause': '0 days 58993 seconds', 'coverage_times_pause': '0 days 59362 seconds', 'nb_photos_decision': 3933, 'nb_gray_level_ok': 3933, 'nb_dedup_ok': 3933, 'nb_two_criteria_ok': 3933, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1868, 'end_of_day_photos_pink': 7, 'end_of_day_photos_dark': 1005, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 429, 'end_of_day_photos_uploaded': 623, 'ratio_coverage': 1.0}, 'dashboard_dict': {'nb_ptf_finished': 16, 'nb_images_finished': 264, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 25, 'nb_images_started': 480, 'nb_selected_images': 744, 'last_update': '2022/08/29', 'portfolio_id': 6858102, 'last_run_id': 474755, 'total_number_of_photos': 1052}} No error ? {'log_dict': {'total_nb_images': 3925, 'max_time_between_images': '0 days 83 seconds', 'coverage_pause': '0 days 58875 seconds', 'coverage_times_pause': '0 days 59301 seconds', 'nb_photos_decision': 3925, 'nb_gray_level_ok': 3925, 'nb_dedup_ok': 3925, 'nb_two_criteria_ok': 3925, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1899, 'end_of_day_photos_pink': 1, 'end_of_day_photos_dark': 991, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 1033, 'ratio_coverage': 1.0}, 'dashboard_dict': {'nb_ptf_finished': 35, 'nb_images_finished': 576, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 7, 'nb_images_started': 137, 'nb_selected_images': 713, 'last_update': '2022/08/25', 'portfolio_id': 6845170, 'last_run_id': 472189, 'total_number_of_photos': 1033}} No error ? {'log_dict': {'total_nb_images': 3924, 'max_time_between_images': '0 days 85 seconds', 'coverage_pause': '0 days 58860 seconds', 'coverage_times_pause': '0 days 59362 seconds', 'nb_photos_decision': 3924, 'nb_gray_level_ok': 3924, 'nb_dedup_ok': 3924, 'nb_two_criteria_ok': 3924, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 2058, 'end_of_day_photos_pink': 7, 'end_of_day_photos_dark': 960, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 898, 'ratio_coverage': 1.0}, 'dashboard_dict': {'nb_ptf_finished': 32, 'nb_images_finished': 494, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 8, 'nb_images_started': 156, 'nb_selected_images': 650, 'last_update': '2022/08/26', 'portfolio_id': 6830485, 'last_run_id': 470781, 'total_number_of_photos': 898}} No error ? {'log_dict': {'total_nb_images': 3917, 'max_time_between_images': '0 days 83 seconds', 'coverage_pause': '0 days 58755 seconds', 'coverage_times_pause': '0 days 59354 seconds', 'nb_photos_decision': 3916, 'nb_gray_level_ok': 3916, 'nb_dedup_ok': 3916, 'nb_two_criteria_ok': 3916, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1284, 'end_of_day_photos_pink': 5, 'end_of_day_photos_dark': 556, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 2071, 'ratio_coverage': 1.0}, 'dashboard_dict': {'nb_ptf_finished': 45, 'nb_images_finished': 714, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 8, 'nb_images_started': 216, 'nb_selected_images': 930, 'last_update': '2022/08/23', 'portfolio_id': 6811061, 'last_run_id': 469411, 'total_number_of_photos': 2075}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 3931, 'max_time_between_images': '0 days 121 seconds', 'coverage_pause': '0 days 58965 seconds', 'coverage_times_pause': '0 days 59198 seconds', 'nb_photos_decision': 3931, 'nb_gray_level_ok': 3931, 'nb_dedup_ok': 3931, 'nb_two_criteria_ok': 3931, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 7, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3923, 'ratio_coverage': 1.0}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'last_update': '2022/08/20', 'portfolio_id': 6800521, 'last_run_id': 465870, 'total_number_of_photos': 3931}} No error ? {'log_dict': {'total_nb_images': 3935, 'max_time_between_images': '0 days 79 seconds', 'coverage_pause': '0 days 59025 seconds', 'coverage_times_pause': '0 days 59367 seconds', 'nb_photos_decision': 3935, 'nb_gray_level_ok': 3935, 'nb_dedup_ok': 3935, 'nb_two_criteria_ok': 3935, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 4, 'end_of_day_photos_pink': 5, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3925, 'ratio_coverage': 1.0}, 'dashboard_dict': {'nb_ptf_finished': 55, 'nb_images_finished': 1095, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 9, 'nb_images_started': 225, 'nb_selected_images': 1320, 'last_update': '2022/08/21', 'portfolio_id': 6785173, 'last_run_id': 464885, 'total_number_of_photos': 3940}} No error ? {'log_dict': {'total_nb_images': 3940, 'max_time_between_images': '0 days 84 seconds', 'coverage_pause': '0 days 59100 seconds', 'coverage_times_pause': '0 days 59297 seconds', 'nb_photos_decision': 3940, 'nb_gray_level_ok': 3940, 'nb_dedup_ok': 3940, 'nb_two_criteria_ok': 3940, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 3, 'end_of_day_photos_pink': 6, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 893, 'end_of_day_photos_uploaded': 3037, 'ratio_coverage': 1.0}, 'dashboard_dict': {'nb_ptf_finished': 62, 'nb_images_finished': 1227, 'nb_ptf_finished_for_older': 1, 'nb_images_finished_for_older': 101, 'nb_ptf_started': 11, 'nb_images_started': 275, 'nb_selected_images': 1603, 'last_update': '2022/08/21', 'portfolio_id': 6771154, 'last_run_id': 463490, 'total_number_of_photos': 4063}} No error ? {'log_dict': {'total_nb_images': 3939, 'max_time_between_images': '0 days 85 seconds', 'coverage_pause': '0 days 59085 seconds', 'coverage_times_pause': '0 days 59309 seconds', 'nb_photos_decision': 3939, 'nb_gray_level_ok': 3939, 'nb_dedup_ok': 3939, 'nb_two_criteria_ok': 3939, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 5, 'end_of_day_photos_pink': 3, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3930, 'ratio_coverage': 1.0}, 'dashboard_dict': {'nb_ptf_finished': 54, 'nb_images_finished': 1122, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 18, 'nb_images_started': 344, 'nb_selected_images': 1466, 'last_update': '2022/08/22', 'portfolio_id': 6756941, 'last_run_id': 462392, 'total_number_of_photos': 3931}} No error ? {'log_dict': {'total_nb_images': 3946, 'max_time_between_images': '0 days 90 seconds', 'coverage_pause': '0 days 59186 seconds', 'coverage_times_pause': '0 days 59365 seconds', 'nb_photos_decision': 3946, 'nb_gray_level_ok': 3946, 'nb_dedup_ok': 3946, 'nb_two_criteria_ok': 3946, 'nb_forced_upload': 0, 'end_of_day_photos_pink': 4, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3941, 'ratio_coverage': 1.0}, 'dashboard_dict': {'nb_ptf_finished': 69, 'nb_images_finished': 1402, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 13, 'nb_images_started': 331, 'nb_selected_images': 1733, 'last_update': '2022/08/22', 'portfolio_id': 6738801, 'last_run_id': 461074, 'total_number_of_photos': 3942}} No error ? {'log_dict': {'total_nb_images': 3941, 'max_time_between_images': '0 days 86 seconds', 'coverage_pause': '0 days 59111 seconds', 'coverage_times_pause': '0 days 59355 seconds', 'nb_photos_decision': 3936, 'nb_gray_level_ok': 3936, 'nb_dedup_ok': 3936, 'nb_two_criteria_ok': 3936, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 2, 'end_of_day_photos_pink': 6, 'end_of_day_photos_duplicated': 1, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 3526, 'end_of_day_photos_uploaded': 405, 'ratio_coverage': 1.0}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 4, 'nb_images_started': 127, 'nb_selected_images': 127, 'last_update': '2022/08/22', 'portfolio_id': 6736624, 'last_run_id': 459828, 'total_number_of_photos': 3932}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 3939, 'max_time_between_images': '0 days 85 seconds', 'coverage_pause': '0 days 59085 seconds', 'coverage_times_pause': '0 days 59308 seconds', 'nb_photos_decision': 3939, 'nb_gray_level_ok': 3939, 'nb_dedup_ok': 3939, 'nb_two_criteria_ok': 3939, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1, 'end_of_day_photos_pink': 10, 'end_of_day_photos_duplicated': 1, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3926, 'ratio_coverage': 1.0}, 'dashboard_dict': {'nb_ptf_finished': 62, 'nb_images_finished': 1156, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 14, 'nb_images_started': 330, 'nb_selected_images': 1486, 'last_update': '2022/08/14', 'portfolio_id': 6714370, 'last_run_id': 457640, 'total_number_of_photos': 3926}} No error ? {'log_dict': {'total_nb_images': 2477, 'max_time_between_images': '0 days 89 seconds', 'coverage_pause': '0 days 37154 seconds', 'coverage_times_pause': '0 days 37372 seconds', 'nb_photos_decision': 2477, 'nb_gray_level_ok': 2477, 'nb_dedup_ok': 2477, 'nb_two_criteria_ok': 2477, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 2, 'end_of_day_photos_pink': 4, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 300, 'end_of_day_photos_uploaded': 2170, 'ratio_coverage': 0.6552849256600646}, 'dashboard_dict': {'nb_ptf_finished': 39, 'nb_images_finished': 747, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 7, 'nb_images_started': 169, 'nb_selected_images': 916, 'last_update': '2022/08/13', 'portfolio_id': 6703539, 'last_run_id': 456478, 'total_number_of_photos': 2475}} No error ? {'log_dict': {'total_nb_images': 3935, 'max_time_between_images': '0 days 86 seconds', 'coverage_pause': '0 days 59024 seconds', 'coverage_times_pause': '0 days 59304 seconds', 'nb_photos_decision': 3935, 'nb_gray_level_ok': 3935, 'nb_dedup_ok': 3935, 'nb_two_criteria_ok': 3935, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 4, 'end_of_day_photos_pink': 6, 'end_of_day_photos_duplicated': 1, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3923, 'ratio_coverage': 1.0}, 'dashboard_dict': {'nb_ptf_finished': 56, 'nb_images_finished': 1043, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 28, 'nb_images_started': 588, 'nb_selected_images': 1631, 'last_update': '2022/08/28', 'portfolio_id': 6680169, 'last_run_id': 455185, 'total_number_of_photos': 3940}} No error ? {'log_dict': {'total_nb_images': 3941, 'max_time_between_images': '0 days 79 seconds', 'coverage_pause': '0 days 59115 seconds', 'coverage_times_pause': '0 days 59374 seconds', 'nb_photos_decision': 3940, 'nb_gray_level_ok': 3940, 'nb_dedup_ok': 3940, 'nb_two_criteria_ok': 3940, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 2, 'end_of_day_photos_pink': 7, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3931, 'ratio_coverage': 1.0}, 'dashboard_dict': {'nb_ptf_finished': 56, 'nb_images_finished': 1036, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 9, 'nb_images_started': 227, 'nb_selected_images': 1263, 'last_update': '2022/08/29', 'portfolio_id': 6662197, 'last_run_id': 468274, 'total_number_of_photos': 3932}} No error ? {'log_dict': {'total_nb_images': 3934, 'max_time_between_images': '0 days 85 seconds', 'coverage_pause': '0 days 59010 seconds', 'coverage_times_pause': '0 days 59242 seconds', 'nb_photos_decision': 3934, 'nb_gray_level_ok': 3934, 'nb_dedup_ok': 3934, 'nb_two_criteria_ok': 3934, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1, 'end_of_day_photos_pink': 6, 'end_of_day_photos_duplicated': 1, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3925, 'ratio_coverage': 1.0}, 'dashboard_dict': {'nb_ptf_finished': 48, 'nb_images_finished': 929, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 22, 'nb_images_started': 429, 'nb_selected_images': 1358, 'last_update': '2022/08/21', 'portfolio_id': 6645254, 'last_run_id': 452689, 'total_number_of_photos': 3938}} No error ? {'log_dict': {'total_nb_images': 3933, 'max_time_between_images': '0 days 84 seconds', 'coverage_pause': '0 days 58993 seconds', 'coverage_times_pause': '0 days 59366 seconds', 'nb_photos_decision': 3932, 'nb_gray_level_ok': 3932, 'nb_dedup_ok': 3932, 'nb_two_criteria_ok': 3932, 'nb_forced_upload': 0, 'end_of_day_photos_pink': 11, 'end_of_day_photos_duplicated': 1, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3920, 'ratio_coverage': 1.0}, 'dashboard_dict': {'nb_ptf_finished': 45, 'nb_images_finished': 803, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 28, 'nb_images_started': 730, 'nb_selected_images': 1533, 'last_update': '2022/09/05', 'portfolio_id': 6633492, 'last_run_id': 451519, 'total_number_of_photos': 3925}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 3936, 'max_time_between_images': '0 days 82 seconds', 'coverage_pause': '0 days 59040 seconds', 'coverage_times_pause': '0 days 59363 seconds', 'nb_photos_decision': 3936, 'nb_gray_level_ok': 3936, 'nb_dedup_ok': 3936, 'nb_two_criteria_ok': 3936, 'nb_forced_upload': 0, 'end_of_day_photos_pink': 10, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3925, 'ratio_coverage': 1.0}, 'dashboard_dict': {'nb_ptf_finished': 34, 'nb_images_finished': 568, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 49, 'nb_images_started': 940, 'nb_selected_images': 1508, 'last_update': '2022/08/24', 'portfolio_id': 6632462, 'last_run_id': 454424, 'total_number_of_photos': 3926}} No error ? {'log_dict': {'total_nb_images': 3939, 'max_time_between_images': '0 days 85 seconds', 'coverage_pause': '0 days 59085 seconds', 'coverage_times_pause': '0 days 59369 seconds', 'nb_photos_decision': 3939, 'nb_gray_level_ok': 3939, 'nb_dedup_ok': 3939, 'nb_two_criteria_ok': 3939, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1, 'end_of_day_photos_pink': 11, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3926, 'ratio_coverage': 1.0}, 'dashboard_dict': {'nb_ptf_finished': 66, 'nb_images_finished': 1181, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 10, 'nb_images_started': 258, 'nb_selected_images': 1439, 'last_update': '2022/08/17', 'portfolio_id': 6630409, 'last_run_id': 454399, 'total_number_of_photos': 3928}} No error ? {'log_dict': {'total_nb_images': 3941, 'max_time_between_images': '0 days 88 seconds', 'coverage_pause': '0 days 59112 seconds', 'coverage_times_pause': '0 days 59367 seconds', 'nb_photos_decision': 3941, 'nb_gray_level_ok': 3941, 'nb_dedup_ok': 3941, 'nb_two_criteria_ok': 3941, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1, 'end_of_day_photos_pink': 9, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3930, 'ratio_coverage': 1.0}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 40, 'nb_images_started': 797, 'nb_selected_images': 797, 'last_update': '2022/08/24', 'portfolio_id': 6629944, 'last_run_id': 454411, 'total_number_of_photos': 3979}} No error ? {'log_dict': {'total_nb_images': 3942, 'max_time_between_images': '0 days 83 seconds', 'coverage_pause': '0 days 59130 seconds', 'coverage_times_pause': '0 days 59372 seconds', 'nb_photos_decision': 3942, 'nb_gray_level_ok': 3942, 'nb_dedup_ok': 3942, 'nb_two_criteria_ok': 3942, 'nb_forced_upload': 0, 'end_of_day_photos_pink': 6, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3935, 'ratio_coverage': 1.0}, 'dashboard_dict': {'nb_ptf_finished': 23, 'nb_images_finished': 521, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 32, 'nb_images_started': 658, 'nb_selected_images': 1179, 'last_update': '2022/08/28', 'portfolio_id': 6625129, 'last_run_id': 454388, 'total_number_of_photos': 3940}} No error ? {'log_dict': {'total_nb_images': 3911, 'max_time_between_images': '0 days 87 seconds', 'coverage_pause': '0 days 58663 seconds', 'coverage_times_pause': '0 days 59355 seconds', 'nb_photos_decision': 3911, 'nb_gray_level_ok': 3911, 'nb_dedup_ok': 3911, 'nb_two_criteria_ok': 3911, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 5, 'end_of_day_photos_pink': 9, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3896, 'ratio_coverage': 1.0}, 'dashboard_dict': {'nb_ptf_finished': 77, 'nb_images_finished': 1405, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 9, 'nb_images_started': 271, 'nb_selected_images': 1676, 'last_update': '2022/08/11', 'portfolio_id': 6612466, 'last_run_id': 454376, 'total_number_of_photos': 3920}} No error ? {'log_dict': {'total_nb_images': 3914, 'max_time_between_images': '0 days 89 seconds', 'coverage_pause': '0 days 58692 seconds', 'coverage_times_pause': '0 days 59285 seconds', 'nb_photos_decision': 3914, 'nb_gray_level_ok': 3914, 'nb_dedup_ok': 3914, 'nb_two_criteria_ok': 3914, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 2, 'end_of_day_photos_pink': 11, 'end_of_day_photos_duplicated': 1, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3899, 'ratio_coverage': 1.0}, 'dashboard_dict': {'nb_ptf_finished': 66, 'nb_images_finished': 1291, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 9, 'nb_images_started': 226, 'nb_selected_images': 1517, 'last_update': '2022/08/02', 'portfolio_id': 6600066, 'last_run_id': 449271, 'total_number_of_photos': 3919}} No error ? {'log_dict': {'total_nb_images': 11754, 'max_time_between_images': '0 days 6397 seconds', 'coverage_pause': '0 days 26466 seconds', 'coverage_times_pause': '0 days 43831 seconds', 'nb_photos_decision': 11774, 'nb_gray_level_ok': 4617, 'nb_dedup_ok': 11773, 'nb_two_criteria_ok': 4616, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1498, 'end_of_day_photos_pink': 20, 'end_of_day_photos_dark': 5638, 'end_of_day_photos_duplicated': 1, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 181, 'end_of_day_photos_uploaded': 4415, 'ratio_coverage': 0.46678071923667086}, 'dashboard_dict': {'nb_ptf_finished': 19, 'nb_images_finished': 1263, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 10, 'nb_images_started': 564, 'nb_selected_images': 1827, 'last_update': '2022/09/04', 'portfolio_id': 6911337, 'last_run_id': 479886, 'total_number_of_photos': 4031}} No error ? {'log_dict': {'total_nb_images': 3929, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 7858 seconds', 'coverage_times_pause': '0 days 15716 seconds', 'nb_photos_decision': 3929, 'nb_gray_level_ok': 911, 'nb_dedup_ok': 3929, 'nb_two_criteria_ok': 911, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1660, 'end_of_day_photos_pink': 2, 'end_of_day_photos_dark': 1357, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 909, 'ratio_coverage': 0.13859150955043298}, 'dashboard_dict': {'nb_ptf_finished': 28, 'nb_images_finished': 390, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 11, 'nb_images_started': 207, 'nb_selected_images': 597, 'last_update': '2022/09/03', 'portfolio_id': 6892921, 'last_run_id': 478927, 'total_number_of_photos': 909}} No error ? {'log_dict': {'total_nb_images': 3919, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 7838 seconds', 'coverage_times_pause': '0 days 15676 seconds', 'nb_photos_decision': 3918, 'nb_gray_level_ok': 662, 'nb_dedup_ok': 3918, 'nb_two_criteria_ok': 662, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 2067, 'end_of_day_photos_dark': 1189, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 662, 'ratio_coverage': 0.13823876964320359}, 'dashboard_dict': {'nb_ptf_finished': 26, 'nb_images_finished': 389, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 4, 'nb_images_started': 74, 'nb_selected_images': 463, 'last_update': '2022/08/30', 'portfolio_id': 6880974, 'last_run_id': 477478, 'total_number_of_photos': 646}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 3921, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 7842 seconds', 'coverage_times_pause': '0 days 15684 seconds', 'nb_photos_decision': 3921, 'nb_gray_level_ok': 1057, 'nb_dedup_ok': 3921, 'nb_two_criteria_ok': 1057, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1813, 'end_of_day_photos_pink': 1, 'end_of_day_photos_dark': 1050, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 1056, 'ratio_coverage': 0.13830931762464946}, 'dashboard_dict': {'nb_ptf_finished': 2, 'nb_images_finished': 28, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 28, 'last_update': '2022/08/27', 'portfolio_id': 6872937, 'last_run_id': 475306, 'total_number_of_photos': 1056}} No error ? {'log_dict': {'total_nb_images': 3920, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 7840 seconds', 'coverage_times_pause': '0 days 15680 seconds', 'nb_photos_decision': 3920, 'nb_gray_level_ok': 1069, 'nb_dedup_ok': 3920, 'nb_two_criteria_ok': 1069, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1834, 'end_of_day_photos_pink': 2, 'end_of_day_photos_dark': 1016, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 1067, 'ratio_coverage': 0.13827404363392654}, 'dashboard_dict': {'nb_ptf_finished': 31, 'nb_images_finished': 537, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 8, 'nb_images_started': 163, 'nb_selected_images': 700, 'last_update': '2022/08/29', 'portfolio_id': 6865211, 'last_run_id': 474338, 'total_number_of_photos': 1067}} No error ? {'log_dict': {'total_nb_images': 3933, 'max_time_between_images': '0 days 93 seconds', 'coverage_pause': '0 days 7866 seconds', 'coverage_times_pause': '0 days 15732 seconds', 'nb_photos_decision': 3933, 'nb_gray_level_ok': 1059, 'nb_dedup_ok': 3933, 'nb_two_criteria_ok': 1059, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1868, 'end_of_day_photos_pink': 7, 'end_of_day_photos_dark': 1005, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 429, 'end_of_day_photos_uploaded': 623, 'ratio_coverage': 0.13873260551332475}, 'dashboard_dict': {'nb_ptf_finished': 16, 'nb_images_finished': 264, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 25, 'nb_images_started': 480, 'nb_selected_images': 744, 'last_update': '2022/08/29', 'portfolio_id': 6858102, 'last_run_id': 474755, 'total_number_of_photos': 1052}} No error ? {'log_dict': {'total_nb_images': 3925, 'max_time_between_images': '0 days 83 seconds', 'coverage_pause': '0 days 7850 seconds', 'coverage_times_pause': '0 days 15700 seconds', 'nb_photos_decision': 3925, 'nb_gray_level_ok': 1034, 'nb_dedup_ok': 3925, 'nb_two_criteria_ok': 1034, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1899, 'end_of_day_photos_pink': 1, 'end_of_day_photos_dark': 991, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 1033, 'ratio_coverage': 0.13845041358754123}, 'dashboard_dict': {'nb_ptf_finished': 35, 'nb_images_finished': 576, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 7, 'nb_images_started': 137, 'nb_selected_images': 713, 'last_update': '2022/08/25', 'portfolio_id': 6845170, 'last_run_id': 472189, 'total_number_of_photos': 1033}} No error ? {'log_dict': {'total_nb_images': 3924, 'max_time_between_images': '0 days 85 seconds', 'coverage_pause': '0 days 7848 seconds', 'coverage_times_pause': '0 days 15696 seconds', 'nb_photos_decision': 3924, 'nb_gray_level_ok': 905, 'nb_dedup_ok': 3924, 'nb_two_criteria_ok': 905, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 2058, 'end_of_day_photos_pink': 7, 'end_of_day_photos_dark': 960, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 898, 'ratio_coverage': 0.13841513959681828}, 'dashboard_dict': {'nb_ptf_finished': 32, 'nb_images_finished': 494, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 8, 'nb_images_started': 156, 'nb_selected_images': 650, 'last_update': '2022/08/26', 'portfolio_id': 6830485, 'last_run_id': 470781, 'total_number_of_photos': 898}} No error ? {'log_dict': {'total_nb_images': 3917, 'max_time_between_images': '0 days 83 seconds', 'coverage_pause': '0 days 7834 seconds', 'coverage_times_pause': '0 days 15668 seconds', 'nb_photos_decision': 3916, 'nb_gray_level_ok': 2076, 'nb_dedup_ok': 3916, 'nb_two_criteria_ok': 2076, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1284, 'end_of_day_photos_pink': 5, 'end_of_day_photos_dark': 556, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 2071, 'ratio_coverage': 0.1381682216617577}, 'dashboard_dict': {'nb_ptf_finished': 45, 'nb_images_finished': 714, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 8, 'nb_images_started': 216, 'nb_selected_images': 930, 'last_update': '2022/08/23', 'portfolio_id': 6811061, 'last_run_id': 469411, 'total_number_of_photos': 2075}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 3931, 'max_time_between_images': '0 days 121 seconds', 'coverage_pause': '0 days 7862 seconds', 'coverage_times_pause': '0 days 15724 seconds', 'nb_photos_decision': 3931, 'nb_gray_level_ok': 3928, 'nb_dedup_ok': 3931, 'nb_two_criteria_ok': 3928, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 7, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3923, 'ratio_coverage': 0.13866205753187888}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'last_update': '2022/08/20', 'portfolio_id': 6800521, 'last_run_id': 465870, 'total_number_of_photos': 3931}} No error ? {'log_dict': {'total_nb_images': 3935, 'max_time_between_images': '0 days 79 seconds', 'coverage_pause': '0 days 7870 seconds', 'coverage_times_pause': '0 days 15740 seconds', 'nb_photos_decision': 3935, 'nb_gray_level_ok': 3931, 'nb_dedup_ok': 3935, 'nb_two_criteria_ok': 3931, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 4, 'end_of_day_photos_pink': 5, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3925, 'ratio_coverage': 0.13880315349477063}, 'dashboard_dict': {'nb_ptf_finished': 55, 'nb_images_finished': 1095, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 9, 'nb_images_started': 225, 'nb_selected_images': 1320, 'last_update': '2022/08/21', 'portfolio_id': 6785173, 'last_run_id': 464885, 'total_number_of_photos': 3940}} No error ? {'log_dict': {'total_nb_images': 3940, 'max_time_between_images': '0 days 84 seconds', 'coverage_pause': '0 days 7880 seconds', 'coverage_times_pause': '0 days 15760 seconds', 'nb_photos_decision': 3940, 'nb_gray_level_ok': 3937, 'nb_dedup_ok': 3940, 'nb_two_criteria_ok': 3937, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 3, 'end_of_day_photos_pink': 6, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 893, 'end_of_day_photos_uploaded': 3037, 'ratio_coverage': 0.13897952344838532}, 'dashboard_dict': {'nb_ptf_finished': 62, 'nb_images_finished': 1227, 'nb_ptf_finished_for_older': 1, 'nb_images_finished_for_older': 101, 'nb_ptf_started': 11, 'nb_images_started': 275, 'nb_selected_images': 1603, 'last_update': '2022/08/21', 'portfolio_id': 6771154, 'last_run_id': 463490, 'total_number_of_photos': 4063}} No error ? {'log_dict': {'total_nb_images': 3939, 'max_time_between_images': '0 days 85 seconds', 'coverage_pause': '0 days 7878 seconds', 'coverage_times_pause': '0 days 15756 seconds', 'nb_photos_decision': 3939, 'nb_gray_level_ok': 3934, 'nb_dedup_ok': 3939, 'nb_two_criteria_ok': 3934, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 5, 'end_of_day_photos_pink': 3, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3930, 'ratio_coverage': 0.1389442494576624}, 'dashboard_dict': {'nb_ptf_finished': 54, 'nb_images_finished': 1122, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 18, 'nb_images_started': 344, 'nb_selected_images': 1466, 'last_update': '2022/08/22', 'portfolio_id': 6756941, 'last_run_id': 462392, 'total_number_of_photos': 3931}} No error ? {'log_dict': {'total_nb_images': 3946, 'max_time_between_images': '0 days 90 seconds', 'coverage_pause': '0 days 7892 seconds', 'coverage_times_pause': '0 days 15784 seconds', 'nb_photos_decision': 3946, 'nb_gray_level_ok': 3946, 'nb_dedup_ok': 3946, 'nb_two_criteria_ok': 3946, 'nb_forced_upload': 0, 'end_of_day_photos_pink': 4, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3941, 'ratio_coverage': 0.13919116739272297}, 'dashboard_dict': {'nb_ptf_finished': 69, 'nb_images_finished': 1402, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 13, 'nb_images_started': 331, 'nb_selected_images': 1733, 'last_update': '2022/08/22', 'portfolio_id': 6738801, 'last_run_id': 461074, 'total_number_of_photos': 3942}} No error ? {'log_dict': {'total_nb_images': 3941, 'max_time_between_images': '0 days 86 seconds', 'coverage_pause': '0 days 7882 seconds', 'coverage_times_pause': '0 days 15764 seconds', 'nb_photos_decision': 3936, 'nb_gray_level_ok': 3934, 'nb_dedup_ok': 3935, 'nb_two_criteria_ok': 3933, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 2, 'end_of_day_photos_pink': 6, 'end_of_day_photos_duplicated': 1, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 3526, 'end_of_day_photos_uploaded': 405, 'ratio_coverage': 0.13901479743910827}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 4, 'nb_images_started': 127, 'nb_selected_images': 127, 'last_update': '2022/08/22', 'portfolio_id': 6736624, 'last_run_id': 459828, 'total_number_of_photos': 3932}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 3939, 'max_time_between_images': '0 days 85 seconds', 'coverage_pause': '0 days 7878 seconds', 'coverage_times_pause': '0 days 15756 seconds', 'nb_photos_decision': 3939, 'nb_gray_level_ok': 3938, 'nb_dedup_ok': 3938, 'nb_two_criteria_ok': 3937, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1, 'end_of_day_photos_pink': 10, 'end_of_day_photos_duplicated': 1, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3926, 'ratio_coverage': 0.1389442494576624}, 'dashboard_dict': {'nb_ptf_finished': 62, 'nb_images_finished': 1156, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 14, 'nb_images_started': 330, 'nb_selected_images': 1486, 'last_update': '2022/08/14', 'portfolio_id': 6714370, 'last_run_id': 457640, 'total_number_of_photos': 3926}} No error ? {'log_dict': {'total_nb_images': 2477, 'max_time_between_images': '0 days 89 seconds', 'coverage_pause': '0 days 4954 seconds', 'coverage_times_pause': '0 days 9908 seconds', 'nb_photos_decision': 2477, 'nb_gray_level_ok': 2475, 'nb_dedup_ok': 2477, 'nb_two_criteria_ok': 2475, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 2, 'end_of_day_photos_pink': 4, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 300, 'end_of_day_photos_uploaded': 2170, 'ratio_coverage': 0.08737367502072348}, 'dashboard_dict': {'nb_ptf_finished': 39, 'nb_images_finished': 747, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 7, 'nb_images_started': 169, 'nb_selected_images': 916, 'last_update': '2022/08/13', 'portfolio_id': 6703539, 'last_run_id': 456478, 'total_number_of_photos': 2475}} No error ? {'log_dict': {'total_nb_images': 3935, 'max_time_between_images': '0 days 86 seconds', 'coverage_pause': '0 days 7870 seconds', 'coverage_times_pause': '0 days 15740 seconds', 'nb_photos_decision': 3935, 'nb_gray_level_ok': 3931, 'nb_dedup_ok': 3934, 'nb_two_criteria_ok': 3930, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 4, 'end_of_day_photos_pink': 6, 'end_of_day_photos_duplicated': 1, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3923, 'ratio_coverage': 0.13880315349477063}, 'dashboard_dict': {'nb_ptf_finished': 56, 'nb_images_finished': 1043, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 28, 'nb_images_started': 588, 'nb_selected_images': 1631, 'last_update': '2022/08/28', 'portfolio_id': 6680169, 'last_run_id': 455185, 'total_number_of_photos': 3940}} No error ? {'log_dict': {'total_nb_images': 3941, 'max_time_between_images': '0 days 79 seconds', 'coverage_pause': '0 days 7882 seconds', 'coverage_times_pause': '0 days 15764 seconds', 'nb_photos_decision': 3940, 'nb_gray_level_ok': 3939, 'nb_dedup_ok': 3940, 'nb_two_criteria_ok': 3939, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 2, 'end_of_day_photos_pink': 7, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3931, 'ratio_coverage': 0.13901479743910827}, 'dashboard_dict': {'nb_ptf_finished': 56, 'nb_images_finished': 1036, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 9, 'nb_images_started': 227, 'nb_selected_images': 1263, 'last_update': '2022/08/29', 'portfolio_id': 6662197, 'last_run_id': 468274, 'total_number_of_photos': 3932}} No error ? {'log_dict': {'total_nb_images': 3934, 'max_time_between_images': '0 days 85 seconds', 'coverage_pause': '0 days 7868 seconds', 'coverage_times_pause': '0 days 15736 seconds', 'nb_photos_decision': 3934, 'nb_gray_level_ok': 3933, 'nb_dedup_ok': 3933, 'nb_two_criteria_ok': 3932, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1, 'end_of_day_photos_pink': 6, 'end_of_day_photos_duplicated': 1, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3925, 'ratio_coverage': 0.1387678795040477}, 'dashboard_dict': {'nb_ptf_finished': 48, 'nb_images_finished': 929, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 22, 'nb_images_started': 429, 'nb_selected_images': 1358, 'last_update': '2022/08/21', 'portfolio_id': 6645254, 'last_run_id': 452689, 'total_number_of_photos': 3938}} No error ? {'log_dict': {'total_nb_images': 3933, 'max_time_between_images': '0 days 84 seconds', 'coverage_pause': '0 days 7866 seconds', 'coverage_times_pause': '0 days 15732 seconds', 'nb_photos_decision': 3932, 'nb_gray_level_ok': 3932, 'nb_dedup_ok': 3931, 'nb_two_criteria_ok': 3931, 'nb_forced_upload': 0, 'end_of_day_photos_pink': 11, 'end_of_day_photos_duplicated': 1, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3920, 'ratio_coverage': 0.13873260551332475}, 'dashboard_dict': {'nb_ptf_finished': 45, 'nb_images_finished': 803, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 28, 'nb_images_started': 730, 'nb_selected_images': 1533, 'last_update': '2022/09/05', 'portfolio_id': 6633492, 'last_run_id': 451519, 'total_number_of_photos': 3925}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 3936, 'max_time_between_images': '0 days 82 seconds', 'coverage_pause': '0 days 7872 seconds', 'coverage_times_pause': '0 days 15744 seconds', 'nb_photos_decision': 3936, 'nb_gray_level_ok': 3936, 'nb_dedup_ok': 3936, 'nb_two_criteria_ok': 3936, 'nb_forced_upload': 0, 'end_of_day_photos_pink': 10, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3925, 'ratio_coverage': 0.13883842748549358}, 'dashboard_dict': {'nb_ptf_finished': 34, 'nb_images_finished': 568, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 49, 'nb_images_started': 940, 'nb_selected_images': 1508, 'last_update': '2022/08/24', 'portfolio_id': 6632462, 'last_run_id': 454424, 'total_number_of_photos': 3926}} No error ? {'log_dict': {'total_nb_images': 3939, 'max_time_between_images': '0 days 85 seconds', 'coverage_pause': '0 days 7878 seconds', 'coverage_times_pause': '0 days 15756 seconds', 'nb_photos_decision': 3939, 'nb_gray_level_ok': 3938, 'nb_dedup_ok': 3939, 'nb_two_criteria_ok': 3938, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1, 'end_of_day_photos_pink': 11, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3926, 'ratio_coverage': 0.1389442494576624}, 'dashboard_dict': {'nb_ptf_finished': 66, 'nb_images_finished': 1181, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 10, 'nb_images_started': 258, 'nb_selected_images': 1439, 'last_update': '2022/08/17', 'portfolio_id': 6630409, 'last_run_id': 454399, 'total_number_of_photos': 3928}} No error ? {'log_dict': {'total_nb_images': 3941, 'max_time_between_images': '0 days 88 seconds', 'coverage_pause': '0 days 7882 seconds', 'coverage_times_pause': '0 days 15764 seconds', 'nb_photos_decision': 3941, 'nb_gray_level_ok': 3940, 'nb_dedup_ok': 3941, 'nb_two_criteria_ok': 3940, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1, 'end_of_day_photos_pink': 9, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3930, 'ratio_coverage': 0.13901479743910827}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 40, 'nb_images_started': 797, 'nb_selected_images': 797, 'last_update': '2022/08/24', 'portfolio_id': 6629944, 'last_run_id': 454411, 'total_number_of_photos': 3979}} No error ? {'log_dict': {'total_nb_images': 3942, 'max_time_between_images': '0 days 83 seconds', 'coverage_pause': '0 days 7884 seconds', 'coverage_times_pause': '0 days 15768 seconds', 'nb_photos_decision': 3942, 'nb_gray_level_ok': 3942, 'nb_dedup_ok': 3942, 'nb_two_criteria_ok': 3942, 'nb_forced_upload': 0, 'end_of_day_photos_pink': 6, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3935, 'ratio_coverage': 0.13905007142983122}, 'dashboard_dict': {'nb_ptf_finished': 23, 'nb_images_finished': 521, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 32, 'nb_images_started': 658, 'nb_selected_images': 1179, 'last_update': '2022/08/28', 'portfolio_id': 6625129, 'last_run_id': 454388, 'total_number_of_photos': 3940}} No error ? {'log_dict': {'total_nb_images': 3911, 'max_time_between_images': '0 days 87 seconds', 'coverage_pause': '0 days 7822 seconds', 'coverage_times_pause': '0 days 15644 seconds', 'nb_photos_decision': 3911, 'nb_gray_level_ok': 3910, 'nb_dedup_ok': 3911, 'nb_two_criteria_ok': 3910, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 5, 'end_of_day_photos_pink': 9, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3896, 'ratio_coverage': 0.13795657771742006}, 'dashboard_dict': {'nb_ptf_finished': 77, 'nb_images_finished': 1405, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 9, 'nb_images_started': 271, 'nb_selected_images': 1676, 'last_update': '2022/08/11', 'portfolio_id': 6612466, 'last_run_id': 454376, 'total_number_of_photos': 3920}} No error ? {'log_dict': {'total_nb_images': 3914, 'max_time_between_images': '0 days 89 seconds', 'coverage_pause': '0 days 7828 seconds', 'coverage_times_pause': '0 days 15656 seconds', 'nb_photos_decision': 3914, 'nb_gray_level_ok': 3912, 'nb_dedup_ok': 3913, 'nb_two_criteria_ok': 3911, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 2, 'end_of_day_photos_pink': 11, 'end_of_day_photos_duplicated': 1, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3899, 'ratio_coverage': 0.1380623996895889}, 'dashboard_dict': {'nb_ptf_finished': 66, 'nb_images_finished': 1291, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 9, 'nb_images_started': 226, 'nb_selected_images': 1517, 'last_update': '2022/08/02', 'portfolio_id': 6600066, 'last_run_id': 449271, 'total_number_of_photos': 3919}} No error ? {'log_dict': {'total_nb_images': 2984, 'max_time_between_images': '0 days 1044 seconds', 'coverage_pause': '0 days 3936 seconds', 'coverage_times_pause': '0 days 6834 seconds', 'nb_photos_decision': 11774, 'nb_gray_level_ok': 4617, 'nb_dedup_ok': 11773, 'nb_two_criteria_ok': 4616, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1498, 'end_of_day_photos_pink': 20, 'end_of_day_photos_dark': 5638, 'end_of_day_photos_duplicated': 1, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 181, 'end_of_day_photos_uploaded': 4415, 'ratio_coverage': 0.06941921374274679}, 'dashboard_dict': {'nb_ptf_finished': 19, 'nb_images_finished': 1263, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 10, 'nb_images_started': 564, 'nb_selected_images': 1827, 'last_update': '2022/09/02', 'portfolio_id': 6911337, 'last_run_id': 479886, 'total_number_of_photos': 4023}} No error ? {'log_dict': {'total_nb_images': 3320, 'max_time_between_images': '0 days 466 seconds', 'coverage_pause': '0 days 3320 seconds', 'coverage_times_pause': '0 days 6640 seconds', 'nb_photos_decision': 3929, 'nb_gray_level_ok': 911, 'nb_dedup_ok': 3929, 'nb_two_criteria_ok': 911, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1660, 'end_of_day_photos_pink': 2, 'end_of_day_photos_dark': 1357, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 909, 'ratio_coverage': 0.05855482460008113}, 'dashboard_dict': {'nb_ptf_finished': 28, 'nb_images_finished': 390, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 11, 'nb_images_started': 207, 'nb_selected_images': 597, 'last_update': '2022/09/02', 'portfolio_id': 6892921, 'last_run_id': 478927, 'total_number_of_photos': 909}} No error ? {'log_dict': {'total_nb_images': 4134, 'max_time_between_images': '0 days 315 seconds', 'coverage_pause': '0 days 4134 seconds', 'coverage_times_pause': '0 days 8268 seconds', 'nb_photos_decision': 3918, 'nb_gray_level_ok': 662, 'nb_dedup_ok': 3918, 'nb_two_criteria_ok': 662, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 2067, 'end_of_day_photos_dark': 1189, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 662, 'ratio_coverage': 0.07291133882431788}, 'dashboard_dict': {'nb_ptf_finished': 26, 'nb_images_finished': 389, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 4, 'nb_images_started': 74, 'nb_selected_images': 463, 'last_update': '2022/08/30', 'portfolio_id': 6880974, 'last_run_id': 477478, 'total_number_of_photos': 646}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 3626, 'max_time_between_images': '0 days 451 seconds', 'coverage_pause': '0 days 3626 seconds', 'coverage_times_pause': '0 days 7252 seconds', 'nb_photos_decision': 3921, 'nb_gray_level_ok': 1057, 'nb_dedup_ok': 3921, 'nb_two_criteria_ok': 1057, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1813, 'end_of_day_photos_pink': 1, 'end_of_day_photos_dark': 1050, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 1056, 'ratio_coverage': 0.06395174518069102}, 'dashboard_dict': {'nb_ptf_finished': 2, 'nb_images_finished': 28, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 28, 'last_update': '2022/08/27', 'portfolio_id': 6872937, 'last_run_id': 475306, 'total_number_of_photos': 1056}} No error ? {'log_dict': {'total_nb_images': 3668, 'max_time_between_images': '0 days 517 seconds', 'coverage_pause': '0 days 3668 seconds', 'coverage_times_pause': '0 days 7336 seconds', 'nb_photos_decision': 3920, 'nb_gray_level_ok': 1069, 'nb_dedup_ok': 3920, 'nb_two_criteria_ok': 1069, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1834, 'end_of_day_photos_pink': 2, 'end_of_day_photos_dark': 1016, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 1067, 'ratio_coverage': 0.06469249898587277}, 'dashboard_dict': {'nb_ptf_finished': 31, 'nb_images_finished': 537, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 8, 'nb_images_started': 163, 'nb_selected_images': 700, 'last_update': '2022/08/29', 'portfolio_id': 6865211, 'last_run_id': 474338, 'total_number_of_photos': 1067}} No error ? {'log_dict': {'total_nb_images': 3736, 'max_time_between_images': '0 days 436 seconds', 'coverage_pause': '0 days 3736 seconds', 'coverage_times_pause': '0 days 7472 seconds', 'nb_photos_decision': 3933, 'nb_gray_level_ok': 1059, 'nb_dedup_ok': 3933, 'nb_two_criteria_ok': 1059, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1868, 'end_of_day_photos_pink': 7, 'end_of_day_photos_dark': 1005, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 429, 'end_of_day_photos_uploaded': 623, 'ratio_coverage': 0.06589181467045274}, 'dashboard_dict': {'nb_ptf_finished': 16, 'nb_images_finished': 264, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 25, 'nb_images_started': 480, 'nb_selected_images': 744, 'last_update': '2022/08/29', 'portfolio_id': 6858102, 'last_run_id': 474755, 'total_number_of_photos': 1052}} No error ? {'log_dict': {'total_nb_images': 3798, 'max_time_between_images': '0 days 511 seconds', 'coverage_pause': '0 days 3798 seconds', 'coverage_times_pause': '0 days 7596 seconds', 'nb_photos_decision': 3925, 'nb_gray_level_ok': 1034, 'nb_dedup_ok': 3925, 'nb_two_criteria_ok': 1034, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1899, 'end_of_day_photos_pink': 1, 'end_of_day_photos_dark': 991, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 1033, 'ratio_coverage': 0.0669853083828639}, 'dashboard_dict': {'nb_ptf_finished': 35, 'nb_images_finished': 576, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 7, 'nb_images_started': 137, 'nb_selected_images': 713, 'last_update': '2022/08/25', 'portfolio_id': 6845170, 'last_run_id': 472189, 'total_number_of_photos': 1033}} No error ? {'log_dict': {'total_nb_images': 4136, 'max_time_between_images': '0 days 502 seconds', 'coverage_pause': '0 days 4116 seconds', 'coverage_times_pause': '0 days 8232 seconds', 'nb_photos_decision': 3924, 'nb_gray_level_ok': 905, 'nb_dedup_ok': 3924, 'nb_two_criteria_ok': 905, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 2058, 'end_of_day_photos_pink': 7, 'end_of_day_photos_dark': 960, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 898, 'ratio_coverage': 0.07259387290781143}, 'dashboard_dict': {'nb_ptf_finished': 32, 'nb_images_finished': 494, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 8, 'nb_images_started': 156, 'nb_selected_images': 650, 'last_update': '2022/08/26', 'portfolio_id': 6830485, 'last_run_id': 470781, 'total_number_of_photos': 898}} No error ? {'log_dict': {'total_nb_images': 2568, 'max_time_between_images': '0 days 449 seconds', 'coverage_pause': '0 days 2568 seconds', 'coverage_times_pause': '0 days 5136 seconds', 'nb_photos_decision': 3916, 'nb_gray_level_ok': 2076, 'nb_dedup_ok': 3916, 'nb_two_criteria_ok': 2076, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1284, 'end_of_day_photos_pink': 5, 'end_of_day_photos_dark': 556, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 2071, 'ratio_coverage': 0.045291804088255526}, 'dashboard_dict': {'nb_ptf_finished': 45, 'nb_images_finished': 714, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 8, 'nb_images_started': 216, 'nb_selected_images': 930, 'last_update': '2022/08/23', 'portfolio_id': 6811061, 'last_run_id': 469411, 'total_number_of_photos': 2075}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 6, 'max_time_between_images': '0 days 7064 seconds', 'coverage_pause': '0 days 6 seconds', 'coverage_times_pause': '0 days 12 seconds', 'nb_photos_decision': 3931, 'nb_gray_level_ok': 3928, 'nb_dedup_ok': 3931, 'nb_two_criteria_ok': 3928, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 7, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3923, 'ratio_coverage': 0.00010582197216882132}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'last_update': '2022/08/20', 'portfolio_id': 6800521, 'last_run_id': 465870, 'total_number_of_photos': 3931}} No error ? {'log_dict': {'total_nb_images': 8, 'max_time_between_images': '0 days 22258 seconds', 'coverage_pause': '0 days 8 seconds', 'coverage_times_pause': '0 days 16 seconds', 'nb_photos_decision': 3935, 'nb_gray_level_ok': 3931, 'nb_dedup_ok': 3935, 'nb_two_criteria_ok': 3931, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 4, 'end_of_day_photos_pink': 5, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3925, 'ratio_coverage': 0.00014109596289176176}, 'dashboard_dict': {'nb_ptf_finished': 55, 'nb_images_finished': 1095, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 9, 'nb_images_started': 225, 'nb_selected_images': 1320, 'last_update': '2022/08/21', 'portfolio_id': 6785173, 'last_run_id': 464885, 'total_number_of_photos': 3940}} No error ? {'log_dict': {'total_nb_images': 6, 'max_time_between_images': '0 days 13249 seconds', 'coverage_pause': '0 days 6 seconds', 'coverage_times_pause': '0 days 12 seconds', 'nb_photos_decision': 3940, 'nb_gray_level_ok': 3937, 'nb_dedup_ok': 3940, 'nb_two_criteria_ok': 3937, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 3, 'end_of_day_photos_pink': 6, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 893, 'end_of_day_photos_uploaded': 3037, 'ratio_coverage': 0.00010582197216882132}, 'dashboard_dict': {'nb_ptf_finished': 62, 'nb_images_finished': 1227, 'nb_ptf_finished_for_older': 1, 'nb_images_finished_for_older': 101, 'nb_ptf_started': 11, 'nb_images_started': 275, 'nb_selected_images': 1603, 'last_update': '2022/08/21', 'portfolio_id': 6771154, 'last_run_id': 463490, 'total_number_of_photos': 4063}} No error ? {'log_dict': {'total_nb_images': 10, 'max_time_between_images': '0 days 21811 seconds', 'coverage_pause': '0 days 10 seconds', 'coverage_times_pause': '0 days 20 seconds', 'nb_photos_decision': 3939, 'nb_gray_level_ok': 3934, 'nb_dedup_ok': 3939, 'nb_two_criteria_ok': 3934, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 5, 'end_of_day_photos_pink': 3, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3930, 'ratio_coverage': 0.0001763699536147022}, 'dashboard_dict': {'nb_ptf_finished': 54, 'nb_images_finished': 1122, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 18, 'nb_images_started': 344, 'nb_selected_images': 1466, 'last_update': '2022/08/22', 'portfolio_id': 6756941, 'last_run_id': 462392, 'total_number_of_photos': 3931}} No error ? {'log_dict': {'total_nb_images': 3946, 'max_time_between_images': '0 days 90 seconds', 'coverage_pause': '0 days 7892 seconds', 'coverage_times_pause': '0 days 15784 seconds', 'nb_photos_decision': 3946, 'nb_gray_level_ok': 3946, 'nb_dedup_ok': 3946, 'nb_two_criteria_ok': 3946, 'nb_forced_upload': 0, 'end_of_day_photos_pink': 4, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3941, 'ratio_coverage': 0.13919116739272297}, 'dashboard_dict': {'nb_ptf_finished': 69, 'nb_images_finished': 1402, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 13, 'nb_images_started': 331, 'nb_selected_images': 1733, 'last_update': '2022/08/22', 'portfolio_id': 6738801, 'last_run_id': 461074, 'total_number_of_photos': 3942}} No error ? {'log_dict': {'total_nb_images': 4, 'max_time_between_images': '0 days 1677 seconds', 'coverage_pause': '0 days 4 seconds', 'coverage_times_pause': '0 days 8 seconds', 'nb_photos_decision': 3936, 'nb_gray_level_ok': 3934, 'nb_dedup_ok': 3935, 'nb_two_criteria_ok': 3933, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 2, 'end_of_day_photos_pink': 6, 'end_of_day_photos_duplicated': 1, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 3526, 'end_of_day_photos_uploaded': 405, 'ratio_coverage': 7.054798144588088e-05}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 4, 'nb_images_started': 127, 'nb_selected_images': 127, 'last_update': '2022/08/22', 'portfolio_id': 6736624, 'last_run_id': 459828, 'total_number_of_photos': 3932}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 2, 'max_time_between_images': '0 days 2 seconds', 'coverage_pause': '0 days 2 seconds', 'coverage_times_pause': '0 days 4 seconds', 'nb_photos_decision': 3939, 'nb_gray_level_ok': 3938, 'nb_dedup_ok': 3938, 'nb_two_criteria_ok': 3937, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1, 'end_of_day_photos_pink': 10, 'end_of_day_photos_duplicated': 1, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3926, 'ratio_coverage': 3.527399072294044e-05}, 'dashboard_dict': {'nb_ptf_finished': 62, 'nb_images_finished': 1156, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 14, 'nb_images_started': 330, 'nb_selected_images': 1486, 'last_update': '2022/08/14', 'portfolio_id': 6714370, 'last_run_id': 457640, 'total_number_of_photos': 3926}} No error ? {'log_dict': {'total_nb_images': 4, 'max_time_between_images': '0 days 3519 seconds', 'coverage_pause': '0 days 4 seconds', 'coverage_times_pause': '0 days 8 seconds', 'nb_photos_decision': 2477, 'nb_gray_level_ok': 2475, 'nb_dedup_ok': 2477, 'nb_two_criteria_ok': 2475, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 2, 'end_of_day_photos_pink': 4, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 300, 'end_of_day_photos_uploaded': 2170, 'ratio_coverage': 7.054798144588088e-05}, 'dashboard_dict': {'nb_ptf_finished': 39, 'nb_images_finished': 747, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 7, 'nb_images_started': 169, 'nb_selected_images': 916, 'last_update': '2022/08/13', 'portfolio_id': 6703539, 'last_run_id': 456478, 'total_number_of_photos': 2475}} No error ? {'log_dict': {'total_nb_images': 8, 'max_time_between_images': '0 days 28998 seconds', 'coverage_pause': '0 days 8 seconds', 'coverage_times_pause': '0 days 16 seconds', 'nb_photos_decision': 3935, 'nb_gray_level_ok': 3931, 'nb_dedup_ok': 3934, 'nb_two_criteria_ok': 3930, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 4, 'end_of_day_photos_pink': 6, 'end_of_day_photos_duplicated': 1, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3923, 'ratio_coverage': 0.00014109596289176176}, 'dashboard_dict': {'nb_ptf_finished': 56, 'nb_images_finished': 1043, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 28, 'nb_images_started': 588, 'nb_selected_images': 1631, 'last_update': '2022/08/28', 'portfolio_id': 6680169, 'last_run_id': 455185, 'total_number_of_photos': 3940}} No error ? {'log_dict': {'total_nb_images': 2, 'max_time_between_images': '0 days 2 seconds', 'coverage_pause': '0 days 2 seconds', 'coverage_times_pause': '0 days 4 seconds', 'nb_photos_decision': 3940, 'nb_gray_level_ok': 3939, 'nb_dedup_ok': 3940, 'nb_two_criteria_ok': 3939, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 2, 'end_of_day_photos_pink': 7, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3931, 'ratio_coverage': 3.527399072294044e-05}, 'dashboard_dict': {'nb_ptf_finished': 56, 'nb_images_finished': 1036, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 9, 'nb_images_started': 227, 'nb_selected_images': 1263, 'last_update': '2022/08/29', 'portfolio_id': 6662197, 'last_run_id': 468274, 'total_number_of_photos': 3932}} No error ? {'log_dict': {'total_nb_images': 2, 'max_time_between_images': '0 days 2 seconds', 'coverage_pause': '0 days 2 seconds', 'coverage_times_pause': '0 days 4 seconds', 'nb_photos_decision': 3934, 'nb_gray_level_ok': 3933, 'nb_dedup_ok': 3933, 'nb_two_criteria_ok': 3932, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1, 'end_of_day_photos_pink': 6, 'end_of_day_photos_duplicated': 1, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3925, 'ratio_coverage': 3.527399072294044e-05}, 'dashboard_dict': {'nb_ptf_finished': 48, 'nb_images_finished': 929, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 22, 'nb_images_started': 429, 'nb_selected_images': 1358, 'last_update': '2022/08/21', 'portfolio_id': 6645254, 'last_run_id': 452689, 'total_number_of_photos': 3938}} No error ? {'log_dict': {'total_nb_images': 3933, 'max_time_between_images': '0 days 84 seconds', 'coverage_pause': '0 days 7866 seconds', 'coverage_times_pause': '0 days 15732 seconds', 'nb_photos_decision': 3932, 'nb_gray_level_ok': 3932, 'nb_dedup_ok': 3931, 'nb_two_criteria_ok': 3931, 'nb_forced_upload': 0, 'end_of_day_photos_pink': 11, 'end_of_day_photos_duplicated': 1, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3920, 'ratio_coverage': 0.13873260551332475}, 'dashboard_dict': {'nb_ptf_finished': 45, 'nb_images_finished': 803, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 28, 'nb_images_started': 730, 'nb_selected_images': 1533, 'last_update': '2022/09/01', 'portfolio_id': 6633492, 'last_run_id': 451519, 'total_number_of_photos': 3925}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 3936, 'max_time_between_images': '0 days 82 seconds', 'coverage_pause': '0 days 7872 seconds', 'coverage_times_pause': '0 days 15744 seconds', 'nb_photos_decision': 3936, 'nb_gray_level_ok': 3936, 'nb_dedup_ok': 3936, 'nb_two_criteria_ok': 3936, 'nb_forced_upload': 0, 'end_of_day_photos_pink': 10, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3925, 'ratio_coverage': 0.13883842748549358}, 'dashboard_dict': {'nb_ptf_finished': 34, 'nb_images_finished': 568, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 49, 'nb_images_started': 940, 'nb_selected_images': 1508, 'last_update': '2022/08/24', 'portfolio_id': 6632462, 'last_run_id': 454424, 'total_number_of_photos': 3926}} No error ? {'log_dict': {'total_nb_images': 2, 'max_time_between_images': '0 days 2 seconds', 'coverage_pause': '0 days 2 seconds', 'coverage_times_pause': '0 days 4 seconds', 'nb_photos_decision': 3939, 'nb_gray_level_ok': 3938, 'nb_dedup_ok': 3939, 'nb_two_criteria_ok': 3938, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1, 'end_of_day_photos_pink': 11, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3926, 'ratio_coverage': 3.527399072294044e-05}, 'dashboard_dict': {'nb_ptf_finished': 66, 'nb_images_finished': 1181, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 10, 'nb_images_started': 258, 'nb_selected_images': 1439, 'last_update': '2022/08/17', 'portfolio_id': 6630409, 'last_run_id': 454399, 'total_number_of_photos': 3928}} No error ? {'log_dict': {'total_nb_images': 2, 'max_time_between_images': '0 days 2 seconds', 'coverage_pause': '0 days 2 seconds', 'coverage_times_pause': '0 days 4 seconds', 'nb_photos_decision': 3941, 'nb_gray_level_ok': 3940, 'nb_dedup_ok': 3941, 'nb_two_criteria_ok': 3940, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1, 'end_of_day_photos_pink': 9, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3930, 'ratio_coverage': 3.527399072294044e-05}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 40, 'nb_images_started': 797, 'nb_selected_images': 797, 'last_update': '2022/08/24', 'portfolio_id': 6629944, 'last_run_id': 454411, 'total_number_of_photos': 3979}} No error ? {'log_dict': {'total_nb_images': 3942, 'max_time_between_images': '0 days 83 seconds', 'coverage_pause': '0 days 7884 seconds', 'coverage_times_pause': '0 days 15768 seconds', 'nb_photos_decision': 3942, 'nb_gray_level_ok': 3942, 'nb_dedup_ok': 3942, 'nb_two_criteria_ok': 3942, 'nb_forced_upload': 0, 'end_of_day_photos_pink': 6, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3935, 'ratio_coverage': 0.13905007142983122}, 'dashboard_dict': {'nb_ptf_finished': 23, 'nb_images_finished': 521, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 32, 'nb_images_started': 658, 'nb_selected_images': 1179, 'last_update': '2022/08/28', 'portfolio_id': 6625129, 'last_run_id': 454388, 'total_number_of_photos': 3940}} No error ? {'log_dict': {'total_nb_images': 2, 'max_time_between_images': '0 days 2 seconds', 'coverage_pause': '0 days 2 seconds', 'coverage_times_pause': '0 days 4 seconds', 'nb_photos_decision': 3911, 'nb_gray_level_ok': 3910, 'nb_dedup_ok': 3911, 'nb_two_criteria_ok': 3910, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 5, 'end_of_day_photos_pink': 9, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3896, 'ratio_coverage': 3.527399072294044e-05}, 'dashboard_dict': {'nb_ptf_finished': 77, 'nb_images_finished': 1405, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 9, 'nb_images_started': 271, 'nb_selected_images': 1676, 'last_update': '2022/08/11', 'portfolio_id': 6612466, 'last_run_id': 454376, 'total_number_of_photos': 3920}} No error ? {'log_dict': {'total_nb_images': 4, 'max_time_between_images': '0 days 24740 seconds', 'coverage_pause': '0 days 4 seconds', 'coverage_times_pause': '0 days 8 seconds', 'nb_photos_decision': 3914, 'nb_gray_level_ok': 3912, 'nb_dedup_ok': 3913, 'nb_two_criteria_ok': 3911, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 2, 'end_of_day_photos_pink': 11, 'end_of_day_photos_duplicated': 1, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3899, 'ratio_coverage': 7.054798144588088e-05}, 'dashboard_dict': {'nb_ptf_finished': 66, 'nb_images_finished': 1291, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 9, 'nb_images_started': 226, 'nb_selected_images': 1517, 'last_update': '2022/08/02', 'portfolio_id': 6600066, 'last_run_id': 449271, 'total_number_of_photos': 3919}} No error ? {'log_dict': {'total_nb_images': 2984, 'max_time_between_images': '0 days 1044 seconds', 'coverage_pause': '0 days 3936 seconds', 'coverage_times_pause': '0 days 6834 seconds', 'nb_photos_decision': 11774, 'nb_gray_level_ok': 4617, 'nb_dedup_ok': 11773, 'nb_two_criteria_ok': 4616, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1498, 'end_of_day_photos_pink': 20, 'end_of_day_photos_dark': 5638, 'end_of_day_photos_duplicated': 1, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 181, 'end_of_day_photos_uploaded': 4415, 'ratio_coverage': 0.06941921374274679}, 'dashboard_dict': {'nb_ptf_finished': 19, 'nb_images_finished': 1263, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 10, 'nb_images_started': 564, 'nb_selected_images': 1827, 'last_update': '2022/09/01', 'portfolio_id': 6911337, 'last_run_id': 479886, 'total_number_of_photos': 4023}} No error ? {'log_dict': {'total_nb_images': 3320, 'max_time_between_images': '0 days 466 seconds', 'coverage_pause': '0 days 3320 seconds', 'coverage_times_pause': '0 days 6640 seconds', 'nb_photos_decision': 3929, 'nb_gray_level_ok': 911, 'nb_dedup_ok': 3929, 'nb_two_criteria_ok': 911, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1660, 'end_of_day_photos_pink': 2, 'end_of_day_photos_dark': 1357, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 909, 'ratio_coverage': 0.05855482460008113}, 'dashboard_dict': {'nb_ptf_finished': 28, 'nb_images_finished': 390, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 11, 'nb_images_started': 207, 'nb_selected_images': 597, 'last_update': '2022/09/01', 'portfolio_id': 6892921, 'last_run_id': 478927, 'total_number_of_photos': 909}} No error ? {'log_dict': {'total_nb_images': 4134, 'max_time_between_images': '0 days 315 seconds', 'coverage_pause': '0 days 4134 seconds', 'coverage_times_pause': '0 days 8268 seconds', 'nb_photos_decision': 3918, 'nb_gray_level_ok': 662, 'nb_dedup_ok': 3918, 'nb_two_criteria_ok': 662, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 2067, 'end_of_day_photos_dark': 1189, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 662, 'ratio_coverage': 0.07291133882431788}, 'dashboard_dict': {'nb_ptf_finished': 26, 'nb_images_finished': 389, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 4, 'nb_images_started': 74, 'nb_selected_images': 463, 'last_update': '2022/08/30', 'portfolio_id': 6880974, 'last_run_id': 477478, 'total_number_of_photos': 646}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 3626, 'max_time_between_images': '0 days 451 seconds', 'coverage_pause': '0 days 3626 seconds', 'coverage_times_pause': '0 days 7252 seconds', 'nb_photos_decision': 3921, 'nb_gray_level_ok': 1057, 'nb_dedup_ok': 3921, 'nb_two_criteria_ok': 1057, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1813, 'end_of_day_photos_pink': 1, 'end_of_day_photos_dark': 1050, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 1056, 'ratio_coverage': 0.06395174518069102}, 'dashboard_dict': {'nb_ptf_finished': 2, 'nb_images_finished': 28, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 28, 'last_update': '2022/08/27', 'portfolio_id': 6872937, 'last_run_id': 475306, 'total_number_of_photos': 1056}} No error ? {'log_dict': {'total_nb_images': 3668, 'max_time_between_images': '0 days 517 seconds', 'coverage_pause': '0 days 3668 seconds', 'coverage_times_pause': '0 days 7336 seconds', 'nb_photos_decision': 3920, 'nb_gray_level_ok': 1069, 'nb_dedup_ok': 3920, 'nb_two_criteria_ok': 1069, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1834, 'end_of_day_photos_pink': 2, 'end_of_day_photos_dark': 1016, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 1067, 'ratio_coverage': 0.06469249898587277}, 'dashboard_dict': {'nb_ptf_finished': 31, 'nb_images_finished': 537, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 8, 'nb_images_started': 163, 'nb_selected_images': 700, 'last_update': '2022/08/29', 'portfolio_id': 6865211, 'last_run_id': 474338, 'total_number_of_photos': 1067}} No error ? {'log_dict': {'total_nb_images': 3736, 'max_time_between_images': '0 days 436 seconds', 'coverage_pause': '0 days 3736 seconds', 'coverage_times_pause': '0 days 7472 seconds', 'nb_photos_decision': 3933, 'nb_gray_level_ok': 1059, 'nb_dedup_ok': 3933, 'nb_two_criteria_ok': 1059, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1868, 'end_of_day_photos_pink': 7, 'end_of_day_photos_dark': 1005, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 429, 'end_of_day_photos_uploaded': 623, 'ratio_coverage': 0.06589181467045274}, 'dashboard_dict': {'nb_ptf_finished': 16, 'nb_images_finished': 264, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 25, 'nb_images_started': 480, 'nb_selected_images': 744, 'last_update': '2022/08/29', 'portfolio_id': 6858102, 'last_run_id': 474755, 'total_number_of_photos': 1052}} No error ? {'log_dict': {'total_nb_images': 3798, 'max_time_between_images': '0 days 511 seconds', 'coverage_pause': '0 days 3798 seconds', 'coverage_times_pause': '0 days 7596 seconds', 'nb_photos_decision': 3925, 'nb_gray_level_ok': 1034, 'nb_dedup_ok': 3925, 'nb_two_criteria_ok': 1034, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1899, 'end_of_day_photos_pink': 1, 'end_of_day_photos_dark': 991, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 1033, 'ratio_coverage': 0.0669853083828639}, 'dashboard_dict': {'nb_ptf_finished': 35, 'nb_images_finished': 576, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 7, 'nb_images_started': 137, 'nb_selected_images': 713, 'last_update': '2022/08/25', 'portfolio_id': 6845170, 'last_run_id': 472189, 'total_number_of_photos': 1033}} No error ? {'log_dict': {'total_nb_images': 4136, 'max_time_between_images': '0 days 502 seconds', 'coverage_pause': '0 days 4116 seconds', 'coverage_times_pause': '0 days 8232 seconds', 'nb_photos_decision': 3924, 'nb_gray_level_ok': 905, 'nb_dedup_ok': 3924, 'nb_two_criteria_ok': 905, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 2058, 'end_of_day_photos_pink': 7, 'end_of_day_photos_dark': 960, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 898, 'ratio_coverage': 0.07259387290781143}, 'dashboard_dict': {'nb_ptf_finished': 32, 'nb_images_finished': 494, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 8, 'nb_images_started': 156, 'nb_selected_images': 650, 'last_update': '2022/08/26', 'portfolio_id': 6830485, 'last_run_id': 470781, 'total_number_of_photos': 898}} No error ? {'log_dict': {'total_nb_images': 2568, 'max_time_between_images': '0 days 449 seconds', 'coverage_pause': '0 days 2568 seconds', 'coverage_times_pause': '0 days 5136 seconds', 'nb_photos_decision': 3916, 'nb_gray_level_ok': 2076, 'nb_dedup_ok': 3916, 'nb_two_criteria_ok': 2076, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1284, 'end_of_day_photos_pink': 5, 'end_of_day_photos_dark': 556, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 2071, 'ratio_coverage': 0.045291804088255526}, 'dashboard_dict': {'nb_ptf_finished': 45, 'nb_images_finished': 714, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 8, 'nb_images_started': 216, 'nb_selected_images': 930, 'last_update': '2022/08/23', 'portfolio_id': 6811061, 'last_run_id': 469411, 'total_number_of_photos': 2075}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 6, 'max_time_between_images': '0 days 7064 seconds', 'coverage_pause': '0 days 6 seconds', 'coverage_times_pause': '0 days 12 seconds', 'nb_photos_decision': 3931, 'nb_gray_level_ok': 3928, 'nb_dedup_ok': 3931, 'nb_two_criteria_ok': 3928, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 7, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3923, 'ratio_coverage': 0.00010582197216882132}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'last_update': '2022/08/20', 'portfolio_id': 6800521, 'last_run_id': 465870, 'total_number_of_photos': 3931}} No error ? {'log_dict': {'total_nb_images': 8, 'max_time_between_images': '0 days 22258 seconds', 'coverage_pause': '0 days 8 seconds', 'coverage_times_pause': '0 days 16 seconds', 'nb_photos_decision': 3935, 'nb_gray_level_ok': 3931, 'nb_dedup_ok': 3935, 'nb_two_criteria_ok': 3931, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 4, 'end_of_day_photos_pink': 5, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3925, 'ratio_coverage': 0.00014109596289176176}, 'dashboard_dict': {'nb_ptf_finished': 55, 'nb_images_finished': 1095, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 9, 'nb_images_started': 225, 'nb_selected_images': 1320, 'last_update': '2022/08/21', 'portfolio_id': 6785173, 'last_run_id': 464885, 'total_number_of_photos': 3940}} No error ? {'log_dict': {'total_nb_images': 6, 'max_time_between_images': '0 days 13249 seconds', 'coverage_pause': '0 days 6 seconds', 'coverage_times_pause': '0 days 12 seconds', 'nb_photos_decision': 3940, 'nb_gray_level_ok': 3937, 'nb_dedup_ok': 3940, 'nb_two_criteria_ok': 3937, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 3, 'end_of_day_photos_pink': 6, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 893, 'end_of_day_photos_uploaded': 3037, 'ratio_coverage': 0.00010582197216882132}, 'dashboard_dict': {'nb_ptf_finished': 62, 'nb_images_finished': 1227, 'nb_ptf_finished_for_older': 1, 'nb_images_finished_for_older': 101, 'nb_ptf_started': 11, 'nb_images_started': 275, 'nb_selected_images': 1603, 'last_update': '2022/08/21', 'portfolio_id': 6771154, 'last_run_id': 463490, 'total_number_of_photos': 4063}} No error ? {'log_dict': {'total_nb_images': 10, 'max_time_between_images': '0 days 21811 seconds', 'coverage_pause': '0 days 10 seconds', 'coverage_times_pause': '0 days 20 seconds', 'nb_photos_decision': 3939, 'nb_gray_level_ok': 3934, 'nb_dedup_ok': 3939, 'nb_two_criteria_ok': 3934, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 5, 'end_of_day_photos_pink': 3, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3930, 'ratio_coverage': 0.0001763699536147022}, 'dashboard_dict': {'nb_ptf_finished': 54, 'nb_images_finished': 1122, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 18, 'nb_images_started': 344, 'nb_selected_images': 1466, 'last_update': '2022/08/22', 'portfolio_id': 6756941, 'last_run_id': 462392, 'total_number_of_photos': 3931}} No error ? {'log_dict': {'total_nb_images': 3946, 'max_time_between_images': '0 days 90 seconds', 'coverage_pause': '0 days 7892 seconds', 'coverage_times_pause': '0 days 15784 seconds', 'nb_photos_decision': 3946, 'nb_gray_level_ok': 3946, 'nb_dedup_ok': 3946, 'nb_two_criteria_ok': 3946, 'nb_forced_upload': 0, 'end_of_day_photos_pink': 4, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3941, 'ratio_coverage': 0.13919116739272297}, 'dashboard_dict': {'nb_ptf_finished': 69, 'nb_images_finished': 1402, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 13, 'nb_images_started': 331, 'nb_selected_images': 1733, 'last_update': '2022/08/22', 'portfolio_id': 6738801, 'last_run_id': 461074, 'total_number_of_photos': 3942}} No error ? {'log_dict': {'total_nb_images': 4, 'max_time_between_images': '0 days 1677 seconds', 'coverage_pause': '0 days 4 seconds', 'coverage_times_pause': '0 days 8 seconds', 'nb_photos_decision': 3936, 'nb_gray_level_ok': 3934, 'nb_dedup_ok': 3935, 'nb_two_criteria_ok': 3933, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 2, 'end_of_day_photos_pink': 6, 'end_of_day_photos_duplicated': 1, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 3526, 'end_of_day_photos_uploaded': 405, 'ratio_coverage': 7.054798144588088e-05}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 4, 'nb_images_started': 127, 'nb_selected_images': 127, 'last_update': '2022/08/22', 'portfolio_id': 6736624, 'last_run_id': 459828, 'total_number_of_photos': 3932}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 2, 'max_time_between_images': '0 days 2 seconds', 'coverage_pause': '0 days 2 seconds', 'coverage_times_pause': '0 days 4 seconds', 'nb_photos_decision': 3939, 'nb_gray_level_ok': 3938, 'nb_dedup_ok': 3938, 'nb_two_criteria_ok': 3937, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1, 'end_of_day_photos_pink': 10, 'end_of_day_photos_duplicated': 1, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3926, 'ratio_coverage': 3.527399072294044e-05}, 'dashboard_dict': {'nb_ptf_finished': 62, 'nb_images_finished': 1156, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 14, 'nb_images_started': 330, 'nb_selected_images': 1486, 'last_update': '2022/08/14', 'portfolio_id': 6714370, 'last_run_id': 457640, 'total_number_of_photos': 3926}} No error ? {'log_dict': {'total_nb_images': 4, 'max_time_between_images': '0 days 3519 seconds', 'coverage_pause': '0 days 4 seconds', 'coverage_times_pause': '0 days 8 seconds', 'nb_photos_decision': 2477, 'nb_gray_level_ok': 2475, 'nb_dedup_ok': 2477, 'nb_two_criteria_ok': 2475, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 2, 'end_of_day_photos_pink': 4, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 300, 'end_of_day_photos_uploaded': 2170, 'ratio_coverage': 7.054798144588088e-05}, 'dashboard_dict': {'nb_ptf_finished': 39, 'nb_images_finished': 747, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 7, 'nb_images_started': 169, 'nb_selected_images': 916, 'last_update': '2022/08/13', 'portfolio_id': 6703539, 'last_run_id': 456478, 'total_number_of_photos': 2475}} No error ? {'log_dict': {'total_nb_images': 8, 'max_time_between_images': '0 days 28998 seconds', 'coverage_pause': '0 days 8 seconds', 'coverage_times_pause': '0 days 16 seconds', 'nb_photos_decision': 3935, 'nb_gray_level_ok': 3931, 'nb_dedup_ok': 3934, 'nb_two_criteria_ok': 3930, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 4, 'end_of_day_photos_pink': 6, 'end_of_day_photos_duplicated': 1, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3923, 'ratio_coverage': 0.00014109596289176176}, 'dashboard_dict': {'nb_ptf_finished': 56, 'nb_images_finished': 1043, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 28, 'nb_images_started': 588, 'nb_selected_images': 1631, 'last_update': '2022/08/28', 'portfolio_id': 6680169, 'last_run_id': 455185, 'total_number_of_photos': 3940}} No error ? {'log_dict': {'total_nb_images': 2, 'max_time_between_images': '0 days 2 seconds', 'coverage_pause': '0 days 2 seconds', 'coverage_times_pause': '0 days 4 seconds', 'nb_photos_decision': 3940, 'nb_gray_level_ok': 3939, 'nb_dedup_ok': 3940, 'nb_two_criteria_ok': 3939, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 2, 'end_of_day_photos_pink': 7, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3931, 'ratio_coverage': 3.527399072294044e-05}, 'dashboard_dict': {'nb_ptf_finished': 56, 'nb_images_finished': 1036, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 9, 'nb_images_started': 227, 'nb_selected_images': 1263, 'last_update': '2022/08/29', 'portfolio_id': 6662197, 'last_run_id': 468274, 'total_number_of_photos': 3932}} No error ? {'log_dict': {'total_nb_images': 2, 'max_time_between_images': '0 days 2 seconds', 'coverage_pause': '0 days 2 seconds', 'coverage_times_pause': '0 days 4 seconds', 'nb_photos_decision': 3934, 'nb_gray_level_ok': 3933, 'nb_dedup_ok': 3933, 'nb_two_criteria_ok': 3932, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1, 'end_of_day_photos_pink': 6, 'end_of_day_photos_duplicated': 1, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3925, 'ratio_coverage': 3.527399072294044e-05}, 'dashboard_dict': {'nb_ptf_finished': 48, 'nb_images_finished': 929, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 22, 'nb_images_started': 429, 'nb_selected_images': 1358, 'last_update': '2022/08/21', 'portfolio_id': 6645254, 'last_run_id': 452689, 'total_number_of_photos': 3938}} No error ? {'log_dict': {'total_nb_images': 3933, 'max_time_between_images': '0 days 84 seconds', 'coverage_pause': '0 days 7866 seconds', 'coverage_times_pause': '0 days 15732 seconds', 'nb_photos_decision': 3932, 'nb_gray_level_ok': 3932, 'nb_dedup_ok': 3931, 'nb_two_criteria_ok': 3931, 'nb_forced_upload': 0, 'end_of_day_photos_pink': 11, 'end_of_day_photos_duplicated': 1, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3920, 'ratio_coverage': 0.13873260551332475}, 'dashboard_dict': {'nb_ptf_finished': 45, 'nb_images_finished': 803, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 28, 'nb_images_started': 730, 'nb_selected_images': 1533, 'last_update': '2022/09/01', 'portfolio_id': 6633492, 'last_run_id': 451519, 'total_number_of_photos': 3925}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 3936, 'max_time_between_images': '0 days 82 seconds', 'coverage_pause': '0 days 7872 seconds', 'coverage_times_pause': '0 days 15744 seconds', 'nb_photos_decision': 3936, 'nb_gray_level_ok': 3936, 'nb_dedup_ok': 3936, 'nb_two_criteria_ok': 3936, 'nb_forced_upload': 0, 'end_of_day_photos_pink': 10, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3925, 'ratio_coverage': 0.13883842748549358}, 'dashboard_dict': {'nb_ptf_finished': 34, 'nb_images_finished': 568, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 49, 'nb_images_started': 940, 'nb_selected_images': 1508, 'last_update': '2022/08/24', 'portfolio_id': 6632462, 'last_run_id': 454424, 'total_number_of_photos': 3926}} No error ? {'log_dict': {'total_nb_images': 2, 'max_time_between_images': '0 days 2 seconds', 'coverage_pause': '0 days 2 seconds', 'coverage_times_pause': '0 days 4 seconds', 'nb_photos_decision': 3939, 'nb_gray_level_ok': 3938, 'nb_dedup_ok': 3939, 'nb_two_criteria_ok': 3938, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1, 'end_of_day_photos_pink': 11, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3926, 'ratio_coverage': 3.527399072294044e-05}, 'dashboard_dict': {'nb_ptf_finished': 66, 'nb_images_finished': 1181, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 10, 'nb_images_started': 258, 'nb_selected_images': 1439, 'last_update': '2022/08/17', 'portfolio_id': 6630409, 'last_run_id': 454399, 'total_number_of_photos': 3928}} No error ? {'log_dict': {'total_nb_images': 2, 'max_time_between_images': '0 days 2 seconds', 'coverage_pause': '0 days 2 seconds', 'coverage_times_pause': '0 days 4 seconds', 'nb_photos_decision': 3941, 'nb_gray_level_ok': 3940, 'nb_dedup_ok': 3941, 'nb_two_criteria_ok': 3940, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1, 'end_of_day_photos_pink': 9, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3930, 'ratio_coverage': 3.527399072294044e-05}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 40, 'nb_images_started': 797, 'nb_selected_images': 797, 'last_update': '2022/08/24', 'portfolio_id': 6629944, 'last_run_id': 454411, 'total_number_of_photos': 3979}} No error ? {'log_dict': {'total_nb_images': 3942, 'max_time_between_images': '0 days 83 seconds', 'coverage_pause': '0 days 7884 seconds', 'coverage_times_pause': '0 days 15768 seconds', 'nb_photos_decision': 3942, 'nb_gray_level_ok': 3942, 'nb_dedup_ok': 3942, 'nb_two_criteria_ok': 3942, 'nb_forced_upload': 0, 'end_of_day_photos_pink': 6, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3935, 'ratio_coverage': 0.13905007142983122}, 'dashboard_dict': {'nb_ptf_finished': 23, 'nb_images_finished': 521, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 32, 'nb_images_started': 658, 'nb_selected_images': 1179, 'last_update': '2022/08/28', 'portfolio_id': 6625129, 'last_run_id': 454388, 'total_number_of_photos': 3940}} No error ? {'log_dict': {'total_nb_images': 2, 'max_time_between_images': '0 days 2 seconds', 'coverage_pause': '0 days 2 seconds', 'coverage_times_pause': '0 days 4 seconds', 'nb_photos_decision': 3911, 'nb_gray_level_ok': 3910, 'nb_dedup_ok': 3911, 'nb_two_criteria_ok': 3910, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 5, 'end_of_day_photos_pink': 9, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3896, 'ratio_coverage': 3.527399072294044e-05}, 'dashboard_dict': {'nb_ptf_finished': 77, 'nb_images_finished': 1405, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 9, 'nb_images_started': 271, 'nb_selected_images': 1676, 'last_update': '2022/08/11', 'portfolio_id': 6612466, 'last_run_id': 454376, 'total_number_of_photos': 3920}} No error ? {'log_dict': {'total_nb_images': 4, 'max_time_between_images': '0 days 24740 seconds', 'coverage_pause': '0 days 4 seconds', 'coverage_times_pause': '0 days 8 seconds', 'nb_photos_decision': 3914, 'nb_gray_level_ok': 3912, 'nb_dedup_ok': 3913, 'nb_two_criteria_ok': 3911, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 2, 'end_of_day_photos_pink': 11, 'end_of_day_photos_duplicated': 1, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3899, 'ratio_coverage': 7.054798144588088e-05}, 'dashboard_dict': {'nb_ptf_finished': 66, 'nb_images_finished': 1291, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 9, 'nb_images_started': 226, 'nb_selected_images': 1517, 'last_update': '2022/08/02', 'portfolio_id': 6600066, 'last_run_id': 449271, 'total_number_of_photos': 3919}} No error ? {'log_dict': {'total_nb_images': 3668, 'max_time_between_images': '0 days 517 seconds', 'coverage_pause': '0 days 3668 seconds', 'coverage_times_pause': '0 days 7336 seconds', 'nb_photos_decision': 3920, 'nb_gray_level_ok': 1069, 'nb_dedup_ok': 3920, 'nb_two_criteria_ok': 1069, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1834, 'end_of_day_photos_pink': 2, 'end_of_day_photos_dark': 1016, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 1067, 'ratio_coverage': 0.06469249898587277}, 'dashboard_dict': {'nb_ptf_finished': 31, 'nb_images_finished': 537, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 8, 'nb_images_started': 163, 'nb_selected_images': 700, 'last_update': '2022/08/27', 'portfolio_id': 6865211, 'last_run_id': 474338, 'total_number_of_photos': 1067}} No error ? {'log_dict': {'total_nb_images': 3798, 'max_time_between_images': '0 days 511 seconds', 'coverage_pause': '0 days 3798 seconds', 'coverage_times_pause': '0 days 7596 seconds', 'nb_photos_decision': 3925, 'nb_gray_level_ok': 1034, 'nb_dedup_ok': 3925, 'nb_two_criteria_ok': 1034, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1899, 'end_of_day_photos_pink': 1, 'end_of_day_photos_dark': 991, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 1033, 'ratio_coverage': 0.0669853083828639}, 'dashboard_dict': {'nb_ptf_finished': 35, 'nb_images_finished': 576, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 7, 'nb_images_started': 137, 'nb_selected_images': 713, 'last_update': '2022/08/25', 'portfolio_id': 6845170, 'last_run_id': 472123, 'total_number_of_photos': 1033}} No error ? {'log_dict': {'total_nb_images': 4136, 'max_time_between_images': '0 days 502 seconds', 'coverage_pause': '0 days 4116 seconds', 'coverage_times_pause': '0 days 8232 seconds', 'nb_photos_decision': 3924, 'nb_gray_level_ok': 905, 'nb_dedup_ok': 3924, 'nb_two_criteria_ok': 905, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 2058, 'end_of_day_photos_pink': 7, 'end_of_day_photos_dark': 960, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 898, 'ratio_coverage': 0.07259387290781143}, 'dashboard_dict': {'nb_ptf_finished': 32, 'nb_images_finished': 494, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 8, 'nb_images_started': 156, 'nb_selected_images': 650, 'last_update': '2022/08/24', 'portfolio_id': 6830485, 'last_run_id': 470724, 'total_number_of_photos': 898}} No error ? {'log_dict': {'total_nb_images': 2568, 'max_time_between_images': '0 days 449 seconds', 'coverage_pause': '0 days 2568 seconds', 'coverage_times_pause': '0 days 5136 seconds', 'nb_photos_decision': 3916, 'nb_gray_level_ok': 2076, 'nb_dedup_ok': 3916, 'nb_two_criteria_ok': 2076, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1284, 'end_of_day_photos_pink': 5, 'end_of_day_photos_dark': 556, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 2071, 'ratio_coverage': 0.045291804088255526}, 'dashboard_dict': {'nb_ptf_finished': 45, 'nb_images_finished': 714, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 8, 'nb_images_started': 216, 'nb_selected_images': 930, 'last_update': '2022/08/23', 'portfolio_id': 6811061, 'last_run_id': 469344, 'total_number_of_photos': 2075}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 8, 'max_time_between_images': '0 days 22258 seconds', 'coverage_pause': '0 days 8 seconds', 'coverage_times_pause': '0 days 16 seconds', 'nb_photos_decision': 3935, 'nb_gray_level_ok': 3931, 'nb_dedup_ok': 3935, 'nb_two_criteria_ok': 3931, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 4, 'end_of_day_photos_pink': 5, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3925, 'ratio_coverage': 0.00014109596289176176}, 'dashboard_dict': {'nb_ptf_finished': 55, 'nb_images_finished': 1095, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 9, 'nb_images_started': 225, 'nb_selected_images': 1320, 'last_update': '2022/08/20', 'portfolio_id': 6785173, 'last_run_id': 464819, 'total_number_of_photos': 3939}} No error ? {'log_dict': {'total_nb_images': 6, 'max_time_between_images': '0 days 13249 seconds', 'coverage_pause': '0 days 6 seconds', 'coverage_times_pause': '0 days 12 seconds', 'nb_photos_decision': 3940, 'nb_gray_level_ok': 3937, 'nb_dedup_ok': 3940, 'nb_two_criteria_ok': 3937, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 3, 'end_of_day_photos_pink': 6, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 893, 'end_of_day_photos_uploaded': 3037, 'ratio_coverage': 0.00010582197216882132}, 'dashboard_dict': {'nb_ptf_finished': 58, 'nb_images_finished': 1089, 'nb_ptf_finished_for_older': 1, 'nb_images_finished_for_older': 101, 'nb_ptf_started': 15, 'nb_images_started': 413, 'nb_selected_images': 1603, 'last_update': '2022/08/19', 'portfolio_id': 6771154, 'last_run_id': 463447, 'total_number_of_photos': 4062}} No error ? {'log_dict': {'total_nb_images': 10, 'max_time_between_images': '0 days 21811 seconds', 'coverage_pause': '0 days 10 seconds', 'coverage_times_pause': '0 days 20 seconds', 'nb_photos_decision': 3939, 'nb_gray_level_ok': 3934, 'nb_dedup_ok': 3939, 'nb_two_criteria_ok': 3934, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 5, 'end_of_day_photos_pink': 3, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3930, 'ratio_coverage': 0.0001763699536147022}, 'dashboard_dict': {'nb_ptf_finished': 54, 'nb_images_finished': 1122, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 18, 'nb_images_started': 344, 'nb_selected_images': 1466, 'last_update': '2022/08/18', 'portfolio_id': 6756941, 'last_run_id': 462344, 'total_number_of_photos': 3930}} No error ? {'log_dict': {'total_nb_images': 3946, 'max_time_between_images': '0 days 90 seconds', 'coverage_pause': '0 days 7892 seconds', 'coverage_times_pause': '0 days 15784 seconds', 'nb_photos_decision': 3946, 'nb_gray_level_ok': 3946, 'nb_dedup_ok': 3946, 'nb_two_criteria_ok': 3946, 'nb_forced_upload': 0, 'end_of_day_photos_pink': 4, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3941, 'ratio_coverage': 0.13919116739272297}, 'dashboard_dict': {'nb_ptf_finished': 68, 'nb_images_finished': 1390, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 14, 'nb_images_started': 343, 'nb_selected_images': 1733, 'last_update': '2022/08/17', 'portfolio_id': 6738801, 'last_run_id': 461015, 'total_number_of_photos': 3941}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 2, 'max_time_between_images': '0 days 2 seconds', 'coverage_pause': '0 days 2 seconds', 'coverage_times_pause': '0 days 4 seconds', 'nb_photos_decision': 3939, 'nb_gray_level_ok': 3938, 'nb_dedup_ok': 3938, 'nb_two_criteria_ok': 3937, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1, 'end_of_day_photos_pink': 10, 'end_of_day_photos_duplicated': 1, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3926, 'ratio_coverage': 3.527399072294044e-05}, 'dashboard_dict': {'nb_ptf_finished': 62, 'nb_images_finished': 1156, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 14, 'nb_images_started': 330, 'nb_selected_images': 1486, 'last_update': '2022/08/14', 'portfolio_id': 6714370, 'last_run_id': 457640, 'total_number_of_photos': 3926}} No error ? {'log_dict': {'total_nb_images': 4, 'max_time_between_images': '0 days 3519 seconds', 'coverage_pause': '0 days 4 seconds', 'coverage_times_pause': '0 days 8 seconds', 'nb_photos_decision': 2477, 'nb_gray_level_ok': 2475, 'nb_dedup_ok': 2477, 'nb_two_criteria_ok': 2475, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 2, 'end_of_day_photos_pink': 4, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 300, 'end_of_day_photos_uploaded': 2170, 'ratio_coverage': 7.054798144588088e-05}, 'dashboard_dict': {'nb_ptf_finished': 39, 'nb_images_finished': 747, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 7, 'nb_images_started': 169, 'nb_selected_images': 916, 'last_update': '2022/08/13', 'portfolio_id': 6703539, 'last_run_id': 456478, 'total_number_of_photos': 2474}} No error ? {'log_dict': {'total_nb_images': 8, 'max_time_between_images': '0 days 28998 seconds', 'coverage_pause': '0 days 8 seconds', 'coverage_times_pause': '0 days 16 seconds', 'nb_photos_decision': 3935, 'nb_gray_level_ok': 3931, 'nb_dedup_ok': 3934, 'nb_two_criteria_ok': 3930, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 4, 'end_of_day_photos_pink': 6, 'end_of_day_photos_duplicated': 1, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3923, 'ratio_coverage': 0.00014109596289176176}, 'dashboard_dict': {'nb_ptf_finished': 51, 'nb_images_finished': 864, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 33, 'nb_images_started': 767, 'nb_selected_images': 1631, 'last_update': '2022/08/12', 'portfolio_id': 6680169, 'last_run_id': 455143, 'total_number_of_photos': 3939}} No error ? {'log_dict': {'total_nb_images': 2, 'max_time_between_images': '0 days 2 seconds', 'coverage_pause': '0 days 2 seconds', 'coverage_times_pause': '0 days 4 seconds', 'nb_photos_decision': 3940, 'nb_gray_level_ok': 3939, 'nb_dedup_ok': 3940, 'nb_two_criteria_ok': 3939, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 2, 'end_of_day_photos_pink': 7, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3931, 'ratio_coverage': 3.527399072294044e-05}, 'dashboard_dict': {'nb_ptf_finished': 48, 'nb_images_finished': 856, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 17, 'nb_images_started': 407, 'nb_selected_images': 1263, 'last_update': '2022/08/11', 'portfolio_id': 6662197, 'last_run_id': 453977, 'total_number_of_photos': 3931}} No error ? {'log_dict': {'total_nb_images': 2, 'max_time_between_images': '0 days 2 seconds', 'coverage_pause': '0 days 2 seconds', 'coverage_times_pause': '0 days 4 seconds', 'nb_photos_decision': 3934, 'nb_gray_level_ok': 3933, 'nb_dedup_ok': 3933, 'nb_two_criteria_ok': 3932, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1, 'end_of_day_photos_pink': 6, 'end_of_day_photos_duplicated': 1, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3925, 'ratio_coverage': 3.527399072294044e-05}, 'dashboard_dict': {'nb_ptf_finished': 48, 'nb_images_finished': 929, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 22, 'nb_images_started': 429, 'nb_selected_images': 1358, 'last_update': '2022/08/10', 'portfolio_id': 6645254, 'last_run_id': 452640, 'total_number_of_photos': 3937}} No error ? {'log_dict': {'total_nb_images': 2, 'max_time_between_images': '0 days 2 seconds', 'coverage_pause': '0 days 2 seconds', 'coverage_times_pause': '0 days 4 seconds', 'nb_photos_decision': 3939, 'nb_gray_level_ok': 3938, 'nb_dedup_ok': 3939, 'nb_two_criteria_ok': 3938, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1, 'end_of_day_photos_pink': 11, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3926, 'ratio_coverage': 3.527399072294044e-05}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 76, 'nb_images_started': 1439, 'nb_selected_images': 1439, 'last_update': '2022/08/06', 'portfolio_id': 6630409, 'last_run_id': 450661, 'total_number_of_photos': 3927}} No error ? {'log_dict': {'total_nb_images': 2, 'max_time_between_images': '0 days 2 seconds', 'coverage_pause': '0 days 2 seconds', 'coverage_times_pause': '0 days 4 seconds', 'nb_photos_decision': 3911, 'nb_gray_level_ok': 3910, 'nb_dedup_ok': 3911, 'nb_two_criteria_ok': 3910, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 5, 'end_of_day_photos_pink': 9, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3896, 'ratio_coverage': 3.527399072294044e-05}, 'dashboard_dict': {'nb_ptf_finished': 77, 'nb_images_finished': 1405, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 9, 'nb_images_started': 271, 'nb_selected_images': 1676, 'last_update': '2022/08/03', 'portfolio_id': 6612466, 'last_run_id': 450107, 'total_number_of_photos': 3919}} No error ? {'log_dict': {'total_nb_images': 4, 'max_time_between_images': '0 days 24740 seconds', 'coverage_pause': '0 days 4 seconds', 'coverage_times_pause': '0 days 8 seconds', 'nb_photos_decision': 3914, 'nb_gray_level_ok': 3912, 'nb_dedup_ok': 3913, 'nb_two_criteria_ok': 3911, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 2, 'end_of_day_photos_pink': 11, 'end_of_day_photos_duplicated': 1, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3899, 'ratio_coverage': 7.054798144588088e-05}, 'dashboard_dict': {'nb_ptf_finished': 66, 'nb_images_finished': 1291, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 9, 'nb_images_started': 226, 'nb_selected_images': 1517, 'last_update': '2022/08/02', 'portfolio_id': 6600066, 'last_run_id': 449257, 'total_number_of_photos': 3918}} Found day : 2022-08-31 00:00:00 Found day : 2022-08-30 00:00:00 Found day : 2022-08-29 00:00:00 Found day : 2022-08-27 00:00:00 Found day : 2022-08-26 00:00:00 Found day : 2022-08-25 00:00:00 Found day : 2022-08-24 00:00:00 Found day : 2022-08-23 00:00:00 Found day : 2022-08-22 00:00:00 Found day : 2022-08-20 00:00:00 Found day : 2022-08-19 00:00:00 Found day : 2022-08-18 00:00:00 Found day : 2022-08-17 00:00:00 Found day : 2022-08-16 00:00:00 Found day : 2022-08-15 00:00:00 Found day : 2022-08-13 00:00:00 Found day : 2022-08-12 00:00:00 Found day : 2022-08-11 00:00:00 Found day : 2022-08-10 00:00:00 Found day : 2022-08-09 00:00:00 Found day : 2022-08-08 00:00:00 Found day : 2022-08-06 00:00:00 Found day : 2022-08-05 00:00:00 Found day : 2022-08-04 00:00:00 Found day : 2022-08-03 00:00:00 Found day : 2022-08-02 00:00:00 Found day : 2022-08-01 00:00:00 after coverage_data SELECT DATE(date_debut) as date, sum(qualite*nombre_balle)/sum(nombre_balle), count(distinct mtr_photo_id) FROM MTRPhoto.dashboard_results dr, MTRUser.mtr_portfolio_photos mpp, MTRPhoto.dashboard_entry_day ded where mpp.mtr_portfolio_id=dr.mtr_portfolio_id and ded.dashboard_place_id = 53 and month(ded.date) = 08 and year(ded.date) = 2022 and dr.dashboard_run_id=ded.last_run_id and dr.qualite>=0 GROUP BY ded.date order by dr.date_debut; SELECT DATE(date_debut) as date, sum(qualite*nombre_balle)/sum(nombre_balle), count(distinct mtr_photo_id) FROM MTRPhoto.dashboard_results dr, MTRUser.mtr_portfolio_photos mpp, MTRPhoto.dashboard_entry_day ded where mpp.mtr_portfolio_id=dr.mtr_portfolio_id and dr.hashtag = '_______emr' and ded.dashboard_place_id = 53 and month(ded.date) = 08 and year(ded.date) = 2022 and dr.dashboard_run_id=ded.last_run_id and dr.qualite>=0 GROUP BY ded.date order by dr.date_debut; SELECT DATE(date_debut) as date, sum(qualite*nombre_balle)/sum(nombre_balle), count(distinct mtr_photo_id) FROM MTRPhoto.dashboard_results dr, MTRUser.mtr_portfolio_photos mpp, MTRPhoto.dashboard_entry_day ded where mpp.mtr_portfolio_id=dr.mtr_portfolio_id and dr.hashtag = '_______jrm' and ded.dashboard_place_id = 53 and month(ded.date) = 08 and year(ded.date) = 2022 and dr.dashboard_run_id=ded.last_run_id and dr.qualite>=0 GROUP BY ded.date order by dr.date_debut; SELECT DATE(date_debut) as date, sum(qualite*nombre_balle)/sum(nombre_balle), count(distinct mtr_photo_id) FROM MTRPhoto.dashboard_results dr, MTRUser.mtr_portfolio_photos mpp, MTRPhoto.dashboard_entry_day ded where mpp.mtr_portfolio_id=dr.mtr_portfolio_id and dr.hashtag = '_______aluminium' and ded.dashboard_place_id = 53 and month(ded.date) = 08 and year(ded.date) = 2022 and dr.dashboard_run_id=ded.last_run_id and dr.qualite>=0 GROUP BY ded.date order by dr.date_debut; SELECT DATE(date_debut) as date, sum(qualite*nombre_balle)/sum(nombre_balle), count(distinct mtr_photo_id) FROM MTRPhoto.dashboard_results dr, MTRUser.mtr_portfolio_photos mpp, MTRPhoto.dashboard_entry_day ded where mpp.mtr_portfolio_id=dr.mtr_portfolio_id and dr.hashtag = '_______pet_fonce' and ded.dashboard_place_id = 53 and month(ded.date) = 08 and year(ded.date) = 2022 and dr.dashboard_run_id=ded.last_run_id and dr.qualite>=0 GROUP BY ded.date order by dr.date_debut; SELECT DATE(date_debut) as date, sum(qualite*nombre_balle)/sum(nombre_balle), count(distinct mtr_photo_id) FROM MTRPhoto.dashboard_results dr, MTRUser.mtr_portfolio_photos mpp, MTRPhoto.dashboard_entry_day ded where mpp.mtr_portfolio_id=dr.mtr_portfolio_id and dr.hashtag = '_______gm' and ded.dashboard_place_id = 53 and month(ded.date) = 08 and year(ded.date) = 2022 and dr.dashboard_run_id=ded.last_run_id and dr.qualite>=0 GROUP BY ded.date order by dr.date_debut; select avg(cps.score) as score, SUBSTRING_INDEX(SUBSTRING_INDEX(mp.name,'__', -1), '_', 1) as sbstr, SUBSTRING_INDEX(SUBSTRING_INDEX(mp.name,'_', -2), '_', 1) as sbstr2, SUBSTRING_INDEX(mp.name,'_', -1) as sbstr3 FROM MTRUser.mtr_portfolio_photos mpp, MTRUser.mtr_portfolios mp,MTRPhoto.class_photo_score cps,MTRBack.hashtags h,MTRPhoto.dashboard_results dr,MTRPhoto.dashboard_entry_day ded, MTRPhoto.dashboard_places dp WHERE mp.id=mpp.mtr_portfolio_id and cps.photo_id=mpp.mtr_photo_id and h.hashtag_id=cps.hashtag_id and dr.mtr_portfolio_id = mpp.mtr_portfolio_id and dr.dashboard_run_id = ded.last_run_id and ded.dashboard_place_id = dp.id and h.hashtag in ('blur', 'mean_blur', 'clear') and dp.id = 53 and mp.name like '%082022%' and cps.thcl = 1533 GROUP BY sbstr ; after number_of_batch date_start : 2022-08-01 : dt_date_just_month_year : 2022-08-01 00:00:00 : VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! after pl.get_datou_sts_from_crontab : verbose : True no sts found, try to find from database SELECT dri.id FROM MTRPhoto.dashboard_run_ids dri, MTRPhoto.dashboard_entry_day ded, MTRPhoto.dashboard_places dp WHERE dp.name= "Romainville_Presse_1" AND ded.dashboard_place_id=dp.id AND dri.dashboard_entry_day=ded.id AND dri.id=ded.last_run_id AND ded.date >= "2022-08-01" AND ded.date <= "2022-08-31" apple3 {'gm': {'mat': 'gm', 'pht': 4209, 'datou_carac_id': 3994, 'unwanted_material': [], 'hashtag_majoritaire_from_carac': 'papier,background'}, 'emr': {'mat': 'emr', 'pht': 4207, 'datou_carac_id': 3993, 'unwanted_material': [], 'hashtag_majoritaire_from_carac': 'carton,background'}, 'jrm': {'mat': 'jrm', 'pht': 3726, 'datou_carac_id': 3459, 'unwanted_material': [], 'hashtag_majoritaire_from_carac': 'papier,background'}, 'ela': {'mat': 'ela', 'pht': 4203, 'datou_carac_id': 3991, 'unwanted_material': [], 'hashtag_majoritaire_from_carac': 'ela,background'}, 'pet_clair': {'mat': 'pet_clair', 'pht': 3327, 'datou_carac_id': 3804, 'unwanted_material': [], 'hashtag_majoritaire_from_carac': 'pet_clair,bouchon,etiquette,barquette_avec_film,background'}, 'film_pedb': {'mat': 'film_pedb', 'pht': 4461, 'datou_carac_id': 4322, 'unwanted_material': [], 'hashtag_majoritaire_from_carac': 'film_plastique'}, 'pehd_pp': {'mat': 'pehd_pp', 'pht': 4211, 'datou_carac_id': 3995, 'unwanted_material': [], 'hashtag_majoritaire_from_carac': 'pehd,etiquette,background'}, 'pet_fonce': {'mat': 'pet_fonce', 'pht': 4200, 'datou_carac_id': 4153, 'unwanted_material': [], 'hashtag_majoritaire_from_carac': 'pet_fonce,etiquette,background'}, 'aluminium': {'mat': 'aluminium', 'pht': 4205, 'datou_carac_id': 3992, 'unwanted_material': [], 'hashtag_majoritaire_from_carac': 'metal,background'}, 'refus': {'mat': 'refus', 'pht': 3594, 'datou_carac_id': 3318, 'unwanted_material': [], 'hashtag_majoritaire_from_carac': 'refus,background'}} SELECT h.hashtag as unwanted_material, substr(dr.hashtag,8) as main_material, ptp.type as pht_type, sum(pcr.value*dr.nombre_balle)/sum(dr.nombre_balle) as ratio, count(distinct mpp.mtr_photo_id) as nb_photo, group_concat(distinct ptp.mtr_portfolio_id_2) as list_port_cont, group_concat(distinct concat(cast(ptp.mtr_portfolio_id_1 as char), ":", cast(ptp.mtr_portfolio_id_2 as char))) as assoc_port, group_concat(distinct concat(cast(ptp.mtr_portfolio_id_1 as char), ":", h.hashtag, ":", cast(ptp.type as char), ":", cast(ptp.mtr_portfolio_id_2 as char))) as assoc_mat FROM MTRPhoto.dashboard_results dr, MTRPhoto.mtr_port_to_port_ids ptp, MTRUser.mtr_portfolio_photos mpp, MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h WHERE dr.dashboard_run_id IN (449271,454376,454388,454411,454399,454424,451519,452689,468274,455185,456478,457640,459828,461074,462392,463490,464885,465870,469411,470781,897152,474755,474338,475306,477478,478927,479886) AND dr.mtr_portfolio_id=ptp.mtr_portfolio_id_1 AND dr.qualite >= 0 AND mpp.mtr_portfolio_id=ptp.mtr_portfolio_id_2 AND pcr.portfolio_id=ptp.mtr_portfolio_id_1 AND h.hashtag_id = pcr.hashtag_id AND ptp.type = pcr.hashtag_type AND mpp.hide_status = 0 AND ptp.hashtag_id=h.hashtag_id AND ptp.type IN (4209,4207,3726,4203,3327,4461,4211,4200,4205,3594) group by h.hashtag, dr.hashtag, ptp.type; VR TODO TO BETTER PARSE ! ({'unwanted_material': 'autre', 'main_material': 'pet_clair', 'pht_type': 3327, 'ratio': 0.025985557831013643, 'nb_photo': 16651, 'list_port_cont': '6601211,6601249,6601319,6601376,6601558,6601691,6601783,6601837,6602312,6603611,6603837,6603984,6604939,6606283,6606361,6607127,6607396,6607889,6608318,6608592,6608684,6608960,6609911,6610060,6610278,6610907,6611078,6613725,6614148,6615899,6616064,6616199,6616975,6617461,6617846,6618177,6618947,6620505,6620992,6621119,6621146,6621174,6621388,6621447,6621537,6622105,6622162,6622311,6622378,6622426,6622514,6622647,6622758,6626372,6626974,6626997,6627200,6627837,6628024,6628557,6628624,6629354,6629396,6635806,6635864,6635897,6635947,6635974,6636029,6636109,6636139,6636295,6636316,6636423,6636599,6636674,6636727,6636791,6637048,6637689,6637708,6637756,6637854,6637954,6637974,6638095,6638421,6638597,6638696,6638833,6638947,6638968,6639187,6639299,6639353,6639652,6639761,6639844,6639904,6639965,6640123,6640725,6640745,6640776,6640959,6641209,6641306,6641333,6641484,6641521,6641655,6641820,6641954,6642026,6642079,6642285,6643237,6643372,6643479,6643603,6643631,6643664,6643695,6643718,6643895,6644078,6644458,6644663,', 'assoc_port': '6600535:6601249,6600537:6601691,6600543:6601211,6600545:6601376,6600547:6601558,6600550:6601783,6600553:6601319,6601140:6602312,6601199:6601837,6602727:6603837,6602729:6603984,6602732:6603611,6604400:6604939,6604702:6606361,6605500:6606283,6605502:6607127,6606682:6608318,6606685:6607889,6606687:6607396,6607836:6608592,6607838:6608684,6608144:6608960,6609197:6610060,6609198:6609911,6609963:6610278,6610497:6611078,6610499:6610907,6612953:6613725,6613333:6614148,6614966:6616199,6614968:6616064,6615360:6615899,6616171:6616975,6616960:6618177,6616966:6617461,6616967:6617846,6618310:6618947,6620036:6620505,6620039:6621388,6620042:6620992,6620404:6621146,6620441:6621447,6620445:6621174,6620446:6621537,6620449:6621119,6621639:6622647,6621642:6622758,6621645:6622514,6621650:6622378,6621652:6622426,6621655:6622162,6621656:6622105,6621661:6622311,6625901:6626372,6626270:6626974,6626272:6626997,6626275:6627200,6627097:6627837,6627099:6628024,6627946:6628557,6627948:6628624,6628988:6629354,6628991:6629396,6630847:6635947,', 'assoc_mat': '6600535:autre:3327:6601249,6600537:autre:3327:6601691,6600543:autre:3327:6601211,6600545:autre:3327:6601376,6600547:autre:3327:6601558,6600550:autre:3327:6601783,6600553:autre:3327:6601319,6601140:autre:3327:6602312,6601199:autre:3327:6601837,6602727:autre:3327:6603837,6602729:autre:3327:6603984,6602732:autre:3327:6603611,6604400:autre:3327:6604939,6604702:autre:3327:6606361,6605500:autre:3327:6606283,6605502:autre:3327:6607127,6606682:autre:3327:6608318,6606685:autre:3327:6607889,6606687:autre:3327:6607396,6607836:autre:3327:6608592,6607838:autre:3327:6608684,6608144:autre:3327:6608960,6609197:autre:3327:6610060,6609198:autre:3327:6609911,6609963:autre:3327:6610278,6610497:autre:3327:6611078,6610499:autre:3327:6610907,6612953:autre:3327:6613725,6613333:autre:3327:6614148,6614966:autre:3327:6616199,6614968:autre:3327:6616064,6615360:autre:3327:6615899,6616171:autre:3327:6616975,6616960:autre:3327:6618177,6616966:autre:3327:6617461,6616967:autre:3327:6617846,6618310:autre:3327:6618947,6620036:autre:3327:662050'}, {'unwanted_material': 'barquette_avec_film', 'main_material': 'pet_clair', 'pht_type': 3327, 'ratio': 0.0050634087913797535, 'nb_photo': 1051, 'list_port_cont': '6601216,6601255,6601316,6601366,6601556,6601694,6601795,6601849,6602314,6603610,6603845,6603981,6604938,6606272,6606380,6607136,6607388,6607885,6608324,6608593,6608675,6608967,6609910,6610048,6610273,6611082,6613721,6614147,6615898,6616193,6616972,6617468,6618176,6618950,6620509,6620988,6621144,6621167,6621391,6621449,6622102,6622163,6622316,6622379,6622436,6622519,6622752,6626364,6626973,6627004,6627197,6627840,6628023,6628564,6628623,6629352,6629394,6635811,6635862,6635901,6635945,6635972,6636036,6636112,6636138,6636318,6636424,6636724,6637044,6637685,6637716,6637764,6637852,6637945,6637984,6638094,6638596,6638700,6638835,6638944,6638974,6639298,6639361,6639645,6639764,6639852,6639896,6639968,6640121,6640722,6640783,6640963,6641211,6641294,6641332,6641486,6641520,6641652,6641944,6642022,6642080,6642290,6643373,6643478,6643608,6643683,6643716,6643902,6644079,6644456,6644652,6645162,6645304,6645766,6647408,6648376,6648805,6649738,6651383,6651686,6654487,6654608,6655045,6655877,6656213,6656668,6659085,6660221,', 'assoc_port': '6600535:6601255,6600537:6601694,6600543:6601216,6600545:6601366,6600547:6601556,6600550:6601795,6600553:6601316,6601140:6602314,6601199:6601849,6602727:6603845,6602729:6603981,6602732:6603610,6604400:6604938,6604702:6606380,6605500:6606272,6605502:6607136,6606682:6608324,6606685:6607885,6606687:6607388,6607836:6608593,6607838:6608675,6608144:6608967,6609197:6610048,6609198:6609910,6609963:6610273,6610497:6611082,6612953:6613721,6613333:6614147,6614966:6616193,6615360:6615898,6616171:6616972,6616960:6618176,6616966:6617468,6618310:6618950,6620036:6620509,6620039:6621391,6620042:6620988,6620404:6621144,6620441:6621449,6620445:6621167,6621642:6622752,6621645:6622519,6621650:6622379,6621652:6622436,6621655:6622163,6621656:6622102,6621661:6622316,6625901:6626364,6626270:6626973,6626272:6627004,6626275:6627197,6627097:6627840,6627099:6628023,6627946:6628564,6627948:6628623,6628988:6629352,6628991:6629394,6630847:6635945,6630849:6636036,6630851:6635972,6630854:6637685,6630934:6637764,6630936:6637716,6630938:6638094,', 'assoc_mat': '6600535:barquette_avec_film:3327:6601255,6600537:barquette_avec_film:3327:6601694,6600543:barquette_avec_film:3327:6601216,6600545:barquette_avec_film:3327:6601366,6600547:barquette_avec_film:3327:6601556,6600550:barquette_avec_film:3327:6601795,6600553:barquette_avec_film:3327:6601316,6601140:barquette_avec_film:3327:6602314,6601199:barquette_avec_film:3327:6601849,6602727:barquette_avec_film:3327:6603845,6602729:barquette_avec_film:3327:6603981,6602732:barquette_avec_film:3327:6603610,6604400:barquette_avec_film:3327:6604938,6604702:barquette_avec_film:3327:6606380,6605500:barquette_avec_film:3327:6606272,6605502:barquette_avec_film:3327:6607136,6606682:barquette_avec_film:3327:6608324,6606685:barquette_avec_film:3327:6607885,6606687:barquette_avec_film:3327:6607388,6607836:barquette_avec_film:3327:6608593,6607838:barquette_avec_film:3327:6608675,6608144:barquette_avec_film:3327:6608967,6609197:barquette_avec_film:3327:6610048,6609198:barquette_avec_film:3327:6609910,6609963:barquette_avec_film:3327:6610273'}, {'unwanted_material': 'barquette_opaque', 'main_material': 'ela', 'pht_type': 4203, 'ratio': 0.0006065490165070008, 'nb_photo': 9, 'list_port_cont': '6603426,6627334,6634749,6723417,6780640,6834099,6852168', 'assoc_port': '6602731:6603426,6626721:6627334,6630937:6634749,6671808:6834099,6722813:6723417,6780026:6780640,6851650:6852168', 'assoc_mat': '6602731:barquette_opaque:4203:6603426,6626721:barquette_opaque:4203:6627334,6630937:barquette_opaque:4203:6634749,6671808:barquette_opaque:4203:6834099,6722813:barquette_opaque:4203:6723417,6780026:barquette_opaque:4203:6780640,6851650:barquette_opaque:4203:6852168'}, {'unwanted_material': 'barquette_opaque', 'main_material': 'emr', 'pht_type': 4209, 'ratio': 0.0005293780694215035, 'nb_photo': 1, 'list_port_cont': '6692906', 'assoc_port': '6691778:6692906', 'assoc_mat': '6691778:barquette_opaque:4209:6692906'}, {'unwanted_material': 'barquette_opaque', 'main_material': 'pehd_pp', 'pht_type': 4211, 'ratio': 0.008662761320534096, 'nb_photo': 659, 'list_port_cont': '6600860,6600903,6601023,6601433,6602273,6602593,6603403,6606082,6607689,6608069,6608289,6609462,6610653,6614532,6615427,6615792,6616525,6618779,6618922,6620328,6621053,6621664,6621960,6622002,6622135,6622199,6624057,6626607,6627268,6628481,6629183,6629252,6634382,6635139,6638289,6638441,6640989,6642058,6642706,6650155,6650276,6650959,6658495,6664041,6668175,6669610,6672035,6674014,6674549,6674630,6674772,6675081,6675105,6675139,6675482,6676524,6677132,6677217,6678042,6678216,6678577,6678660,6678688,6678769,6678960,6678988,6681252,6687138,6692292,6693194,6693681,6693891,6694045,6694217,6694420,6698421,6698805,6699377,6699427,6700669,6707231,6711232,6711409,6711495,6712142,6713437,6713607,6713753,6714397,6716562,6717498,6717555,6718025,6719023,6719736,6720660,6720723,6721143,6721925,6722677,6723045,6723102,6724740,6724912,6724973,6725830,6729866,6730263,6730718,6731855,6732324,6732440,6735375,6738136,6740197,6740602,6741090,6741939,6743256,6743597,6743876,6745278,6747827,6751581,6751678,6751683,6752336,6754140,', 'assoc_port': '10844008:10846065,10844009:10845784,10844011:10845552,10844012:10845981,10844014:10845176,10844016:10845161,10844017:10845129,10844018:10844946,10844019:10845048,10844020:10844679,12107427:12108055,12107429:12107821,6600536:6601433,6600544:6600860,6600546:6601023,6600551:6600903,6601138:6602593,6601649:6602273,6602733:6603403,6604399:6608069,6605499:6610653,6605688:6606082,6606683:6607689,6607839:6608289,6609199:6609462,6614199:6614532,6614969:6615427,6615362:6615792,6616173:6616525,6618307:6618779,6618311:6618922,6620040:6620328,6620422:6621664,6620444:6621053,6621638:6624057,6621647:6622199,6621651:6622135,6621654:6621960,6621659:6622002,6626268:6626607,6627098:6627268,6627945:6628481,6628987:6629183,6628989:6629252,6630852:6674014,6630932:6674630,6630935:6674772,6630939:6675105,6631065:6675081,6631069:6675482,6631193:6635139,6631477:6676524,6631489:6677132,6631492:6677217,6631967:6634382,6632585:6678216,6632660:6678577,6632663:6678660,6632714:6678769,6632787:6678688,6632877:6678960,6632881:6678988,6635669:', 'assoc_mat': '10844008:barquette_opaque:4211:10846065,10844009:barquette_opaque:4211:10845784,10844011:barquette_opaque:4211:10845552,10844012:barquette_opaque:4211:10845981,10844014:barquette_opaque:4211:10845176,10844016:barquette_opaque:4211:10845161,10844017:barquette_opaque:4211:10845129,10844018:barquette_opaque:4211:10844946,10844019:barquette_opaque:4211:10845048,10844020:barquette_opaque:4211:10844679,12107427:barquette_opaque:4211:12108055,12107429:barquette_opaque:4211:12107821,6600536:barquette_opaque:4211:6601433,6600544:barquette_opaque:4211:6600860,6600546:barquette_opaque:4211:6601023,6600551:barquette_opaque:4211:6600903,6601138:barquette_opaque:4211:6602593,6601649:barquette_opaque:4211:6602273,6602733:barquette_opaque:4211:6603403,6604399:barquette_opaque:4211:6608069,6605499:barquette_opaque:4211:6610653,6605688:barquette_opaque:4211:6606082,6606683:barquette_opaque:4211:6607689,6607839:barquette_opaque:4211:6608289,6609199:barquette_opaque:4211:6609462,6614199:barquette_opaque:4211:6614532,6614969:barq'}, {'unwanted_material': 'barquette_opaque', 'main_material': 'pet_fonce', 'pht_type': 4200, 'ratio': 0.0009915902324084817, 'nb_photo': 5, 'list_port_cont': '6649286,6687459,6784020,6813915,6920756', 'assoc_port': '6631070:6649286,6686295:6687459,6782249:6784020,6813389:6813915,6920100:6920756', 'assoc_mat': '6631070:barquette_opaque:4200:6649286,6686295:barquette_opaque:4200:6687459,6782249:barquette_opaque:4200:6784020,6813389:barquette_opaque:4200:6813915,6920100:barquette_opaque:4200:6920756'}, {'unwanted_material': 'bouchon', 'main_material': 'pet_clair', 'pht_type': 3327, 'ratio': 0.002148587132747826, 'nb_photo': 2481, 'list_port_cont': '6601204,6601258,6601320,6601369,6601559,6601701,6601789,6601838,6602303,6603616,6603840,6603991,6604940,6606271,6606371,6607138,6607392,6607893,6608314,6608584,6608679,6608959,6609909,6610052,6610283,6610913,6611085,6613733,6614158,6615892,6616060,6616205,6616979,6617470,6617845,6618175,6618953,6620508,6620996,6621149,6621177,6621393,6621437,6621531,6622101,6622159,6622323,6622381,6622429,6622524,6622659,6622748,6626363,6626980,6626996,6627191,6627830,6628020,6628559,6628625,6629350,6629387,6635807,6635871,6635902,6635950,6635976,6636031,6636142,6636288,6636337,6636425,6636596,6636683,6636733,6636798,6637042,6637681,6637704,6637763,6637859,6637953,6637977,6638087,6638418,6638605,6638699,6638834,6638943,6638976,6639182,6639296,6639351,6639643,6639763,6639846,6639907,6639971,6640125,6640715,6640780,6640955,6641210,6641300,6641327,6641485,6641509,6641661,6641818,6641952,6642084,6642292,6643375,6643473,6643600,6643630,6643663,6643691,6643711,6643907,6644068,6644455,6644662,6645166,6645298,6645757,6647406,6648003,', 'assoc_port': '6600535:6601258,6600537:6601701,6600543:6601204,6600545:6601369,6600547:6601559,6600550:6601789,6600553:6601320,6601140:6602303,6601199:6601838,6602727:6603840,6602729:6603991,6602732:6603616,6604400:6604940,6604702:6606371,6605500:6606271,6605502:6607138,6606682:6608314,6606685:6607893,6606687:6607392,6607836:6608584,6607838:6608679,6608144:6608959,6609197:6610052,6609198:6609909,6609963:6610283,6610497:6611085,6610499:6610913,6612953:6613733,6613333:6614158,6614966:6616205,6614968:6616060,6615360:6615892,6616171:6616979,6616960:6618175,6616966:6617470,6616967:6617845,6618310:6618953,6620036:6620508,6620039:6621393,6620042:6620996,6620404:6621149,6620441:6621437,6620445:6621177,6620446:6621531,6621639:6622659,6621642:6622748,6621645:6622524,6621650:6622381,6621652:6622429,6621655:6622159,6621656:6622101,6621661:6622323,6625901:6626363,6626270:6626980,6626272:6626996,6626275:6627191,6627097:6627830,6627099:6628020,6627946:6628559,6627948:6628625,6628988:6629350,6628991:6629387,6630847:6635950,6630849:6636031,', 'assoc_mat': '6600535:bouchon:3327:6601258,6600537:bouchon:3327:6601701,6600543:bouchon:3327:6601204,6600545:bouchon:3327:6601369,6600547:bouchon:3327:6601559,6600550:bouchon:3327:6601789,6600553:bouchon:3327:6601320,6601140:bouchon:3327:6602303,6601199:bouchon:3327:6601838,6602727:bouchon:3327:6603840,6602729:bouchon:3327:6603991,6602732:bouchon:3327:6603616,6604400:bouchon:3327:6604940,6604702:bouchon:3327:6606371,6605500:bouchon:3327:6606271,6605502:bouchon:3327:6607138,6606682:bouchon:3327:6608314,6606685:bouchon:3327:6607893,6606687:bouchon:3327:6607392,6607836:bouchon:3327:6608584,6607838:bouchon:3327:6608679,6608144:bouchon:3327:6608959,6609197:bouchon:3327:6610052,6609198:bouchon:3327:6609909,6609963:bouchon:3327:6610283,6610497:bouchon:3327:6611085,6610499:bouchon:3327:6610913,6612953:bouchon:3327:6613733,6613333:bouchon:3327:6614158,6614966:bouchon:3327:6616205,6614968:bouchon:3327:6616060,6615360:bouchon:3327:6615892,6616171:bouchon:3327:6616979,6616960:bouchon:3327:6618175,6616966:bouchon:3327:6617470,6616967:b'}, {'unwanted_material': 'carton', 'main_material': 'ela', 'pht_type': 4203, 'ratio': 0.015781843756573148, 'nb_photo': 1998, 'list_port_cont': '6603428,6608804,6618325,6624159,6627335,6634751,6634798,6660090,6698369,6704158,6712719,6720528,6723218,6723410,6735159,6735455,6741137,6754060,6761153,6768731,6775020,6780639,6799269,6800310,6801317,6806363,6808106,6808745,6810123,6812813,6822554,6826369,6834087,6838770,6846433,6852159,6863267,6865659,6869925,6876020,6924800,6930493,6940832,10844173', 'assoc_port': '10844025:10844173,6602731:6603428,6608146:6608804,6617603:6618325,6620405:6624159,6626721:6627335,6630937:6634751,6631483:6634798,6632879:6660090,6638160:6704158,6653521:6723218,6664117:6735455,6671808:6834087,6682068:6768731,6685476:6799269,6685991:6800310,6686304:6801317,6690887:6735159,6696473:6698369,6712332:6712719,6718634:6720528,6722813:6723410,6740022:6741137,6745199:6810123,6753416:6754060,6760133:6761153,6765566:6808745,6774410:6775020,6780026:6780639,6786466:6808106,6793236:6806363,6811950:6812813,6820599:6822554,6825858:6826369,6837012:6838770,6846007:6846433,6851650:6852159,6863104:6863267,6865559:6865659,6869544:6869925,6875674:6876020,6894306:6930493,6900378:6940832,6923650:6924800', 'assoc_mat': '10844025:carton:4203:10844173,6602731:carton:4203:6603428,6608146:carton:4203:6608804,6617603:carton:4203:6618325,6620405:carton:4203:6624159,6626721:carton:4203:6627335,6630937:carton:4203:6634751,6631483:carton:4203:6634798,6632879:carton:4203:6660090,6638160:carton:4203:6704158,6653521:carton:4203:6723218,6664117:carton:4203:6735455,6671808:carton:4203:6834087,6682068:carton:4203:6768731,6685476:carton:4203:6799269,6685991:carton:4203:6800310,6686304:carton:4203:6801317,6690887:carton:4203:6735159,6696473:carton:4203:6698369,6712332:carton:4203:6712719,6718634:carton:4203:6720528,6722813:carton:4203:6723410,6740022:carton:4203:6741137,6745199:carton:4203:6810123,6753416:carton:4203:6754060,6760133:carton:4203:6761153,6765566:carton:4203:6808745,6774410:carton:4203:6775020,6780026:carton:4203:6780639,6786466:carton:4203:6808106,6793236:carton:4203:6806363,6811950:carton:4203:6812813,6820599:carton:4203:6822554,6825858:carton:4203:6826369,6837012:carton:4203:6838770,6846007:carton:4203:6846433,6851650:carton'}, {'unwanted_material': 'carton', 'main_material': 'emr', 'pht_type': 4207, 'ratio': 0.9743551532309155, 'nb_photo': 4, 'list_port_cont': '12107738,12108208', 'assoc_port': '12107419:12108208,12107426:12107738', 'assoc_mat': '12107419:carton:4207:12108208,12107426:carton:4207:12107738'}, {'unwanted_material': 'carton', 'main_material': 'emr', 'pht_type': 4209, 'ratio': 0.004418352534261281, 'nb_photo': 161, 'list_port_cont': '6600769,6601467,6602156,6616727,6617535,6617707,6618976,6620415,6621476,6621927,6622071,6625405,6627053,6637137,6638503,6641082,6644340,6647280,6648123,6651932,6655484,6657576,6664017,6666562,6667513,6668138,6668212,6669002,6669287,6669404,6670447,6670556,6670902,6672181,6673400,6674363,6678083,6682353,6690824,6692905,6694179,6695453,6695907,6697455,6699015,6711039,6712083,6712246,6716814,6721878,6723683,6740491,6742328,6751444,6754763,6812438,6824357', 'assoc_port': '6600533:6601467,6600540:6602156,6600552:6600769,6616168:6616727,6616961:6617707,6616963:6617535,6618302:6618976,6620037:6620415,6620443:6621476,6621640:6622071,6621646:6621927,6625237:6625405,6626722:6627053,6631064:6666562,6631190:6668138,6631196:6668212,6631480:6669002,6631482:6669287,6631491:6669404,6632580:6670447,6632661:6670556,6632883:6670902,6633864:6637137,6638162:6638503,6638777:6644340,6640593:6641082,6646444:6647280,6647214:6648123,6650509:6651932,6654838:6655484,6656897:6657576,6663620:6664017,6664426:6667513,6671806:6672181,6672700:6673400,6673893:6674363,6677866:6678083,6681682:6682353,6682898:6690824,6685513:6697455,6688873:6699015,6691778:6692905,6692502:6694179,6694731:6695907,6694740:6695453,6709375:6711039,6710867:6712246,6711682:6712083,6716079:6716814,6721779:6721878,6723504:6723683,6739465:6742328,6740030:6740491,6741911:6754763,6750987:6751444,6811912:6812438,6823971:6824357', 'assoc_mat': '6600533:carton:4209:6601467,6600540:carton:4209:6602156,6600552:carton:4209:6600769,6616168:carton:4209:6616727,6616961:carton:4209:6617707,6616963:carton:4209:6617535,6618302:carton:4209:6618976,6620037:carton:4209:6620415,6620443:carton:4209:6621476,6621640:carton:4209:6622071,6621646:carton:4209:6621927,6625237:carton:4209:6625405,6626722:carton:4209:6627053,6631064:carton:4209:6666562,6631190:carton:4209:6668138,6631196:carton:4209:6668212,6631480:carton:4209:6669002,6631482:carton:4209:6669287,6631491:carton:4209:6669404,6632580:carton:4209:6670447,6632661:carton:4209:6670556,6632883:carton:4209:6670902,6633864:carton:4209:6637137,6638162:carton:4209:6638503,6638777:carton:4209:6644340,6640593:carton:4209:6641082,6646444:carton:4209:6647280,6647214:carton:4209:6648123,6650509:carton:4209:6651932,6654838:carton:4209:6655484,6656897:carton:4209:6657576,6663620:carton:4209:6664017,6664426:carton:4209:6667513,6671806:carton:4209:6672181,6672700:carton:4209:6673400,6673893:carton:4209:6674363,6677866:carton:4'}, {'unwanted_material': 'carton', 'main_material': 'gm', 'pht_type': 4209, 'ratio': 0.0034360485265016666, 'nb_photo': 74, 'list_port_cont': '6846228,6863059,6869289,6886849,6890963,6894674,6908912,6914945,6920514,6922344,6960443,12107789,12108019,12108273,12108337,12108377,12108542,12108682,12151219', 'assoc_port': '12107418:12151219,12107420:12108682,12107421:12108542,12107422:12108377,12107424:12108273,12107425:12108337,12107428:12108019,12107430:12107789,6845636:6846228,6862271:6863059,6868823:6869289,6886556:6886849,6890813:6890963,6894304:6894674,6902262:6908912,6914405:6914945,6919130:6920514,6919131:6960443,6920918:6922344', 'assoc_mat': '12107418:carton:4209:12151219,12107420:carton:4209:12108682,12107421:carton:4209:12108542,12107422:carton:4209:12108377,12107424:carton:4209:12108273,12107425:carton:4209:12108337,12107428:carton:4209:12108019,12107430:carton:4209:12107789,6845636:carton:4209:6846228,6862271:carton:4209:6863059,6868823:carton:4209:6869289,6886556:carton:4209:6886849,6890813:carton:4209:6890963,6894304:carton:4209:6894674,6902262:carton:4209:6908912,6914405:carton:4209:6914945,6919130:carton:4209:6920514,6919131:carton:4209:6960443,6920918:carton:4209:6922344'}, {'unwanted_material': 'carton', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 0.7882882989748035, 'nb_photo': 99, 'list_port_cont': '6617257,6617678,6633558,6659532', 'assoc_port': '6616962:6617257,6616964:6617678,6631478:6633558,6652939:6659532', 'assoc_mat': '6616962:carton:4207:6617257,6616964:carton:4207:6617678,6631478:carton:4207:6633558,6652939:carton:4207:6659532'}, {'unwanted_material': 'carton', 'main_material': 'pehd_pp', 'pht_type': 4211, 'ratio': 0.005541745404523602, 'nb_photo': 10072, 'list_port_cont': '6600862,6600896,6601025,6601432,6601509,6602274,6602602,6603017,6603405,6605885,6606079,6607679,6608062,6608285,6609455,6610403,6610610,6610646,6611147,6613688,6614029,6614524,6615392,6615433,6615557,6615807,6616523,6617433,6618778,6618919,6620209,6620333,6620915,6621055,6621679,6621959,6621994,6622138,6622194,6622460,6624060,6625559,6626610,6626645,6627278,6628471,6629181,6629246,6634380,6634648,6634846,6635132,6635839,6638277,6638440,6639151,6640998,6642060,6642703,6648971,6650047,6650147,6650271,6650967,6658510,6664044,6666448,6668089,6668177,6669622,6672030,6674022,6674547,6674632,6674763,6675077,6675104,6675135,6675473,6676026,6676537,6676625,6677127,6677221,6677812,6678043,6678220,6678576,6678652,6678765,6678931,6678963,6678994,6679223,6681249,6687137,6691499,6691652,6692287,6693204,6693679,6693897,6694010,6694038,6694216,6694416,6695511,6697512,6698426,6698766,6698791,6699371,6699423,6700624,6700657,6705442,6706626,6706767,6707236,6707810,6709732,6711227,6711402,6711481,6712143,6712484,6712643,6712742,', 'assoc_port': '10844008:10846058,10844009:10845786,10844010:10846035,10844011:10845555,10844012:10845974,10844013:10845417,10844014:10845188,10844015:10845076,10844016:10845159,10844017:10845134,10844018:10844944,10844019:10845036,10844020:10844680,10844021:10844446,12107423:12108311,12107427:12108078,12107429:12107832,6600536:6601432,6600541:6601509,6600544:6600862,6600546:6601025,6600551:6600896,6601138:6602602,6601649:6602274,6602728:6603017,6602733:6603405,6604399:6608062,6605499:6610646,6605503:6605885,6605688:6606079,6606683:6607679,6607835:6610403,6607839:6608285,6609199:6609455,6610498:6610610,6610992:6611147,6613334:6613688,6613876:6614029,6614199:6614524,6614967:6615392,6614969:6615433,6615340:6615557,6615362:6615807,6616173:6616523,6616982:6617433,6618307:6618778,6618311:6618919,6620038:6620209,6620040:6620333,6620422:6621679,6620444:6621055,6620447:6620915,6621638:6624060,6621643:6622460,6621647:6622194,6621651:6622138,6621654:6621959,6621659:6621994,6625236:6625559,6626268:6626610,6626274:6626645,6627098:662727', 'assoc_mat': '10844008:carton:4211:10846058,10844009:carton:4211:10845786,10844010:carton:4211:10846035,10844011:carton:4211:10845555,10844012:carton:4211:10845974,10844013:carton:4211:10845417,10844014:carton:4211:10845188,10844015:carton:4211:10845076,10844016:carton:4211:10845159,10844017:carton:4211:10845134,10844018:carton:4211:10844944,10844019:carton:4211:10845036,10844020:carton:4211:10844680,10844021:carton:4211:10844446,12107423:carton:4211:12108311,12107427:carton:4211:12108078,12107429:carton:4211:12107832,6600536:carton:4211:6601432,6600541:carton:4211:6601509,6600544:carton:4211:6600862,6600546:carton:4211:6601025,6600551:carton:4211:6600896,6601138:carton:4211:6602602,6601649:carton:4211:6602274,6602728:carton:4211:6603017,6602733:carton:4211:6603405,6604399:carton:4211:6608062,6605499:carton:4211:6610646,6605503:carton:4211:6605885,6605688:carton:4211:6606079,6606683:carton:4211:6607679,6607835:carton:4211:6610403,6607839:carton:4211:6608285,6609199:carton:4211:6609455,6610498:carton:4211:6610610,6610992:ca'}, {'unwanted_material': 'carton', 'main_material': 'pet_clair', 'pht_type': 3327, 'ratio': 0.021265796174868765, 'nb_photo': 11055, 'list_port_cont': '6601215,6601254,6601311,6601365,6601560,6601690,6601782,6601848,6602311,6603606,6603844,6603989,6604932,6606278,6606384,6607129,6607398,6607888,6608321,6608587,6608682,6608971,6609916,6610055,6610284,6610912,6611077,6613728,6614151,6615888,6616062,6616202,6616976,6617459,6617851,6618180,6618944,6620516,6620989,6621115,6621137,6621173,6621387,6621436,6621535,6622109,6622160,6622315,6622373,6622427,6622513,6622655,6622753,6626373,6626971,6627002,6627199,6627839,6628013,6628560,6628619,6629361,6629384,6635813,6635874,6635895,6635941,6635971,6636033,6636118,6636148,6636296,6636333,6636418,6636592,6636681,6636726,6636802,6637043,6637688,6637712,6637762,6637860,6637949,6637973,6638091,6638425,6638595,6638701,6638837,6638945,6638981,6639192,6639297,6639349,6639651,6639755,6639845,6639906,6639972,6640117,6640719,6640754,6640781,6640958,6641217,6641305,6641322,6641489,6641514,6641657,6641813,6641946,6642029,6642085,6642288,6643238,6643376,6643471,6643599,6643635,6643658,6643688,6643713,6643897,6644067,6644460,6644654,', 'assoc_port': '6600535:6601254,6600537:6601690,6600543:6601215,6600545:6601365,6600547:6601560,6600550:6601782,6600553:6601311,6601140:6602311,6601199:6601848,6602727:6603844,6602729:6603989,6602732:6603606,6604400:6604932,6604702:6606384,6605500:6606278,6605502:6607129,6606682:6608321,6606685:6607888,6606687:6607398,6607836:6608587,6607838:6608682,6608144:6608971,6609197:6610055,6609198:6609916,6609963:6610284,6610497:6611077,6610499:6610912,6612953:6613728,6613333:6614151,6614966:6616202,6614968:6616062,6615360:6615888,6616171:6616976,6616960:6618180,6616966:6617459,6616967:6617851,6618310:6618944,6620036:6620516,6620039:6621387,6620042:6620989,6620404:6621137,6620441:6621436,6620445:6621173,6620446:6621535,6620449:6621115,6621639:6622655,6621642:6622753,6621645:6622513,6621650:6622373,6621652:6622427,6621655:6622160,6621656:6622109,6621661:6622315,6625901:6626373,6626270:6626971,6626272:6627002,6626275:6627199,6627097:6627839,6627099:6628013,6627946:6628560,6627948:6628619,6628988:6629361,6628991:6629384,6630847:6635941,', 'assoc_mat': '6600535:carton:3327:6601254,6600537:carton:3327:6601690,6600543:carton:3327:6601215,6600545:carton:3327:6601365,6600547:carton:3327:6601560,6600550:carton:3327:6601782,6600553:carton:3327:6601311,6601140:carton:3327:6602311,6601199:carton:3327:6601848,6602727:carton:3327:6603844,6602729:carton:3327:6603989,6602732:carton:3327:6603606,6604400:carton:3327:6604932,6604702:carton:3327:6606384,6605500:carton:3327:6606278,6605502:carton:3327:6607129,6606682:carton:3327:6608321,6606685:carton:3327:6607888,6606687:carton:3327:6607398,6607836:carton:3327:6608587,6607838:carton:3327:6608682,6608144:carton:3327:6608971,6609197:carton:3327:6610055,6609198:carton:3327:6609916,6609963:carton:3327:6610284,6610497:carton:3327:6611077,6610499:carton:3327:6610912,6612953:carton:3327:6613728,6613333:carton:3327:6614151,6614966:carton:3327:6616202,6614968:carton:3327:6616062,6615360:carton:3327:6615888,6616171:carton:3327:6616976,6616960:carton:3327:6618180,6616966:carton:3327:6617459,6616967:carton:3327:6617851,6618310:carton:3'}, {'unwanted_material': 'carton', 'main_material': 'pet_fonce', 'pht_type': 4200, 'ratio': 0.0030077102589759186, 'nb_photo': 188, 'list_port_cont': '6600928,6602053,6613067,6615617,6620856,6626789,6634257,6637078,6637444,6638372,6639234,6641575,6646017,6647334,6649471,6649914,6653437,6654689,6655701,6658478,6662382,6670056,6672616,6674513,6683667,6684475,6687238,6687457,6696453,6696810,6698452,6711567,6712284,6712773,6714498,6717605,6719822,6720209,6720249,6720369,6721251,6722524,6740808,6745523,6745785,6750251,6754193,6754563,6765279,6766693,6780395,6780519,6784030,6786852,6788641,6791341,6793689,6795536,6817651,6821378,6824090,6835185,6836549,6840202,6849237,6852379,6854531,6859034,6862722,6865777,6866323,6867980,6869264,6874412,6875751,6875979,6882733,6886815,6888107,6889496,6902501,6904840,6914439,6920752,6921621,6924262', 'assoc_port': '6600538:6600928,6601136:6602053,6612632:6613067,6615365:6615617,6620439:6620856,6626271:6626789,6630848:6646017,6631186:6634257,6631194:6649914,6631961:6655701,6632583:6662382,6632966:6670056,6635673:6637444,6635681:6637078,6637843:6638372,6638774:6639234,6641286:6641575,6646447:6647334,6648940:6649471,6650951:6653437,6654041:6654689,6657889:6658478,6671809:6672616,6673895:6674513,6681680:6683667,6683618:6684475,6685440:6720369,6685511:6720209,6686027:6719822,6686295:6687457,6686312:6687238,6688871:6714498,6690894:6698452,6693641:6696453,6696476:6696810,6710860:6711567,6711680:6712284,6712324:6712773,6716688:6717605,6718843:6720249,6720803:6721251,6722354:6722524,6740018:6740808,6740709:6745523,6744268:6745785,6748062:6750251,6753406:6754563,6753419:6754193,6764848:6765279,6765563:6766693,6779977:6780519,6780017:6780395,6782249:6784030,6786463:6786852,6787690:6788641,6790918:6791341,6793238:6793689,6795258:6795536,6817300:6817651,6820776:6821378,6823753:6824090,6833510:6835185,6835942:6836549,6839793:6840202,', 'assoc_mat': '6600538:carton:4200:6600928,6601136:carton:4200:6602053,6612632:carton:4200:6613067,6615365:carton:4200:6615617,6620439:carton:4200:6620856,6626271:carton:4200:6626789,6630848:carton:4200:6646017,6631186:carton:4200:6634257,6631194:carton:4200:6649914,6631961:carton:4200:6655701,6632583:carton:4200:6662382,6632966:carton:4200:6670056,6635673:carton:4200:6637444,6635681:carton:4200:6637078,6637843:carton:4200:6638372,6638774:carton:4200:6639234,6641286:carton:4200:6641575,6646447:carton:4200:6647334,6648940:carton:4200:6649471,6650951:carton:4200:6653437,6654041:carton:4200:6654689,6657889:carton:4200:6658478,6671809:carton:4200:6672616,6673895:carton:4200:6674513,6681680:carton:4200:6683667,6683618:carton:4200:6684475,6685440:carton:4200:6720369,6685511:carton:4200:6720209,6686027:carton:4200:6719822,6686295:carton:4200:6687457,6686312:carton:4200:6687238,6688871:carton:4200:6714498,6690894:carton:4200:6698452,6693641:carton:4200:6696453,6696476:carton:4200:6696810,6710860:carton:4200:6711567,6711680:carton:4'}, {'unwanted_material': 'ela', 'main_material': 'ela', 'pht_type': 4203, 'ratio': 0.9213990406858268, 'nb_photo': 851, 'list_port_cont': '6603436,6608816,6618318,6624164,6627339,6634755,6634797,6660094,6660517,6698372,6704166,6712720,6720539,6723233,6723408,6735149,6735451,6741141,6754061,6761154,6768736,6775025,6780642,6799277,6800318,6801314,6806353,6808104,6808746,6810130,6812814,6822548,6826377,6834092,6838771,6846432,6852158,6863258,6865673,6869916,6876021,6930479,6940847,10844172', 'assoc_port': '10844025:10844172,6602731:6603436,6608146:6608816,6617603:6618318,6620405:6624164,6626721:6627339,6630937:6634755,6631483:6634797,6631962:6660517,6632879:6660094,6638160:6704166,6653521:6723233,6664117:6735451,6671808:6834092,6682068:6768736,6685476:6799277,6685991:6800318,6686304:6801314,6690887:6735149,6696473:6698372,6712332:6712720,6718634:6720539,6722813:6723408,6740022:6741141,6745199:6810130,6753416:6754061,6760133:6761154,6765566:6808746,6774410:6775025,6780026:6780642,6786466:6808104,6793236:6806353,6811950:6812814,6820599:6822548,6825858:6826377,6837012:6838771,6846007:6846432,6851650:6852158,6863104:6863258,6865559:6865673,6869544:6869916,6875674:6876021,6894306:6930479,6900378:6940847', 'assoc_mat': '10844025:ela:4203:10844172,6602731:ela:4203:6603436,6608146:ela:4203:6608816,6617603:ela:4203:6618318,6620405:ela:4203:6624164,6626721:ela:4203:6627339,6630937:ela:4203:6634755,6631483:ela:4203:6634797,6631962:ela:4203:6660517,6632879:ela:4203:6660094,6638160:ela:4203:6704166,6653521:ela:4203:6723233,6664117:ela:4203:6735451,6671808:ela:4203:6834092,6682068:ela:4203:6768736,6685476:ela:4203:6799277,6685991:ela:4203:6800318,6686304:ela:4203:6801314,6690887:ela:4203:6735149,6696473:ela:4203:6698372,6712332:ela:4203:6712720,6718634:ela:4203:6720539,6722813:ela:4203:6723408,6740022:ela:4203:6741141,6745199:ela:4203:6810130,6753416:ela:4203:6754061,6760133:ela:4203:6761154,6765566:ela:4203:6808746,6774410:ela:4203:6775025,6780026:ela:4203:6780642,6786466:ela:4203:6808104,6793236:ela:4203:6806353,6811950:ela:4203:6812814,6820599:ela:4203:6822548,6825858:ela:4203:6826377,6837012:ela:4203:6838771,6846007:ela:4203:6846432,6851650:ela:4203:6852158,6863104:ela:4203:6863258,6865559:ela:4203:6865673,6869544:ela:4203:68699'}, {'unwanted_material': 'ela', 'main_material': 'emr', 'pht_type': 4209, 'ratio': 0.0007116836898320703, 'nb_photo': 13, 'list_port_cont': '6622066,6638510,6668140,6674367,6682359,6692900,6699027,6751454,6812448', 'assoc_port': '6621640:6622066,6631190:6668140,6638162:6638510,6673893:6674367,6681682:6682359,6688873:6699027,6691778:6692900,6750987:6751454,6811912:6812448', 'assoc_mat': '6621640:ela:4209:6622066,6631190:ela:4209:6668140,6638162:ela:4209:6638510,6673893:ela:4209:6674367,6681682:ela:4209:6682359,6688873:ela:4209:6699027,6691778:ela:4209:6692900,6750987:ela:4209:6751454,6811912:ela:4209:6812448'}, {'unwanted_material': 'ela', 'main_material': 'gm', 'pht_type': 4209, 'ratio': 0.00032398461757896294, 'nb_photo': 4, 'list_port_cont': '6846232,6863050,6869299,6922346', 'assoc_port': '6845636:6846232,6862271:6863050,6868823:6869299,6920918:6922346', 'assoc_mat': '6845636:ela:4209:6846232,6862271:ela:4209:6863050,6868823:ela:4209:6869299,6920918:ela:4209:6922346'}, {'unwanted_material': 'ela', 'main_material': 'pehd_pp', 'pht_type': 4211, 'ratio': 0.00015698953627416628, 'nb_photo': 147, 'list_port_cont': '6606078,6610614,6610650,6611153,6618777,6621995,6624051,6626615,6629238,6634390,6638443,6650283,6668181,6674761,6676619,6687148,6691488,6692283,6693901,6697509,6698420,6712139,6712495,6712638,6713763,6714406,6719444,6721923,6723047,6725696,6725822,6730328,6732327,6732432,6735373,6735646,6743245,6748843,6752335,6753734,6754131,6754280,6755113,6756969,6757867,6757971,6759593,6762164,6768398,6778929,6780252,6780740,6780892,6784776,6785335,6790082,6794260,6795576,6797595,6799113,6799411,6799545,6799693,6800458,6800536,6800674,6800830,6808649,6808671,6808798,6809166,6810011,6810258,6812213,6835747,6840031,6842616,6854223,6855219,6855451,6869220,6889386,6889562,6917712,6920224,6922983,6961422,10844945,10845415,10846062,12107826', 'assoc_port': '10844008:10846062,10844013:10845415,10844018:10844945,12107429:12107826,6605499:6610650,6605688:6606078,6610498:6610614,6610992:6611153,6618307:6618777,6621638:6624051,6621659:6621995,6626268:6626615,6628989:6629238,6630935:6674761,6631484:6676619,6631967:6634390,6635671:6693901,6638161:6638443,6649833:6650283,6653520:6723047,6653523:6725696,6654837:6725822,6663625:6735646,6666361:6668181,6671801:6755113,6683616:6790082,6683620:6691488,6685431:6799113,6685484:6854223,6685489:6799411,6685506:6799545,6685519:6799693,6685533:6697509,6686006:6855219,6686021:6855451,6686031:6800458,6686094:6800536,6686289:6800674,6686298:6800830,6686321:6687148,6688870:6732432,6688875:6732327,6690891:6735373,6691780:6730328,6691869:6692283,6696477:6698420,6710862:6713763,6711681:6712139,6711684:6714406,6712328:6712638,6712336:6712495,6718636:6719444,6721635:6721923,6738742:6810258,6740001:6752335,6740031:6743245,6743340:6757867,6748058:6810011,6748061:6748843,6748064:6756969,6753412:6754131,6753415:6754280,6753418:6753734,6757493:', 'assoc_mat': '10844008:ela:4211:10846062,10844013:ela:4211:10845415,10844018:ela:4211:10844945,12107429:ela:4211:12107826,6605499:ela:4211:6610650,6605688:ela:4211:6606078,6610498:ela:4211:6610614,6610992:ela:4211:6611153,6618307:ela:4211:6618777,6621638:ela:4211:6624051,6621659:ela:4211:6621995,6626268:ela:4211:6626615,6628989:ela:4211:6629238,6630935:ela:4211:6674761,6631484:ela:4211:6676619,6631967:ela:4211:6634390,6635671:ela:4211:6693901,6638161:ela:4211:6638443,6649833:ela:4211:6650283,6653520:ela:4211:6723047,6653523:ela:4211:6725696,6654837:ela:4211:6725822,6663625:ela:4211:6735646,6666361:ela:4211:6668181,6671801:ela:4211:6755113,6683616:ela:4211:6790082,6683620:ela:4211:6691488,6685431:ela:4211:6799113,6685484:ela:4211:6854223,6685489:ela:4211:6799411,6685506:ela:4211:6799545,6685519:ela:4211:6799693,6685533:ela:4211:6697509,6686006:ela:4211:6855219,6686021:ela:4211:6855451,6686031:ela:4211:6800458,6686094:ela:4211:6800536,6686289:ela:4211:6800674,6686298:ela:4211:6800830,6686321:ela:4211:6687148,6688870:ela:4211'}, {'unwanted_material': 'ela', 'main_material': 'pet_fonce', 'pht_type': 4200, 'ratio': 0.0010348878985054983, 'nb_photo': 35, 'list_port_cont': '6604882,6609168,6620173,6628355,6637450,6641567,6654693,6665190,6684476,6719824,6754201,6754550,6780397,6797660,6813919,6835187,6842436,6852373,6859023,6862721,6866325,6867974,6875989,6888099,6895293,6920760', 'assoc_port': '6604397:6604882,6608145:6609168,6620043:6620173,6627944:6628355,6635673:6637450,6641286:6641567,6654041:6654693,6664429:6665190,6683618:6684476,6686027:6719824,6753406:6754550,6753419:6754201,6780017:6780397,6797266:6797660,6813389:6813919,6833510:6835187,6842061:6842436,6852123:6852373,6858797:6859023,6862270:6862721,6865552:6866325,6867749:6867974,6875675:6875989,6887861:6888099,6894305:6895293,6920100:6920760', 'assoc_mat': '6604397:ela:4200:6604882,6608145:ela:4200:6609168,6620043:ela:4200:6620173,6627944:ela:4200:6628355,6635673:ela:4200:6637450,6641286:ela:4200:6641567,6654041:ela:4200:6654693,6664429:ela:4200:6665190,6683618:ela:4200:6684476,6686027:ela:4200:6719824,6753406:ela:4200:6754550,6753419:ela:4200:6754201,6780017:ela:4200:6780397,6797266:ela:4200:6797660,6813389:ela:4200:6813919,6833510:ela:4200:6835187,6842061:ela:4200:6842436,6852123:ela:4200:6852373,6858797:ela:4200:6859023,6862270:ela:4200:6862721,6865552:ela:4200:6866325,6867749:ela:4200:6867974,6875675:ela:4200:6875989,6887861:ela:4200:6888099,6894305:ela:4200:6895293,6920100:ela:4200:6920760'}, {'unwanted_material': 'etiquette', 'main_material': 'ela', 'pht_type': 4203, 'ratio': 0.00021900090159665767, 'nb_photo': 78, 'list_port_cont': '6603427,6608805,6624167,6634748,6634790,6660096,6698374,6704172,6712723,6720540,6723232,6723415,6735146,6741134,6754075,6761156,6775024,6780647,6799267,6800315,6801318,6806348,6808094,6808744,6810125,6822562,6826365,6834101,6838767,6852166,6863265,6865664,6869922,6876013,6930484,10844168', 'assoc_port': '10844025:10844168,6602731:6603427,6608146:6608805,6620405:6624167,6630937:6634748,6631483:6634790,6632879:6660096,6638160:6704172,6653521:6723232,6671808:6834101,6685476:6799267,6685991:6800315,6686304:6801318,6690887:6735146,6696473:6698374,6712332:6712723,6718634:6720540,6722813:6723415,6740022:6741134,6745199:6810125,6753416:6754075,6760133:6761156,6765566:6808744,6774410:6775024,6780026:6780647,6786466:6808094,6793236:6806348,6820599:6822562,6825858:6826365,6837012:6838767,6851650:6852166,6863104:6863265,6865559:6865664,6869544:6869922,6875674:6876013,6894306:6930484', 'assoc_mat': '10844025:etiquette:4203:10844168,6602731:etiquette:4203:6603427,6608146:etiquette:4203:6608805,6620405:etiquette:4203:6624167,6630937:etiquette:4203:6634748,6631483:etiquette:4203:6634790,6632879:etiquette:4203:6660096,6638160:etiquette:4203:6704172,6653521:etiquette:4203:6723232,6671808:etiquette:4203:6834101,6685476:etiquette:4203:6799267,6685991:etiquette:4203:6800315,6686304:etiquette:4203:6801318,6690887:etiquette:4203:6735146,6696473:etiquette:4203:6698374,6712332:etiquette:4203:6712723,6718634:etiquette:4203:6720540,6722813:etiquette:4203:6723415,6740022:etiquette:4203:6741134,6745199:etiquette:4203:6810125,6753416:etiquette:4203:6754075,6760133:etiquette:4203:6761156,6765566:etiquette:4203:6808744,6774410:etiquette:4203:6775024,6780026:etiquette:4203:6780647,6786466:etiquette:4203:6808094,6793236:etiquette:4203:6806348,6820599:etiquette:4203:6822562,6825858:etiquette:4203:6826365,6837012:etiquette:4203:6838767,6851650:etiquette:4203:6852166,6863104:etiquette:4203:6863265,6865559:etiquette:4203:6865664'}, {'unwanted_material': 'etiquette', 'main_material': 'emr', 'pht_type': 4209, 'ratio': 0.00030922441233135133, 'nb_photo': 45, 'list_port_cont': '6600778,6617522,6618983,6620411,6621477,6621941,6625401,6641076,6647266,6648129,6651936,6667511,6669411,6670890,6672171,6673397,6674364,6678090,6682348,6690825,6695447,6695912,6697467,6699022,6711044,6712233,6723686,6740487,6742318,6751446,6754766', 'assoc_port': '6600552:6600778,6616963:6617522,6618302:6618983,6620037:6620411,6620443:6621477,6621646:6621941,6625237:6625401,6631491:6669411,6632883:6670890,6640593:6641076,6646444:6647266,6647214:6648129,6650509:6651936,6664426:6667511,6671806:6672171,6672700:6673397,6673893:6674364,6677866:6678090,6681682:6682348,6682898:6690825,6685513:6697467,6688873:6699022,6694731:6695912,6694740:6695447,6709375:6711044,6710867:6712233,6723504:6723686,6739465:6742318,6740030:6740487,6741911:6754766,6750987:6751446', 'assoc_mat': '6600552:etiquette:4209:6600778,6616963:etiquette:4209:6617522,6618302:etiquette:4209:6618983,6620037:etiquette:4209:6620411,6620443:etiquette:4209:6621477,6621646:etiquette:4209:6621941,6625237:etiquette:4209:6625401,6631491:etiquette:4209:6669411,6632883:etiquette:4209:6670890,6640593:etiquette:4209:6641076,6646444:etiquette:4209:6647266,6647214:etiquette:4209:6648129,6650509:etiquette:4209:6651936,6664426:etiquette:4209:6667511,6671806:etiquette:4209:6672171,6672700:etiquette:4209:6673397,6673893:etiquette:4209:6674364,6677866:etiquette:4209:6678090,6681682:etiquette:4209:6682348,6682898:etiquette:4209:6690825,6685513:etiquette:4209:6697467,6688873:etiquette:4209:6699022,6694731:etiquette:4209:6695912,6694740:etiquette:4209:6695447,6709375:etiquette:4209:6711044,6710867:etiquette:4209:6712233,6723504:etiquette:4209:6723686,6739465:etiquette:4209:6742318,6740030:etiquette:4209:6740487,6741911:etiquette:4209:6754766,6750987:etiquette:4209:6751446'}, {'unwanted_material': 'etiquette', 'main_material': 'gm', 'pht_type': 4209, 'ratio': 0.00022776236187163268, 'nb_photo': 13, 'list_port_cont': '6869297,6890964,6908904,6960438,12108034,12108669', 'assoc_port': '12107420:12108669,12107428:12108034,6868823:6869297,6890813:6890964,6902262:6908904,6919131:6960438', 'assoc_mat': '12107420:etiquette:4209:12108669,12107428:etiquette:4209:12108034,6868823:etiquette:4209:6869297,6890813:etiquette:4209:6890964,6902262:etiquette:4209:6908904,6919131:etiquette:4209:6960438'}, {'unwanted_material': 'etiquette', 'main_material': 'pehd_pp', 'pht_type': 4211, 'ratio': 9.761859113588492e-05, 'nb_photo': 731, 'list_port_cont': '6600902,6602270,6608065,6608287,6609459,6610411,6610617,6611154,6614525,6615396,6615423,6615803,6617425,6620339,6620925,6621056,6621665,6621973,6621996,6622127,6622201,6622459,6624053,6625563,6628477,6634393,6634662,6634854,6635143,6635844,6639158,6640993,6650044,6650156,6650281,6658498,6664049,6666450,6669614,6672026,6674393,6674548,6674635,6674760,6675108,6675142,6675485,6676526,6676614,6677128,6677225,6677804,6678044,6678223,6678571,6678768,6678969,6679218,6681248,6687147,6691498,6691665,6692288,6694047,6694207,6694414,6695513,6697508,6698432,6698802,6699435,6700656,6705444,6706636,6706768,6707239,6707826,6709730,6711224,6711404,6711483,6712141,6712483,6712632,6712743,6713443,6713604,6713764,6714402,6716469,6716553,6717496,6717550,6718035,6718534,6719031,6719449,6719733,6720659,6721132,6721831,6722611,6722685,6723046,6723113,6723251,6723786,6724921,6724969,6725105,6725687,6729864,6730275,6730327,6730721,6731860,6732320,6732438,6735374,6735654,6738119,6740200,6740600,6741082,6741932,6743253,6743387,6743591,', 'assoc_port': '10844009:10845795,10844011:10845547,10844012:10845968,10844014:10845181,10844016:10845171,10844017:10845140,10844018:10844947,10844019:10845034,10844020:10844676,10844021:10844452,12107427:12108051,12107429:12107825,6600551:6600902,6601649:6602270,6604399:6608065,6607835:6610411,6607839:6608287,6609199:6609459,6610498:6610617,6610992:6611154,6614199:6614525,6614967:6615396,6614969:6615423,6615362:6615803,6616982:6617425,6620040:6620339,6620422:6621665,6620444:6621056,6620447:6620925,6621638:6624053,6621643:6622459,6621647:6622201,6621651:6622127,6621654:6621973,6621659:6621996,6625236:6625563,6627945:6628477,6630850:6634854,6630856:6634662,6630932:6674635,6630935:6674760,6630939:6675108,6631069:6675485,6631193:6635143,6631477:6676526,6631484:6676614,6631489:6677128,6631492:6677225,6631960:6677804,6631967:6634393,6632585:6678223,6632660:6678571,6632714:6678768,6632877:6678969,6632963:6679218,6633862:6635844,6635676:6694047,6635682:6694207,6637840:6700656,6638773:6705444,6638776:6639158,6640587:6706636,6640590:', 'assoc_mat': '10844009:etiquette:4211:10845795,10844011:etiquette:4211:10845547,10844012:etiquette:4211:10845968,10844014:etiquette:4211:10845181,10844016:etiquette:4211:10845171,10844017:etiquette:4211:10845140,10844018:etiquette:4211:10844947,10844019:etiquette:4211:10845034,10844020:etiquette:4211:10844676,10844021:etiquette:4211:10844452,12107427:etiquette:4211:12108051,12107429:etiquette:4211:12107825,6600551:etiquette:4211:6600902,6601649:etiquette:4211:6602270,6604399:etiquette:4211:6608065,6607835:etiquette:4211:6610411,6607839:etiquette:4211:6608287,6609199:etiquette:4211:6609459,6610498:etiquette:4211:6610617,6610992:etiquette:4211:6611154,6614199:etiquette:4211:6614525,6614967:etiquette:4211:6615396,6614969:etiquette:4211:6615423,6615362:etiquette:4211:6615803,6616982:etiquette:4211:6617425,6620040:etiquette:4211:6620339,6620422:etiquette:4211:6621665,6620444:etiquette:4211:6621056,6620447:etiquette:4211:6620925,6621638:etiquette:4211:6624053,6621643:etiquette:4211:6622459,6621647:etiquette:4211:6622201,6621651:'}, {'unwanted_material': 'etiquette', 'main_material': 'pet_clair', 'pht_type': 3327, 'ratio': 0.004348080716206635, 'nb_photo': 2177, 'list_port_cont': '6601212,6601260,6601313,6601368,6601566,6601697,6601794,6601839,6602310,6603617,6603847,6603990,6604929,6606281,6606358,6607128,6607393,6607886,6608319,6608595,6609912,6610053,6610275,6610911,6611081,6613732,6614155,6615891,6616068,6616203,6616981,6617464,6617847,6618173,6618943,6620503,6620995,6621113,6621139,6621170,6621386,6621441,6621536,6622158,6622312,6622433,6622517,6622652,6622759,6626361,6626978,6626999,6627195,6627832,6628014,6628554,6628614,6629363,6629389,6635808,6635870,6635898,6635951,6635977,6636117,6636143,6636289,6636331,6636428,6636605,6636678,6636737,6636797,6637045,6637679,6637710,6637767,6637948,6637983,6638086,6638422,6638600,6638706,6638840,6638940,6638970,6639190,6639289,6639354,6639650,6639754,6639847,6639897,6639975,6640120,6640716,6640750,6640777,6640954,6641212,6641304,6641334,6641488,6641517,6641651,6641811,6641945,6642027,6642087,6642291,6643242,6643378,6643477,6643637,6643657,6643690,6643720,6643900,6644076,6644462,6644664,6645167,6645306,6645763,6648004,6648352,6648373,6649645,', 'assoc_port': '6600535:6601260,6600537:6601697,6600543:6601212,6600545:6601368,6600547:6601566,6600550:6601794,6600553:6601313,6601140:6602310,6601199:6601839,6602727:6603847,6602729:6603990,6602732:6603617,6604400:6604929,6604702:6606358,6605500:6606281,6605502:6607128,6606682:6608319,6606685:6607886,6606687:6607393,6607836:6608595,6609197:6610053,6609198:6609912,6609963:6610275,6610497:6611081,6610499:6610911,6612953:6613732,6613333:6614155,6614966:6616203,6614968:6616068,6615360:6615891,6616171:6616981,6616960:6618173,6616966:6617464,6616967:6617847,6618310:6618943,6620036:6620503,6620039:6621386,6620042:6620995,6620404:6621139,6620441:6621441,6620445:6621170,6620446:6621536,6620449:6621113,6621639:6622652,6621642:6622759,6621645:6622517,6621652:6622433,6621655:6622158,6621661:6622312,6625901:6626361,6626270:6626978,6626272:6626999,6626275:6627195,6627097:6627832,6627099:6628014,6627946:6628554,6627948:6628614,6628988:6629363,6628991:6629389,6630847:6635951,6630851:6635977,6630853:6636678,6630854:6637679,6630934:6637767,', 'assoc_mat': '6600535:etiquette:3327:6601260,6600537:etiquette:3327:6601697,6600543:etiquette:3327:6601212,6600545:etiquette:3327:6601368,6600547:etiquette:3327:6601566,6600550:etiquette:3327:6601794,6600553:etiquette:3327:6601313,6601140:etiquette:3327:6602310,6601199:etiquette:3327:6601839,6602727:etiquette:3327:6603847,6602729:etiquette:3327:6603990,6602732:etiquette:3327:6603617,6604400:etiquette:3327:6604929,6604702:etiquette:3327:6606358,6605500:etiquette:3327:6606281,6605502:etiquette:3327:6607128,6606682:etiquette:3327:6608319,6606685:etiquette:3327:6607886,6606687:etiquette:3327:6607393,6607836:etiquette:3327:6608595,6609197:etiquette:3327:6610053,6609198:etiquette:3327:6609912,6609963:etiquette:3327:6610275,6610497:etiquette:3327:6611081,6610499:etiquette:3327:6610911,6612953:etiquette:3327:6613732,6613333:etiquette:3327:6614155,6614966:etiquette:3327:6616203,6614968:etiquette:3327:6616068,6615360:etiquette:3327:6615891,6616171:etiquette:3327:6616981,6616960:etiquette:3327:6618173,6616966:etiquette:3327:6617464,6'}, {'unwanted_material': 'etiquette', 'main_material': 'pet_fonce', 'pht_type': 4200, 'ratio': 0.00042222109924499836, 'nb_photo': 28, 'list_port_cont': '6613076,6621900,6635395,6637437,6638359,6641572,6654692,6665194,6669586,6670051,6686808,6687472,6714497,6717610,6719817,6745800,6765266,6766701,6780408,6780724,6797654,6836540,6840198,6865778,6874405,6886806,6902498,6904836', 'assoc_port': '6612632:6613076,6621653:6621900,6632786:6635395,6632966:6670051,6635673:6637437,6637843:6638359,6641286:6641572,6654041:6654692,6664429:6665194,6668950:6669586,6686027:6719817,6686295:6687472,6686325:6686808,6688871:6714497,6716688:6717610,6744268:6745800,6764848:6765266,6765563:6766701,6779960:6780724,6780017:6780408,6797266:6797654,6835942:6836540,6839793:6840198,6865562:6865778,6873774:6874405,6886550:6886806,6899435:6902498,6904395:6904836', 'assoc_mat': '6612632:etiquette:4200:6613076,6621653:etiquette:4200:6621900,6632786:etiquette:4200:6635395,6632966:etiquette:4200:6670051,6635673:etiquette:4200:6637437,6637843:etiquette:4200:6638359,6641286:etiquette:4200:6641572,6654041:etiquette:4200:6654692,6664429:etiquette:4200:6665194,6668950:etiquette:4200:6669586,6686027:etiquette:4200:6719817,6686295:etiquette:4200:6687472,6686325:etiquette:4200:6686808,6688871:etiquette:4200:6714497,6716688:etiquette:4200:6717610,6744268:etiquette:4200:6745800,6764848:etiquette:4200:6765266,6765563:etiquette:4200:6766701,6779960:etiquette:4200:6780724,6780017:etiquette:4200:6780408,6797266:etiquette:4200:6797654,6835942:etiquette:4200:6836540,6839793:etiquette:4200:6840198,6865562:etiquette:4200:6865778,6873774:etiquette:4200:6874405,6886550:etiquette:4200:6886806,6899435:etiquette:4200:6902498,6904395:etiquette:4200:6904836'}, {'unwanted_material': 'film_plastique', 'main_material': 'ela', 'pht_type': 4203, 'ratio': 0.0010375570916267033, 'nb_photo': 51, 'list_port_cont': '6603435,6618321,6624160,6627326,6698377,6704173,6723230,6735453,6741145,6754070,6761155,6768723,6775026,6780641,6799270,6800313,6801310,6808096,6810127,6822556,6826374,6834088,6838769,6846429,6852169,6869926,6876022,6930487,6940833', 'assoc_port': '6602731:6603435,6617603:6618321,6620405:6624160,6626721:6627326,6638160:6704173,6653521:6723230,6664117:6735453,6671808:6834088,6682068:6768723,6685476:6799270,6685991:6800313,6686304:6801310,6696473:6698377,6740022:6741145,6745199:6810127,6753416:6754070,6760133:6761155,6774410:6775026,6780026:6780641,6786466:6808096,6820599:6822556,6825858:6826374,6837012:6838769,6846007:6846429,6851650:6852169,6869544:6869926,6875674:6876022,6894306:6930487,6900378:6940833', 'assoc_mat': '6602731:film_plastique:4203:6603435,6617603:film_plastique:4203:6618321,6620405:film_plastique:4203:6624160,6626721:film_plastique:4203:6627326,6638160:film_plastique:4203:6704173,6653521:film_plastique:4203:6723230,6664117:film_plastique:4203:6735453,6671808:film_plastique:4203:6834088,6682068:film_plastique:4203:6768723,6685476:film_plastique:4203:6799270,6685991:film_plastique:4203:6800313,6686304:film_plastique:4203:6801310,6696473:film_plastique:4203:6698377,6740022:film_plastique:4203:6741145,6745199:film_plastique:4203:6810127,6753416:film_plastique:4203:6754070,6760133:film_plastique:4203:6761155,6774410:film_plastique:4203:6775026,6780026:film_plastique:4203:6780641,6786466:film_plastique:4203:6808096,6820599:film_plastique:4203:6822556,6825858:film_plastique:4203:6826374,6837012:film_plastique:4203:6838769,6846007:film_plastique:4203:6846429,6851650:film_plastique:4203:6852169,6869544:film_plastique:4203:6869926,6875674:film_plastique:4203:6876022,6894306:film_plastique:4203:6930487,6900378:film_pla'}, {'unwanted_material': 'film_plastique', 'main_material': 'emr', 'pht_type': 4209, 'ratio': 0.0024536770792147593, 'nb_photo': 69, 'list_port_cont': '6600779,6602159,6617705,6618987,6620421,6620776,6621929,6622078,6627041,6638509,6641074,6648120,6655495,6664009,6667518,6668136,6668210,6670551,6670887,6672176,6673393,6674366,6678097,6690827,6692895,6694182,6695921,6697464,6699019,6712090,6712235,6716808,6721888,6723150,6723675,6724773,6740489,6742332,6751452,6824345', 'assoc_port': '6600540:6602159,6600552:6600779,6616961:6617705,6618302:6618987,6620037:6620421,6620448:6620776,6621640:6622078,6621646:6621929,6626722:6627041,6631190:6668136,6631196:6668210,6632661:6670551,6632883:6670887,6638162:6638509,6640593:6641074,6647214:6648120,6654838:6655495,6663620:6664009,6664426:6667518,6671806:6672176,6672700:6673393,6673893:6674366,6677866:6678097,6682898:6690827,6685513:6697464,6688873:6699019,6691778:6692895,6692502:6694182,6694731:6695921,6710867:6712235,6711682:6712090,6716079:6716808,6721779:6721888,6722817:6723150,6723504:6723675,6724593:6724773,6739465:6742332,6740030:6740489,6750987:6751452,6823971:6824345', 'assoc_mat': '6600540:film_plastique:4209:6602159,6600552:film_plastique:4209:6600779,6616961:film_plastique:4209:6617705,6618302:film_plastique:4209:6618987,6620037:film_plastique:4209:6620421,6620448:film_plastique:4209:6620776,6621640:film_plastique:4209:6622078,6621646:film_plastique:4209:6621929,6626722:film_plastique:4209:6627041,6631190:film_plastique:4209:6668136,6631196:film_plastique:4209:6668210,6632661:film_plastique:4209:6670551,6632883:film_plastique:4209:6670887,6638162:film_plastique:4209:6638509,6640593:film_plastique:4209:6641074,6647214:film_plastique:4209:6648120,6654838:film_plastique:4209:6655495,6663620:film_plastique:4209:6664009,6664426:film_plastique:4209:6667518,6671806:film_plastique:4209:6672176,6672700:film_plastique:4209:6673393,6673893:film_plastique:4209:6674366,6677866:film_plastique:4209:6678097,6682898:film_plastique:4209:6690827,6685513:film_plastique:4209:6697464,6688873:film_plastique:4209:6699019,6691778:film_plastique:4209:6692895,6692502:film_plastique:4209:6694182,6694731:film_pla'}, {'unwanted_material': 'film_plastique', 'main_material': 'gm', 'pht_type': 4209, 'ratio': 0.004405144558639858, 'nb_photo': 50, 'list_port_cont': '6846222,6863051,6869293,6869651,6886840,6890965,6908908,6914944,6917082,6920507,6922345,6960431,12107792,12108029,12108283,12108676', 'assoc_port': '12107420:12108676,12107424:12108283,12107428:12108029,12107430:12107792,6845636:6846222,6862271:6863051,6868823:6869293,6869543:6869651,6886556:6886840,6890813:6890965,6902262:6908908,6914405:6914944,6916368:6917082,6919130:6920507,6919131:6960431,6920918:6922345', 'assoc_mat': '12107420:film_plastique:4209:12108676,12107424:film_plastique:4209:12108283,12107428:film_plastique:4209:12108029,12107430:film_plastique:4209:12107792,6845636:film_plastique:4209:6846222,6862271:film_plastique:4209:6863051,6868823:film_plastique:4209:6869293,6869543:film_plastique:4209:6869651,6886556:film_plastique:4209:6886840,6890813:film_plastique:4209:6890965,6902262:film_plastique:4209:6908908,6914405:film_plastique:4209:6914944,6916368:film_plastique:4209:6917082,6919130:film_plastique:4209:6920507,6919131:film_plastique:4209:6960431,6920918:film_plastique:4209:6922345'}, {'unwanted_material': 'film_plastique', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 0.006753454742247015, 'nb_photo': 34, 'list_port_cont': '6617254,6617671,6659522', 'assoc_port': '6616962:6617254,6616964:6617671,6652939:6659522', 'assoc_mat': '6616962:film_plastique:4207:6617254,6616964:film_plastique:4207:6617671,6652939:film_plastique:4207:6659522'}, {'unwanted_material': 'film_plastique', 'main_material': 'pehd_pp', 'pht_type': 4211, 'ratio': 0.002259746608148063, 'nb_photo': 5499, 'list_port_cont': '6600849,6600890,6601017,6601442,6602275,6602592,6603008,6603406,6606076,6607678,6608058,6608295,6609456,6610404,6610609,6610652,6611148,6614536,6615399,6615435,6615793,6616511,6617424,6618766,6618925,6620326,6620921,6621065,6621674,6621974,6622008,6622128,6622208,6622454,6624061,6625573,6626621,6626647,6627282,6628485,6629175,6629247,6634383,6634658,6634850,6635144,6635829,6638283,6638444,6639153,6641001,6642062,6642716,6650045,6650153,6650270,6650961,6658508,6664038,6666449,6668094,6668173,6669613,6672032,6674008,6674546,6674641,6674770,6675073,6675109,6675137,6675474,6676525,6676617,6677121,6677223,6677802,6678045,6678212,6678572,6678654,6678774,6678959,6678990,6679232,6681260,6687145,6691518,6691651,6692290,6693202,6693680,6693906,6694032,6694214,6694412,6695522,6697517,6698427,6698760,6698790,6699374,6699429,6700667,6705446,6706630,6706777,6707225,6707821,6709736,6711239,6711396,6711489,6712153,6712493,6712628,6712756,6713442,6713595,6713761,6714400,6716476,6716567,6717500,6717544,6718036,6718525,6719027,', 'assoc_port': '10844008:10846072,10844009:10845794,10844010:10846040,10844011:10845549,10844012:10845979,10844013:10845414,10844014:10845182,10844015:10845079,10844016:10845170,10844017:10845132,10844018:10844951,10844019:10845054,10844020:10844687,10844021:10844442,12107423:12108313,12107427:12108076,12107429:12107822,6600536:6601442,6600544:6600849,6600546:6601017,6600551:6600890,6601138:6602592,6601649:6602275,6602728:6603008,6602733:6603406,6604399:6608058,6605499:6610652,6605688:6606076,6606683:6607678,6607835:6610404,6607839:6608295,6609199:6609456,6610498:6610609,6610992:6611148,6614199:6614536,6614967:6615399,6614969:6615435,6615362:6615793,6616173:6616511,6616982:6617424,6618307:6618766,6618311:6618925,6620040:6620326,6620422:6621674,6620444:6621065,6620447:6620921,6621638:6624061,6621643:6622454,6621647:6622208,6621651:6622128,6621654:6621974,6621659:6622008,6625236:6625573,6626268:6626621,6626274:6626647,6627098:6627282,6627945:6628485,6628987:6629175,6628989:6629247,6630850:6634850,6630852:6674008,6630856:663465', 'assoc_mat': '10844008:film_plastique:4211:10846072,10844009:film_plastique:4211:10845794,10844010:film_plastique:4211:10846040,10844011:film_plastique:4211:10845549,10844012:film_plastique:4211:10845979,10844013:film_plastique:4211:10845414,10844014:film_plastique:4211:10845182,10844015:film_plastique:4211:10845079,10844016:film_plastique:4211:10845170,10844017:film_plastique:4211:10845132,10844018:film_plastique:4211:10844951,10844019:film_plastique:4211:10845054,10844020:film_plastique:4211:10844687,10844021:film_plastique:4211:10844442,12107423:film_plastique:4211:12108313,12107427:film_plastique:4211:12108076,12107429:film_plastique:4211:12107822,6600536:film_plastique:4211:6601442,6600544:film_plastique:4211:6600849,6600546:film_plastique:4211:6601017,6600551:film_plastique:4211:6600890,6601138:film_plastique:4211:6602592,6601649:film_plastique:4211:6602275,6602728:film_plastique:4211:6603008,6602733:film_plastique:4211:6603406,6604399:film_plastique:4211:6608058,6605499:film_plastique:4211:6610652,6605688:film_plast'}, {'unwanted_material': 'film_plastique', 'main_material': 'pet_fonce', 'pht_type': 4200, 'ratio': 0.009562760165995879, 'nb_photo': 651, 'list_port_cont': '6600935,6602065,6604873,6606113,6609166,6613072,6615619,6618496,6620183,6620863,6621894,6626781,6628361,6634253,6635399,6637071,6637439,6638362,6639237,6641573,6646019,6647326,6649276,6649481,6649910,6653428,6654681,6655699,6658476,6662389,6665188,6669588,6670057,6672611,6674515,6683658,6684468,6686795,6687232,6687468,6696454,6696813,6698466,6711565,6712273,6712779,6714502,6717597,6719828,6720160,6720216,6720243,6720362,6721257,6722534,6724152,6739287,6740805,6745514,6745792,6750253,6754188,6754560,6759424,6765277,6766706,6767355,6780405,6780527,6780713,6784028,6786844,6788649,6791328,6793700,6795545,6797658,6813918,6817663,6821381,6824093,6835171,6836542,6840210,6842440,6849225,6851785,6852368,6854521,6859028,6862726,6865775,6866336,6867967,6869257,6874408,6875757,6882725,6886810,6888104,6889508,6895295,6900331,6902499,6904843,6914441,6920747,6921624,6924250', 'assoc_port': '6600538:6600935,6601136:6602065,6604397:6604873,6605689:6606113,6608145:6609166,6612632:6613072,6615365:6615619,6618309:6618496,6620043:6620183,6620439:6620863,6621653:6621894,6626271:6626781,6627944:6628361,6630848:6646019,6631070:6649276,6631186:6634253,6631194:6649910,6631961:6655699,6632583:6662389,6632786:6635399,6632966:6670057,6635673:6637439,6635681:6637071,6637843:6638362,6638774:6639237,6641286:6641573,6646447:6647326,6648940:6649481,6650951:6653428,6654041:6654681,6657889:6658476,6664429:6665188,6668950:6669588,6671809:6672611,6673895:6674515,6681680:6683658,6683618:6684468,6685440:6720362,6685511:6720216,6686027:6719828,6686041:6720160,6686295:6687468,6686312:6687232,6686325:6686795,6688871:6714502,6690894:6698466,6693641:6696454,6696476:6696813,6710860:6711565,6711680:6712273,6712324:6712779,6716688:6717597,6718843:6720243,6720803:6721257,6722354:6722534,6723892:6724152,6738748:6739287,6740018:6740805,6740709:6745514,6744268:6745792,6748062:6750253,6753406:6754560,6753419:6754188,6759057:6759424,', 'assoc_mat': '6600538:film_plastique:4200:6600935,6601136:film_plastique:4200:6602065,6604397:film_plastique:4200:6604873,6605689:film_plastique:4200:6606113,6608145:film_plastique:4200:6609166,6612632:film_plastique:4200:6613072,6615365:film_plastique:4200:6615619,6618309:film_plastique:4200:6618496,6620043:film_plastique:4200:6620183,6620439:film_plastique:4200:6620863,6621653:film_plastique:4200:6621894,6626271:film_plastique:4200:6626781,6627944:film_plastique:4200:6628361,6630848:film_plastique:4200:6646019,6631070:film_plastique:4200:6649276,6631186:film_plastique:4200:6634253,6631194:film_plastique:4200:6649910,6631961:film_plastique:4200:6655699,6632583:film_plastique:4200:6662389,6632786:film_plastique:4200:6635399,6632966:film_plastique:4200:6670057,6635673:film_plastique:4200:6637439,6635681:film_plastique:4200:6637071,6637843:film_plastique:4200:6638362,6638774:film_plastique:4200:6639237,6641286:film_plastique:4200:6641573,6646447:film_plastique:4200:6647326,6648940:film_plastique:4200:6649481,6650951:film_pla'}, {'unwanted_material': 'kraft', 'main_material': 'ela', 'pht_type': 4203, 'ratio': 0.0013476688860348137, 'nb_photo': 25, 'list_port_cont': '6603437,6608810,6624174,6698367,6704169,6720534,6723222,6723404,6735448,6754066,6768737,6775016,6799274,6806349,6808099,6808748,6822563,6826367,6930490', 'assoc_port': '6602731:6603437,6608146:6608810,6620405:6624174,6638160:6704169,6653521:6723222,6664117:6735448,6682068:6768737,6685476:6799274,6696473:6698367,6718634:6720534,6722813:6723404,6753416:6754066,6765566:6808748,6774410:6775016,6786466:6808099,6793236:6806349,6820599:6822563,6825858:6826367,6894306:6930490', 'assoc_mat': '6602731:kraft:4203:6603437,6608146:kraft:4203:6608810,6620405:kraft:4203:6624174,6638160:kraft:4203:6704169,6653521:kraft:4203:6723222,6664117:kraft:4203:6735448,6682068:kraft:4203:6768737,6685476:kraft:4203:6799274,6696473:kraft:4203:6698367,6718634:kraft:4203:6720534,6722813:kraft:4203:6723404,6753416:kraft:4203:6754066,6765566:kraft:4203:6808748,6774410:kraft:4203:6775016,6786466:kraft:4203:6808099,6793236:kraft:4203:6806349,6820599:kraft:4203:6822563,6825858:kraft:4203:6826367,6894306:kraft:4203:6930490'}, {'unwanted_material': 'kraft', 'main_material': 'pehd_pp', 'pht_type': 4211, 'ratio': 0.0002605400427680809, 'nb_photo': 31, 'list_port_cont': '6602597,6603402,6608291,6621971,6629173,6635141,6674012,6675078,6718038,6721839,6731861,6756973,6763094,6767267,6782609,6783130,6786055,6787764,6799513,6800227,6800537,6806177,6808705,6863473,6869206,6917724', 'assoc_port': '6601138:6602597,6602733:6603402,6607839:6608291,6621654:6621971,6628987:6629173,6630852:6674012,6631065:6675078,6631193:6635141,6640595:6806177,6651292:6721839,6657891:6731861,6685502:6799513,6685989:6800227,6686094:6800537,6717679:6718038,6748064:6756973,6762546:6763094,6765565:6808705,6766922:6767267,6779975:6786055,6782244:6783130,6782282:6782609,6787218:6787764,6862775:6863473,6868825:6869206,6916370:6917724', 'assoc_mat': '6601138:kraft:4211:6602597,6602733:kraft:4211:6603402,6607839:kraft:4211:6608291,6621654:kraft:4211:6621971,6628987:kraft:4211:6629173,6630852:kraft:4211:6674012,6631065:kraft:4211:6675078,6631193:kraft:4211:6635141,6640595:kraft:4211:6806177,6651292:kraft:4211:6721839,6657891:kraft:4211:6731861,6685502:kraft:4211:6799513,6685989:kraft:4211:6800227,6686094:kraft:4211:6800537,6717679:kraft:4211:6718038,6748064:kraft:4211:6756973,6762546:kraft:4211:6763094,6765565:kraft:4211:6808705,6766922:kraft:4211:6767267,6779975:kraft:4211:6786055,6782244:kraft:4211:6783130,6782282:kraft:4211:6782609,6787218:kraft:4211:6787764,6862775:kraft:4211:6863473,6868825:kraft:4211:6869206,6916370:kraft:4211:6917724'}, {'unwanted_material': 'kraft', 'main_material': 'pet_fonce', 'pht_type': 4200, 'ratio': 0.002080903131306298, 'nb_photo': 8, 'list_port_cont': '6654687,6665187,6711559,6739285,6786851,6875988,6895294', 'assoc_port': '6654041:6654687,6664429:6665187,6710860:6711559,6738748:6739285,6786463:6786851,6875675:6875988,6894305:6895294', 'assoc_mat': '6654041:kraft:4200:6654687,6664429:kraft:4200:6665187,6710860:kraft:4200:6711559,6738748:kraft:4200:6739285,6786463:kraft:4200:6786851,6875675:kraft:4200:6875988,6894305:kraft:4200:6895294'}, {'unwanted_material': 'metal', 'main_material': 'ela', 'pht_type': 4203, 'ratio': 0.0025689075464105384, 'nb_photo': 116, 'list_port_cont': '6603439,6608802,6618323,6624168,6627336,6634744,6634804,6698366,6704170,6712714,6720531,6723221,6723414,6735153,6741143,6754064,6768738,6775029,6780637,6799279,6800304,6801309,6806355,6808095,6808740,6810126,6812819,6822550,6826362,6834102,6838768,6846434,6852156,6863255,6865671,6869930,6876016,6930480,6940846,10844182', 'assoc_port': '10844025:10844182,6602731:6603439,6608146:6608802,6617603:6618323,6620405:6624168,6626721:6627336,6630937:6634744,6631483:6634804,6638160:6704170,6653521:6723221,6671808:6834102,6682068:6768738,6685476:6799279,6685991:6800304,6686304:6801309,6690887:6735153,6696473:6698366,6712332:6712714,6718634:6720531,6722813:6723414,6740022:6741143,6745199:6810126,6753416:6754064,6765566:6808740,6774410:6775029,6780026:6780637,6786466:6808095,6793236:6806355,6811950:6812819,6820599:6822550,6825858:6826362,6837012:6838768,6846007:6846434,6851650:6852156,6863104:6863255,6865559:6865671,6869544:6869930,6875674:6876016,6894306:6930480,6900378:6940846', 'assoc_mat': '10844025:metal:4203:10844182,6602731:metal:4203:6603439,6608146:metal:4203:6608802,6617603:metal:4203:6618323,6620405:metal:4203:6624168,6626721:metal:4203:6627336,6630937:metal:4203:6634744,6631483:metal:4203:6634804,6638160:metal:4203:6704170,6653521:metal:4203:6723221,6671808:metal:4203:6834102,6682068:metal:4203:6768738,6685476:metal:4203:6799279,6685991:metal:4203:6800304,6686304:metal:4203:6801309,6690887:metal:4203:6735153,6696473:metal:4203:6698366,6712332:metal:4203:6712714,6718634:metal:4203:6720531,6722813:metal:4203:6723414,6740022:metal:4203:6741143,6745199:metal:4203:6810126,6753416:metal:4203:6754064,6765566:metal:4203:6808740,6774410:metal:4203:6775029,6780026:metal:4203:6780637,6786466:metal:4203:6808095,6793236:metal:4203:6806355,6811950:metal:4203:6812819,6820599:metal:4203:6822550,6825858:metal:4203:6826362,6837012:metal:4203:6838768,6846007:metal:4203:6846434,6851650:metal:4203:6852156,6863104:metal:4203:6863255,6865559:metal:4203:6865671,6869544:metal:4203:6869930,6875674:metal:4203:6876'}, {'unwanted_material': 'metal', 'main_material': 'emr', 'pht_type': 4209, 'ratio': 0.01620320652826406, 'nb_photo': 95, 'list_port_cont': '6600765,6601464,6602163,6616735,6618978,6620417,6620780,6621471,6622065,6625394,6627054,6638506,6641080,6644333,6647279,6648126,6651921,6655492,6664016,6666561,6668141,6668996,6669285,6669399,6670444,6670900,6672174,6673388,6678096,6690826,6692907,6695450,6695916,6697457,6711036,6712095,6712243,6716818,6721890,6723141,6723677,6740494,6751439,6754759,6791206,6812443', 'assoc_port': '6600533:6601464,6600540:6602163,6600552:6600765,6616168:6616735,6618302:6618978,6620037:6620417,6620443:6621471,6620448:6620780,6621640:6622065,6625237:6625394,6626722:6627054,6631064:6666561,6631190:6668141,6631480:6668996,6631482:6669285,6631491:6669399,6632580:6670444,6632883:6670900,6638162:6638506,6638777:6644333,6640593:6641080,6646444:6647279,6647214:6648126,6650509:6651921,6654838:6655492,6663620:6664016,6671806:6672174,6672700:6673388,6677866:6678096,6682898:6690826,6685513:6697457,6691778:6692907,6694731:6695916,6694740:6695450,6709375:6711036,6710867:6712243,6711682:6712095,6716079:6716818,6721779:6721890,6722817:6723141,6723504:6723677,6740030:6740494,6741911:6754759,6750987:6751439,6790915:6791206,6811912:6812443', 'assoc_mat': '6600533:metal:4209:6601464,6600540:metal:4209:6602163,6600552:metal:4209:6600765,6616168:metal:4209:6616735,6618302:metal:4209:6618978,6620037:metal:4209:6620417,6620443:metal:4209:6621471,6620448:metal:4209:6620780,6621640:metal:4209:6622065,6625237:metal:4209:6625394,6626722:metal:4209:6627054,6631064:metal:4209:6666561,6631190:metal:4209:6668141,6631480:metal:4209:6668996,6631482:metal:4209:6669285,6631491:metal:4209:6669399,6632580:metal:4209:6670444,6632883:metal:4209:6670900,6638162:metal:4209:6638506,6638777:metal:4209:6644333,6640593:metal:4209:6641080,6646444:metal:4209:6647279,6647214:metal:4209:6648126,6650509:metal:4209:6651921,6654838:metal:4209:6655492,6663620:metal:4209:6664016,6671806:metal:4209:6672174,6672700:metal:4209:6673388,6677866:metal:4209:6678096,6682898:metal:4209:6690826,6685513:metal:4209:6697457,6691778:metal:4209:6692907,6694731:metal:4209:6695916,6694740:metal:4209:6695450,6709375:metal:4209:6711036,6710867:metal:4209:6712243,6711682:metal:4209:6712095,6716079:metal:4209:671681'}, {'unwanted_material': 'metal', 'main_material': 'gm', 'pht_type': 4209, 'ratio': 0.03813640273004401, 'nb_photo': 50, 'list_port_cont': '6846234,6869292,6869658,6886838,6890968,6894664,6908915,6914949,6920506,6922343,6960437,12108025,12108375,12108683', 'assoc_port': '12107420:12108683,12107422:12108375,12107428:12108025,6845636:6846234,6868823:6869292,6869543:6869658,6886556:6886838,6890813:6890968,6894304:6894664,6902262:6908915,6914405:6914949,6919130:6920506,6919131:6960437,6920918:6922343', 'assoc_mat': '12107420:metal:4209:12108683,12107422:metal:4209:12108375,12107428:metal:4209:12108025,6845636:metal:4209:6846234,6868823:metal:4209:6869292,6869543:metal:4209:6869658,6886556:metal:4209:6886838,6890813:metal:4209:6890968,6894304:metal:4209:6894664,6902262:metal:4209:6908915,6914405:metal:4209:6914949,6919130:metal:4209:6920506,6919131:metal:4209:6960437,6920918:metal:4209:6922343'}, {'unwanted_material': 'metal', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 0.28424781729752074, 'nb_photo': 15, 'list_port_cont': '6617261,6617679,6659518', 'assoc_port': '6616962:6617261,6616964:6617679,6652939:6659518', 'assoc_mat': '6616962:metal:4207:6617261,6616964:metal:4207:6617679,6652939:metal:4207:6659518'}, {'unwanted_material': 'metal', 'main_material': 'pehd_pp', 'pht_type': 4211, 'ratio': 0.014105013759782188, 'nb_photo': 4099, 'list_port_cont': '6600856,6600899,6601011,6601438,6601603,6602271,6602596,6603016,6603404,6606080,6607692,6608057,6608280,6609447,6610406,6610603,6610660,6611150,6613941,6614530,6615402,6615431,6615798,6616522,6617438,6618772,6618911,6620212,6620337,6620916,6621058,6621671,6621967,6622006,6622131,6622198,6622469,6624050,6625565,6626622,6626649,6627272,6628473,6629174,6629239,6634384,6634649,6634849,6635130,6635842,6638288,6638454,6639155,6641000,6642050,6642701,6649970,6650051,6650148,6650282,6650968,6653714,6658501,6664036,6666452,6668086,6668172,6669618,6672033,6674018,6674395,6674559,6674640,6674768,6675067,6675113,6675145,6675475,6676538,6676615,6677120,6677227,6677799,6678035,6678225,6678304,6678567,6678655,6678773,6678968,6679000,6679222,6681257,6687134,6691497,6691663,6692286,6693199,6693683,6693905,6694046,6694218,6694411,6695512,6697510,6698424,6698770,6698800,6699365,6699425,6700612,6700659,6705447,6706623,6706766,6707227,6707825,6709724,6711225,6711407,6711492,6712148,6712489,6712634,6712755,6713434,6713596,6713751,', 'assoc_port': '10844008:10846070,10844009:10845782,10844010:10846037,10844011:10845544,10844012:10845982,10844013:10845413,10844014:10845190,10844015:10845088,10844016:10845174,10844017:10845137,10844018:10844954,10844019:10845038,10844020:10844683,10844021:10844455,12107423:12108305,12107427:12108080,12107429:12107834,6600536:6601438,6600544:6600856,6600546:6601011,6600551:6600899,6601138:6602596,6601142:6601603,6601649:6602271,6602728:6603016,6602733:6603404,6604399:6608057,6605499:6610660,6605688:6606080,6606683:6607692,6607835:6610406,6607839:6608280,6609199:6609447,6610498:6610603,6610992:6611150,6613877:6613941,6614199:6614530,6614967:6615402,6614969:6615431,6615362:6615798,6616173:6616522,6616982:6617438,6618307:6618772,6618311:6618911,6620038:6620212,6620040:6620337,6620422:6621671,6620444:6621058,6620447:6620916,6621638:6624050,6621643:6622469,6621647:6622198,6621651:6622131,6621654:6621967,6621659:6622006,6625236:6625565,6626268:6626622,6626274:6626649,6627098:6627272,6627945:6628473,6628987:6629174,6628989:662923', 'assoc_mat': '10844008:metal:4211:10846070,10844009:metal:4211:10845782,10844010:metal:4211:10846037,10844011:metal:4211:10845544,10844012:metal:4211:10845982,10844013:metal:4211:10845413,10844014:metal:4211:10845190,10844015:metal:4211:10845088,10844016:metal:4211:10845174,10844017:metal:4211:10845137,10844018:metal:4211:10844954,10844019:metal:4211:10845038,10844020:metal:4211:10844683,10844021:metal:4211:10844455,12107423:metal:4211:12108305,12107427:metal:4211:12108080,12107429:metal:4211:12107834,6600536:metal:4211:6601438,6600544:metal:4211:6600856,6600546:metal:4211:6601011,6600551:metal:4211:6600899,6601138:metal:4211:6602596,6601142:metal:4211:6601603,6601649:metal:4211:6602271,6602728:metal:4211:6603016,6602733:metal:4211:6603404,6604399:metal:4211:6608057,6605499:metal:4211:6610660,6605688:metal:4211:6606080,6606683:metal:4211:6607692,6607835:metal:4211:6610406,6607839:metal:4211:6608280,6609199:metal:4211:6609447,6610498:metal:4211:6610603,6610992:metal:4211:6611150,6613877:metal:4211:6613941,6614199:metal:4211'}, {'unwanted_material': 'metal', 'main_material': 'pet_clair', 'pht_type': 3327, 'ratio': 0.0018611932504713049, 'nb_photo': 168, 'list_port_cont': '6602309,6606381,6607132,6607892,6608676,6609913,6610058,6613724,6618178,6621382,6621446,6622317,6622515,6622750,6627836,6629357,6635868,6636122,6636323,6636736,6637761,6638093,6638417,6638705,6638836,6638971,6639356,6639756,6639841,6640772,6640965,6642021,6642089,6643659,6643689,6644080,6648806,6652946,6664581,6668616,6674494,6675599,6676588,6681849,6685021,6686471,6687366,6687492,6688258,6688984,6689512,6689535,6690288,6690633,6692197,6692683,6693648,6696369,6697176,6697873,6698735,6698882,6699062,6699467,6700152,6712810,6712846,6713279,6718380,6719374,6721461,6722064,6723542,6724041,6725336,6740417,6745471,6746032,6750024,6751761,6754361,6754498,6754531,6756337,6760376,6761240,6765850,6767303,6767722,6781605,6782080,6783162,6784119,6788824,6789101,6789299,6790666,6792153,6792401,6797280,6797781,6798013,6817846,6821598,6833582,6834267,6840067,6843272,6851938,6852133,6852491,6854288,6865690,6865866,6869175,6875951,6876047,6876102,6876518,6887363,6887386,6888987,6890298,6891134,6895349,6904238,6904578,6915036', 'assoc_port': '6601140:6602309,6604702:6606381,6605502:6607132,6606685:6607892,6607838:6608676,6609197:6610058,6609198:6609913,6612953:6613724,6616960:6618178,6620039:6621382,6620441:6621446,6621642:6622750,6621645:6622515,6621661:6622317,6627097:6627836,6628988:6629357,6630934:6637761,6630938:6638093,6631068:6638836,6631071:6638971,6631076:6639356,6631490:6640772,6631493:6640965,6631964:6642089,6632713:6648806,6632788:6643659,6632880:6636323,6632882:6644080,6633863:6635868,6635683:6636736,6635684:6636122,6637839:6638705,6637844:6638417,6638772:6639841,6638775:6639756,6640596:6643689,6641258:6642021,6650952:6652946,6663623:6664581,6667559:6668616,6673888:6675599,6673890:6674494,6674743:6676588,6681004:6681849,6683621:6685021,6685438:6699467,6685448:6698882,6685487:6698735,6685490:6699062,6685495:6700152,6685528:6687366,6685534:6686471,6686008:6697873,6686056:6697176,6686063:6689512,6686284:6689535,6686287:6690633,6686297:6688984,6686305:6688258,6686329:6687492,6688867:6690288,6690873:6692197,6691781:6692683,6692503:6693648,', 'assoc_mat': '6601140:metal:3327:6602309,6604702:metal:3327:6606381,6605502:metal:3327:6607132,6606685:metal:3327:6607892,6607838:metal:3327:6608676,6609197:metal:3327:6610058,6609198:metal:3327:6609913,6612953:metal:3327:6613724,6616960:metal:3327:6618178,6620039:metal:3327:6621382,6620441:metal:3327:6621446,6621642:metal:3327:6622750,6621645:metal:3327:6622515,6621661:metal:3327:6622317,6627097:metal:3327:6627836,6628988:metal:3327:6629357,6630934:metal:3327:6637761,6630938:metal:3327:6638093,6631068:metal:3327:6638836,6631071:metal:3327:6638971,6631076:metal:3327:6639356,6631490:metal:3327:6640772,6631493:metal:3327:6640965,6631964:metal:3327:6642089,6632713:metal:3327:6648806,6632788:metal:3327:6643659,6632880:metal:3327:6636323,6632882:metal:3327:6644080,6633863:metal:3327:6635868,6635683:metal:3327:6636736,6635684:metal:3327:6636122,6637839:metal:3327:6638705,6637844:metal:3327:6638417,6638772:metal:3327:6639841,6638775:metal:3327:6639756,6640596:metal:3327:6643689,6641258:metal:3327:6642021,6650952:metal:3327:665294'}, {'unwanted_material': 'metal', 'main_material': 'pet_fonce', 'pht_type': 4200, 'ratio': 0.008187433477581552, 'nb_photo': 161, 'list_port_cont': '6600924,6604874,6606109,6609169,6613066,6615621,6618495,6620180,6620864,6621895,6628356,6635390,6637077,6637440,6638365,6639245,6646018,6649283,6649472,6649917,6653439,6654695,6655708,6662393,6672612,6674525,6683669,6684477,6686796,6687223,6687470,6696448,6696812,6698463,6711552,6712278,6714493,6719818,6720151,6720203,6720239,6720363,6721248,6722529,6724153,6740811,6745799,6750239,6754562,6759423,6765268,6767356,6780402,6780532,6784026,6786842,6788648,6791326,6793698,6797669,6813916,6824104,6835192,6836545,6840197,6842435,6849222,6851783,6852365,6854532,6859036,6862724,6866334,6867975,6869267,6874413,6875761,6875987,6882735,6895285,6900330,6902505,6904844,6914446,6920751,6921633', 'assoc_port': '6600538:6600924,6604397:6604874,6605689:6606109,6608145:6609169,6612632:6613066,6615365:6615621,6618309:6618495,6620043:6620180,6620439:6620864,6621653:6621895,6627944:6628356,6630848:6646018,6631070:6649283,6631194:6649917,6631961:6655708,6632583:6662393,6632786:6635390,6635673:6637440,6635681:6637077,6637843:6638365,6638774:6639245,6648940:6649472,6650951:6653439,6654041:6654695,6671809:6672612,6673895:6674525,6681680:6683669,6683618:6684477,6685440:6720363,6685511:6720203,6686027:6719818,6686041:6720151,6686295:6687470,6686312:6687223,6686325:6686796,6688871:6714493,6690894:6698463,6693641:6696448,6696476:6696812,6710860:6711552,6711680:6712278,6718843:6720239,6720803:6721248,6722354:6722529,6723892:6724153,6740018:6740811,6744268:6745799,6748062:6750239,6753406:6754562,6759057:6759423,6764848:6765268,6766924:6767356,6779977:6780532,6780017:6780402,6782249:6784026,6786463:6786842,6787690:6788648,6790918:6791326,6793238:6793698,6797266:6797669,6813389:6813916,6823753:6824104,6833510:6835192,6835942:6836545,', 'assoc_mat': '6600538:metal:4200:6600924,6604397:metal:4200:6604874,6605689:metal:4200:6606109,6608145:metal:4200:6609169,6612632:metal:4200:6613066,6615365:metal:4200:6615621,6618309:metal:4200:6618495,6620043:metal:4200:6620180,6620439:metal:4200:6620864,6621653:metal:4200:6621895,6627944:metal:4200:6628356,6630848:metal:4200:6646018,6631070:metal:4200:6649283,6631194:metal:4200:6649917,6631961:metal:4200:6655708,6632583:metal:4200:6662393,6632786:metal:4200:6635390,6635673:metal:4200:6637440,6635681:metal:4200:6637077,6637843:metal:4200:6638365,6638774:metal:4200:6639245,6648940:metal:4200:6649472,6650951:metal:4200:6653439,6654041:metal:4200:6654695,6671809:metal:4200:6672612,6673895:metal:4200:6674525,6681680:metal:4200:6683669,6683618:metal:4200:6684477,6685440:metal:4200:6720363,6685511:metal:4200:6720203,6686027:metal:4200:6719818,6686041:metal:4200:6720151,6686295:metal:4200:6687470,6686312:metal:4200:6687223,6686325:metal:4200:6686796,6688871:metal:4200:6714493,6690894:metal:4200:6698463,6693641:metal:4200:669644'}, {'unwanted_material': 'papier', 'main_material': 'ela', 'pht_type': 4203, 'ratio': 0.061231730810446236, 'nb_photo': 10116, 'list_port_cont': '6603432,6608812,6618330,6624173,6627328,6634747,6634795,6660087,6698364,6704163,6712713,6720535,6723229,6723411,6735156,6735458,6741135,6754073,6761149,6768728,6775022,6780633,6799278,6800307,6801306,6806356,6808105,6808742,6810131,6812817,6822555,6826373,6834089,6838762,6846431,6852157,6863266,6865666,6869918,6876010,6930481,6940835,10844177', 'assoc_port': '10844025:10844177,6602731:6603432,6608146:6608812,6617603:6618330,6620405:6624173,6626721:6627328,6630937:6634747,6631483:6634795,6632879:6660087,6638160:6704163,6653521:6723229,6664117:6735458,6671808:6834089,6682068:6768728,6685476:6799278,6685991:6800307,6686304:6801306,6690887:6735156,6696473:6698364,6712332:6712713,6718634:6720535,6722813:6723411,6740022:6741135,6745199:6810131,6753416:6754073,6760133:6761149,6765566:6808742,6774410:6775022,6780026:6780633,6786466:6808105,6793236:6806356,6811950:6812817,6820599:6822555,6825858:6826373,6837012:6838762,6846007:6846431,6851650:6852157,6863104:6863266,6865559:6865666,6869544:6869918,6875674:6876010,6894306:6930481,6900378:6940835', 'assoc_mat': '10844025:papier:4203:10844177,6602731:papier:4203:6603432,6608146:papier:4203:6608812,6617603:papier:4203:6618330,6620405:papier:4203:6624173,6626721:papier:4203:6627328,6630937:papier:4203:6634747,6631483:papier:4203:6634795,6632879:papier:4203:6660087,6638160:papier:4203:6704163,6653521:papier:4203:6723229,6664117:papier:4203:6735458,6671808:papier:4203:6834089,6682068:papier:4203:6768728,6685476:papier:4203:6799278,6685991:papier:4203:6800307,6686304:papier:4203:6801306,6690887:papier:4203:6735156,6696473:papier:4203:6698364,6712332:papier:4203:6712713,6718634:papier:4203:6720535,6722813:papier:4203:6723411,6740022:papier:4203:6741135,6745199:papier:4203:6810131,6753416:papier:4203:6754073,6760133:papier:4203:6761149,6765566:papier:4203:6808742,6774410:papier:4203:6775022,6780026:papier:4203:6780633,6786466:papier:4203:6808105,6793236:papier:4203:6806356,6811950:papier:4203:6812817,6820599:papier:4203:6822555,6825858:papier:4203:6826373,6837012:papier:4203:6838762,6846007:papier:4203:6846431,6851650:papier'}, {'unwanted_material': 'papier', 'main_material': 'emr', 'pht_type': 4207, 'ratio': 0.026271390056728197, 'nb_photo': 8, 'list_port_cont': '12107737,12108213', 'assoc_port': '12107419:12108213,12107426:12107737', 'assoc_mat': '12107419:papier:4207:12108213,12107426:papier:4207:12107737'}, {'unwanted_material': 'papier', 'main_material': 'emr', 'pht_type': 4209, 'ratio': 0.9818228416534489, 'nb_photo': 22895, 'list_port_cont': '6600771,6601474,6602161,6616739,6617534,6617710,6618973,6620407,6620774,6621480,6621932,6622068,6625404,6627042,6637128,6638496,6641078,6644338,6647274,6648128,6651923,6655481,6657574,6664005,6666560,6667526,6668133,6668203,6668997,6669282,6669400,6670442,6670550,6670895,6672175,6673389,6674361,6678087,6682355,6690830,6692892,6694186,6695449,6695911,6697461,6699021,6711049,6712084,6712241,6716813,6721889,6723151,6723680,6724781,6740492,6742323,6751441,6754771,6791212,6812437,6824349', 'assoc_port': '6600533:6601474,6600540:6602161,6600552:6600771,6616168:6616739,6616961:6617710,6616963:6617534,6618302:6618973,6620037:6620407,6620443:6621480,6620448:6620774,6621640:6622068,6621646:6621932,6625237:6625404,6626722:6627042,6631064:6666560,6631190:6668133,6631196:6668203,6631480:6668997,6631482:6669282,6631491:6669400,6632580:6670442,6632661:6670550,6632883:6670895,6633864:6637128,6638162:6638496,6638777:6644338,6640593:6641078,6646444:6647274,6647214:6648128,6650509:6651923,6654838:6655481,6656897:6657574,6663620:6664005,6664426:6667526,6671806:6672175,6672700:6673389,6673893:6674361,6677866:6678087,6681682:6682355,6682898:6690830,6685513:6697461,6688873:6699021,6691778:6692892,6692502:6694186,6694731:6695911,6694740:6695449,6709375:6711049,6710867:6712241,6711682:6712084,6716079:6716813,6721779:6721889,6722817:6723151,6723504:6723680,6724593:6724781,6739465:6742323,6740030:6740492,6741911:6754771,6750987:6751441,6790915:6791212,6811912:6812437,6823971:6824349', 'assoc_mat': '6600533:papier:4209:6601474,6600540:papier:4209:6602161,6600552:papier:4209:6600771,6616168:papier:4209:6616739,6616961:papier:4209:6617710,6616963:papier:4209:6617534,6618302:papier:4209:6618973,6620037:papier:4209:6620407,6620443:papier:4209:6621480,6620448:papier:4209:6620774,6621640:papier:4209:6622068,6621646:papier:4209:6621932,6625237:papier:4209:6625404,6626722:papier:4209:6627042,6631064:papier:4209:6666560,6631190:papier:4209:6668133,6631196:papier:4209:6668203,6631480:papier:4209:6668997,6631482:papier:4209:6669282,6631491:papier:4209:6669400,6632580:papier:4209:6670442,6632661:papier:4209:6670550,6632883:papier:4209:6670895,6633864:papier:4209:6637128,6638162:papier:4209:6638496,6638777:papier:4209:6644338,6640593:papier:4209:6641078,6646444:papier:4209:6647274,6647214:papier:4209:6648128,6650509:papier:4209:6651923,6654838:papier:4209:6655481,6656897:papier:4209:6657574,6663620:papier:4209:6664005,6664426:papier:4209:6667526,6671806:papier:4209:6672175,6672700:papier:4209:6673389,6673893:papier:4'}, {'unwanted_material': 'papier', 'main_material': 'gm', 'pht_type': 4209, 'ratio': 0.9778679543860948, 'nb_photo': 9654, 'list_port_cont': '6846225,6863052,6869290,6869652,6886839,6890954,6894669,6908902,6914938,6917074,6920517,6922339,6960439,12107799,12108033,12108279,12108335,12108368,12108547,12108681,12151216', 'assoc_port': '12107418:12151216,12107420:12108681,12107421:12108547,12107422:12108368,12107424:12108279,12107425:12108335,12107428:12108033,12107430:12107799,6845636:6846225,6862271:6863052,6868823:6869290,6869543:6869652,6886556:6886839,6890813:6890954,6894304:6894669,6902262:6908902,6914405:6914938,6916368:6917074,6919130:6920517,6919131:6960439,6920918:6922339', 'assoc_mat': '12107418:papier:4209:12151216,12107420:papier:4209:12108681,12107421:papier:4209:12108547,12107422:papier:4209:12108368,12107424:papier:4209:12108279,12107425:papier:4209:12108335,12107428:papier:4209:12108033,12107430:papier:4209:12107799,6845636:papier:4209:6846225,6862271:papier:4209:6863052,6868823:papier:4209:6869290,6869543:papier:4209:6869652,6886556:papier:4209:6886839,6890813:papier:4209:6890954,6894304:papier:4209:6894669,6902262:papier:4209:6908902,6914405:papier:4209:6914938,6916368:papier:4209:6917074,6919130:papier:4209:6920517,6919131:papier:4209:6960439,6920918:papier:4209:6922339'}, {'unwanted_material': 'papier', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 0.01913239060931627, 'nb_photo': 173, 'list_port_cont': '6617263,6617672,6633555,6659520', 'assoc_port': '6616962:6617263,6616964:6617672,6631478:6633555,6652939:6659520', 'assoc_mat': '6616962:papier:4207:6617263,6616964:papier:4207:6617672,6631478:papier:4207:6633555,6652939:papier:4207:6659520'}, {'unwanted_material': 'papier', 'main_material': 'pehd_pp', 'pht_type': 4211, 'ratio': 0.02200696110253512, 'nb_photo': 44767, 'list_port_cont': '6600859,6600889,6601024,6601441,6601504,6602279,6602446,6602594,6603004,6603395,6605883,6606067,6607684,6608067,6608284,6609460,6610408,6610604,6610647,6611155,6613695,6614035,6614526,6615395,6615430,6615802,6616513,6617436,6618598,6618775,6618915,6620220,6620329,6620926,6621066,6621670,6621709,6621963,6621993,6622136,6622195,6622456,6624056,6625570,6626617,6626659,6627281,6628480,6629180,6629253,6634378,6634445,6634659,6634723,6634856,6635137,6635833,6638284,6638445,6639159,6640995,6642056,6642709,6648980,6650056,6650154,6650269,6650966,6653712,6658497,6664045,6666459,6668084,6668174,6669620,6672034,6674013,6674557,6674636,6674758,6674902,6675068,6675112,6675138,6675487,6676025,6676535,6676626,6677122,6677215,6677813,6678048,6678214,6678566,6678657,6678767,6678938,6678965,6679003,6679162,6679227,6681256,6687142,6691490,6691666,6692285,6693203,6693684,6693895,6694008,6694043,6694209,6694415,6695514,6697518,6698423,6698761,6698796,6699375,6699424,6700614,6700670,6704525,6705435,6706448,6706631,6706771,6707237,', 'assoc_port': '10844008:10846064,10844009:10845789,10844010:10846038,10844011:10845545,10844012:10845980,10844013:10845418,10844014:10845180,10844015:10845083,10844016:10845173,10844017:10845135,10844018:10844948,10844019:10845046,10844020:10844685,10844021:10844451,12107423:12108307,12107427:12108063,12107429:12107830,6600536:6601441,6600541:6601504,6600544:6600859,6600546:6601024,6600551:6600889,6601134:6602446,6601138:6602594,6601649:6602279,6602728:6603004,6602733:6603395,6604399:6608067,6605499:6610647,6605503:6605883,6605688:6606067,6606683:6607684,6607835:6610408,6607839:6608284,6609199:6609460,6610498:6610604,6610992:6611155,6613334:6613695,6613876:6614035,6614199:6614526,6614967:6615395,6614969:6615430,6615362:6615802,6616173:6616513,6616982:6617436,6618305:6618598,6618307:6618775,6618311:6618915,6620038:6620220,6620040:6620329,6620422:6621670,6620440:6621709,6620444:6621066,6620447:6620926,6621638:6624056,6621643:6622456,6621647:6622195,6621651:6622136,6621654:6621963,6621659:6621993,6625236:6625570,6626268:662661', 'assoc_mat': '10844008:papier:4211:10846064,10844009:papier:4211:10845789,10844010:papier:4211:10846038,10844011:papier:4211:10845545,10844012:papier:4211:10845980,10844013:papier:4211:10845418,10844014:papier:4211:10845180,10844015:papier:4211:10845083,10844016:papier:4211:10845173,10844017:papier:4211:10845135,10844018:papier:4211:10844948,10844019:papier:4211:10845046,10844020:papier:4211:10844685,10844021:papier:4211:10844451,12107423:papier:4211:12108307,12107427:papier:4211:12108063,12107429:papier:4211:12107830,6600536:papier:4211:6601441,6600541:papier:4211:6601504,6600544:papier:4211:6600859,6600546:papier:4211:6601024,6600551:papier:4211:6600889,6601134:papier:4211:6602446,6601138:papier:4211:6602594,6601649:papier:4211:6602279,6602728:papier:4211:6603004,6602733:papier:4211:6603395,6604399:papier:4211:6608067,6605499:papier:4211:6610647,6605503:papier:4211:6605883,6605688:papier:4211:6606067,6606683:papier:4211:6607684,6607835:papier:4211:6610408,6607839:papier:4211:6608284,6609199:papier:4211:6609460,6610498:pa'}, {'unwanted_material': 'papier', 'main_material': 'pet_clair', 'pht_type': 3327, 'ratio': 0.009355240101605987, 'nb_photo': 6285, 'list_port_cont': '6601213,6601256,6601317,6601373,6601553,6601698,6601785,6601845,6602306,6603618,6603848,6603983,6604941,6606282,6606355,6607130,6607397,6607894,6608325,6608588,6608678,6608962,6609907,6610050,6610277,6610916,6611080,6613729,6614150,6615896,6616066,6616196,6616978,6617467,6617840,6618171,6618951,6620513,6620986,6621120,6621143,6621171,6621389,6621444,6621532,6622103,6622164,6622319,6622375,6622434,6622526,6622660,6622747,6626370,6626972,6627003,6627196,6627833,6628017,6628555,6628622,6629355,6629386,6635801,6635866,6635899,6635944,6635981,6636042,6636111,6636140,6636285,6636315,6636430,6636597,6636684,6636728,6636793,6637051,6637686,6637707,6637760,6637847,6637947,6637985,6638092,6638415,6638592,6638709,6638831,6638953,6638977,6639183,6639295,6639358,6639648,6639762,6639839,6639905,6639970,6640128,6640718,6640743,6640775,6640957,6641216,6641307,6641324,6641487,6641516,6641659,6641814,6641948,6642020,6642091,6642283,6643241,6643369,6643482,6643610,6643638,6643667,6643692,6643717,6643898,6644077,6644463,6644658,', 'assoc_port': '6600535:6601256,6600537:6601698,6600543:6601213,6600545:6601373,6600547:6601553,6600550:6601785,6600553:6601317,6601140:6602306,6601199:6601845,6602727:6603848,6602729:6603983,6602732:6603618,6604400:6604941,6604702:6606355,6605500:6606282,6605502:6607130,6606682:6608325,6606685:6607894,6606687:6607397,6607836:6608588,6607838:6608678,6608144:6608962,6609197:6610050,6609198:6609907,6609963:6610277,6610497:6611080,6610499:6610916,6612953:6613729,6613333:6614150,6614966:6616196,6614968:6616066,6615360:6615896,6616171:6616978,6616960:6618171,6616966:6617467,6616967:6617840,6618310:6618951,6620036:6620513,6620039:6621389,6620042:6620986,6620404:6621143,6620441:6621444,6620445:6621171,6620446:6621532,6620449:6621120,6621639:6622660,6621642:6622747,6621645:6622526,6621650:6622375,6621652:6622434,6621655:6622164,6621656:6622103,6621661:6622319,6625901:6626370,6626270:6626972,6626272:6627003,6626275:6627196,6627097:6627833,6627099:6628017,6627946:6628555,6627948:6628622,6628988:6629355,6628991:6629386,6630847:6635944,', 'assoc_mat': '6600535:papier:3327:6601256,6600537:papier:3327:6601698,6600543:papier:3327:6601213,6600545:papier:3327:6601373,6600547:papier:3327:6601553,6600550:papier:3327:6601785,6600553:papier:3327:6601317,6601140:papier:3327:6602306,6601199:papier:3327:6601845,6602727:papier:3327:6603848,6602729:papier:3327:6603983,6602732:papier:3327:6603618,6604400:papier:3327:6604941,6604702:papier:3327:6606355,6605500:papier:3327:6606282,6605502:papier:3327:6607130,6606682:papier:3327:6608325,6606685:papier:3327:6607894,6606687:papier:3327:6607397,6607836:papier:3327:6608588,6607838:papier:3327:6608678,6608144:papier:3327:6608962,6609197:papier:3327:6610050,6609198:papier:3327:6609907,6609963:papier:3327:6610277,6610497:papier:3327:6611080,6610499:papier:3327:6610916,6612953:papier:3327:6613729,6613333:papier:3327:6614150,6614966:papier:3327:6616196,6614968:papier:3327:6616066,6615360:papier:3327:6615896,6616171:papier:3327:6616978,6616960:papier:3327:6618171,6616966:papier:3327:6617467,6616967:papier:3327:6617840,6618310:papier:3'}, {'unwanted_material': 'papier', 'main_material': 'pet_fonce', 'pht_type': 4200, 'ratio': 0.017125275841086585, 'nb_photo': 2971, 'list_port_cont': '6600926,6602063,6604875,6606104,6609174,6613071,6615626,6618500,6620184,6620854,6621908,6626783,6628360,6634243,6635396,6637073,6637446,6638360,6639247,6641571,6646008,6647325,6649284,6649479,6649902,6653435,6654683,6655706,6658468,6662396,6665198,6669579,6670065,6672619,6674516,6683662,6684471,6686799,6687236,6687458,6696447,6696824,6698461,6711553,6712279,6712781,6714496,6717599,6719829,6720164,6720215,6720241,6720368,6721253,6722530,6724154,6739279,6740796,6745518,6745791,6750249,6754202,6754551,6759426,6765269,6766705,6767366,6780400,6780521,6780722,6784029,6786845,6788639,6791340,6793690,6795542,6797664,6813924,6817658,6821374,6824105,6835188,6836541,6840208,6842437,6849226,6851792,6852378,6854525,6859024,6862734,6865779,6866332,6867973,6869258,6874411,6875759,6875982,6882729,6886818,6888094,6889509,6895296,6902512,6904831,6914440,6920757,6921627,6924261', 'assoc_port': '6600538:6600926,6601136:6602063,6604397:6604875,6605689:6606104,6608145:6609174,6612632:6613071,6615365:6615626,6618309:6618500,6620043:6620184,6620439:6620854,6621653:6621908,6626271:6626783,6627944:6628360,6630848:6646008,6631070:6649284,6631186:6634243,6631194:6649902,6631961:6655706,6632583:6662396,6632786:6635396,6632966:6670065,6635673:6637446,6635681:6637073,6637843:6638360,6638774:6639247,6641286:6641571,6646447:6647325,6648940:6649479,6650951:6653435,6654041:6654683,6657889:6658468,6664429:6665198,6668950:6669579,6671809:6672619,6673895:6674516,6681680:6683662,6683618:6684471,6685440:6720368,6685511:6720215,6686027:6719829,6686041:6720164,6686295:6687458,6686312:6687236,6686325:6686799,6688871:6714496,6690894:6698461,6693641:6696447,6696476:6696824,6710860:6711553,6711680:6712279,6712324:6712781,6716688:6717599,6718843:6720241,6720803:6721253,6722354:6722530,6723892:6724154,6738748:6739279,6740018:6740796,6740709:6745518,6744268:6745791,6748062:6750249,6753406:6754551,6753419:6754202,6759057:6759426,', 'assoc_mat': '6600538:papier:4200:6600926,6601136:papier:4200:6602063,6604397:papier:4200:6604875,6605689:papier:4200:6606104,6608145:papier:4200:6609174,6612632:papier:4200:6613071,6615365:papier:4200:6615626,6618309:papier:4200:6618500,6620043:papier:4200:6620184,6620439:papier:4200:6620854,6621653:papier:4200:6621908,6626271:papier:4200:6626783,6627944:papier:4200:6628360,6630848:papier:4200:6646008,6631070:papier:4200:6649284,6631186:papier:4200:6634243,6631194:papier:4200:6649902,6631961:papier:4200:6655706,6632583:papier:4200:6662396,6632786:papier:4200:6635396,6632966:papier:4200:6670065,6635673:papier:4200:6637446,6635681:papier:4200:6637073,6637843:papier:4200:6638360,6638774:papier:4200:6639247,6641286:papier:4200:6641571,6646447:papier:4200:6647325,6648940:papier:4200:6649479,6650951:papier:4200:6653435,6654041:papier:4200:6654683,6657889:papier:4200:6658468,6664429:papier:4200:6665198,6668950:papier:4200:6669579,6671809:papier:4200:6672619,6673895:papier:4200:6674516,6681680:papier:4200:6683662,6683618:papier:4'}, {'unwanted_material': 'pehd', 'main_material': 'ela', 'pht_type': 4203, 'ratio': 0.0013604158722732354, 'nb_photo': 67, 'list_port_cont': '6603441,6608813,6618332,6624169,6627324,6634752,6634796,6698371,6704167,6712710,6720530,6723225,6723402,6735152,6735445,6754074,6761147,6775031,6799271,6801313,6806359,6808097,6808736,6826372,6834093,6838765,6852167,6865667,6876014,6930485,6940839,10844181', 'assoc_port': '10844025:10844181,6602731:6603441,6608146:6608813,6617603:6618332,6620405:6624169,6626721:6627324,6630937:6634752,6631483:6634796,6638160:6704167,6653521:6723225,6664117:6735445,6671808:6834093,6685476:6799271,6686304:6801313,6690887:6735152,6696473:6698371,6712332:6712710,6718634:6720530,6722813:6723402,6753416:6754074,6760133:6761147,6765566:6808736,6774410:6775031,6786466:6808097,6793236:6806359,6825858:6826372,6837012:6838765,6851650:6852167,6865559:6865667,6875674:6876014,6894306:6930485,6900378:6940839', 'assoc_mat': '10844025:pehd:4203:10844181,6602731:pehd:4203:6603441,6608146:pehd:4203:6608813,6617603:pehd:4203:6618332,6620405:pehd:4203:6624169,6626721:pehd:4203:6627324,6630937:pehd:4203:6634752,6631483:pehd:4203:6634796,6638160:pehd:4203:6704167,6653521:pehd:4203:6723225,6664117:pehd:4203:6735445,6671808:pehd:4203:6834093,6685476:pehd:4203:6799271,6686304:pehd:4203:6801313,6690887:pehd:4203:6735152,6696473:pehd:4203:6698371,6712332:pehd:4203:6712710,6718634:pehd:4203:6720530,6722813:pehd:4203:6723402,6753416:pehd:4203:6754074,6760133:pehd:4203:6761147,6765566:pehd:4203:6808736,6774410:pehd:4203:6775031,6786466:pehd:4203:6808097,6793236:pehd:4203:6806359,6825858:pehd:4203:6826372,6837012:pehd:4203:6838765,6851650:pehd:4203:6852167,6865559:pehd:4203:6865667,6875674:pehd:4203:6876014,6894306:pehd:4203:6930485,6900378:pehd:4203:6940839'}, {'unwanted_material': 'pehd', 'main_material': 'emr', 'pht_type': 4209, 'ratio': 0.0004041124511179276, 'nb_photo': 6, 'list_port_cont': '6618980,6620778,6655493,6669280,6711051,6751445', 'assoc_port': '6618302:6618980,6620448:6620778,6631482:6669280,6654838:6655493,6709375:6711051,6750987:6751445', 'assoc_mat': '6618302:pehd:4209:6618980,6620448:pehd:4209:6620778,6631482:pehd:4209:6669280,6654838:pehd:4209:6655493,6709375:pehd:4209:6711051,6750987:pehd:4209:6751445'}, {'unwanted_material': 'pehd', 'main_material': 'gm', 'pht_type': 4209, 'ratio': 0.0005712244972110796, 'nb_photo': 6, 'list_port_cont': '6869288,6869648,6922350,12108027,12108673', 'assoc_port': '12107420:12108673,12107428:12108027,6868823:6869288,6869543:6869648,6920918:6922350', 'assoc_mat': '12107420:pehd:4209:12108673,12107428:pehd:4209:12108027,6868823:pehd:4209:6869288,6869543:pehd:4209:6869648,6920918:pehd:4209:6922350'}, {'unwanted_material': 'pehd', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 0.07610095728061055, 'nb_photo': 1, 'list_port_cont': '6659525', 'assoc_port': '6652939:6659525', 'assoc_mat': '6652939:pehd:4207:6659525'}, {'unwanted_material': 'pehd', 'main_material': 'pehd_pp', 'pht_type': 4211, 'ratio': 0.9648891206027819, 'nb_photo': 8269, 'list_port_cont': '6600597,6600702,6600852,6600891,6601022,6601052,6601428,6601500,6601604,6602281,6602444,6602601,6603006,6603409,6605890,6606075,6607690,6608072,6608288,6609448,6610185,6610407,6610605,6610648,6611149,6613701,6613906,6613939,6614041,6614531,6615390,6615428,6615558,6615799,6616519,6617435,6618606,6618771,6618913,6620221,6620341,6620928,6621057,6621666,6621699,6621790,6621962,6622001,6622037,6622126,6622206,6622461,6624054,6625571,6626612,6626650,6627283,6628486,6629182,6629248,6634392,6634439,6634652,6634721,6634852,6635131,6635834,6638285,6638453,6639157,6640992,6642047,6642713,6648978,6649961,6650055,6650160,6650275,6650956,6653710,6658507,6664051,6666446,6668093,6668166,6669619,6672027,6674019,6674406,6674558,6674637,6674764,6674895,6675069,6675098,6675131,6675486,6676018,6676531,6676620,6677123,6677226,6677805,6678033,6678221,6678316,6678581,6678659,6678689,6678763,6678928,6678955,6678997,6679159,6679231,6681253,6687144,6691496,6691661,6692281,6693207,6693677,6693893,6694000,6694040,6694208,6694413,6695519,', 'assoc_port': '10844008:10846067,10844009:10845792,10844010:10846032,10844011:10845548,10844012:10845975,10844013:10845405,10844014:10845186,10844015:10845082,10844016:10845169,10844017:10845131,10844018:10844955,10844019:10845040,10844020:10844684,10844021:10844450,12107423:12108306,12107427:12108068,12107429:12107833,6600532:6601052,6600536:6601428,6600541:6601500,6600544:6600852,6600546:6601022,6600548:6600702,6600551:6600891,6600554:6600597,6601134:6602444,6601138:6602601,6601142:6601604,6601649:6602281,6602728:6603006,6602733:6603409,6604399:6608072,6605499:6610648,6605503:6605890,6605688:6606075,6606683:6607690,6607835:6610407,6607837:6610185,6607839:6608288,6609199:6609448,6610498:6610605,6610992:6611149,6613334:6613701,6613876:6614041,6613877:6613939,6613878:6613906,6614199:6614531,6614967:6615390,6614969:6615428,6615340:6615558,6615362:6615799,6616173:6616519,6616982:6617435,6618305:6618606,6618307:6618771,6618311:6618913,6620038:6620221,6620040:6620341,6620422:6621666,6620440:6621699,6620444:6621057,6620447:662092', 'assoc_mat': '10844008:pehd:4211:10846067,10844009:pehd:4211:10845792,10844010:pehd:4211:10846032,10844011:pehd:4211:10845548,10844012:pehd:4211:10845975,10844013:pehd:4211:10845405,10844014:pehd:4211:10845186,10844015:pehd:4211:10845082,10844016:pehd:4211:10845169,10844017:pehd:4211:10845131,10844018:pehd:4211:10844955,10844019:pehd:4211:10845040,10844020:pehd:4211:10844684,10844021:pehd:4211:10844450,12107423:pehd:4211:12108306,12107427:pehd:4211:12108068,12107429:pehd:4211:12107833,6600532:pehd:4211:6601052,6600536:pehd:4211:6601428,6600541:pehd:4211:6601500,6600544:pehd:4211:6600852,6600546:pehd:4211:6601022,6600548:pehd:4211:6600702,6600551:pehd:4211:6600891,6600554:pehd:4211:6600597,6601134:pehd:4211:6602444,6601138:pehd:4211:6602601,6601142:pehd:4211:6601604,6601649:pehd:4211:6602281,6602728:pehd:4211:6603006,6602733:pehd:4211:6603409,6604399:pehd:4211:6608072,6605499:pehd:4211:6610648,6605503:pehd:4211:6605890,6605688:pehd:4211:6606075,6606683:pehd:4211:6607690,6607835:pehd:4211:6610407,6607837:pehd:4211:6610185,66'}, {'unwanted_material': 'pehd', 'main_material': 'pet_clair', 'pht_type': 3327, 'ratio': 0.0019293084660709505, 'nb_photo': 273, 'list_port_cont': '6601307,6601555,6601786,6602308,6603607,6603836,6604931,6606273,6606378,6607134,6607399,6607896,6608317,6608582,6609917,6610054,6610919,6611086,6613723,6616969,6621109,6621147,6621175,6621381,6621443,6622372,6622653,6622754,6626366,6626981,6628626,6629353,6629393,6635973,6636120,6636144,6636682,6637052,6637758,6638416,6638593,6638979,6639653,6639753,6639840,6639973,6640752,6640773,6640962,6641208,6641482,6641513,6641943,6642092,6643483,6643627,6643714,6643896,6645157,6645307,6645764,6648008,6648357,6648811,6649737,6652023,6652944,6654490,6655049,6656662,6657953,6663978,6670191,6671021,6672471,6673060,6674484,6675451,6675589,6676584,6681848,6682438,6684388,6686711,6687374,6687704,6688265,6689126,6689282,6689505,6690578,6690632,6692194,6692352,6692541,6692686,6693519,6694785,6696037,6697044,6697601,6697680,6698233,6698691,6698892,6698922,6699065,6710963,6711527,6712030,6712064,6712351,6712522,6712805,6712843,6713118,6713310,6717346,6720929,6721463,6723979,6724042,6725337,6725396,6727508,6740875,6741549,6742203,', 'assoc_port': '6600547:6601555,6600550:6601786,6600553:6601307,6601140:6602308,6602727:6603836,6602732:6603607,6604400:6604931,6604702:6606378,6605500:6606273,6605502:6607134,6606682:6608317,6606685:6607896,6606687:6607399,6607836:6608582,6609197:6610054,6609198:6609917,6610497:6611086,6610499:6610919,6612953:6613723,6616171:6616969,6620039:6621381,6620404:6621147,6620441:6621443,6620445:6621175,6620449:6621109,6621639:6622653,6621642:6622754,6621650:6622372,6625901:6626366,6626270:6626981,6627948:6628626,6628988:6629353,6628991:6629393,6630851:6635973,6630853:6636682,6630934:6637758,6631071:6638979,6631073:6639653,6631075:6639973,6631486:6641482,6631488:6640752,6631490:6640773,6631493:6640962,6631964:6642092,6631965:6641513,6632579:6645157,6632584:6645764,6632662:6643483,6632711:6643714,6632713:6648811,6632876:6643896,6632968:6645307,6633861:6637052,6635680:6636144,6635684:6636120,6637842:6638593,6637844:6638416,6638772:6639840,6638775:6639753,6640591:6641208,6641288:6643627,6641292:6641943,6646445:6648008,6647213:6648357,', 'assoc_mat': '6600547:pehd:3327:6601555,6600550:pehd:3327:6601786,6600553:pehd:3327:6601307,6601140:pehd:3327:6602308,6602727:pehd:3327:6603836,6602732:pehd:3327:6603607,6604400:pehd:3327:6604931,6604702:pehd:3327:6606378,6605500:pehd:3327:6606273,6605502:pehd:3327:6607134,6606682:pehd:3327:6608317,6606685:pehd:3327:6607896,6606687:pehd:3327:6607399,6607836:pehd:3327:6608582,6609197:pehd:3327:6610054,6609198:pehd:3327:6609917,6610497:pehd:3327:6611086,6610499:pehd:3327:6610919,6612953:pehd:3327:6613723,6616171:pehd:3327:6616969,6620039:pehd:3327:6621381,6620404:pehd:3327:6621147,6620441:pehd:3327:6621443,6620445:pehd:3327:6621175,6620449:pehd:3327:6621109,6621639:pehd:3327:6622653,6621642:pehd:3327:6622754,6621650:pehd:3327:6622372,6625901:pehd:3327:6626366,6626270:pehd:3327:6626981,6627948:pehd:3327:6628626,6628988:pehd:3327:6629353,6628991:pehd:3327:6629393,6630851:pehd:3327:6635973,6630853:pehd:3327:6636682,6630934:pehd:3327:6637758,6631071:pehd:3327:6638979,6631073:pehd:3327:6639653,6631075:pehd:3327:6639973,6631486:pe'}, {'unwanted_material': 'pehd', 'main_material': 'pet_fonce', 'pht_type': 4200, 'ratio': 0.0051100227990344554, 'nb_photo': 146, 'list_port_cont': '6604877,6609170,6613068,6615614,6618503,6620187,6620866,6621902,6628367,6634250,6637080,6637448,6641565,6653431,6654691,6655698,6658465,6662390,6665200,6669580,6670050,6672621,6674514,6683659,6684464,6687228,6696451,6698464,6711561,6712283,6712785,6714507,6717609,6719826,6720245,6720364,6721249,6740804,6745511,6745786,6750247,6754189,6754553,6759422,6765273,6766697,6780403,6780526,6780710,6786856,6788637,6791338,6793691,6795538,6797665,6821369,6824092,6842448,6849223,6851780,6852369,6854529,6859027,6862725,6866337,6867970,6869263,6875756,6882722,6888109,6895287,6902508,6914447,6920759,6921629,6924255', 'assoc_port': '6604397:6604877,6608145:6609170,6612632:6613068,6615365:6615614,6618309:6618503,6620043:6620187,6620439:6620866,6621653:6621902,6627944:6628367,6631186:6634250,6631961:6655698,6632583:6662390,6632966:6670050,6635673:6637448,6635681:6637080,6641286:6641565,6650951:6653431,6654041:6654691,6657889:6658465,6664429:6665200,6668950:6669580,6671809:6672621,6673895:6674514,6681680:6683659,6683618:6684464,6685440:6720364,6686027:6719826,6686312:6687228,6688871:6714507,6690894:6698464,6693641:6696451,6710860:6711561,6711680:6712283,6712324:6712785,6716688:6717609,6718843:6720245,6720803:6721249,6740018:6740804,6740709:6745511,6744268:6745786,6748062:6750247,6753406:6754553,6753419:6754189,6759057:6759422,6764848:6765273,6765563:6766697,6779960:6780710,6779977:6780526,6780017:6780403,6786463:6786856,6787690:6788637,6790918:6791338,6793238:6793691,6795258:6795538,6797266:6797665,6820776:6821369,6823753:6824092,6842061:6842448,6848832:6849223,6850353:6851780,6852123:6852369,6854184:6854529,6858797:6859027,6862270:6862725,', 'assoc_mat': '6604397:pehd:4200:6604877,6608145:pehd:4200:6609170,6612632:pehd:4200:6613068,6615365:pehd:4200:6615614,6618309:pehd:4200:6618503,6620043:pehd:4200:6620187,6620439:pehd:4200:6620866,6621653:pehd:4200:6621902,6627944:pehd:4200:6628367,6631186:pehd:4200:6634250,6631961:pehd:4200:6655698,6632583:pehd:4200:6662390,6632966:pehd:4200:6670050,6635673:pehd:4200:6637448,6635681:pehd:4200:6637080,6641286:pehd:4200:6641565,6650951:pehd:4200:6653431,6654041:pehd:4200:6654691,6657889:pehd:4200:6658465,6664429:pehd:4200:6665200,6668950:pehd:4200:6669580,6671809:pehd:4200:6672621,6673895:pehd:4200:6674514,6681680:pehd:4200:6683659,6683618:pehd:4200:6684464,6685440:pehd:4200:6720364,6686027:pehd:4200:6719826,6686312:pehd:4200:6687228,6688871:pehd:4200:6714507,6690894:pehd:4200:6698464,6693641:pehd:4200:6696451,6710860:pehd:4200:6711561,6711680:pehd:4200:6712283,6712324:pehd:4200:6712785,6716688:pehd:4200:6717609,6718843:pehd:4200:6720245,6720803:pehd:4200:6721249,6740018:pehd:4200:6740804,6740709:pehd:4200:6745511,6744268:pe'}, {'unwanted_material': 'pet_clair', 'main_material': 'ela', 'pht_type': 4203, 'ratio': 0.0005167916399878171, 'nb_photo': 10, 'list_port_cont': '6608803,6712721,6754068,6800312,6806350,6808098,6876008,6940836', 'assoc_port': '6608146:6608803,6685991:6800312,6712332:6712721,6753416:6754068,6786466:6808098,6793236:6806350,6875674:6876008,6900378:6940836', 'assoc_mat': '6608146:pet_clair:4203:6608803,6685991:pet_clair:4203:6800312,6712332:pet_clair:4203:6712721,6753416:pet_clair:4203:6754068,6786466:pet_clair:4203:6808098,6793236:pet_clair:4203:6806350,6875674:pet_clair:4203:6876008,6900378:pet_clair:4203:6940836'}, {'unwanted_material': 'pet_clair', 'main_material': 'emr', 'pht_type': 4209, 'ratio': 0.002615200546649331, 'nb_photo': 21, 'list_port_cont': '6600774,6602155,6638508,6669283,6673392,6694184,6695455,6712247,6723146,6740495,6742322,6751442,6754773', 'assoc_port': '6600540:6602155,6600552:6600774,6631482:6669283,6638162:6638508,6672700:6673392,6692502:6694184,6694740:6695455,6710867:6712247,6722817:6723146,6739465:6742322,6740030:6740495,6741911:6754773,6750987:6751442', 'assoc_mat': '6600540:pet_clair:4209:6602155,6600552:pet_clair:4209:6600774,6631482:pet_clair:4209:6669283,6638162:pet_clair:4209:6638508,6672700:pet_clair:4209:6673392,6692502:pet_clair:4209:6694184,6694740:pet_clair:4209:6695455,6710867:pet_clair:4209:6712247,6722817:pet_clair:4209:6723146,6739465:pet_clair:4209:6742322,6740030:pet_clair:4209:6740495,6741911:pet_clair:4209:6754773,6750987:pet_clair:4209:6751442'}, {'unwanted_material': 'pet_clair', 'main_material': 'gm', 'pht_type': 4209, 'ratio': 0.0001938470394354349, 'nb_photo': 4, 'list_port_cont': '6869295,6869655,6914936,6960440', 'assoc_port': '6868823:6869295,6869543:6869655,6914405:6914936,6919131:6960440', 'assoc_mat': '6868823:pet_clair:4209:6869295,6869543:pet_clair:4209:6869655,6914405:pet_clair:4209:6914936,6919131:pet_clair:4209:6960440'}, {'unwanted_material': 'pet_clair', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 0.0010334097253368944, 'nb_photo': 3, 'list_port_cont': '6617252,6617677,6633560', 'assoc_port': '6616962:6617252,6616964:6617677,6631478:6633560', 'assoc_mat': '6616962:pet_clair:4207:6617252,6616964:pet_clair:4207:6617677,6631478:pet_clair:4207:6633560'}, {'unwanted_material': 'pet_clair', 'main_material': 'pehd_pp', 'pht_type': 4211, 'ratio': 0.0015524153897367723, 'nb_photo': 1500, 'list_port_cont': '6600858,6600897,6601013,6601431,6602282,6602595,6603012,6603407,6606068,6607680,6608064,6608283,6609454,6610409,6610606,6610649,6611145,6614534,6615393,6615436,6615797,6616526,6617426,6618921,6620330,6620914,6621054,6621668,6621965,6621997,6622134,6622196,6622457,6624048,6625562,6626620,6626654,6627270,6628482,6629176,6629250,6634388,6634656,6634855,6635135,6635836,6638280,6638446,6639162,6640996,6642051,6642710,6650049,6650151,6650272,6650962,6658506,6664046,6666445,6668082,6668178,6669608,6672025,6674016,6674544,6674638,6674762,6675076,6675106,6675132,6675480,6676532,6676622,6677125,6677222,6677808,6678040,6678226,6678568,6678651,6678771,6678961,6678993,6679220,6681247,6687136,6691495,6691657,6692280,6693193,6693673,6693892,6694033,6694210,6694409,6695508,6697514,6698425,6698773,6698798,6699368,6699436,6705438,6706628,6706772,6707230,6709725,6711231,6711405,6711487,6712154,6712633,6712745,6713436,6713606,6713756,6714401,6716473,6716566,6717505,6717554,6718023,6718524,6719029,6719453,6719723,6720668,6720734,', 'assoc_port': '10844008:10846061,10844009:10845791,10844010:10846028,10844011:10845556,10844012:10845977,10844014:10845189,10844015:10845087,10844017:10845127,10844018:10844952,10844019:10845053,10844020:10844681,10844021:10844449,12107423:12108303,12107427:12108066,12107429:12107823,6600536:6601431,6600544:6600858,6600546:6601013,6600551:6600897,6601138:6602595,6601649:6602282,6602728:6603012,6602733:6603407,6604399:6608064,6605499:6610649,6605688:6606068,6606683:6607680,6607835:6610409,6607839:6608283,6609199:6609454,6610498:6610606,6610992:6611145,6614199:6614534,6614967:6615393,6614969:6615436,6615362:6615797,6616173:6616526,6616982:6617426,6618311:6618921,6620040:6620330,6620422:6621668,6620444:6621054,6620447:6620914,6621638:6624048,6621643:6622457,6621647:6622196,6621651:6622134,6621654:6621965,6621659:6621997,6625236:6625562,6626268:6626620,6626274:6626654,6627098:6627270,6627945:6628482,6628987:6629176,6628989:6629250,6630850:6634855,6630852:6674016,6630856:6634656,6630932:6674638,6630935:6674762,6630939:6675106,66', 'assoc_mat': '10844008:pet_clair:4211:10846061,10844009:pet_clair:4211:10845791,10844010:pet_clair:4211:10846028,10844011:pet_clair:4211:10845556,10844012:pet_clair:4211:10845977,10844014:pet_clair:4211:10845189,10844015:pet_clair:4211:10845087,10844017:pet_clair:4211:10845127,10844018:pet_clair:4211:10844952,10844019:pet_clair:4211:10845053,10844020:pet_clair:4211:10844681,10844021:pet_clair:4211:10844449,12107423:pet_clair:4211:12108303,12107427:pet_clair:4211:12108066,12107429:pet_clair:4211:12107823,6600536:pet_clair:4211:6601431,6600544:pet_clair:4211:6600858,6600546:pet_clair:4211:6601013,6600551:pet_clair:4211:6600897,6601138:pet_clair:4211:6602595,6601649:pet_clair:4211:6602282,6602728:pet_clair:4211:6603012,6602733:pet_clair:4211:6603407,6604399:pet_clair:4211:6608064,6605499:pet_clair:4211:6610649,6605688:pet_clair:4211:6606068,6606683:pet_clair:4211:6607680,6607835:pet_clair:4211:6610409,6607839:pet_clair:4211:6608283,6609199:pet_clair:4211:6609454,6610498:pet_clair:4211:6610606,6610992:pet_clair:4211:6611145,66'}, {'unwanted_material': 'pet_clair', 'main_material': 'pet_clair', 'pht_type': 3327, 'ratio': 0.9599310617320319, 'nb_photo': 267351, 'list_port_cont': '6601210,6601259,6601315,6601372,6601561,6601699,6601793,6601843,6602315,6603612,6603846,6603988,6604935,6606277,6606379,6607135,6607387,6607887,6608320,6608594,6608685,6608963,6609915,6610051,6610272,6610908,6611079,6613731,6614159,6615900,6616061,6616197,6616980,6617460,6617848,6618172,6618946,6620507,6620990,6621111,6621145,6621178,6621380,6621448,6621534,6622108,6622166,6622320,6622376,6622431,6622522,6622656,6622746,6626362,6626970,6627008,6627198,6627829,6628015,6628553,6628621,6629351,6629395,6635805,6635872,6635894,6635946,6635979,6636038,6636114,6636146,6636284,6636327,6636427,6636595,6636676,6636732,6636800,6637047,6637357,6637676,6637709,6637759,6637850,6637946,6637981,6638089,6638412,6638604,6638708,6638827,6638952,6638975,6639189,6639290,6639357,6639644,6639751,6639842,6639900,6639967,6640118,6640724,6640748,6640771,6640953,6641215,6641298,6641330,6641481,6641511,6641662,6641812,6641955,6642028,6642082,6642295,6643245,6643371,6643476,6643601,6643634,6643665,6643684,6643715,6643904,6644075,6644466,', 'assoc_port': '6600535:6601259,6600537:6601699,6600543:6601210,6600545:6601372,6600547:6601561,6600550:6601793,6600553:6601315,6601140:6602315,6601199:6601843,6602727:6603846,6602729:6603988,6602732:6603612,6604400:6604935,6604702:6606379,6605500:6606277,6605502:6607135,6606682:6608320,6606685:6607887,6606687:6607387,6607836:6608594,6607838:6608685,6608144:6608963,6609197:6610051,6609198:6609915,6609963:6610272,6610497:6611079,6610499:6610908,6612953:6613731,6613333:6614159,6614966:6616197,6614968:6616061,6615360:6615900,6616171:6616980,6616960:6618172,6616966:6617460,6616967:6617848,6618310:6618946,6620036:6620507,6620039:6621380,6620042:6620990,6620404:6621145,6620441:6621448,6620445:6621178,6620446:6621534,6620449:6621111,6621639:6622656,6621642:6622746,6621645:6622522,6621650:6622376,6621652:6622431,6621655:6622166,6621656:6622108,6621661:6622320,6625901:6626362,6626270:6626970,6626272:6627008,6626275:6627198,6627097:6627829,6627099:6628015,6627946:6628553,6627948:6628621,6628988:6629351,6628991:6629395,6630847:6635946,', 'assoc_mat': '6600535:pet_clair:3327:6601259,6600537:pet_clair:3327:6601699,6600543:pet_clair:3327:6601210,6600545:pet_clair:3327:6601372,6600547:pet_clair:3327:6601561,6600550:pet_clair:3327:6601793,6600553:pet_clair:3327:6601315,6601140:pet_clair:3327:6602315,6601199:pet_clair:3327:6601843,6602727:pet_clair:3327:6603846,6602729:pet_clair:3327:6603988,6602732:pet_clair:3327:6603612,6604400:pet_clair:3327:6604935,6604702:pet_clair:3327:6606379,6605500:pet_clair:3327:6606277,6605502:pet_clair:3327:6607135,6606682:pet_clair:3327:6608320,6606685:pet_clair:3327:6607887,6606687:pet_clair:3327:6607387,6607836:pet_clair:3327:6608594,6607838:pet_clair:3327:6608685,6608144:pet_clair:3327:6608963,6609197:pet_clair:3327:6610051,6609198:pet_clair:3327:6609915,6609963:pet_clair:3327:6610272,6610497:pet_clair:3327:6611079,6610499:pet_clair:3327:6610908,6612953:pet_clair:3327:6613731,6613333:pet_clair:3327:6614159,6614966:pet_clair:3327:6616197,6614968:pet_clair:3327:6616061,6615360:pet_clair:3327:6615900,6616171:pet_clair:3327:6616980,6'}, {'unwanted_material': 'pet_clair', 'main_material': 'pet_fonce', 'pht_type': 4200, 'ratio': 0.013850132418607056, 'nb_photo': 729, 'list_port_cont': '6600932,6602056,6604868,6606116,6609176,6613074,6615622,6618504,6620175,6620851,6621896,6626788,6628359,6634256,6635400,6637083,6637447,6638371,6639240,6641570,6646011,6647331,6649288,6649483,6649916,6653442,6654690,6655705,6658463,6662388,6665196,6669581,6670064,6672613,6674519,6683665,6684474,6686801,6687235,6687462,6696450,6696819,6698459,6711564,6712276,6712777,6714501,6717602,6719815,6720155,6720212,6720236,6720365,6721245,6722531,6724155,6739274,6740798,6745510,6745796,6750242,6754194,6754554,6759416,6765275,6766695,6767363,6780396,6780522,6780718,6784027,6786850,6788647,6791335,6793696,6795535,6797659,6813917,6817661,6821368,6824094,6835198,6836547,6840209,6842441,6849227,6851786,6852367,6854528,6859033,6862731,6865772,6866324,6867968,6869265,6874404,6875758,6875978,6882732,6886808,6888105,6889504,6895291,6900326,6902507,6904839,6914449,6920746,6921620,6924256', 'assoc_port': '6600538:6600932,6601136:6602056,6604397:6604868,6605689:6606116,6608145:6609176,6612632:6613074,6615365:6615622,6618309:6618504,6620043:6620175,6620439:6620851,6621653:6621896,6626271:6626788,6627944:6628359,6630848:6646011,6631070:6649288,6631186:6634256,6631194:6649916,6631961:6655705,6632583:6662388,6632786:6635400,6632966:6670064,6635673:6637447,6635681:6637083,6637843:6638371,6638774:6639240,6641286:6641570,6646447:6647331,6648940:6649483,6650951:6653442,6654041:6654690,6657889:6658463,6664429:6665196,6668950:6669581,6671809:6672613,6673895:6674519,6681680:6683665,6683618:6684474,6685440:6720365,6685511:6720212,6686027:6719815,6686041:6720155,6686295:6687462,6686312:6687235,6686325:6686801,6688871:6714501,6690894:6698459,6693641:6696450,6696476:6696819,6710860:6711564,6711680:6712276,6712324:6712777,6716688:6717602,6718843:6720236,6720803:6721245,6722354:6722531,6723892:6724155,6738748:6739274,6740018:6740798,6740709:6745510,6744268:6745796,6748062:6750242,6753406:6754554,6753419:6754194,6759057:6759416,', 'assoc_mat': '6600538:pet_clair:4200:6600932,6601136:pet_clair:4200:6602056,6604397:pet_clair:4200:6604868,6605689:pet_clair:4200:6606116,6608145:pet_clair:4200:6609176,6612632:pet_clair:4200:6613074,6615365:pet_clair:4200:6615622,6618309:pet_clair:4200:6618504,6620043:pet_clair:4200:6620175,6620439:pet_clair:4200:6620851,6621653:pet_clair:4200:6621896,6626271:pet_clair:4200:6626788,6627944:pet_clair:4200:6628359,6630848:pet_clair:4200:6646011,6631070:pet_clair:4200:6649288,6631186:pet_clair:4200:6634256,6631194:pet_clair:4200:6649916,6631961:pet_clair:4200:6655705,6632583:pet_clair:4200:6662388,6632786:pet_clair:4200:6635400,6632966:pet_clair:4200:6670064,6635673:pet_clair:4200:6637447,6635681:pet_clair:4200:6637083,6637843:pet_clair:4200:6638371,6638774:pet_clair:4200:6639240,6641286:pet_clair:4200:6641570,6646447:pet_clair:4200:6647331,6648940:pet_clair:4200:6649483,6650951:pet_clair:4200:6653442,6654041:pet_clair:4200:6654690,6657889:pet_clair:4200:6658463,6664429:pet_clair:4200:6665196,6668950:pet_clair:4200:6669581,6'}, {'unwanted_material': 'pet_fonce', 'main_material': 'ela', 'pht_type': 4203, 'ratio': 0.00022092315643821876, 'nb_photo': 2, 'list_port_cont': '6712712,6806360', 'assoc_port': '6712332:6712712,6793236:6806360', 'assoc_mat': '6712332:pet_fonce:4203:6712712,6793236:pet_fonce:4203:6806360'}, {'unwanted_material': 'pet_fonce', 'main_material': 'pehd_pp', 'pht_type': 4211, 'ratio': 0.0003846699616495868, 'nb_photo': 87, 'list_port_cont': '6600861,6603394,6607677,6615422,6622000,6622197,6624062,6627276,6628479,6629185,6634858,6635145,6672029,6674545,6675144,6675478,6677810,6678775,6691486,6694039,6698430,6699376,6699426,6707232,6719024,6720655,6721843,6723783,6724752,6724915,6725834,6730262,6732433,6741928,6743868,6751578,6751686,6754292,6756063,6768401,6769194,6775051,6780889,6782985,6783127,6789494,6789900,6792092,6794401,6795573,6800465,6800534,6800819,6801501,6808800,6808842,6835780,6855452,6869892,6885665,6917719,6920225,6922977,10844443', 'assoc_port': '10844021:10844443,6600544:6600861,6602733:6603394,6606683:6607677,6614969:6615422,6621638:6624062,6621647:6622197,6621659:6622000,6627098:6627276,6627945:6628479,6628987:6629185,6630850:6634858,6631069:6675478,6631193:6635145,6631960:6677810,6632714:6678775,6635676:6694039,6640592:6707232,6647212:6719024,6651292:6721843,6654038:6724915,6654837:6725834,6668952:6751578,6671805:6756063,6671810:6672029,6673889:6674545,6674723:6675144,6683614:6789900,6683620:6691486,6686021:6855452,6686031:6800465,6686094:6800534,6686298:6800819,6686318:6801501,6688870:6732433,6690893:6730262,6694730:6699426,6696471:6699376,6696477:6698430,6720298:6720655,6723498:6723783,6724591:6724752,6741314:6741928,6743337:6743868,6750985:6751686,6753415:6754292,6764851:6808842,6765559:6808800,6767894:6768401,6768944:6769194,6773721:6775051,6780010:6780889,6782241:6782985,6782244:6783127,6788947:6789494,6791774:6792092,6793940:6794401,6795260:6795573,6833511:6869892,6835299:6835780,6885269:6885665,6916370:6917719,6919132:6920225,6920914:692297', 'assoc_mat': '10844021:pet_fonce:4211:10844443,6600544:pet_fonce:4211:6600861,6602733:pet_fonce:4211:6603394,6606683:pet_fonce:4211:6607677,6614969:pet_fonce:4211:6615422,6621638:pet_fonce:4211:6624062,6621647:pet_fonce:4211:6622197,6621659:pet_fonce:4211:6622000,6627098:pet_fonce:4211:6627276,6627945:pet_fonce:4211:6628479,6628987:pet_fonce:4211:6629185,6630850:pet_fonce:4211:6634858,6631069:pet_fonce:4211:6675478,6631193:pet_fonce:4211:6635145,6631960:pet_fonce:4211:6677810,6632714:pet_fonce:4211:6678775,6635676:pet_fonce:4211:6694039,6640592:pet_fonce:4211:6707232,6647212:pet_fonce:4211:6719024,6651292:pet_fonce:4211:6721843,6654038:pet_fonce:4211:6724915,6654837:pet_fonce:4211:6725834,6668952:pet_fonce:4211:6751578,6671805:pet_fonce:4211:6756063,6671810:pet_fonce:4211:6672029,6673889:pet_fonce:4211:6674545,6674723:pet_fonce:4211:6675144,6683614:pet_fonce:4211:6789900,6683620:pet_fonce:4211:6691486,6686021:pet_fonce:4211:6855452,6686031:pet_fonce:4211:6800465,6686094:pet_fonce:4211:6800534,6686298:pet_fonce:4211:6800819'}, {'unwanted_material': 'pet_fonce', 'main_material': 'pet_clair', 'pht_type': 3327, 'ratio': 0.0027937857287839945, 'nb_photo': 263, 'list_port_cont': '6601312,6601378,6602302,6604937,6607386,6607897,6609918,6610056,6614156,6616198,6617469,6618949,6621166,6621524,6622171,6622318,6622432,6622523,6627007,6627194,6628022,6628558,6628620,6629360,6629385,6635890,6636150,6636335,6637041,6637956,6638951,6639300,6639360,6639649,6639843,6639963,6640116,6641206,6641660,6642031,6642088,6643666,6643686,6644074,6645311,6645758,6647413,6648013,6648348,6651389,6651678,6652033,6652947,6653022,6654605,6655887,6658048,6659096,6660216,6665644,6665949,6668610,6672473,6673067,6674828,6675455,6682558,6684379,6686720,6687693,6687751,6688499,6688987,6689537,6689587,6689850,6690097,6690214,6690635,6692361,6692530,6692691,6693861,6694779,6695712,6696111,6697041,6697340,6697715,6697768,6697941,6698112,6698730,6698987,6711529,6712340,6712870,6713125,6713218,6713281,6719368,6721992,6722018,6722072,6722229,6723374,6723733,6724035,6725340,6740139,6740418,6742670,6743702,6744133,6748415,6748972,6749009,6749528,6750026,6751763,6754264,6754530,6758447,6759452,6760150,6760421,6765840,6766308,', 'assoc_port': '6600545:6601378,6600553:6601312,6601140:6602302,6604400:6604937,6606685:6607897,6606687:6607386,6609197:6610056,6609198:6609918,6613333:6614156,6614966:6616198,6616966:6617469,6618310:6618949,6620445:6621166,6620446:6621524,6621645:6622523,6621652:6622432,6621655:6622171,6621661:6622318,6626272:6627007,6626275:6627194,6627099:6628022,6627946:6628558,6627948:6628620,6628988:6629360,6628991:6629385,6631066:6641660,6631073:6639649,6631075:6639963,6631076:6639360,6631185:6638951,6631476:6640116,6631964:6642088,6632584:6645758,6632785:6635890,6632788:6643666,6632880:6636335,6632882:6644074,6632968:6645311,6633861:6637041,6635680:6636150,6637237:6637956,6637846:6639300,6638772:6639843,6640591:6641206,6640596:6643686,6641258:6642031,6646445:6648013,6646448:6647413,6647213:6648348,6649832:6652033,6650508:6651389,6650511:6651678,6650952:6652947,6652019:6653022,6653519:6654605,6654835:6655887,6654836:6659096,6656899:6658048,6657892:6660216,6664425:6665644,6664427:6665949,6667559:6668610,6671807:6672473,6671811:6673067,', 'assoc_mat': '6600545:pet_fonce:3327:6601378,6600553:pet_fonce:3327:6601312,6601140:pet_fonce:3327:6602302,6604400:pet_fonce:3327:6604937,6606685:pet_fonce:3327:6607897,6606687:pet_fonce:3327:6607386,6609197:pet_fonce:3327:6610056,6609198:pet_fonce:3327:6609918,6613333:pet_fonce:3327:6614156,6614966:pet_fonce:3327:6616198,6616966:pet_fonce:3327:6617469,6618310:pet_fonce:3327:6618949,6620445:pet_fonce:3327:6621166,6620446:pet_fonce:3327:6621524,6621645:pet_fonce:3327:6622523,6621652:pet_fonce:3327:6622432,6621655:pet_fonce:3327:6622171,6621661:pet_fonce:3327:6622318,6626272:pet_fonce:3327:6627007,6626275:pet_fonce:3327:6627194,6627099:pet_fonce:3327:6628022,6627946:pet_fonce:3327:6628558,6627948:pet_fonce:3327:6628620,6628988:pet_fonce:3327:6629360,6628991:pet_fonce:3327:6629385,6631066:pet_fonce:3327:6641660,6631073:pet_fonce:3327:6639649,6631075:pet_fonce:3327:6639963,6631076:pet_fonce:3327:6639360,6631185:pet_fonce:3327:6638951,6631476:pet_fonce:3327:6640116,6631964:pet_fonce:3327:6642088,6632584:pet_fonce:3327:6645758,6'}, {'unwanted_material': 'pet_fonce', 'main_material': 'pet_fonce', 'pht_type': 4200, 'ratio': 0.9433959349191054, 'nb_photo': 1865, 'list_port_cont': '6600921,6602052,6604879,6606107,6609173,6613064,6615625,6618497,6620185,6620862,6621905,6626786,6628358,6634244,6635391,6637070,6637445,6638364,6639248,6641566,6646009,6647335,6649279,6649476,6649915,6653441,6654686,6655703,6658466,6662391,6665191,6669589,6670061,6672609,6674517,6683670,6684465,6686804,6687227,6687466,6696439,6696818,6698462,6711554,6712271,6712775,6714495,6717596,6719814,6720150,6720211,6720250,6720367,6721247,6722527,6724149,6739286,6740801,6745519,6745787,6750252,6754190,6754558,6759425,6765276,6766699,6767360,6780401,6780523,6780723,6784025,6786849,6788646,6791336,6793695,6795539,6797667,6813921,6817652,6821383,6824097,6835196,6836551,6840207,6842434,6849224,6851782,6852366,6854523,6859029,6862727,6865773,6866335,6867976,6869266,6874407,6875753,6875975,6882723,6886803,6888103,6889495,6895281,6900334,6902509,6904835,6914448,6920755,6921623,6924260', 'assoc_port': '6600538:6600921,6601136:6602052,6604397:6604879,6605689:6606107,6608145:6609173,6612632:6613064,6615365:6615625,6618309:6618497,6620043:6620185,6620439:6620862,6621653:6621905,6626271:6626786,6627944:6628358,6630848:6646009,6631070:6649279,6631186:6634244,6631194:6649915,6631961:6655703,6632583:6662391,6632786:6635391,6632966:6670061,6635673:6637445,6635681:6637070,6637843:6638364,6638774:6639248,6641286:6641566,6646447:6647335,6648940:6649476,6650951:6653441,6654041:6654686,6657889:6658466,6664429:6665191,6668950:6669589,6671809:6672609,6673895:6674517,6681680:6683670,6683618:6684465,6685440:6720367,6685511:6720211,6686027:6719814,6686041:6720150,6686295:6687466,6686312:6687227,6686325:6686804,6688871:6714495,6690894:6698462,6693641:6696439,6696476:6696818,6710860:6711554,6711680:6712271,6712324:6712775,6716688:6717596,6718843:6720250,6720803:6721247,6722354:6722527,6723892:6724149,6738748:6739286,6740018:6740801,6740709:6745519,6744268:6745787,6748062:6750252,6753406:6754558,6753419:6754190,6759057:6759425,', 'assoc_mat': '6600538:pet_fonce:4200:6600921,6601136:pet_fonce:4200:6602052,6604397:pet_fonce:4200:6604879,6605689:pet_fonce:4200:6606107,6608145:pet_fonce:4200:6609173,6612632:pet_fonce:4200:6613064,6615365:pet_fonce:4200:6615625,6618309:pet_fonce:4200:6618497,6620043:pet_fonce:4200:6620185,6620439:pet_fonce:4200:6620862,6621653:pet_fonce:4200:6621905,6626271:pet_fonce:4200:6626786,6627944:pet_fonce:4200:6628358,6630848:pet_fonce:4200:6646009,6631070:pet_fonce:4200:6649279,6631186:pet_fonce:4200:6634244,6631194:pet_fonce:4200:6649915,6631961:pet_fonce:4200:6655703,6632583:pet_fonce:4200:6662391,6632786:pet_fonce:4200:6635391,6632966:pet_fonce:4200:6670061,6635673:pet_fonce:4200:6637445,6635681:pet_fonce:4200:6637070,6637843:pet_fonce:4200:6638364,6638774:pet_fonce:4200:6639248,6641286:pet_fonce:4200:6641566,6646447:pet_fonce:4200:6647335,6648940:pet_fonce:4200:6649476,6650951:pet_fonce:4200:6653441,6654041:pet_fonce:4200:6654686,6657889:pet_fonce:4200:6658466,6664429:pet_fonce:4200:6665191,6668950:pet_fonce:4200:6669589,6'}, {'unwanted_material': 'pet_opaque', 'main_material': 'ela', 'pht_type': 4203, 'ratio': 0.0009264502462378221, 'nb_photo': 9, 'list_port_cont': '6608814,6660097,6712722,6735145,6799275,6808109,6869931', 'assoc_port': '6608146:6608814,6632879:6660097,6685476:6799275,6690887:6735145,6712332:6712722,6786466:6808109,6869544:6869931', 'assoc_mat': '6608146:pet_opaque:4203:6608814,6632879:pet_opaque:4203:6660097,6685476:pet_opaque:4203:6799275,6690887:pet_opaque:4203:6735145,6712332:pet_opaque:4203:6712722,6786466:pet_opaque:4203:6808109,6869544:pet_opaque:4203:6869931'}, {'unwanted_material': 'pet_opaque', 'main_material': 'emr', 'pht_type': 4209, 'ratio': 0.007255625347838711, 'nb_photo': 19, 'list_port_cont': '6616740,6617521,6620419,6621938,6627043,6638500,6668139,6668209,6670564,6670896,6678093,6740485,6791207', 'assoc_port': '6616168:6616740,6616963:6617521,6620037:6620419,6621646:6621938,6626722:6627043,6631190:6668139,6631196:6668209,6632661:6670564,6632883:6670896,6638162:6638500,6677866:6678093,6740030:6740485,6790915:6791207', 'assoc_mat': '6616168:pet_opaque:4209:6616740,6616963:pet_opaque:4209:6617521,6620037:pet_opaque:4209:6620419,6621646:pet_opaque:4209:6621938,6626722:pet_opaque:4209:6627043,6631190:pet_opaque:4209:6668139,6631196:pet_opaque:4209:6668209,6632661:pet_opaque:4209:6670564,6632883:pet_opaque:4209:6670896,6638162:pet_opaque:4209:6638500,6677866:pet_opaque:4209:6678093,6740030:pet_opaque:4209:6740485,6790915:pet_opaque:4209:6791207'}, {'unwanted_material': 'pet_opaque', 'main_material': 'pehd_pp', 'pht_type': 4211, 'ratio': 0.0016345171833525593, 'nb_photo': 222, 'list_port_cont': '6600901,6602283,6603013,6606069,6608294,6610401,6610657,6611146,6614528,6615400,6621062,6621675,6621998,6622129,6622205,6626613,6629184,6629244,6634651,6635837,6638286,6639164,6650157,6668179,6669616,6672038,6674023,6674634,6674773,6675099,6675136,6677119,6677811,6678215,6678578,6678957,6679224,6681250,6691510,6691659,6693900,6694213,6694417,6698434,6698768,6698799,6699430,6711411,6711493,6712146,6712497,6712754,6713439,6716561,6717501,6717546,6718028,6719452,6720657,6720722,6724914,6725690,6725833,6728841,6729870,6730329,6730727,6731863,6732437,6735376,6738126,6740205,6740607,6741938,6743382,6745286,6751579,6751673,6754142,6754990,6755968,6756060,6756975,6762171,6763524,6767274,6768410,6773018,6774679,6775056,6778932,6780264,6780486,6783061,6791499,6793831,6794248,6794400,6795572,6796823,6799103,6799441,6799779,6800492,6800530,6801272,6801402,6806174,6808133,6808682,6808713,6808832,6808873,6809086,6810005,6815419,6822330,6839899,6842610,6853846,6855228,6855448,6863478,6866679,6869888,6870654,6875922,6890225,', 'assoc_port': '10844011:10845551,10844021:10844440,6600551:6600901,6601649:6602283,6602728:6603013,6605499:6610657,6605688:6606069,6607835:6610401,6607839:6608294,6610992:6611146,6614199:6614528,6614967:6615400,6620422:6621675,6620444:6621062,6621647:6622205,6621651:6622129,6621659:6621998,6626268:6626613,6628987:6629184,6628989:6629244,6630852:6674023,6630856:6634651,6630932:6674634,6630935:6674773,6630939:6675099,6631489:6677119,6631960:6677811,6632585:6678215,6632660:6678578,6632877:6678957,6632963:6679224,6633862:6635837,6635671:6693900,6635682:6694213,6637236:6698768,6637845:6638286,6638776:6639164,6640595:6806174,6647215:6717546,6648944:6650157,6653523:6725690,6654038:6724914,6654837:6725833,6655426:6728841,6656895:6729870,6657891:6731863,6666361:6668179,6668952:6751579,6668953:6669616,6671805:6756060,6671810:6672038,6672701:6755968,6674723:6675136,6681005:6681250,6683620:6691510,6685431:6799103,6685494:6799441,6685525:6799779,6686006:6855228,6686021:6855448,6686094:6800530,6686269:6800492,6686302:6801272,6686308:6801', 'assoc_mat': '10844011:pet_opaque:4211:10845551,10844021:pet_opaque:4211:10844440,6600551:pet_opaque:4211:6600901,6601649:pet_opaque:4211:6602283,6602728:pet_opaque:4211:6603013,6605499:pet_opaque:4211:6610657,6605688:pet_opaque:4211:6606069,6607835:pet_opaque:4211:6610401,6607839:pet_opaque:4211:6608294,6610992:pet_opaque:4211:6611146,6614199:pet_opaque:4211:6614528,6614967:pet_opaque:4211:6615400,6620422:pet_opaque:4211:6621675,6620444:pet_opaque:4211:6621062,6621647:pet_opaque:4211:6622205,6621651:pet_opaque:4211:6622129,6621659:pet_opaque:4211:6621998,6626268:pet_opaque:4211:6626613,6628987:pet_opaque:4211:6629184,6628989:pet_opaque:4211:6629244,6630852:pet_opaque:4211:6674023,6630856:pet_opaque:4211:6634651,6630932:pet_opaque:4211:6674634,6630935:pet_opaque:4211:6674773,6630939:pet_opaque:4211:6675099,6631489:pet_opaque:4211:6677119,6631960:pet_opaque:4211:6677811,6632585:pet_opaque:4211:6678215,6632660:pet_opaque:4211:6678578,6632877:pet_opaque:4211:6678957,6632963:pet_opaque:4211:6679224,6633862:pet_opaque:4211:6635'}, {'unwanted_material': 'pet_opaque', 'main_material': 'pet_fonce', 'pht_type': 4200, 'ratio': 0.006625372408584668, 'nb_photo': 447, 'list_port_cont': '6600927,6602060,6604867,6606114,6609165,6613073,6615618,6618507,6620186,6620865,6621897,6626785,6628362,6634254,6635389,6637069,6637443,6638357,6639233,6641563,6646016,6647330,6649289,6649475,6649908,6653440,6654682,6655700,6658472,6662384,6665186,6669577,6670052,6672606,6674518,6683671,6684478,6686802,6687225,6687464,6696442,6696817,6698458,6711562,6712277,6712786,6714508,6717607,6719819,6720158,6720206,6720247,6720358,6721243,6722532,6724146,6739282,6740800,6745521,6745789,6750245,6754191,6754564,6759415,6765265,6766702,6767358,6780406,6780528,6780714,6784016,6786843,6788645,6791330,6793704,6795548,6797668,6817665,6821371,6824096,6835190,6840200,6842443,6849228,6851781,6852374,6854530,6859022,6862735,6865768,6866326,6867982,6869259,6874403,6875763,6882730,6886804,6888096,6889498,6895283,6900338,6902503,6904834,6914452,6920753,6921628,6924247', 'assoc_port': '6600538:6600927,6601136:6602060,6604397:6604867,6605689:6606114,6608145:6609165,6612632:6613073,6615365:6615618,6618309:6618507,6620043:6620186,6620439:6620865,6621653:6621897,6626271:6626785,6627944:6628362,6630848:6646016,6631070:6649289,6631186:6634254,6631194:6649908,6631961:6655700,6632583:6662384,6632786:6635389,6632966:6670052,6635673:6637443,6635681:6637069,6637843:6638357,6638774:6639233,6641286:6641563,6646447:6647330,6648940:6649475,6650951:6653440,6654041:6654682,6657889:6658472,6664429:6665186,6668950:6669577,6671809:6672606,6673895:6674518,6681680:6683671,6683618:6684478,6685440:6720358,6685511:6720206,6686027:6719819,6686041:6720158,6686295:6687464,6686312:6687225,6686325:6686802,6688871:6714508,6690894:6698458,6693641:6696442,6696476:6696817,6710860:6711562,6711680:6712277,6712324:6712786,6716688:6717607,6718843:6720247,6720803:6721243,6722354:6722532,6723892:6724146,6738748:6739282,6740018:6740800,6740709:6745521,6744268:6745789,6748062:6750245,6753406:6754564,6753419:6754191,6759057:6759415,', 'assoc_mat': '6600538:pet_opaque:4200:6600927,6601136:pet_opaque:4200:6602060,6604397:pet_opaque:4200:6604867,6605689:pet_opaque:4200:6606114,6608145:pet_opaque:4200:6609165,6612632:pet_opaque:4200:6613073,6615365:pet_opaque:4200:6615618,6618309:pet_opaque:4200:6618507,6620043:pet_opaque:4200:6620186,6620439:pet_opaque:4200:6620865,6621653:pet_opaque:4200:6621897,6626271:pet_opaque:4200:6626785,6627944:pet_opaque:4200:6628362,6630848:pet_opaque:4200:6646016,6631070:pet_opaque:4200:6649289,6631186:pet_opaque:4200:6634254,6631194:pet_opaque:4200:6649908,6631961:pet_opaque:4200:6655700,6632583:pet_opaque:4200:6662384,6632786:pet_opaque:4200:6635389,6632966:pet_opaque:4200:6670052,6635673:pet_opaque:4200:6637443,6635681:pet_opaque:4200:6637069,6637843:pet_opaque:4200:6638357,6638774:pet_opaque:4200:6639233,6641286:pet_opaque:4200:6641563,6646447:pet_opaque:4200:6647330,6648940:pet_opaque:4200:6649475,6650951:pet_opaque:4200:6653440,6654041:pet_opaque:4200:6654682,6657889:pet_opaque:4200:6658472,6664429:pet_opaque:4200:6665186,'}, {'unwanted_material': 'textiles_sanitaires', 'main_material': 'ela', 'pht_type': 4203, 'ratio': 5.317677982697793e-05, 'nb_photo': 1, 'list_port_cont': '6754069', 'assoc_port': '6753416:6754069', 'assoc_mat': '6753416:textiles_sanitaires:4203:6754069'}, {'unwanted_material': 'textiles_sanitaires', 'main_material': 'pehd_pp', 'pht_type': 4211, 'ratio': 0.00014015295179752374, 'nb_photo': 14, 'list_port_cont': '6608063,6675111,6678967,6709734,6720656,6724749,6725824,6735649,6787860,6791503,6813248,6828520,6855445,10845973', 'assoc_port': '10844012:10845973,6604399:6608063,6630939:6675111,6632877:6678967,6654837:6725824,6663625:6735649,6686021:6855445,6709374:6709734,6720298:6720656,6724591:6724749,6787210:6787860,6790919:6791503,6812962:6813248,6814154:6828520', 'assoc_mat': '10844012:textiles_sanitaires:4211:10845973,6604399:textiles_sanitaires:4211:6608063,6630939:textiles_sanitaires:4211:6675111,6632877:textiles_sanitaires:4211:6678967,6654837:textiles_sanitaires:4211:6725824,6663625:textiles_sanitaires:4211:6735649,6686021:textiles_sanitaires:4211:6855445,6709374:textiles_sanitaires:4211:6709734,6720298:textiles_sanitaires:4211:6720656,6724591:textiles_sanitaires:4211:6724749,6787210:textiles_sanitaires:4211:6787860,6790919:textiles_sanitaires:4211:6791503,6812962:textiles_sanitaires:4211:6813248,6814154:textiles_sanitaires:4211:6828520'}) select count(distinct mtr_photo_id) from MTRUser.mtr_portfolio_photos where mtr_portfolio_id in (select mtr_portfolio_id from MTRPhoto.dashboard_results where dashboard_run_id in(449271,454376,454388,454411,454399,454424,451519,452689,468274,455185,456478,457640,459828,461074,462392,463490,464885,465870,469411,470781,897152,474755,474338,475306,477478,478927,479886)); after get_hostname_from_raspi hasthag : emr hasthag that could be used but not yet : _______carton,background SELECT substr(hashtag,8), substr(date_debut,1,7) as month, (sum(qualite*nombre_balle)/sum(nombre_balle)) FROM MTRPhoto.dashboard_results WHERE hashtag = '_______emr' and mtr_portfolio_id in (select id FROM MTRUser.mtr_portfolios where mtr_user_id=1038) and qualite >=0 and dashboard_run_id in (select last_run_id from MTRPhoto.dashboard_entry_day where dashboard_place_id=53 and date >='2022-08-01' and date <= '2022-08-31') GROUP BY month order by month; hasthag : jrm hasthag that could be used but not yet : _______papier,background SELECT substr(hashtag,8), substr(date_debut,1,7) as month, (sum(qualite*nombre_balle)/sum(nombre_balle)) FROM MTRPhoto.dashboard_results WHERE hashtag = '_______jrm' and mtr_portfolio_id in (select id FROM MTRUser.mtr_portfolios where mtr_user_id=1038) and qualite >=0 and dashboard_run_id in (select last_run_id from MTRPhoto.dashboard_entry_day where dashboard_place_id=53 and date >='2022-08-01' and date <= '2022-08-31') GROUP BY month order by month; hasthag : aluminium hasthag that could be used but not yet : _______metal,background SELECT substr(hashtag,8), substr(date_debut,1,7) as month, (sum(qualite*nombre_balle)/sum(nombre_balle)) FROM MTRPhoto.dashboard_results WHERE hashtag = '_______aluminium' and mtr_portfolio_id in (select id FROM MTRUser.mtr_portfolios where mtr_user_id=1038) and qualite >=0 and dashboard_run_id in (select last_run_id from MTRPhoto.dashboard_entry_day where dashboard_place_id=53 and date >='2022-08-01' and date <= '2022-08-31') GROUP BY month order by month; hasthag : pet_fonce hasthag that could be used but not yet : _______pet_fonce,etiquette,background SELECT substr(hashtag,8), substr(date_debut,1,7) as month, (sum(qualite*nombre_balle)/sum(nombre_balle)) FROM MTRPhoto.dashboard_results WHERE hashtag = '_______pet_fonce' and mtr_portfolio_id in (select id FROM MTRUser.mtr_portfolios where mtr_user_id=1038) and qualite >=0 and dashboard_run_id in (select last_run_id from MTRPhoto.dashboard_entry_day where dashboard_place_id=53 and date >='2022-08-01' and date <= '2022-08-31') GROUP BY month order by month; hasthag : gm hasthag that could be used but not yet : _______papier,background SELECT substr(hashtag,8), substr(date_debut,1,7) as month, (sum(qualite*nombre_balle)/sum(nombre_balle)) FROM MTRPhoto.dashboard_results WHERE hashtag = '_______gm' and mtr_portfolio_id in (select id FROM MTRUser.mtr_portfolios where mtr_user_id=1038) and qualite >=0 and dashboard_run_id in (select last_run_id from MTRPhoto.dashboard_entry_day where dashboard_place_id=53 and date >='2022-08-01' and date <= '2022-08-31') GROUP BY month order by month; after impurety_average_per_hashtag {'number_of_analysed_photos': ((29394,),), 'unwanted_material_monthly_percentage': ((0.04166288885557681,),), 'material_repartition': (('pet_clair', 11530), ('pehd_pp', 8058), ('pet_fonce', 2026), ('emr', 805), ('ela', 779), ('gm', 319), ('pcnc', 86)), 'material_dict': {'pet_clair': 11530, 'pehd_pp': 8058, 'pet_fonce': 2026, 'autres': 1989}, 'coverage_data': (('2022/08/31/', 0.691297), ('2022/08/30/', 0.653266), ('2022/08/29/', 0.840173), ('2022/08/27/', 1.0), ('2022/08/26/', 0.767143), ('2022/08/25/', 0.354839), ('2022/08/24/', 0.807854), ('2022/08/23/', 0.76), ('2022/08/22/', 0.767742), ('2022/08/20/', 0.138662), ('2022/08/19/', 0.829545), ('2022/08/18/', 0.76544), ('2022/08/17/', 0.765348), ('2022/08/16/', 0.809002), ('2022/08/15/', 0.139015), ('2022/08/13/', 0.777927), ('2022/08/12/', 0.815502), ('2022/08/11/', 0.639485), ('2022/08/10/', 0.820269), ('2022/08/09/', 0.684094), ('2022/08/08/', 0.52381), ('2022/08/06/', 0.376658), ('2022/08/05/', 0.820709), ('2022/08/04/', 0.139015), ('2022/08/03/', 0.4419), ('2022/08/02/', 0.838305), ('2022/08/01/', 0.851022)), 'impurety_average_data': ((datetime.date(2022, 8, 2), 0.014282331762157728, 103), (datetime.date(2022, 8, 3), 0.03494206677880239, 211), (datetime.date(2022, 8, 5), 0.029420780762543012, 438), (datetime.date(2022, 8, 6), 0.04557840319999026, 54), (datetime.date(2022, 8, 8), 0.022841014228638157, 375), (datetime.date(2022, 8, 9), 0.02268268592206632, 320), (datetime.date(2022, 8, 10), 0.021294981158255618, 407), (datetime.date(2022, 8, 11), 0.022496316372650236, 115), (datetime.date(2022, 8, 12), 0.037292023387041164, 482), (datetime.date(2022, 8, 13), 0.030188267365227943, 442), (datetime.date(2022, 8, 16), 0.06353963932551064, 211), (datetime.date(2022, 8, 17), 0.055518220907447555, 133), (datetime.date(2022, 8, 18), 0.028245770796200272, 128), (datetime.date(2022, 8, 19), 0.029592761588569258, 277), (datetime.date(2022, 8, 22), 0.010668998327936066, 36), (datetime.date(2022, 8, 23), 0.02985658365132344, 351), (datetime.date(2022, 8, 24), 0.02890717923269598, 369), (datetime.date(2022, 8, 25), 0.02964405365672207, 385), (datetime.date(2022, 8, 26), 0.027188360813364603, 209), (datetime.date(2022, 8, 28), 0.014876381935804891, 33), (datetime.date(2022, 8, 29), 0.023942954543620824, 233), (datetime.date(2022, 8, 30), 0.03176500481166622, 362), (datetime.date(2022, 8, 31), 0.024400799858355637, 340)), 'impurety_average_data_per_hashtag': {'emr': ((datetime.date(2022, 8, 2), 0.014497225753743103, 90), (datetime.date(2022, 8, 3), 0.035407726190541, 201), (datetime.date(2022, 8, 5), 0.029420780762543012, 438), (datetime.date(2022, 8, 6), 0.051389769677544335, 43), (datetime.date(2022, 8, 8), 0.022841014228638157, 375), (datetime.date(2022, 8, 9), 0.022808792662868328, 304), (datetime.date(2022, 8, 10), 0.021294981158255618, 407), (datetime.date(2022, 8, 11), 0.022496316372650236, 115), (datetime.date(2022, 8, 12), 0.037292023387041164, 482), (datetime.date(2022, 8, 13), 0.030188267365227943, 442), (datetime.date(2022, 8, 16), 0.06353963932551064, 211), (datetime.date(2022, 8, 17), 0.055518220907447555, 133), (datetime.date(2022, 8, 18), 0.028245770796200272, 128), (datetime.date(2022, 8, 19), 0.03144342737311807, 238), (datetime.date(2022, 8, 22), 0.010668998327936066, 36), (datetime.date(2022, 8, 23), 0.030080632780942033, 330), (datetime.date(2022, 8, 24), 0.029230789634089597, 345), (datetime.date(2022, 8, 25), 0.029901630015503007, 357), (datetime.date(2022, 8, 26), 0.028097448563616227, 175), (datetime.date(2022, 8, 29), 0.03005524006484819, 165), (datetime.date(2022, 8, 30), 0.03263495327830263, 307), (datetime.date(2022, 8, 31), 0.02525588399363416, 301)), 'jrm': ((datetime.date(2022, 8, 2), 0.012085072487249132, 13), (datetime.date(2022, 8, 19), 0.010114825333022708, 10), (datetime.date(2022, 8, 23), 0.024498907798673017, 5), (datetime.date(2022, 8, 26), 0.0052974707656706635, 12), (datetime.date(2022, 8, 29), 0.0180872193641313, 5), (datetime.date(2022, 8, 30), 0.012309361035885383, 18), (datetime.date(2022, 8, 31), 0.0, 30)), 'aluminium': ((datetime.date(2022, 8, 3), 0.0029466085982426723, 10), (datetime.date(2022, 8, 6), 0.0, 11), (datetime.date(2022, 8, 28), 0.014876381935804891, 33), (datetime.date(2022, 8, 29), 0.0027249051959917212, 35), (datetime.date(2022, 8, 30), 0.0, 5)), 'pet_fonce': ((datetime.date(2022, 8, 9), 0.01691330253037371, 16), (datetime.date(2022, 8, 19), 0.01514668242834379, 6), (datetime.date(2022, 8, 29), 0.0, 6)), 'gm': ((datetime.date(2022, 8, 19), 0.0036688743500458555, 23), (datetime.date(2022, 8, 23), 2.7541150063779214e-07, 16), (datetime.date(2022, 8, 24), 0.009998135847154843, 24), (datetime.date(2022, 8, 25), 0.007110951820118182, 28), (datetime.date(2022, 8, 26), 0.0026635914561474365, 22), (datetime.date(2022, 8, 29), 0.005845156606103965, 22), (datetime.date(2022, 8, 30), 0.01774597693816732, 32), (datetime.date(2022, 8, 31), 0.04037847154938461, 9))}, 'quality_array': [['7.002742885641196', '01082022'], ['7.276538764582762', '02082022'], ['7.489191991610414', '03082022'], ['7.1515808570282635', '04082022'], ['7.481548146738859', '05082022'], ['7.304119764213931', '06082022'], ['7.180322525692267', '08082022'], ['6.878113539107664', '09082022'], ['7.100998473868195', '10082022'], ['7.303181417036363', '11082022'], ['6.929539513848952', '12082022'], ['6.949887273916412', '13082022'], ['6.952864344290567', '15082022'], ['6.946439599449299', '16082022'], ['8.200164971876198', '17082022'], ['7.414826551741067', '18082022'], ['7.567049552876916', '19082022'], ['8.275572615180698', '22082022'], ['8.683058890962057', '23082022'], ['9.447587725285345', '24082022'], ['9.907266828738836', '25082022'], ['9.398694081509628', '26082022'], ['3.699836545530341', '28082022'], ['9.278913980706943', '29082022'], ['9.808918378829057', '30082022'], ['12.679394134058633', '31082022']], 'number_of_batch': ((325,),), 'datou_id_sts': 3980, 'map_hashtag_number_mat': {'hash_to_mat_nb': ({'unwanted_material': 'autre', 'main_material': 'pet_clair', 'pht_type': 3327, 'ratio': 0.025985557831013643, 'nb_photo': 16651, 'list_port_cont': '6601211,6601249,6601319,6601376,6601558,6601691,6601783,6601837,6602312,6603611,6603837,6603984,6604939,6606283,6606361,6607127,6607396,6607889,6608318,6608592,6608684,6608960,6609911,6610060,6610278,6610907,6611078,6613725,6614148,6615899,6616064,6616199,6616975,6617461,6617846,6618177,6618947,6620505,6620992,6621119,6621146,6621174,6621388,6621447,6621537,6622105,6622162,6622311,6622378,6622426,6622514,6622647,6622758,6626372,6626974,6626997,6627200,6627837,6628024,6628557,6628624,6629354,6629396,6635806,6635864,6635897,6635947,6635974,6636029,6636109,6636139,6636295,6636316,6636423,6636599,6636674,6636727,6636791,6637048,6637689,6637708,6637756,6637854,6637954,6637974,6638095,6638421,6638597,6638696,6638833,6638947,6638968,6639187,6639299,6639353,6639652,6639761,6639844,6639904,6639965,6640123,6640725,6640745,6640776,6640959,6641209,6641306,6641333,6641484,6641521,6641655,6641820,6641954,6642026,6642079,6642285,6643237,6643372,6643479,6643603,6643631,6643664,6643695,6643718,6643895,6644078,6644458,6644663,', 'assoc_port': '6600535:6601249,6600537:6601691,6600543:6601211,6600545:6601376,6600547:6601558,6600550:6601783,6600553:6601319,6601140:6602312,6601199:6601837,6602727:6603837,6602729:6603984,6602732:6603611,6604400:6604939,6604702:6606361,6605500:6606283,6605502:6607127,6606682:6608318,6606685:6607889,6606687:6607396,6607836:6608592,6607838:6608684,6608144:6608960,6609197:6610060,6609198:6609911,6609963:6610278,6610497:6611078,6610499:6610907,6612953:6613725,6613333:6614148,6614966:6616199,6614968:6616064,6615360:6615899,6616171:6616975,6616960:6618177,6616966:6617461,6616967:6617846,6618310:6618947,6620036:6620505,6620039:6621388,6620042:6620992,6620404:6621146,6620441:6621447,6620445:6621174,6620446:6621537,6620449:6621119,6621639:6622647,6621642:6622758,6621645:6622514,6621650:6622378,6621652:6622426,6621655:6622162,6621656:6622105,6621661:6622311,6625901:6626372,6626270:6626974,6626272:6626997,6626275:6627200,6627097:6627837,6627099:6628024,6627946:6628557,6627948:6628624,6628988:6629354,6628991:6629396,6630847:6635947,', 'assoc_mat': '6600535:autre:3327:6601249,6600537:autre:3327:6601691,6600543:autre:3327:6601211,6600545:autre:3327:6601376,6600547:autre:3327:6601558,6600550:autre:3327:6601783,6600553:autre:3327:6601319,6601140:autre:3327:6602312,6601199:autre:3327:6601837,6602727:autre:3327:6603837,6602729:autre:3327:6603984,6602732:autre:3327:6603611,6604400:autre:3327:6604939,6604702:autre:3327:6606361,6605500:autre:3327:6606283,6605502:autre:3327:6607127,6606682:autre:3327:6608318,6606685:autre:3327:6607889,6606687:autre:3327:6607396,6607836:autre:3327:6608592,6607838:autre:3327:6608684,6608144:autre:3327:6608960,6609197:autre:3327:6610060,6609198:autre:3327:6609911,6609963:autre:3327:6610278,6610497:autre:3327:6611078,6610499:autre:3327:6610907,6612953:autre:3327:6613725,6613333:autre:3327:6614148,6614966:autre:3327:6616199,6614968:autre:3327:6616064,6615360:autre:3327:6615899,6616171:autre:3327:6616975,6616960:autre:3327:6618177,6616966:autre:3327:6617461,6616967:autre:3327:6617846,6618310:autre:3327:6618947,6620036:autre:3327:662050'}, {'unwanted_material': 'barquette_avec_film', 'main_material': 'pet_clair', 'pht_type': 3327, 'ratio': 0.0050634087913797535, 'nb_photo': 1051, 'list_port_cont': '6601216,6601255,6601316,6601366,6601556,6601694,6601795,6601849,6602314,6603610,6603845,6603981,6604938,6606272,6606380,6607136,6607388,6607885,6608324,6608593,6608675,6608967,6609910,6610048,6610273,6611082,6613721,6614147,6615898,6616193,6616972,6617468,6618176,6618950,6620509,6620988,6621144,6621167,6621391,6621449,6622102,6622163,6622316,6622379,6622436,6622519,6622752,6626364,6626973,6627004,6627197,6627840,6628023,6628564,6628623,6629352,6629394,6635811,6635862,6635901,6635945,6635972,6636036,6636112,6636138,6636318,6636424,6636724,6637044,6637685,6637716,6637764,6637852,6637945,6637984,6638094,6638596,6638700,6638835,6638944,6638974,6639298,6639361,6639645,6639764,6639852,6639896,6639968,6640121,6640722,6640783,6640963,6641211,6641294,6641332,6641486,6641520,6641652,6641944,6642022,6642080,6642290,6643373,6643478,6643608,6643683,6643716,6643902,6644079,6644456,6644652,6645162,6645304,6645766,6647408,6648376,6648805,6649738,6651383,6651686,6654487,6654608,6655045,6655877,6656213,6656668,6659085,6660221,', 'assoc_port': '6600535:6601255,6600537:6601694,6600543:6601216,6600545:6601366,6600547:6601556,6600550:6601795,6600553:6601316,6601140:6602314,6601199:6601849,6602727:6603845,6602729:6603981,6602732:6603610,6604400:6604938,6604702:6606380,6605500:6606272,6605502:6607136,6606682:6608324,6606685:6607885,6606687:6607388,6607836:6608593,6607838:6608675,6608144:6608967,6609197:6610048,6609198:6609910,6609963:6610273,6610497:6611082,6612953:6613721,6613333:6614147,6614966:6616193,6615360:6615898,6616171:6616972,6616960:6618176,6616966:6617468,6618310:6618950,6620036:6620509,6620039:6621391,6620042:6620988,6620404:6621144,6620441:6621449,6620445:6621167,6621642:6622752,6621645:6622519,6621650:6622379,6621652:6622436,6621655:6622163,6621656:6622102,6621661:6622316,6625901:6626364,6626270:6626973,6626272:6627004,6626275:6627197,6627097:6627840,6627099:6628023,6627946:6628564,6627948:6628623,6628988:6629352,6628991:6629394,6630847:6635945,6630849:6636036,6630851:6635972,6630854:6637685,6630934:6637764,6630936:6637716,6630938:6638094,', 'assoc_mat': '6600535:barquette_avec_film:3327:6601255,6600537:barquette_avec_film:3327:6601694,6600543:barquette_avec_film:3327:6601216,6600545:barquette_avec_film:3327:6601366,6600547:barquette_avec_film:3327:6601556,6600550:barquette_avec_film:3327:6601795,6600553:barquette_avec_film:3327:6601316,6601140:barquette_avec_film:3327:6602314,6601199:barquette_avec_film:3327:6601849,6602727:barquette_avec_film:3327:6603845,6602729:barquette_avec_film:3327:6603981,6602732:barquette_avec_film:3327:6603610,6604400:barquette_avec_film:3327:6604938,6604702:barquette_avec_film:3327:6606380,6605500:barquette_avec_film:3327:6606272,6605502:barquette_avec_film:3327:6607136,6606682:barquette_avec_film:3327:6608324,6606685:barquette_avec_film:3327:6607885,6606687:barquette_avec_film:3327:6607388,6607836:barquette_avec_film:3327:6608593,6607838:barquette_avec_film:3327:6608675,6608144:barquette_avec_film:3327:6608967,6609197:barquette_avec_film:3327:6610048,6609198:barquette_avec_film:3327:6609910,6609963:barquette_avec_film:3327:6610273'}, {'unwanted_material': 'barquette_opaque', 'main_material': 'ela', 'pht_type': 4203, 'ratio': 0.0006065490165070008, 'nb_photo': 9, 'list_port_cont': '6603426,6627334,6634749,6723417,6780640,6834099,6852168', 'assoc_port': '6602731:6603426,6626721:6627334,6630937:6634749,6671808:6834099,6722813:6723417,6780026:6780640,6851650:6852168', 'assoc_mat': '6602731:barquette_opaque:4203:6603426,6626721:barquette_opaque:4203:6627334,6630937:barquette_opaque:4203:6634749,6671808:barquette_opaque:4203:6834099,6722813:barquette_opaque:4203:6723417,6780026:barquette_opaque:4203:6780640,6851650:barquette_opaque:4203:6852168'}, {'unwanted_material': 'barquette_opaque', 'main_material': 'emr', 'pht_type': 4209, 'ratio': 0.0005293780694215035, 'nb_photo': 1, 'list_port_cont': '6692906', 'assoc_port': '6691778:6692906', 'assoc_mat': '6691778:barquette_opaque:4209:6692906'}, {'unwanted_material': 'barquette_opaque', 'main_material': 'pehd_pp', 'pht_type': 4211, 'ratio': 0.008662761320534096, 'nb_photo': 659, 'list_port_cont': '6600860,6600903,6601023,6601433,6602273,6602593,6603403,6606082,6607689,6608069,6608289,6609462,6610653,6614532,6615427,6615792,6616525,6618779,6618922,6620328,6621053,6621664,6621960,6622002,6622135,6622199,6624057,6626607,6627268,6628481,6629183,6629252,6634382,6635139,6638289,6638441,6640989,6642058,6642706,6650155,6650276,6650959,6658495,6664041,6668175,6669610,6672035,6674014,6674549,6674630,6674772,6675081,6675105,6675139,6675482,6676524,6677132,6677217,6678042,6678216,6678577,6678660,6678688,6678769,6678960,6678988,6681252,6687138,6692292,6693194,6693681,6693891,6694045,6694217,6694420,6698421,6698805,6699377,6699427,6700669,6707231,6711232,6711409,6711495,6712142,6713437,6713607,6713753,6714397,6716562,6717498,6717555,6718025,6719023,6719736,6720660,6720723,6721143,6721925,6722677,6723045,6723102,6724740,6724912,6724973,6725830,6729866,6730263,6730718,6731855,6732324,6732440,6735375,6738136,6740197,6740602,6741090,6741939,6743256,6743597,6743876,6745278,6747827,6751581,6751678,6751683,6752336,6754140,', 'assoc_port': '10844008:10846065,10844009:10845784,10844011:10845552,10844012:10845981,10844014:10845176,10844016:10845161,10844017:10845129,10844018:10844946,10844019:10845048,10844020:10844679,12107427:12108055,12107429:12107821,6600536:6601433,6600544:6600860,6600546:6601023,6600551:6600903,6601138:6602593,6601649:6602273,6602733:6603403,6604399:6608069,6605499:6610653,6605688:6606082,6606683:6607689,6607839:6608289,6609199:6609462,6614199:6614532,6614969:6615427,6615362:6615792,6616173:6616525,6618307:6618779,6618311:6618922,6620040:6620328,6620422:6621664,6620444:6621053,6621638:6624057,6621647:6622199,6621651:6622135,6621654:6621960,6621659:6622002,6626268:6626607,6627098:6627268,6627945:6628481,6628987:6629183,6628989:6629252,6630852:6674014,6630932:6674630,6630935:6674772,6630939:6675105,6631065:6675081,6631069:6675482,6631193:6635139,6631477:6676524,6631489:6677132,6631492:6677217,6631967:6634382,6632585:6678216,6632660:6678577,6632663:6678660,6632714:6678769,6632787:6678688,6632877:6678960,6632881:6678988,6635669:', 'assoc_mat': '10844008:barquette_opaque:4211:10846065,10844009:barquette_opaque:4211:10845784,10844011:barquette_opaque:4211:10845552,10844012:barquette_opaque:4211:10845981,10844014:barquette_opaque:4211:10845176,10844016:barquette_opaque:4211:10845161,10844017:barquette_opaque:4211:10845129,10844018:barquette_opaque:4211:10844946,10844019:barquette_opaque:4211:10845048,10844020:barquette_opaque:4211:10844679,12107427:barquette_opaque:4211:12108055,12107429:barquette_opaque:4211:12107821,6600536:barquette_opaque:4211:6601433,6600544:barquette_opaque:4211:6600860,6600546:barquette_opaque:4211:6601023,6600551:barquette_opaque:4211:6600903,6601138:barquette_opaque:4211:6602593,6601649:barquette_opaque:4211:6602273,6602733:barquette_opaque:4211:6603403,6604399:barquette_opaque:4211:6608069,6605499:barquette_opaque:4211:6610653,6605688:barquette_opaque:4211:6606082,6606683:barquette_opaque:4211:6607689,6607839:barquette_opaque:4211:6608289,6609199:barquette_opaque:4211:6609462,6614199:barquette_opaque:4211:6614532,6614969:barq'}, {'unwanted_material': 'barquette_opaque', 'main_material': 'pet_fonce', 'pht_type': 4200, 'ratio': 0.0009915902324084817, 'nb_photo': 5, 'list_port_cont': '6649286,6687459,6784020,6813915,6920756', 'assoc_port': '6631070:6649286,6686295:6687459,6782249:6784020,6813389:6813915,6920100:6920756', 'assoc_mat': '6631070:barquette_opaque:4200:6649286,6686295:barquette_opaque:4200:6687459,6782249:barquette_opaque:4200:6784020,6813389:barquette_opaque:4200:6813915,6920100:barquette_opaque:4200:6920756'}, {'unwanted_material': 'bouchon', 'main_material': 'pet_clair', 'pht_type': 3327, 'ratio': 0.002148587132747826, 'nb_photo': 2481, 'list_port_cont': '6601204,6601258,6601320,6601369,6601559,6601701,6601789,6601838,6602303,6603616,6603840,6603991,6604940,6606271,6606371,6607138,6607392,6607893,6608314,6608584,6608679,6608959,6609909,6610052,6610283,6610913,6611085,6613733,6614158,6615892,6616060,6616205,6616979,6617470,6617845,6618175,6618953,6620508,6620996,6621149,6621177,6621393,6621437,6621531,6622101,6622159,6622323,6622381,6622429,6622524,6622659,6622748,6626363,6626980,6626996,6627191,6627830,6628020,6628559,6628625,6629350,6629387,6635807,6635871,6635902,6635950,6635976,6636031,6636142,6636288,6636337,6636425,6636596,6636683,6636733,6636798,6637042,6637681,6637704,6637763,6637859,6637953,6637977,6638087,6638418,6638605,6638699,6638834,6638943,6638976,6639182,6639296,6639351,6639643,6639763,6639846,6639907,6639971,6640125,6640715,6640780,6640955,6641210,6641300,6641327,6641485,6641509,6641661,6641818,6641952,6642084,6642292,6643375,6643473,6643600,6643630,6643663,6643691,6643711,6643907,6644068,6644455,6644662,6645166,6645298,6645757,6647406,6648003,', 'assoc_port': '6600535:6601258,6600537:6601701,6600543:6601204,6600545:6601369,6600547:6601559,6600550:6601789,6600553:6601320,6601140:6602303,6601199:6601838,6602727:6603840,6602729:6603991,6602732:6603616,6604400:6604940,6604702:6606371,6605500:6606271,6605502:6607138,6606682:6608314,6606685:6607893,6606687:6607392,6607836:6608584,6607838:6608679,6608144:6608959,6609197:6610052,6609198:6609909,6609963:6610283,6610497:6611085,6610499:6610913,6612953:6613733,6613333:6614158,6614966:6616205,6614968:6616060,6615360:6615892,6616171:6616979,6616960:6618175,6616966:6617470,6616967:6617845,6618310:6618953,6620036:6620508,6620039:6621393,6620042:6620996,6620404:6621149,6620441:6621437,6620445:6621177,6620446:6621531,6621639:6622659,6621642:6622748,6621645:6622524,6621650:6622381,6621652:6622429,6621655:6622159,6621656:6622101,6621661:6622323,6625901:6626363,6626270:6626980,6626272:6626996,6626275:6627191,6627097:6627830,6627099:6628020,6627946:6628559,6627948:6628625,6628988:6629350,6628991:6629387,6630847:6635950,6630849:6636031,', 'assoc_mat': '6600535:bouchon:3327:6601258,6600537:bouchon:3327:6601701,6600543:bouchon:3327:6601204,6600545:bouchon:3327:6601369,6600547:bouchon:3327:6601559,6600550:bouchon:3327:6601789,6600553:bouchon:3327:6601320,6601140:bouchon:3327:6602303,6601199:bouchon:3327:6601838,6602727:bouchon:3327:6603840,6602729:bouchon:3327:6603991,6602732:bouchon:3327:6603616,6604400:bouchon:3327:6604940,6604702:bouchon:3327:6606371,6605500:bouchon:3327:6606271,6605502:bouchon:3327:6607138,6606682:bouchon:3327:6608314,6606685:bouchon:3327:6607893,6606687:bouchon:3327:6607392,6607836:bouchon:3327:6608584,6607838:bouchon:3327:6608679,6608144:bouchon:3327:6608959,6609197:bouchon:3327:6610052,6609198:bouchon:3327:6609909,6609963:bouchon:3327:6610283,6610497:bouchon:3327:6611085,6610499:bouchon:3327:6610913,6612953:bouchon:3327:6613733,6613333:bouchon:3327:6614158,6614966:bouchon:3327:6616205,6614968:bouchon:3327:6616060,6615360:bouchon:3327:6615892,6616171:bouchon:3327:6616979,6616960:bouchon:3327:6618175,6616966:bouchon:3327:6617470,6616967:b'}, {'unwanted_material': 'carton', 'main_material': 'ela', 'pht_type': 4203, 'ratio': 0.015781843756573148, 'nb_photo': 1998, 'list_port_cont': '6603428,6608804,6618325,6624159,6627335,6634751,6634798,6660090,6698369,6704158,6712719,6720528,6723218,6723410,6735159,6735455,6741137,6754060,6761153,6768731,6775020,6780639,6799269,6800310,6801317,6806363,6808106,6808745,6810123,6812813,6822554,6826369,6834087,6838770,6846433,6852159,6863267,6865659,6869925,6876020,6924800,6930493,6940832,10844173', 'assoc_port': '10844025:10844173,6602731:6603428,6608146:6608804,6617603:6618325,6620405:6624159,6626721:6627335,6630937:6634751,6631483:6634798,6632879:6660090,6638160:6704158,6653521:6723218,6664117:6735455,6671808:6834087,6682068:6768731,6685476:6799269,6685991:6800310,6686304:6801317,6690887:6735159,6696473:6698369,6712332:6712719,6718634:6720528,6722813:6723410,6740022:6741137,6745199:6810123,6753416:6754060,6760133:6761153,6765566:6808745,6774410:6775020,6780026:6780639,6786466:6808106,6793236:6806363,6811950:6812813,6820599:6822554,6825858:6826369,6837012:6838770,6846007:6846433,6851650:6852159,6863104:6863267,6865559:6865659,6869544:6869925,6875674:6876020,6894306:6930493,6900378:6940832,6923650:6924800', 'assoc_mat': '10844025:carton:4203:10844173,6602731:carton:4203:6603428,6608146:carton:4203:6608804,6617603:carton:4203:6618325,6620405:carton:4203:6624159,6626721:carton:4203:6627335,6630937:carton:4203:6634751,6631483:carton:4203:6634798,6632879:carton:4203:6660090,6638160:carton:4203:6704158,6653521:carton:4203:6723218,6664117:carton:4203:6735455,6671808:carton:4203:6834087,6682068:carton:4203:6768731,6685476:carton:4203:6799269,6685991:carton:4203:6800310,6686304:carton:4203:6801317,6690887:carton:4203:6735159,6696473:carton:4203:6698369,6712332:carton:4203:6712719,6718634:carton:4203:6720528,6722813:carton:4203:6723410,6740022:carton:4203:6741137,6745199:carton:4203:6810123,6753416:carton:4203:6754060,6760133:carton:4203:6761153,6765566:carton:4203:6808745,6774410:carton:4203:6775020,6780026:carton:4203:6780639,6786466:carton:4203:6808106,6793236:carton:4203:6806363,6811950:carton:4203:6812813,6820599:carton:4203:6822554,6825858:carton:4203:6826369,6837012:carton:4203:6838770,6846007:carton:4203:6846433,6851650:carton'}, {'unwanted_material': 'carton', 'main_material': 'emr', 'pht_type': 4207, 'ratio': 0.9743551532309155, 'nb_photo': 4, 'list_port_cont': '12107738,12108208', 'assoc_port': '12107419:12108208,12107426:12107738', 'assoc_mat': '12107419:carton:4207:12108208,12107426:carton:4207:12107738'}, {'unwanted_material': 'carton', 'main_material': 'emr', 'pht_type': 4209, 'ratio': 0.004418352534261281, 'nb_photo': 161, 'list_port_cont': '6600769,6601467,6602156,6616727,6617535,6617707,6618976,6620415,6621476,6621927,6622071,6625405,6627053,6637137,6638503,6641082,6644340,6647280,6648123,6651932,6655484,6657576,6664017,6666562,6667513,6668138,6668212,6669002,6669287,6669404,6670447,6670556,6670902,6672181,6673400,6674363,6678083,6682353,6690824,6692905,6694179,6695453,6695907,6697455,6699015,6711039,6712083,6712246,6716814,6721878,6723683,6740491,6742328,6751444,6754763,6812438,6824357', 'assoc_port': '6600533:6601467,6600540:6602156,6600552:6600769,6616168:6616727,6616961:6617707,6616963:6617535,6618302:6618976,6620037:6620415,6620443:6621476,6621640:6622071,6621646:6621927,6625237:6625405,6626722:6627053,6631064:6666562,6631190:6668138,6631196:6668212,6631480:6669002,6631482:6669287,6631491:6669404,6632580:6670447,6632661:6670556,6632883:6670902,6633864:6637137,6638162:6638503,6638777:6644340,6640593:6641082,6646444:6647280,6647214:6648123,6650509:6651932,6654838:6655484,6656897:6657576,6663620:6664017,6664426:6667513,6671806:6672181,6672700:6673400,6673893:6674363,6677866:6678083,6681682:6682353,6682898:6690824,6685513:6697455,6688873:6699015,6691778:6692905,6692502:6694179,6694731:6695907,6694740:6695453,6709375:6711039,6710867:6712246,6711682:6712083,6716079:6716814,6721779:6721878,6723504:6723683,6739465:6742328,6740030:6740491,6741911:6754763,6750987:6751444,6811912:6812438,6823971:6824357', 'assoc_mat': '6600533:carton:4209:6601467,6600540:carton:4209:6602156,6600552:carton:4209:6600769,6616168:carton:4209:6616727,6616961:carton:4209:6617707,6616963:carton:4209:6617535,6618302:carton:4209:6618976,6620037:carton:4209:6620415,6620443:carton:4209:6621476,6621640:carton:4209:6622071,6621646:carton:4209:6621927,6625237:carton:4209:6625405,6626722:carton:4209:6627053,6631064:carton:4209:6666562,6631190:carton:4209:6668138,6631196:carton:4209:6668212,6631480:carton:4209:6669002,6631482:carton:4209:6669287,6631491:carton:4209:6669404,6632580:carton:4209:6670447,6632661:carton:4209:6670556,6632883:carton:4209:6670902,6633864:carton:4209:6637137,6638162:carton:4209:6638503,6638777:carton:4209:6644340,6640593:carton:4209:6641082,6646444:carton:4209:6647280,6647214:carton:4209:6648123,6650509:carton:4209:6651932,6654838:carton:4209:6655484,6656897:carton:4209:6657576,6663620:carton:4209:6664017,6664426:carton:4209:6667513,6671806:carton:4209:6672181,6672700:carton:4209:6673400,6673893:carton:4209:6674363,6677866:carton:4'}, {'unwanted_material': 'carton', 'main_material': 'gm', 'pht_type': 4209, 'ratio': 0.0034360485265016666, 'nb_photo': 74, 'list_port_cont': '6846228,6863059,6869289,6886849,6890963,6894674,6908912,6914945,6920514,6922344,6960443,12107789,12108019,12108273,12108337,12108377,12108542,12108682,12151219', 'assoc_port': '12107418:12151219,12107420:12108682,12107421:12108542,12107422:12108377,12107424:12108273,12107425:12108337,12107428:12108019,12107430:12107789,6845636:6846228,6862271:6863059,6868823:6869289,6886556:6886849,6890813:6890963,6894304:6894674,6902262:6908912,6914405:6914945,6919130:6920514,6919131:6960443,6920918:6922344', 'assoc_mat': '12107418:carton:4209:12151219,12107420:carton:4209:12108682,12107421:carton:4209:12108542,12107422:carton:4209:12108377,12107424:carton:4209:12108273,12107425:carton:4209:12108337,12107428:carton:4209:12108019,12107430:carton:4209:12107789,6845636:carton:4209:6846228,6862271:carton:4209:6863059,6868823:carton:4209:6869289,6886556:carton:4209:6886849,6890813:carton:4209:6890963,6894304:carton:4209:6894674,6902262:carton:4209:6908912,6914405:carton:4209:6914945,6919130:carton:4209:6920514,6919131:carton:4209:6960443,6920918:carton:4209:6922344'}, {'unwanted_material': 'carton', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 0.7882882989748035, 'nb_photo': 99, 'list_port_cont': '6617257,6617678,6633558,6659532', 'assoc_port': '6616962:6617257,6616964:6617678,6631478:6633558,6652939:6659532', 'assoc_mat': '6616962:carton:4207:6617257,6616964:carton:4207:6617678,6631478:carton:4207:6633558,6652939:carton:4207:6659532'}, {'unwanted_material': 'carton', 'main_material': 'pehd_pp', 'pht_type': 4211, 'ratio': 0.005541745404523602, 'nb_photo': 10072, 'list_port_cont': '6600862,6600896,6601025,6601432,6601509,6602274,6602602,6603017,6603405,6605885,6606079,6607679,6608062,6608285,6609455,6610403,6610610,6610646,6611147,6613688,6614029,6614524,6615392,6615433,6615557,6615807,6616523,6617433,6618778,6618919,6620209,6620333,6620915,6621055,6621679,6621959,6621994,6622138,6622194,6622460,6624060,6625559,6626610,6626645,6627278,6628471,6629181,6629246,6634380,6634648,6634846,6635132,6635839,6638277,6638440,6639151,6640998,6642060,6642703,6648971,6650047,6650147,6650271,6650967,6658510,6664044,6666448,6668089,6668177,6669622,6672030,6674022,6674547,6674632,6674763,6675077,6675104,6675135,6675473,6676026,6676537,6676625,6677127,6677221,6677812,6678043,6678220,6678576,6678652,6678765,6678931,6678963,6678994,6679223,6681249,6687137,6691499,6691652,6692287,6693204,6693679,6693897,6694010,6694038,6694216,6694416,6695511,6697512,6698426,6698766,6698791,6699371,6699423,6700624,6700657,6705442,6706626,6706767,6707236,6707810,6709732,6711227,6711402,6711481,6712143,6712484,6712643,6712742,', 'assoc_port': '10844008:10846058,10844009:10845786,10844010:10846035,10844011:10845555,10844012:10845974,10844013:10845417,10844014:10845188,10844015:10845076,10844016:10845159,10844017:10845134,10844018:10844944,10844019:10845036,10844020:10844680,10844021:10844446,12107423:12108311,12107427:12108078,12107429:12107832,6600536:6601432,6600541:6601509,6600544:6600862,6600546:6601025,6600551:6600896,6601138:6602602,6601649:6602274,6602728:6603017,6602733:6603405,6604399:6608062,6605499:6610646,6605503:6605885,6605688:6606079,6606683:6607679,6607835:6610403,6607839:6608285,6609199:6609455,6610498:6610610,6610992:6611147,6613334:6613688,6613876:6614029,6614199:6614524,6614967:6615392,6614969:6615433,6615340:6615557,6615362:6615807,6616173:6616523,6616982:6617433,6618307:6618778,6618311:6618919,6620038:6620209,6620040:6620333,6620422:6621679,6620444:6621055,6620447:6620915,6621638:6624060,6621643:6622460,6621647:6622194,6621651:6622138,6621654:6621959,6621659:6621994,6625236:6625559,6626268:6626610,6626274:6626645,6627098:662727', 'assoc_mat': '10844008:carton:4211:10846058,10844009:carton:4211:10845786,10844010:carton:4211:10846035,10844011:carton:4211:10845555,10844012:carton:4211:10845974,10844013:carton:4211:10845417,10844014:carton:4211:10845188,10844015:carton:4211:10845076,10844016:carton:4211:10845159,10844017:carton:4211:10845134,10844018:carton:4211:10844944,10844019:carton:4211:10845036,10844020:carton:4211:10844680,10844021:carton:4211:10844446,12107423:carton:4211:12108311,12107427:carton:4211:12108078,12107429:carton:4211:12107832,6600536:carton:4211:6601432,6600541:carton:4211:6601509,6600544:carton:4211:6600862,6600546:carton:4211:6601025,6600551:carton:4211:6600896,6601138:carton:4211:6602602,6601649:carton:4211:6602274,6602728:carton:4211:6603017,6602733:carton:4211:6603405,6604399:carton:4211:6608062,6605499:carton:4211:6610646,6605503:carton:4211:6605885,6605688:carton:4211:6606079,6606683:carton:4211:6607679,6607835:carton:4211:6610403,6607839:carton:4211:6608285,6609199:carton:4211:6609455,6610498:carton:4211:6610610,6610992:ca'}, {'unwanted_material': 'carton', 'main_material': 'pet_clair', 'pht_type': 3327, 'ratio': 0.021265796174868765, 'nb_photo': 11055, 'list_port_cont': '6601215,6601254,6601311,6601365,6601560,6601690,6601782,6601848,6602311,6603606,6603844,6603989,6604932,6606278,6606384,6607129,6607398,6607888,6608321,6608587,6608682,6608971,6609916,6610055,6610284,6610912,6611077,6613728,6614151,6615888,6616062,6616202,6616976,6617459,6617851,6618180,6618944,6620516,6620989,6621115,6621137,6621173,6621387,6621436,6621535,6622109,6622160,6622315,6622373,6622427,6622513,6622655,6622753,6626373,6626971,6627002,6627199,6627839,6628013,6628560,6628619,6629361,6629384,6635813,6635874,6635895,6635941,6635971,6636033,6636118,6636148,6636296,6636333,6636418,6636592,6636681,6636726,6636802,6637043,6637688,6637712,6637762,6637860,6637949,6637973,6638091,6638425,6638595,6638701,6638837,6638945,6638981,6639192,6639297,6639349,6639651,6639755,6639845,6639906,6639972,6640117,6640719,6640754,6640781,6640958,6641217,6641305,6641322,6641489,6641514,6641657,6641813,6641946,6642029,6642085,6642288,6643238,6643376,6643471,6643599,6643635,6643658,6643688,6643713,6643897,6644067,6644460,6644654,', 'assoc_port': '6600535:6601254,6600537:6601690,6600543:6601215,6600545:6601365,6600547:6601560,6600550:6601782,6600553:6601311,6601140:6602311,6601199:6601848,6602727:6603844,6602729:6603989,6602732:6603606,6604400:6604932,6604702:6606384,6605500:6606278,6605502:6607129,6606682:6608321,6606685:6607888,6606687:6607398,6607836:6608587,6607838:6608682,6608144:6608971,6609197:6610055,6609198:6609916,6609963:6610284,6610497:6611077,6610499:6610912,6612953:6613728,6613333:6614151,6614966:6616202,6614968:6616062,6615360:6615888,6616171:6616976,6616960:6618180,6616966:6617459,6616967:6617851,6618310:6618944,6620036:6620516,6620039:6621387,6620042:6620989,6620404:6621137,6620441:6621436,6620445:6621173,6620446:6621535,6620449:6621115,6621639:6622655,6621642:6622753,6621645:6622513,6621650:6622373,6621652:6622427,6621655:6622160,6621656:6622109,6621661:6622315,6625901:6626373,6626270:6626971,6626272:6627002,6626275:6627199,6627097:6627839,6627099:6628013,6627946:6628560,6627948:6628619,6628988:6629361,6628991:6629384,6630847:6635941,', 'assoc_mat': '6600535:carton:3327:6601254,6600537:carton:3327:6601690,6600543:carton:3327:6601215,6600545:carton:3327:6601365,6600547:carton:3327:6601560,6600550:carton:3327:6601782,6600553:carton:3327:6601311,6601140:carton:3327:6602311,6601199:carton:3327:6601848,6602727:carton:3327:6603844,6602729:carton:3327:6603989,6602732:carton:3327:6603606,6604400:carton:3327:6604932,6604702:carton:3327:6606384,6605500:carton:3327:6606278,6605502:carton:3327:6607129,6606682:carton:3327:6608321,6606685:carton:3327:6607888,6606687:carton:3327:6607398,6607836:carton:3327:6608587,6607838:carton:3327:6608682,6608144:carton:3327:6608971,6609197:carton:3327:6610055,6609198:carton:3327:6609916,6609963:carton:3327:6610284,6610497:carton:3327:6611077,6610499:carton:3327:6610912,6612953:carton:3327:6613728,6613333:carton:3327:6614151,6614966:carton:3327:6616202,6614968:carton:3327:6616062,6615360:carton:3327:6615888,6616171:carton:3327:6616976,6616960:carton:3327:6618180,6616966:carton:3327:6617459,6616967:carton:3327:6617851,6618310:carton:3'}, {'unwanted_material': 'carton', 'main_material': 'pet_fonce', 'pht_type': 4200, 'ratio': 0.0030077102589759186, 'nb_photo': 188, 'list_port_cont': '6600928,6602053,6613067,6615617,6620856,6626789,6634257,6637078,6637444,6638372,6639234,6641575,6646017,6647334,6649471,6649914,6653437,6654689,6655701,6658478,6662382,6670056,6672616,6674513,6683667,6684475,6687238,6687457,6696453,6696810,6698452,6711567,6712284,6712773,6714498,6717605,6719822,6720209,6720249,6720369,6721251,6722524,6740808,6745523,6745785,6750251,6754193,6754563,6765279,6766693,6780395,6780519,6784030,6786852,6788641,6791341,6793689,6795536,6817651,6821378,6824090,6835185,6836549,6840202,6849237,6852379,6854531,6859034,6862722,6865777,6866323,6867980,6869264,6874412,6875751,6875979,6882733,6886815,6888107,6889496,6902501,6904840,6914439,6920752,6921621,6924262', 'assoc_port': '6600538:6600928,6601136:6602053,6612632:6613067,6615365:6615617,6620439:6620856,6626271:6626789,6630848:6646017,6631186:6634257,6631194:6649914,6631961:6655701,6632583:6662382,6632966:6670056,6635673:6637444,6635681:6637078,6637843:6638372,6638774:6639234,6641286:6641575,6646447:6647334,6648940:6649471,6650951:6653437,6654041:6654689,6657889:6658478,6671809:6672616,6673895:6674513,6681680:6683667,6683618:6684475,6685440:6720369,6685511:6720209,6686027:6719822,6686295:6687457,6686312:6687238,6688871:6714498,6690894:6698452,6693641:6696453,6696476:6696810,6710860:6711567,6711680:6712284,6712324:6712773,6716688:6717605,6718843:6720249,6720803:6721251,6722354:6722524,6740018:6740808,6740709:6745523,6744268:6745785,6748062:6750251,6753406:6754563,6753419:6754193,6764848:6765279,6765563:6766693,6779977:6780519,6780017:6780395,6782249:6784030,6786463:6786852,6787690:6788641,6790918:6791341,6793238:6793689,6795258:6795536,6817300:6817651,6820776:6821378,6823753:6824090,6833510:6835185,6835942:6836549,6839793:6840202,', 'assoc_mat': '6600538:carton:4200:6600928,6601136:carton:4200:6602053,6612632:carton:4200:6613067,6615365:carton:4200:6615617,6620439:carton:4200:6620856,6626271:carton:4200:6626789,6630848:carton:4200:6646017,6631186:carton:4200:6634257,6631194:carton:4200:6649914,6631961:carton:4200:6655701,6632583:carton:4200:6662382,6632966:carton:4200:6670056,6635673:carton:4200:6637444,6635681:carton:4200:6637078,6637843:carton:4200:6638372,6638774:carton:4200:6639234,6641286:carton:4200:6641575,6646447:carton:4200:6647334,6648940:carton:4200:6649471,6650951:carton:4200:6653437,6654041:carton:4200:6654689,6657889:carton:4200:6658478,6671809:carton:4200:6672616,6673895:carton:4200:6674513,6681680:carton:4200:6683667,6683618:carton:4200:6684475,6685440:carton:4200:6720369,6685511:carton:4200:6720209,6686027:carton:4200:6719822,6686295:carton:4200:6687457,6686312:carton:4200:6687238,6688871:carton:4200:6714498,6690894:carton:4200:6698452,6693641:carton:4200:6696453,6696476:carton:4200:6696810,6710860:carton:4200:6711567,6711680:carton:4'}, {'unwanted_material': 'ela', 'main_material': 'ela', 'pht_type': 4203, 'ratio': 0.9213990406858268, 'nb_photo': 851, 'list_port_cont': '6603436,6608816,6618318,6624164,6627339,6634755,6634797,6660094,6660517,6698372,6704166,6712720,6720539,6723233,6723408,6735149,6735451,6741141,6754061,6761154,6768736,6775025,6780642,6799277,6800318,6801314,6806353,6808104,6808746,6810130,6812814,6822548,6826377,6834092,6838771,6846432,6852158,6863258,6865673,6869916,6876021,6930479,6940847,10844172', 'assoc_port': '10844025:10844172,6602731:6603436,6608146:6608816,6617603:6618318,6620405:6624164,6626721:6627339,6630937:6634755,6631483:6634797,6631962:6660517,6632879:6660094,6638160:6704166,6653521:6723233,6664117:6735451,6671808:6834092,6682068:6768736,6685476:6799277,6685991:6800318,6686304:6801314,6690887:6735149,6696473:6698372,6712332:6712720,6718634:6720539,6722813:6723408,6740022:6741141,6745199:6810130,6753416:6754061,6760133:6761154,6765566:6808746,6774410:6775025,6780026:6780642,6786466:6808104,6793236:6806353,6811950:6812814,6820599:6822548,6825858:6826377,6837012:6838771,6846007:6846432,6851650:6852158,6863104:6863258,6865559:6865673,6869544:6869916,6875674:6876021,6894306:6930479,6900378:6940847', 'assoc_mat': '10844025:ela:4203:10844172,6602731:ela:4203:6603436,6608146:ela:4203:6608816,6617603:ela:4203:6618318,6620405:ela:4203:6624164,6626721:ela:4203:6627339,6630937:ela:4203:6634755,6631483:ela:4203:6634797,6631962:ela:4203:6660517,6632879:ela:4203:6660094,6638160:ela:4203:6704166,6653521:ela:4203:6723233,6664117:ela:4203:6735451,6671808:ela:4203:6834092,6682068:ela:4203:6768736,6685476:ela:4203:6799277,6685991:ela:4203:6800318,6686304:ela:4203:6801314,6690887:ela:4203:6735149,6696473:ela:4203:6698372,6712332:ela:4203:6712720,6718634:ela:4203:6720539,6722813:ela:4203:6723408,6740022:ela:4203:6741141,6745199:ela:4203:6810130,6753416:ela:4203:6754061,6760133:ela:4203:6761154,6765566:ela:4203:6808746,6774410:ela:4203:6775025,6780026:ela:4203:6780642,6786466:ela:4203:6808104,6793236:ela:4203:6806353,6811950:ela:4203:6812814,6820599:ela:4203:6822548,6825858:ela:4203:6826377,6837012:ela:4203:6838771,6846007:ela:4203:6846432,6851650:ela:4203:6852158,6863104:ela:4203:6863258,6865559:ela:4203:6865673,6869544:ela:4203:68699'}, {'unwanted_material': 'ela', 'main_material': 'emr', 'pht_type': 4209, 'ratio': 0.0007116836898320703, 'nb_photo': 13, 'list_port_cont': '6622066,6638510,6668140,6674367,6682359,6692900,6699027,6751454,6812448', 'assoc_port': '6621640:6622066,6631190:6668140,6638162:6638510,6673893:6674367,6681682:6682359,6688873:6699027,6691778:6692900,6750987:6751454,6811912:6812448', 'assoc_mat': '6621640:ela:4209:6622066,6631190:ela:4209:6668140,6638162:ela:4209:6638510,6673893:ela:4209:6674367,6681682:ela:4209:6682359,6688873:ela:4209:6699027,6691778:ela:4209:6692900,6750987:ela:4209:6751454,6811912:ela:4209:6812448'}, {'unwanted_material': 'ela', 'main_material': 'gm', 'pht_type': 4209, 'ratio': 0.00032398461757896294, 'nb_photo': 4, 'list_port_cont': '6846232,6863050,6869299,6922346', 'assoc_port': '6845636:6846232,6862271:6863050,6868823:6869299,6920918:6922346', 'assoc_mat': '6845636:ela:4209:6846232,6862271:ela:4209:6863050,6868823:ela:4209:6869299,6920918:ela:4209:6922346'}, {'unwanted_material': 'ela', 'main_material': 'pehd_pp', 'pht_type': 4211, 'ratio': 0.00015698953627416628, 'nb_photo': 147, 'list_port_cont': '6606078,6610614,6610650,6611153,6618777,6621995,6624051,6626615,6629238,6634390,6638443,6650283,6668181,6674761,6676619,6687148,6691488,6692283,6693901,6697509,6698420,6712139,6712495,6712638,6713763,6714406,6719444,6721923,6723047,6725696,6725822,6730328,6732327,6732432,6735373,6735646,6743245,6748843,6752335,6753734,6754131,6754280,6755113,6756969,6757867,6757971,6759593,6762164,6768398,6778929,6780252,6780740,6780892,6784776,6785335,6790082,6794260,6795576,6797595,6799113,6799411,6799545,6799693,6800458,6800536,6800674,6800830,6808649,6808671,6808798,6809166,6810011,6810258,6812213,6835747,6840031,6842616,6854223,6855219,6855451,6869220,6889386,6889562,6917712,6920224,6922983,6961422,10844945,10845415,10846062,12107826', 'assoc_port': '10844008:10846062,10844013:10845415,10844018:10844945,12107429:12107826,6605499:6610650,6605688:6606078,6610498:6610614,6610992:6611153,6618307:6618777,6621638:6624051,6621659:6621995,6626268:6626615,6628989:6629238,6630935:6674761,6631484:6676619,6631967:6634390,6635671:6693901,6638161:6638443,6649833:6650283,6653520:6723047,6653523:6725696,6654837:6725822,6663625:6735646,6666361:6668181,6671801:6755113,6683616:6790082,6683620:6691488,6685431:6799113,6685484:6854223,6685489:6799411,6685506:6799545,6685519:6799693,6685533:6697509,6686006:6855219,6686021:6855451,6686031:6800458,6686094:6800536,6686289:6800674,6686298:6800830,6686321:6687148,6688870:6732432,6688875:6732327,6690891:6735373,6691780:6730328,6691869:6692283,6696477:6698420,6710862:6713763,6711681:6712139,6711684:6714406,6712328:6712638,6712336:6712495,6718636:6719444,6721635:6721923,6738742:6810258,6740001:6752335,6740031:6743245,6743340:6757867,6748058:6810011,6748061:6748843,6748064:6756969,6753412:6754131,6753415:6754280,6753418:6753734,6757493:', 'assoc_mat': '10844008:ela:4211:10846062,10844013:ela:4211:10845415,10844018:ela:4211:10844945,12107429:ela:4211:12107826,6605499:ela:4211:6610650,6605688:ela:4211:6606078,6610498:ela:4211:6610614,6610992:ela:4211:6611153,6618307:ela:4211:6618777,6621638:ela:4211:6624051,6621659:ela:4211:6621995,6626268:ela:4211:6626615,6628989:ela:4211:6629238,6630935:ela:4211:6674761,6631484:ela:4211:6676619,6631967:ela:4211:6634390,6635671:ela:4211:6693901,6638161:ela:4211:6638443,6649833:ela:4211:6650283,6653520:ela:4211:6723047,6653523:ela:4211:6725696,6654837:ela:4211:6725822,6663625:ela:4211:6735646,6666361:ela:4211:6668181,6671801:ela:4211:6755113,6683616:ela:4211:6790082,6683620:ela:4211:6691488,6685431:ela:4211:6799113,6685484:ela:4211:6854223,6685489:ela:4211:6799411,6685506:ela:4211:6799545,6685519:ela:4211:6799693,6685533:ela:4211:6697509,6686006:ela:4211:6855219,6686021:ela:4211:6855451,6686031:ela:4211:6800458,6686094:ela:4211:6800536,6686289:ela:4211:6800674,6686298:ela:4211:6800830,6686321:ela:4211:6687148,6688870:ela:4211'}, {'unwanted_material': 'ela', 'main_material': 'pet_fonce', 'pht_type': 4200, 'ratio': 0.0010348878985054983, 'nb_photo': 35, 'list_port_cont': '6604882,6609168,6620173,6628355,6637450,6641567,6654693,6665190,6684476,6719824,6754201,6754550,6780397,6797660,6813919,6835187,6842436,6852373,6859023,6862721,6866325,6867974,6875989,6888099,6895293,6920760', 'assoc_port': '6604397:6604882,6608145:6609168,6620043:6620173,6627944:6628355,6635673:6637450,6641286:6641567,6654041:6654693,6664429:6665190,6683618:6684476,6686027:6719824,6753406:6754550,6753419:6754201,6780017:6780397,6797266:6797660,6813389:6813919,6833510:6835187,6842061:6842436,6852123:6852373,6858797:6859023,6862270:6862721,6865552:6866325,6867749:6867974,6875675:6875989,6887861:6888099,6894305:6895293,6920100:6920760', 'assoc_mat': '6604397:ela:4200:6604882,6608145:ela:4200:6609168,6620043:ela:4200:6620173,6627944:ela:4200:6628355,6635673:ela:4200:6637450,6641286:ela:4200:6641567,6654041:ela:4200:6654693,6664429:ela:4200:6665190,6683618:ela:4200:6684476,6686027:ela:4200:6719824,6753406:ela:4200:6754550,6753419:ela:4200:6754201,6780017:ela:4200:6780397,6797266:ela:4200:6797660,6813389:ela:4200:6813919,6833510:ela:4200:6835187,6842061:ela:4200:6842436,6852123:ela:4200:6852373,6858797:ela:4200:6859023,6862270:ela:4200:6862721,6865552:ela:4200:6866325,6867749:ela:4200:6867974,6875675:ela:4200:6875989,6887861:ela:4200:6888099,6894305:ela:4200:6895293,6920100:ela:4200:6920760'}, {'unwanted_material': 'etiquette', 'main_material': 'ela', 'pht_type': 4203, 'ratio': 0.00021900090159665767, 'nb_photo': 78, 'list_port_cont': '6603427,6608805,6624167,6634748,6634790,6660096,6698374,6704172,6712723,6720540,6723232,6723415,6735146,6741134,6754075,6761156,6775024,6780647,6799267,6800315,6801318,6806348,6808094,6808744,6810125,6822562,6826365,6834101,6838767,6852166,6863265,6865664,6869922,6876013,6930484,10844168', 'assoc_port': '10844025:10844168,6602731:6603427,6608146:6608805,6620405:6624167,6630937:6634748,6631483:6634790,6632879:6660096,6638160:6704172,6653521:6723232,6671808:6834101,6685476:6799267,6685991:6800315,6686304:6801318,6690887:6735146,6696473:6698374,6712332:6712723,6718634:6720540,6722813:6723415,6740022:6741134,6745199:6810125,6753416:6754075,6760133:6761156,6765566:6808744,6774410:6775024,6780026:6780647,6786466:6808094,6793236:6806348,6820599:6822562,6825858:6826365,6837012:6838767,6851650:6852166,6863104:6863265,6865559:6865664,6869544:6869922,6875674:6876013,6894306:6930484', 'assoc_mat': '10844025:etiquette:4203:10844168,6602731:etiquette:4203:6603427,6608146:etiquette:4203:6608805,6620405:etiquette:4203:6624167,6630937:etiquette:4203:6634748,6631483:etiquette:4203:6634790,6632879:etiquette:4203:6660096,6638160:etiquette:4203:6704172,6653521:etiquette:4203:6723232,6671808:etiquette:4203:6834101,6685476:etiquette:4203:6799267,6685991:etiquette:4203:6800315,6686304:etiquette:4203:6801318,6690887:etiquette:4203:6735146,6696473:etiquette:4203:6698374,6712332:etiquette:4203:6712723,6718634:etiquette:4203:6720540,6722813:etiquette:4203:6723415,6740022:etiquette:4203:6741134,6745199:etiquette:4203:6810125,6753416:etiquette:4203:6754075,6760133:etiquette:4203:6761156,6765566:etiquette:4203:6808744,6774410:etiquette:4203:6775024,6780026:etiquette:4203:6780647,6786466:etiquette:4203:6808094,6793236:etiquette:4203:6806348,6820599:etiquette:4203:6822562,6825858:etiquette:4203:6826365,6837012:etiquette:4203:6838767,6851650:etiquette:4203:6852166,6863104:etiquette:4203:6863265,6865559:etiquette:4203:6865664'}, {'unwanted_material': 'etiquette', 'main_material': 'emr', 'pht_type': 4209, 'ratio': 0.00030922441233135133, 'nb_photo': 45, 'list_port_cont': '6600778,6617522,6618983,6620411,6621477,6621941,6625401,6641076,6647266,6648129,6651936,6667511,6669411,6670890,6672171,6673397,6674364,6678090,6682348,6690825,6695447,6695912,6697467,6699022,6711044,6712233,6723686,6740487,6742318,6751446,6754766', 'assoc_port': '6600552:6600778,6616963:6617522,6618302:6618983,6620037:6620411,6620443:6621477,6621646:6621941,6625237:6625401,6631491:6669411,6632883:6670890,6640593:6641076,6646444:6647266,6647214:6648129,6650509:6651936,6664426:6667511,6671806:6672171,6672700:6673397,6673893:6674364,6677866:6678090,6681682:6682348,6682898:6690825,6685513:6697467,6688873:6699022,6694731:6695912,6694740:6695447,6709375:6711044,6710867:6712233,6723504:6723686,6739465:6742318,6740030:6740487,6741911:6754766,6750987:6751446', 'assoc_mat': '6600552:etiquette:4209:6600778,6616963:etiquette:4209:6617522,6618302:etiquette:4209:6618983,6620037:etiquette:4209:6620411,6620443:etiquette:4209:6621477,6621646:etiquette:4209:6621941,6625237:etiquette:4209:6625401,6631491:etiquette:4209:6669411,6632883:etiquette:4209:6670890,6640593:etiquette:4209:6641076,6646444:etiquette:4209:6647266,6647214:etiquette:4209:6648129,6650509:etiquette:4209:6651936,6664426:etiquette:4209:6667511,6671806:etiquette:4209:6672171,6672700:etiquette:4209:6673397,6673893:etiquette:4209:6674364,6677866:etiquette:4209:6678090,6681682:etiquette:4209:6682348,6682898:etiquette:4209:6690825,6685513:etiquette:4209:6697467,6688873:etiquette:4209:6699022,6694731:etiquette:4209:6695912,6694740:etiquette:4209:6695447,6709375:etiquette:4209:6711044,6710867:etiquette:4209:6712233,6723504:etiquette:4209:6723686,6739465:etiquette:4209:6742318,6740030:etiquette:4209:6740487,6741911:etiquette:4209:6754766,6750987:etiquette:4209:6751446'}, {'unwanted_material': 'etiquette', 'main_material': 'gm', 'pht_type': 4209, 'ratio': 0.00022776236187163268, 'nb_photo': 13, 'list_port_cont': '6869297,6890964,6908904,6960438,12108034,12108669', 'assoc_port': '12107420:12108669,12107428:12108034,6868823:6869297,6890813:6890964,6902262:6908904,6919131:6960438', 'assoc_mat': '12107420:etiquette:4209:12108669,12107428:etiquette:4209:12108034,6868823:etiquette:4209:6869297,6890813:etiquette:4209:6890964,6902262:etiquette:4209:6908904,6919131:etiquette:4209:6960438'}, {'unwanted_material': 'etiquette', 'main_material': 'pehd_pp', 'pht_type': 4211, 'ratio': 9.761859113588492e-05, 'nb_photo': 731, 'list_port_cont': '6600902,6602270,6608065,6608287,6609459,6610411,6610617,6611154,6614525,6615396,6615423,6615803,6617425,6620339,6620925,6621056,6621665,6621973,6621996,6622127,6622201,6622459,6624053,6625563,6628477,6634393,6634662,6634854,6635143,6635844,6639158,6640993,6650044,6650156,6650281,6658498,6664049,6666450,6669614,6672026,6674393,6674548,6674635,6674760,6675108,6675142,6675485,6676526,6676614,6677128,6677225,6677804,6678044,6678223,6678571,6678768,6678969,6679218,6681248,6687147,6691498,6691665,6692288,6694047,6694207,6694414,6695513,6697508,6698432,6698802,6699435,6700656,6705444,6706636,6706768,6707239,6707826,6709730,6711224,6711404,6711483,6712141,6712483,6712632,6712743,6713443,6713604,6713764,6714402,6716469,6716553,6717496,6717550,6718035,6718534,6719031,6719449,6719733,6720659,6721132,6721831,6722611,6722685,6723046,6723113,6723251,6723786,6724921,6724969,6725105,6725687,6729864,6730275,6730327,6730721,6731860,6732320,6732438,6735374,6735654,6738119,6740200,6740600,6741082,6741932,6743253,6743387,6743591,', 'assoc_port': '10844009:10845795,10844011:10845547,10844012:10845968,10844014:10845181,10844016:10845171,10844017:10845140,10844018:10844947,10844019:10845034,10844020:10844676,10844021:10844452,12107427:12108051,12107429:12107825,6600551:6600902,6601649:6602270,6604399:6608065,6607835:6610411,6607839:6608287,6609199:6609459,6610498:6610617,6610992:6611154,6614199:6614525,6614967:6615396,6614969:6615423,6615362:6615803,6616982:6617425,6620040:6620339,6620422:6621665,6620444:6621056,6620447:6620925,6621638:6624053,6621643:6622459,6621647:6622201,6621651:6622127,6621654:6621973,6621659:6621996,6625236:6625563,6627945:6628477,6630850:6634854,6630856:6634662,6630932:6674635,6630935:6674760,6630939:6675108,6631069:6675485,6631193:6635143,6631477:6676526,6631484:6676614,6631489:6677128,6631492:6677225,6631960:6677804,6631967:6634393,6632585:6678223,6632660:6678571,6632714:6678768,6632877:6678969,6632963:6679218,6633862:6635844,6635676:6694047,6635682:6694207,6637840:6700656,6638773:6705444,6638776:6639158,6640587:6706636,6640590:', 'assoc_mat': '10844009:etiquette:4211:10845795,10844011:etiquette:4211:10845547,10844012:etiquette:4211:10845968,10844014:etiquette:4211:10845181,10844016:etiquette:4211:10845171,10844017:etiquette:4211:10845140,10844018:etiquette:4211:10844947,10844019:etiquette:4211:10845034,10844020:etiquette:4211:10844676,10844021:etiquette:4211:10844452,12107427:etiquette:4211:12108051,12107429:etiquette:4211:12107825,6600551:etiquette:4211:6600902,6601649:etiquette:4211:6602270,6604399:etiquette:4211:6608065,6607835:etiquette:4211:6610411,6607839:etiquette:4211:6608287,6609199:etiquette:4211:6609459,6610498:etiquette:4211:6610617,6610992:etiquette:4211:6611154,6614199:etiquette:4211:6614525,6614967:etiquette:4211:6615396,6614969:etiquette:4211:6615423,6615362:etiquette:4211:6615803,6616982:etiquette:4211:6617425,6620040:etiquette:4211:6620339,6620422:etiquette:4211:6621665,6620444:etiquette:4211:6621056,6620447:etiquette:4211:6620925,6621638:etiquette:4211:6624053,6621643:etiquette:4211:6622459,6621647:etiquette:4211:6622201,6621651:'}, {'unwanted_material': 'etiquette', 'main_material': 'pet_clair', 'pht_type': 3327, 'ratio': 0.004348080716206635, 'nb_photo': 2177, 'list_port_cont': '6601212,6601260,6601313,6601368,6601566,6601697,6601794,6601839,6602310,6603617,6603847,6603990,6604929,6606281,6606358,6607128,6607393,6607886,6608319,6608595,6609912,6610053,6610275,6610911,6611081,6613732,6614155,6615891,6616068,6616203,6616981,6617464,6617847,6618173,6618943,6620503,6620995,6621113,6621139,6621170,6621386,6621441,6621536,6622158,6622312,6622433,6622517,6622652,6622759,6626361,6626978,6626999,6627195,6627832,6628014,6628554,6628614,6629363,6629389,6635808,6635870,6635898,6635951,6635977,6636117,6636143,6636289,6636331,6636428,6636605,6636678,6636737,6636797,6637045,6637679,6637710,6637767,6637948,6637983,6638086,6638422,6638600,6638706,6638840,6638940,6638970,6639190,6639289,6639354,6639650,6639754,6639847,6639897,6639975,6640120,6640716,6640750,6640777,6640954,6641212,6641304,6641334,6641488,6641517,6641651,6641811,6641945,6642027,6642087,6642291,6643242,6643378,6643477,6643637,6643657,6643690,6643720,6643900,6644076,6644462,6644664,6645167,6645306,6645763,6648004,6648352,6648373,6649645,', 'assoc_port': '6600535:6601260,6600537:6601697,6600543:6601212,6600545:6601368,6600547:6601566,6600550:6601794,6600553:6601313,6601140:6602310,6601199:6601839,6602727:6603847,6602729:6603990,6602732:6603617,6604400:6604929,6604702:6606358,6605500:6606281,6605502:6607128,6606682:6608319,6606685:6607886,6606687:6607393,6607836:6608595,6609197:6610053,6609198:6609912,6609963:6610275,6610497:6611081,6610499:6610911,6612953:6613732,6613333:6614155,6614966:6616203,6614968:6616068,6615360:6615891,6616171:6616981,6616960:6618173,6616966:6617464,6616967:6617847,6618310:6618943,6620036:6620503,6620039:6621386,6620042:6620995,6620404:6621139,6620441:6621441,6620445:6621170,6620446:6621536,6620449:6621113,6621639:6622652,6621642:6622759,6621645:6622517,6621652:6622433,6621655:6622158,6621661:6622312,6625901:6626361,6626270:6626978,6626272:6626999,6626275:6627195,6627097:6627832,6627099:6628014,6627946:6628554,6627948:6628614,6628988:6629363,6628991:6629389,6630847:6635951,6630851:6635977,6630853:6636678,6630854:6637679,6630934:6637767,', 'assoc_mat': '6600535:etiquette:3327:6601260,6600537:etiquette:3327:6601697,6600543:etiquette:3327:6601212,6600545:etiquette:3327:6601368,6600547:etiquette:3327:6601566,6600550:etiquette:3327:6601794,6600553:etiquette:3327:6601313,6601140:etiquette:3327:6602310,6601199:etiquette:3327:6601839,6602727:etiquette:3327:6603847,6602729:etiquette:3327:6603990,6602732:etiquette:3327:6603617,6604400:etiquette:3327:6604929,6604702:etiquette:3327:6606358,6605500:etiquette:3327:6606281,6605502:etiquette:3327:6607128,6606682:etiquette:3327:6608319,6606685:etiquette:3327:6607886,6606687:etiquette:3327:6607393,6607836:etiquette:3327:6608595,6609197:etiquette:3327:6610053,6609198:etiquette:3327:6609912,6609963:etiquette:3327:6610275,6610497:etiquette:3327:6611081,6610499:etiquette:3327:6610911,6612953:etiquette:3327:6613732,6613333:etiquette:3327:6614155,6614966:etiquette:3327:6616203,6614968:etiquette:3327:6616068,6615360:etiquette:3327:6615891,6616171:etiquette:3327:6616981,6616960:etiquette:3327:6618173,6616966:etiquette:3327:6617464,6'}, {'unwanted_material': 'etiquette', 'main_material': 'pet_fonce', 'pht_type': 4200, 'ratio': 0.00042222109924499836, 'nb_photo': 28, 'list_port_cont': '6613076,6621900,6635395,6637437,6638359,6641572,6654692,6665194,6669586,6670051,6686808,6687472,6714497,6717610,6719817,6745800,6765266,6766701,6780408,6780724,6797654,6836540,6840198,6865778,6874405,6886806,6902498,6904836', 'assoc_port': '6612632:6613076,6621653:6621900,6632786:6635395,6632966:6670051,6635673:6637437,6637843:6638359,6641286:6641572,6654041:6654692,6664429:6665194,6668950:6669586,6686027:6719817,6686295:6687472,6686325:6686808,6688871:6714497,6716688:6717610,6744268:6745800,6764848:6765266,6765563:6766701,6779960:6780724,6780017:6780408,6797266:6797654,6835942:6836540,6839793:6840198,6865562:6865778,6873774:6874405,6886550:6886806,6899435:6902498,6904395:6904836', 'assoc_mat': '6612632:etiquette:4200:6613076,6621653:etiquette:4200:6621900,6632786:etiquette:4200:6635395,6632966:etiquette:4200:6670051,6635673:etiquette:4200:6637437,6637843:etiquette:4200:6638359,6641286:etiquette:4200:6641572,6654041:etiquette:4200:6654692,6664429:etiquette:4200:6665194,6668950:etiquette:4200:6669586,6686027:etiquette:4200:6719817,6686295:etiquette:4200:6687472,6686325:etiquette:4200:6686808,6688871:etiquette:4200:6714497,6716688:etiquette:4200:6717610,6744268:etiquette:4200:6745800,6764848:etiquette:4200:6765266,6765563:etiquette:4200:6766701,6779960:etiquette:4200:6780724,6780017:etiquette:4200:6780408,6797266:etiquette:4200:6797654,6835942:etiquette:4200:6836540,6839793:etiquette:4200:6840198,6865562:etiquette:4200:6865778,6873774:etiquette:4200:6874405,6886550:etiquette:4200:6886806,6899435:etiquette:4200:6902498,6904395:etiquette:4200:6904836'}, {'unwanted_material': 'film_plastique', 'main_material': 'ela', 'pht_type': 4203, 'ratio': 0.0010375570916267033, 'nb_photo': 51, 'list_port_cont': '6603435,6618321,6624160,6627326,6698377,6704173,6723230,6735453,6741145,6754070,6761155,6768723,6775026,6780641,6799270,6800313,6801310,6808096,6810127,6822556,6826374,6834088,6838769,6846429,6852169,6869926,6876022,6930487,6940833', 'assoc_port': '6602731:6603435,6617603:6618321,6620405:6624160,6626721:6627326,6638160:6704173,6653521:6723230,6664117:6735453,6671808:6834088,6682068:6768723,6685476:6799270,6685991:6800313,6686304:6801310,6696473:6698377,6740022:6741145,6745199:6810127,6753416:6754070,6760133:6761155,6774410:6775026,6780026:6780641,6786466:6808096,6820599:6822556,6825858:6826374,6837012:6838769,6846007:6846429,6851650:6852169,6869544:6869926,6875674:6876022,6894306:6930487,6900378:6940833', 'assoc_mat': '6602731:film_plastique:4203:6603435,6617603:film_plastique:4203:6618321,6620405:film_plastique:4203:6624160,6626721:film_plastique:4203:6627326,6638160:film_plastique:4203:6704173,6653521:film_plastique:4203:6723230,6664117:film_plastique:4203:6735453,6671808:film_plastique:4203:6834088,6682068:film_plastique:4203:6768723,6685476:film_plastique:4203:6799270,6685991:film_plastique:4203:6800313,6686304:film_plastique:4203:6801310,6696473:film_plastique:4203:6698377,6740022:film_plastique:4203:6741145,6745199:film_plastique:4203:6810127,6753416:film_plastique:4203:6754070,6760133:film_plastique:4203:6761155,6774410:film_plastique:4203:6775026,6780026:film_plastique:4203:6780641,6786466:film_plastique:4203:6808096,6820599:film_plastique:4203:6822556,6825858:film_plastique:4203:6826374,6837012:film_plastique:4203:6838769,6846007:film_plastique:4203:6846429,6851650:film_plastique:4203:6852169,6869544:film_plastique:4203:6869926,6875674:film_plastique:4203:6876022,6894306:film_plastique:4203:6930487,6900378:film_pla'}, {'unwanted_material': 'film_plastique', 'main_material': 'emr', 'pht_type': 4209, 'ratio': 0.0024536770792147593, 'nb_photo': 69, 'list_port_cont': '6600779,6602159,6617705,6618987,6620421,6620776,6621929,6622078,6627041,6638509,6641074,6648120,6655495,6664009,6667518,6668136,6668210,6670551,6670887,6672176,6673393,6674366,6678097,6690827,6692895,6694182,6695921,6697464,6699019,6712090,6712235,6716808,6721888,6723150,6723675,6724773,6740489,6742332,6751452,6824345', 'assoc_port': '6600540:6602159,6600552:6600779,6616961:6617705,6618302:6618987,6620037:6620421,6620448:6620776,6621640:6622078,6621646:6621929,6626722:6627041,6631190:6668136,6631196:6668210,6632661:6670551,6632883:6670887,6638162:6638509,6640593:6641074,6647214:6648120,6654838:6655495,6663620:6664009,6664426:6667518,6671806:6672176,6672700:6673393,6673893:6674366,6677866:6678097,6682898:6690827,6685513:6697464,6688873:6699019,6691778:6692895,6692502:6694182,6694731:6695921,6710867:6712235,6711682:6712090,6716079:6716808,6721779:6721888,6722817:6723150,6723504:6723675,6724593:6724773,6739465:6742332,6740030:6740489,6750987:6751452,6823971:6824345', 'assoc_mat': '6600540:film_plastique:4209:6602159,6600552:film_plastique:4209:6600779,6616961:film_plastique:4209:6617705,6618302:film_plastique:4209:6618987,6620037:film_plastique:4209:6620421,6620448:film_plastique:4209:6620776,6621640:film_plastique:4209:6622078,6621646:film_plastique:4209:6621929,6626722:film_plastique:4209:6627041,6631190:film_plastique:4209:6668136,6631196:film_plastique:4209:6668210,6632661:film_plastique:4209:6670551,6632883:film_plastique:4209:6670887,6638162:film_plastique:4209:6638509,6640593:film_plastique:4209:6641074,6647214:film_plastique:4209:6648120,6654838:film_plastique:4209:6655495,6663620:film_plastique:4209:6664009,6664426:film_plastique:4209:6667518,6671806:film_plastique:4209:6672176,6672700:film_plastique:4209:6673393,6673893:film_plastique:4209:6674366,6677866:film_plastique:4209:6678097,6682898:film_plastique:4209:6690827,6685513:film_plastique:4209:6697464,6688873:film_plastique:4209:6699019,6691778:film_plastique:4209:6692895,6692502:film_plastique:4209:6694182,6694731:film_pla'}, {'unwanted_material': 'film_plastique', 'main_material': 'gm', 'pht_type': 4209, 'ratio': 0.004405144558639858, 'nb_photo': 50, 'list_port_cont': '6846222,6863051,6869293,6869651,6886840,6890965,6908908,6914944,6917082,6920507,6922345,6960431,12107792,12108029,12108283,12108676', 'assoc_port': '12107420:12108676,12107424:12108283,12107428:12108029,12107430:12107792,6845636:6846222,6862271:6863051,6868823:6869293,6869543:6869651,6886556:6886840,6890813:6890965,6902262:6908908,6914405:6914944,6916368:6917082,6919130:6920507,6919131:6960431,6920918:6922345', 'assoc_mat': '12107420:film_plastique:4209:12108676,12107424:film_plastique:4209:12108283,12107428:film_plastique:4209:12108029,12107430:film_plastique:4209:12107792,6845636:film_plastique:4209:6846222,6862271:film_plastique:4209:6863051,6868823:film_plastique:4209:6869293,6869543:film_plastique:4209:6869651,6886556:film_plastique:4209:6886840,6890813:film_plastique:4209:6890965,6902262:film_plastique:4209:6908908,6914405:film_plastique:4209:6914944,6916368:film_plastique:4209:6917082,6919130:film_plastique:4209:6920507,6919131:film_plastique:4209:6960431,6920918:film_plastique:4209:6922345'}, {'unwanted_material': 'film_plastique', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 0.006753454742247015, 'nb_photo': 34, 'list_port_cont': '6617254,6617671,6659522', 'assoc_port': '6616962:6617254,6616964:6617671,6652939:6659522', 'assoc_mat': '6616962:film_plastique:4207:6617254,6616964:film_plastique:4207:6617671,6652939:film_plastique:4207:6659522'}, {'unwanted_material': 'film_plastique', 'main_material': 'pehd_pp', 'pht_type': 4211, 'ratio': 0.002259746608148063, 'nb_photo': 5499, 'list_port_cont': '6600849,6600890,6601017,6601442,6602275,6602592,6603008,6603406,6606076,6607678,6608058,6608295,6609456,6610404,6610609,6610652,6611148,6614536,6615399,6615435,6615793,6616511,6617424,6618766,6618925,6620326,6620921,6621065,6621674,6621974,6622008,6622128,6622208,6622454,6624061,6625573,6626621,6626647,6627282,6628485,6629175,6629247,6634383,6634658,6634850,6635144,6635829,6638283,6638444,6639153,6641001,6642062,6642716,6650045,6650153,6650270,6650961,6658508,6664038,6666449,6668094,6668173,6669613,6672032,6674008,6674546,6674641,6674770,6675073,6675109,6675137,6675474,6676525,6676617,6677121,6677223,6677802,6678045,6678212,6678572,6678654,6678774,6678959,6678990,6679232,6681260,6687145,6691518,6691651,6692290,6693202,6693680,6693906,6694032,6694214,6694412,6695522,6697517,6698427,6698760,6698790,6699374,6699429,6700667,6705446,6706630,6706777,6707225,6707821,6709736,6711239,6711396,6711489,6712153,6712493,6712628,6712756,6713442,6713595,6713761,6714400,6716476,6716567,6717500,6717544,6718036,6718525,6719027,', 'assoc_port': '10844008:10846072,10844009:10845794,10844010:10846040,10844011:10845549,10844012:10845979,10844013:10845414,10844014:10845182,10844015:10845079,10844016:10845170,10844017:10845132,10844018:10844951,10844019:10845054,10844020:10844687,10844021:10844442,12107423:12108313,12107427:12108076,12107429:12107822,6600536:6601442,6600544:6600849,6600546:6601017,6600551:6600890,6601138:6602592,6601649:6602275,6602728:6603008,6602733:6603406,6604399:6608058,6605499:6610652,6605688:6606076,6606683:6607678,6607835:6610404,6607839:6608295,6609199:6609456,6610498:6610609,6610992:6611148,6614199:6614536,6614967:6615399,6614969:6615435,6615362:6615793,6616173:6616511,6616982:6617424,6618307:6618766,6618311:6618925,6620040:6620326,6620422:6621674,6620444:6621065,6620447:6620921,6621638:6624061,6621643:6622454,6621647:6622208,6621651:6622128,6621654:6621974,6621659:6622008,6625236:6625573,6626268:6626621,6626274:6626647,6627098:6627282,6627945:6628485,6628987:6629175,6628989:6629247,6630850:6634850,6630852:6674008,6630856:663465', 'assoc_mat': '10844008:film_plastique:4211:10846072,10844009:film_plastique:4211:10845794,10844010:film_plastique:4211:10846040,10844011:film_plastique:4211:10845549,10844012:film_plastique:4211:10845979,10844013:film_plastique:4211:10845414,10844014:film_plastique:4211:10845182,10844015:film_plastique:4211:10845079,10844016:film_plastique:4211:10845170,10844017:film_plastique:4211:10845132,10844018:film_plastique:4211:10844951,10844019:film_plastique:4211:10845054,10844020:film_plastique:4211:10844687,10844021:film_plastique:4211:10844442,12107423:film_plastique:4211:12108313,12107427:film_plastique:4211:12108076,12107429:film_plastique:4211:12107822,6600536:film_plastique:4211:6601442,6600544:film_plastique:4211:6600849,6600546:film_plastique:4211:6601017,6600551:film_plastique:4211:6600890,6601138:film_plastique:4211:6602592,6601649:film_plastique:4211:6602275,6602728:film_plastique:4211:6603008,6602733:film_plastique:4211:6603406,6604399:film_plastique:4211:6608058,6605499:film_plastique:4211:6610652,6605688:film_plast'}, {'unwanted_material': 'film_plastique', 'main_material': 'pet_fonce', 'pht_type': 4200, 'ratio': 0.009562760165995879, 'nb_photo': 651, 'list_port_cont': '6600935,6602065,6604873,6606113,6609166,6613072,6615619,6618496,6620183,6620863,6621894,6626781,6628361,6634253,6635399,6637071,6637439,6638362,6639237,6641573,6646019,6647326,6649276,6649481,6649910,6653428,6654681,6655699,6658476,6662389,6665188,6669588,6670057,6672611,6674515,6683658,6684468,6686795,6687232,6687468,6696454,6696813,6698466,6711565,6712273,6712779,6714502,6717597,6719828,6720160,6720216,6720243,6720362,6721257,6722534,6724152,6739287,6740805,6745514,6745792,6750253,6754188,6754560,6759424,6765277,6766706,6767355,6780405,6780527,6780713,6784028,6786844,6788649,6791328,6793700,6795545,6797658,6813918,6817663,6821381,6824093,6835171,6836542,6840210,6842440,6849225,6851785,6852368,6854521,6859028,6862726,6865775,6866336,6867967,6869257,6874408,6875757,6882725,6886810,6888104,6889508,6895295,6900331,6902499,6904843,6914441,6920747,6921624,6924250', 'assoc_port': '6600538:6600935,6601136:6602065,6604397:6604873,6605689:6606113,6608145:6609166,6612632:6613072,6615365:6615619,6618309:6618496,6620043:6620183,6620439:6620863,6621653:6621894,6626271:6626781,6627944:6628361,6630848:6646019,6631070:6649276,6631186:6634253,6631194:6649910,6631961:6655699,6632583:6662389,6632786:6635399,6632966:6670057,6635673:6637439,6635681:6637071,6637843:6638362,6638774:6639237,6641286:6641573,6646447:6647326,6648940:6649481,6650951:6653428,6654041:6654681,6657889:6658476,6664429:6665188,6668950:6669588,6671809:6672611,6673895:6674515,6681680:6683658,6683618:6684468,6685440:6720362,6685511:6720216,6686027:6719828,6686041:6720160,6686295:6687468,6686312:6687232,6686325:6686795,6688871:6714502,6690894:6698466,6693641:6696454,6696476:6696813,6710860:6711565,6711680:6712273,6712324:6712779,6716688:6717597,6718843:6720243,6720803:6721257,6722354:6722534,6723892:6724152,6738748:6739287,6740018:6740805,6740709:6745514,6744268:6745792,6748062:6750253,6753406:6754560,6753419:6754188,6759057:6759424,', 'assoc_mat': '6600538:film_plastique:4200:6600935,6601136:film_plastique:4200:6602065,6604397:film_plastique:4200:6604873,6605689:film_plastique:4200:6606113,6608145:film_plastique:4200:6609166,6612632:film_plastique:4200:6613072,6615365:film_plastique:4200:6615619,6618309:film_plastique:4200:6618496,6620043:film_plastique:4200:6620183,6620439:film_plastique:4200:6620863,6621653:film_plastique:4200:6621894,6626271:film_plastique:4200:6626781,6627944:film_plastique:4200:6628361,6630848:film_plastique:4200:6646019,6631070:film_plastique:4200:6649276,6631186:film_plastique:4200:6634253,6631194:film_plastique:4200:6649910,6631961:film_plastique:4200:6655699,6632583:film_plastique:4200:6662389,6632786:film_plastique:4200:6635399,6632966:film_plastique:4200:6670057,6635673:film_plastique:4200:6637439,6635681:film_plastique:4200:6637071,6637843:film_plastique:4200:6638362,6638774:film_plastique:4200:6639237,6641286:film_plastique:4200:6641573,6646447:film_plastique:4200:6647326,6648940:film_plastique:4200:6649481,6650951:film_pla'}, {'unwanted_material': 'kraft', 'main_material': 'ela', 'pht_type': 4203, 'ratio': 0.0013476688860348137, 'nb_photo': 25, 'list_port_cont': '6603437,6608810,6624174,6698367,6704169,6720534,6723222,6723404,6735448,6754066,6768737,6775016,6799274,6806349,6808099,6808748,6822563,6826367,6930490', 'assoc_port': '6602731:6603437,6608146:6608810,6620405:6624174,6638160:6704169,6653521:6723222,6664117:6735448,6682068:6768737,6685476:6799274,6696473:6698367,6718634:6720534,6722813:6723404,6753416:6754066,6765566:6808748,6774410:6775016,6786466:6808099,6793236:6806349,6820599:6822563,6825858:6826367,6894306:6930490', 'assoc_mat': '6602731:kraft:4203:6603437,6608146:kraft:4203:6608810,6620405:kraft:4203:6624174,6638160:kraft:4203:6704169,6653521:kraft:4203:6723222,6664117:kraft:4203:6735448,6682068:kraft:4203:6768737,6685476:kraft:4203:6799274,6696473:kraft:4203:6698367,6718634:kraft:4203:6720534,6722813:kraft:4203:6723404,6753416:kraft:4203:6754066,6765566:kraft:4203:6808748,6774410:kraft:4203:6775016,6786466:kraft:4203:6808099,6793236:kraft:4203:6806349,6820599:kraft:4203:6822563,6825858:kraft:4203:6826367,6894306:kraft:4203:6930490'}, {'unwanted_material': 'kraft', 'main_material': 'pehd_pp', 'pht_type': 4211, 'ratio': 0.0002605400427680809, 'nb_photo': 31, 'list_port_cont': '6602597,6603402,6608291,6621971,6629173,6635141,6674012,6675078,6718038,6721839,6731861,6756973,6763094,6767267,6782609,6783130,6786055,6787764,6799513,6800227,6800537,6806177,6808705,6863473,6869206,6917724', 'assoc_port': '6601138:6602597,6602733:6603402,6607839:6608291,6621654:6621971,6628987:6629173,6630852:6674012,6631065:6675078,6631193:6635141,6640595:6806177,6651292:6721839,6657891:6731861,6685502:6799513,6685989:6800227,6686094:6800537,6717679:6718038,6748064:6756973,6762546:6763094,6765565:6808705,6766922:6767267,6779975:6786055,6782244:6783130,6782282:6782609,6787218:6787764,6862775:6863473,6868825:6869206,6916370:6917724', 'assoc_mat': '6601138:kraft:4211:6602597,6602733:kraft:4211:6603402,6607839:kraft:4211:6608291,6621654:kraft:4211:6621971,6628987:kraft:4211:6629173,6630852:kraft:4211:6674012,6631065:kraft:4211:6675078,6631193:kraft:4211:6635141,6640595:kraft:4211:6806177,6651292:kraft:4211:6721839,6657891:kraft:4211:6731861,6685502:kraft:4211:6799513,6685989:kraft:4211:6800227,6686094:kraft:4211:6800537,6717679:kraft:4211:6718038,6748064:kraft:4211:6756973,6762546:kraft:4211:6763094,6765565:kraft:4211:6808705,6766922:kraft:4211:6767267,6779975:kraft:4211:6786055,6782244:kraft:4211:6783130,6782282:kraft:4211:6782609,6787218:kraft:4211:6787764,6862775:kraft:4211:6863473,6868825:kraft:4211:6869206,6916370:kraft:4211:6917724'}, {'unwanted_material': 'kraft', 'main_material': 'pet_fonce', 'pht_type': 4200, 'ratio': 0.002080903131306298, 'nb_photo': 8, 'list_port_cont': '6654687,6665187,6711559,6739285,6786851,6875988,6895294', 'assoc_port': '6654041:6654687,6664429:6665187,6710860:6711559,6738748:6739285,6786463:6786851,6875675:6875988,6894305:6895294', 'assoc_mat': '6654041:kraft:4200:6654687,6664429:kraft:4200:6665187,6710860:kraft:4200:6711559,6738748:kraft:4200:6739285,6786463:kraft:4200:6786851,6875675:kraft:4200:6875988,6894305:kraft:4200:6895294'}, {'unwanted_material': 'metal', 'main_material': 'ela', 'pht_type': 4203, 'ratio': 0.0025689075464105384, 'nb_photo': 116, 'list_port_cont': '6603439,6608802,6618323,6624168,6627336,6634744,6634804,6698366,6704170,6712714,6720531,6723221,6723414,6735153,6741143,6754064,6768738,6775029,6780637,6799279,6800304,6801309,6806355,6808095,6808740,6810126,6812819,6822550,6826362,6834102,6838768,6846434,6852156,6863255,6865671,6869930,6876016,6930480,6940846,10844182', 'assoc_port': '10844025:10844182,6602731:6603439,6608146:6608802,6617603:6618323,6620405:6624168,6626721:6627336,6630937:6634744,6631483:6634804,6638160:6704170,6653521:6723221,6671808:6834102,6682068:6768738,6685476:6799279,6685991:6800304,6686304:6801309,6690887:6735153,6696473:6698366,6712332:6712714,6718634:6720531,6722813:6723414,6740022:6741143,6745199:6810126,6753416:6754064,6765566:6808740,6774410:6775029,6780026:6780637,6786466:6808095,6793236:6806355,6811950:6812819,6820599:6822550,6825858:6826362,6837012:6838768,6846007:6846434,6851650:6852156,6863104:6863255,6865559:6865671,6869544:6869930,6875674:6876016,6894306:6930480,6900378:6940846', 'assoc_mat': '10844025:metal:4203:10844182,6602731:metal:4203:6603439,6608146:metal:4203:6608802,6617603:metal:4203:6618323,6620405:metal:4203:6624168,6626721:metal:4203:6627336,6630937:metal:4203:6634744,6631483:metal:4203:6634804,6638160:metal:4203:6704170,6653521:metal:4203:6723221,6671808:metal:4203:6834102,6682068:metal:4203:6768738,6685476:metal:4203:6799279,6685991:metal:4203:6800304,6686304:metal:4203:6801309,6690887:metal:4203:6735153,6696473:metal:4203:6698366,6712332:metal:4203:6712714,6718634:metal:4203:6720531,6722813:metal:4203:6723414,6740022:metal:4203:6741143,6745199:metal:4203:6810126,6753416:metal:4203:6754064,6765566:metal:4203:6808740,6774410:metal:4203:6775029,6780026:metal:4203:6780637,6786466:metal:4203:6808095,6793236:metal:4203:6806355,6811950:metal:4203:6812819,6820599:metal:4203:6822550,6825858:metal:4203:6826362,6837012:metal:4203:6838768,6846007:metal:4203:6846434,6851650:metal:4203:6852156,6863104:metal:4203:6863255,6865559:metal:4203:6865671,6869544:metal:4203:6869930,6875674:metal:4203:6876'}, {'unwanted_material': 'metal', 'main_material': 'emr', 'pht_type': 4209, 'ratio': 0.01620320652826406, 'nb_photo': 95, 'list_port_cont': '6600765,6601464,6602163,6616735,6618978,6620417,6620780,6621471,6622065,6625394,6627054,6638506,6641080,6644333,6647279,6648126,6651921,6655492,6664016,6666561,6668141,6668996,6669285,6669399,6670444,6670900,6672174,6673388,6678096,6690826,6692907,6695450,6695916,6697457,6711036,6712095,6712243,6716818,6721890,6723141,6723677,6740494,6751439,6754759,6791206,6812443', 'assoc_port': '6600533:6601464,6600540:6602163,6600552:6600765,6616168:6616735,6618302:6618978,6620037:6620417,6620443:6621471,6620448:6620780,6621640:6622065,6625237:6625394,6626722:6627054,6631064:6666561,6631190:6668141,6631480:6668996,6631482:6669285,6631491:6669399,6632580:6670444,6632883:6670900,6638162:6638506,6638777:6644333,6640593:6641080,6646444:6647279,6647214:6648126,6650509:6651921,6654838:6655492,6663620:6664016,6671806:6672174,6672700:6673388,6677866:6678096,6682898:6690826,6685513:6697457,6691778:6692907,6694731:6695916,6694740:6695450,6709375:6711036,6710867:6712243,6711682:6712095,6716079:6716818,6721779:6721890,6722817:6723141,6723504:6723677,6740030:6740494,6741911:6754759,6750987:6751439,6790915:6791206,6811912:6812443', 'assoc_mat': '6600533:metal:4209:6601464,6600540:metal:4209:6602163,6600552:metal:4209:6600765,6616168:metal:4209:6616735,6618302:metal:4209:6618978,6620037:metal:4209:6620417,6620443:metal:4209:6621471,6620448:metal:4209:6620780,6621640:metal:4209:6622065,6625237:metal:4209:6625394,6626722:metal:4209:6627054,6631064:metal:4209:6666561,6631190:metal:4209:6668141,6631480:metal:4209:6668996,6631482:metal:4209:6669285,6631491:metal:4209:6669399,6632580:metal:4209:6670444,6632883:metal:4209:6670900,6638162:metal:4209:6638506,6638777:metal:4209:6644333,6640593:metal:4209:6641080,6646444:metal:4209:6647279,6647214:metal:4209:6648126,6650509:metal:4209:6651921,6654838:metal:4209:6655492,6663620:metal:4209:6664016,6671806:metal:4209:6672174,6672700:metal:4209:6673388,6677866:metal:4209:6678096,6682898:metal:4209:6690826,6685513:metal:4209:6697457,6691778:metal:4209:6692907,6694731:metal:4209:6695916,6694740:metal:4209:6695450,6709375:metal:4209:6711036,6710867:metal:4209:6712243,6711682:metal:4209:6712095,6716079:metal:4209:671681'}, {'unwanted_material': 'metal', 'main_material': 'gm', 'pht_type': 4209, 'ratio': 0.03813640273004401, 'nb_photo': 50, 'list_port_cont': '6846234,6869292,6869658,6886838,6890968,6894664,6908915,6914949,6920506,6922343,6960437,12108025,12108375,12108683', 'assoc_port': '12107420:12108683,12107422:12108375,12107428:12108025,6845636:6846234,6868823:6869292,6869543:6869658,6886556:6886838,6890813:6890968,6894304:6894664,6902262:6908915,6914405:6914949,6919130:6920506,6919131:6960437,6920918:6922343', 'assoc_mat': '12107420:metal:4209:12108683,12107422:metal:4209:12108375,12107428:metal:4209:12108025,6845636:metal:4209:6846234,6868823:metal:4209:6869292,6869543:metal:4209:6869658,6886556:metal:4209:6886838,6890813:metal:4209:6890968,6894304:metal:4209:6894664,6902262:metal:4209:6908915,6914405:metal:4209:6914949,6919130:metal:4209:6920506,6919131:metal:4209:6960437,6920918:metal:4209:6922343'}, {'unwanted_material': 'metal', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 0.28424781729752074, 'nb_photo': 15, 'list_port_cont': '6617261,6617679,6659518', 'assoc_port': '6616962:6617261,6616964:6617679,6652939:6659518', 'assoc_mat': '6616962:metal:4207:6617261,6616964:metal:4207:6617679,6652939:metal:4207:6659518'}, {'unwanted_material': 'metal', 'main_material': 'pehd_pp', 'pht_type': 4211, 'ratio': 0.014105013759782188, 'nb_photo': 4099, 'list_port_cont': '6600856,6600899,6601011,6601438,6601603,6602271,6602596,6603016,6603404,6606080,6607692,6608057,6608280,6609447,6610406,6610603,6610660,6611150,6613941,6614530,6615402,6615431,6615798,6616522,6617438,6618772,6618911,6620212,6620337,6620916,6621058,6621671,6621967,6622006,6622131,6622198,6622469,6624050,6625565,6626622,6626649,6627272,6628473,6629174,6629239,6634384,6634649,6634849,6635130,6635842,6638288,6638454,6639155,6641000,6642050,6642701,6649970,6650051,6650148,6650282,6650968,6653714,6658501,6664036,6666452,6668086,6668172,6669618,6672033,6674018,6674395,6674559,6674640,6674768,6675067,6675113,6675145,6675475,6676538,6676615,6677120,6677227,6677799,6678035,6678225,6678304,6678567,6678655,6678773,6678968,6679000,6679222,6681257,6687134,6691497,6691663,6692286,6693199,6693683,6693905,6694046,6694218,6694411,6695512,6697510,6698424,6698770,6698800,6699365,6699425,6700612,6700659,6705447,6706623,6706766,6707227,6707825,6709724,6711225,6711407,6711492,6712148,6712489,6712634,6712755,6713434,6713596,6713751,', 'assoc_port': '10844008:10846070,10844009:10845782,10844010:10846037,10844011:10845544,10844012:10845982,10844013:10845413,10844014:10845190,10844015:10845088,10844016:10845174,10844017:10845137,10844018:10844954,10844019:10845038,10844020:10844683,10844021:10844455,12107423:12108305,12107427:12108080,12107429:12107834,6600536:6601438,6600544:6600856,6600546:6601011,6600551:6600899,6601138:6602596,6601142:6601603,6601649:6602271,6602728:6603016,6602733:6603404,6604399:6608057,6605499:6610660,6605688:6606080,6606683:6607692,6607835:6610406,6607839:6608280,6609199:6609447,6610498:6610603,6610992:6611150,6613877:6613941,6614199:6614530,6614967:6615402,6614969:6615431,6615362:6615798,6616173:6616522,6616982:6617438,6618307:6618772,6618311:6618911,6620038:6620212,6620040:6620337,6620422:6621671,6620444:6621058,6620447:6620916,6621638:6624050,6621643:6622469,6621647:6622198,6621651:6622131,6621654:6621967,6621659:6622006,6625236:6625565,6626268:6626622,6626274:6626649,6627098:6627272,6627945:6628473,6628987:6629174,6628989:662923', 'assoc_mat': '10844008:metal:4211:10846070,10844009:metal:4211:10845782,10844010:metal:4211:10846037,10844011:metal:4211:10845544,10844012:metal:4211:10845982,10844013:metal:4211:10845413,10844014:metal:4211:10845190,10844015:metal:4211:10845088,10844016:metal:4211:10845174,10844017:metal:4211:10845137,10844018:metal:4211:10844954,10844019:metal:4211:10845038,10844020:metal:4211:10844683,10844021:metal:4211:10844455,12107423:metal:4211:12108305,12107427:metal:4211:12108080,12107429:metal:4211:12107834,6600536:metal:4211:6601438,6600544:metal:4211:6600856,6600546:metal:4211:6601011,6600551:metal:4211:6600899,6601138:metal:4211:6602596,6601142:metal:4211:6601603,6601649:metal:4211:6602271,6602728:metal:4211:6603016,6602733:metal:4211:6603404,6604399:metal:4211:6608057,6605499:metal:4211:6610660,6605688:metal:4211:6606080,6606683:metal:4211:6607692,6607835:metal:4211:6610406,6607839:metal:4211:6608280,6609199:metal:4211:6609447,6610498:metal:4211:6610603,6610992:metal:4211:6611150,6613877:metal:4211:6613941,6614199:metal:4211'}, {'unwanted_material': 'metal', 'main_material': 'pet_clair', 'pht_type': 3327, 'ratio': 0.0018611932504713049, 'nb_photo': 168, 'list_port_cont': '6602309,6606381,6607132,6607892,6608676,6609913,6610058,6613724,6618178,6621382,6621446,6622317,6622515,6622750,6627836,6629357,6635868,6636122,6636323,6636736,6637761,6638093,6638417,6638705,6638836,6638971,6639356,6639756,6639841,6640772,6640965,6642021,6642089,6643659,6643689,6644080,6648806,6652946,6664581,6668616,6674494,6675599,6676588,6681849,6685021,6686471,6687366,6687492,6688258,6688984,6689512,6689535,6690288,6690633,6692197,6692683,6693648,6696369,6697176,6697873,6698735,6698882,6699062,6699467,6700152,6712810,6712846,6713279,6718380,6719374,6721461,6722064,6723542,6724041,6725336,6740417,6745471,6746032,6750024,6751761,6754361,6754498,6754531,6756337,6760376,6761240,6765850,6767303,6767722,6781605,6782080,6783162,6784119,6788824,6789101,6789299,6790666,6792153,6792401,6797280,6797781,6798013,6817846,6821598,6833582,6834267,6840067,6843272,6851938,6852133,6852491,6854288,6865690,6865866,6869175,6875951,6876047,6876102,6876518,6887363,6887386,6888987,6890298,6891134,6895349,6904238,6904578,6915036', 'assoc_port': '6601140:6602309,6604702:6606381,6605502:6607132,6606685:6607892,6607838:6608676,6609197:6610058,6609198:6609913,6612953:6613724,6616960:6618178,6620039:6621382,6620441:6621446,6621642:6622750,6621645:6622515,6621661:6622317,6627097:6627836,6628988:6629357,6630934:6637761,6630938:6638093,6631068:6638836,6631071:6638971,6631076:6639356,6631490:6640772,6631493:6640965,6631964:6642089,6632713:6648806,6632788:6643659,6632880:6636323,6632882:6644080,6633863:6635868,6635683:6636736,6635684:6636122,6637839:6638705,6637844:6638417,6638772:6639841,6638775:6639756,6640596:6643689,6641258:6642021,6650952:6652946,6663623:6664581,6667559:6668616,6673888:6675599,6673890:6674494,6674743:6676588,6681004:6681849,6683621:6685021,6685438:6699467,6685448:6698882,6685487:6698735,6685490:6699062,6685495:6700152,6685528:6687366,6685534:6686471,6686008:6697873,6686056:6697176,6686063:6689512,6686284:6689535,6686287:6690633,6686297:6688984,6686305:6688258,6686329:6687492,6688867:6690288,6690873:6692197,6691781:6692683,6692503:6693648,', 'assoc_mat': '6601140:metal:3327:6602309,6604702:metal:3327:6606381,6605502:metal:3327:6607132,6606685:metal:3327:6607892,6607838:metal:3327:6608676,6609197:metal:3327:6610058,6609198:metal:3327:6609913,6612953:metal:3327:6613724,6616960:metal:3327:6618178,6620039:metal:3327:6621382,6620441:metal:3327:6621446,6621642:metal:3327:6622750,6621645:metal:3327:6622515,6621661:metal:3327:6622317,6627097:metal:3327:6627836,6628988:metal:3327:6629357,6630934:metal:3327:6637761,6630938:metal:3327:6638093,6631068:metal:3327:6638836,6631071:metal:3327:6638971,6631076:metal:3327:6639356,6631490:metal:3327:6640772,6631493:metal:3327:6640965,6631964:metal:3327:6642089,6632713:metal:3327:6648806,6632788:metal:3327:6643659,6632880:metal:3327:6636323,6632882:metal:3327:6644080,6633863:metal:3327:6635868,6635683:metal:3327:6636736,6635684:metal:3327:6636122,6637839:metal:3327:6638705,6637844:metal:3327:6638417,6638772:metal:3327:6639841,6638775:metal:3327:6639756,6640596:metal:3327:6643689,6641258:metal:3327:6642021,6650952:metal:3327:665294'}, {'unwanted_material': 'metal', 'main_material': 'pet_fonce', 'pht_type': 4200, 'ratio': 0.008187433477581552, 'nb_photo': 161, 'list_port_cont': '6600924,6604874,6606109,6609169,6613066,6615621,6618495,6620180,6620864,6621895,6628356,6635390,6637077,6637440,6638365,6639245,6646018,6649283,6649472,6649917,6653439,6654695,6655708,6662393,6672612,6674525,6683669,6684477,6686796,6687223,6687470,6696448,6696812,6698463,6711552,6712278,6714493,6719818,6720151,6720203,6720239,6720363,6721248,6722529,6724153,6740811,6745799,6750239,6754562,6759423,6765268,6767356,6780402,6780532,6784026,6786842,6788648,6791326,6793698,6797669,6813916,6824104,6835192,6836545,6840197,6842435,6849222,6851783,6852365,6854532,6859036,6862724,6866334,6867975,6869267,6874413,6875761,6875987,6882735,6895285,6900330,6902505,6904844,6914446,6920751,6921633', 'assoc_port': '6600538:6600924,6604397:6604874,6605689:6606109,6608145:6609169,6612632:6613066,6615365:6615621,6618309:6618495,6620043:6620180,6620439:6620864,6621653:6621895,6627944:6628356,6630848:6646018,6631070:6649283,6631194:6649917,6631961:6655708,6632583:6662393,6632786:6635390,6635673:6637440,6635681:6637077,6637843:6638365,6638774:6639245,6648940:6649472,6650951:6653439,6654041:6654695,6671809:6672612,6673895:6674525,6681680:6683669,6683618:6684477,6685440:6720363,6685511:6720203,6686027:6719818,6686041:6720151,6686295:6687470,6686312:6687223,6686325:6686796,6688871:6714493,6690894:6698463,6693641:6696448,6696476:6696812,6710860:6711552,6711680:6712278,6718843:6720239,6720803:6721248,6722354:6722529,6723892:6724153,6740018:6740811,6744268:6745799,6748062:6750239,6753406:6754562,6759057:6759423,6764848:6765268,6766924:6767356,6779977:6780532,6780017:6780402,6782249:6784026,6786463:6786842,6787690:6788648,6790918:6791326,6793238:6793698,6797266:6797669,6813389:6813916,6823753:6824104,6833510:6835192,6835942:6836545,', 'assoc_mat': '6600538:metal:4200:6600924,6604397:metal:4200:6604874,6605689:metal:4200:6606109,6608145:metal:4200:6609169,6612632:metal:4200:6613066,6615365:metal:4200:6615621,6618309:metal:4200:6618495,6620043:metal:4200:6620180,6620439:metal:4200:6620864,6621653:metal:4200:6621895,6627944:metal:4200:6628356,6630848:metal:4200:6646018,6631070:metal:4200:6649283,6631194:metal:4200:6649917,6631961:metal:4200:6655708,6632583:metal:4200:6662393,6632786:metal:4200:6635390,6635673:metal:4200:6637440,6635681:metal:4200:6637077,6637843:metal:4200:6638365,6638774:metal:4200:6639245,6648940:metal:4200:6649472,6650951:metal:4200:6653439,6654041:metal:4200:6654695,6671809:metal:4200:6672612,6673895:metal:4200:6674525,6681680:metal:4200:6683669,6683618:metal:4200:6684477,6685440:metal:4200:6720363,6685511:metal:4200:6720203,6686027:metal:4200:6719818,6686041:metal:4200:6720151,6686295:metal:4200:6687470,6686312:metal:4200:6687223,6686325:metal:4200:6686796,6688871:metal:4200:6714493,6690894:metal:4200:6698463,6693641:metal:4200:669644'}, {'unwanted_material': 'papier', 'main_material': 'ela', 'pht_type': 4203, 'ratio': 0.061231730810446236, 'nb_photo': 10116, 'list_port_cont': '6603432,6608812,6618330,6624173,6627328,6634747,6634795,6660087,6698364,6704163,6712713,6720535,6723229,6723411,6735156,6735458,6741135,6754073,6761149,6768728,6775022,6780633,6799278,6800307,6801306,6806356,6808105,6808742,6810131,6812817,6822555,6826373,6834089,6838762,6846431,6852157,6863266,6865666,6869918,6876010,6930481,6940835,10844177', 'assoc_port': '10844025:10844177,6602731:6603432,6608146:6608812,6617603:6618330,6620405:6624173,6626721:6627328,6630937:6634747,6631483:6634795,6632879:6660087,6638160:6704163,6653521:6723229,6664117:6735458,6671808:6834089,6682068:6768728,6685476:6799278,6685991:6800307,6686304:6801306,6690887:6735156,6696473:6698364,6712332:6712713,6718634:6720535,6722813:6723411,6740022:6741135,6745199:6810131,6753416:6754073,6760133:6761149,6765566:6808742,6774410:6775022,6780026:6780633,6786466:6808105,6793236:6806356,6811950:6812817,6820599:6822555,6825858:6826373,6837012:6838762,6846007:6846431,6851650:6852157,6863104:6863266,6865559:6865666,6869544:6869918,6875674:6876010,6894306:6930481,6900378:6940835', 'assoc_mat': '10844025:papier:4203:10844177,6602731:papier:4203:6603432,6608146:papier:4203:6608812,6617603:papier:4203:6618330,6620405:papier:4203:6624173,6626721:papier:4203:6627328,6630937:papier:4203:6634747,6631483:papier:4203:6634795,6632879:papier:4203:6660087,6638160:papier:4203:6704163,6653521:papier:4203:6723229,6664117:papier:4203:6735458,6671808:papier:4203:6834089,6682068:papier:4203:6768728,6685476:papier:4203:6799278,6685991:papier:4203:6800307,6686304:papier:4203:6801306,6690887:papier:4203:6735156,6696473:papier:4203:6698364,6712332:papier:4203:6712713,6718634:papier:4203:6720535,6722813:papier:4203:6723411,6740022:papier:4203:6741135,6745199:papier:4203:6810131,6753416:papier:4203:6754073,6760133:papier:4203:6761149,6765566:papier:4203:6808742,6774410:papier:4203:6775022,6780026:papier:4203:6780633,6786466:papier:4203:6808105,6793236:papier:4203:6806356,6811950:papier:4203:6812817,6820599:papier:4203:6822555,6825858:papier:4203:6826373,6837012:papier:4203:6838762,6846007:papier:4203:6846431,6851650:papier'}, {'unwanted_material': 'papier', 'main_material': 'emr', 'pht_type': 4207, 'ratio': 0.026271390056728197, 'nb_photo': 8, 'list_port_cont': '12107737,12108213', 'assoc_port': '12107419:12108213,12107426:12107737', 'assoc_mat': '12107419:papier:4207:12108213,12107426:papier:4207:12107737'}, {'unwanted_material': 'papier', 'main_material': 'emr', 'pht_type': 4209, 'ratio': 0.9818228416534489, 'nb_photo': 22895, 'list_port_cont': '6600771,6601474,6602161,6616739,6617534,6617710,6618973,6620407,6620774,6621480,6621932,6622068,6625404,6627042,6637128,6638496,6641078,6644338,6647274,6648128,6651923,6655481,6657574,6664005,6666560,6667526,6668133,6668203,6668997,6669282,6669400,6670442,6670550,6670895,6672175,6673389,6674361,6678087,6682355,6690830,6692892,6694186,6695449,6695911,6697461,6699021,6711049,6712084,6712241,6716813,6721889,6723151,6723680,6724781,6740492,6742323,6751441,6754771,6791212,6812437,6824349', 'assoc_port': '6600533:6601474,6600540:6602161,6600552:6600771,6616168:6616739,6616961:6617710,6616963:6617534,6618302:6618973,6620037:6620407,6620443:6621480,6620448:6620774,6621640:6622068,6621646:6621932,6625237:6625404,6626722:6627042,6631064:6666560,6631190:6668133,6631196:6668203,6631480:6668997,6631482:6669282,6631491:6669400,6632580:6670442,6632661:6670550,6632883:6670895,6633864:6637128,6638162:6638496,6638777:6644338,6640593:6641078,6646444:6647274,6647214:6648128,6650509:6651923,6654838:6655481,6656897:6657574,6663620:6664005,6664426:6667526,6671806:6672175,6672700:6673389,6673893:6674361,6677866:6678087,6681682:6682355,6682898:6690830,6685513:6697461,6688873:6699021,6691778:6692892,6692502:6694186,6694731:6695911,6694740:6695449,6709375:6711049,6710867:6712241,6711682:6712084,6716079:6716813,6721779:6721889,6722817:6723151,6723504:6723680,6724593:6724781,6739465:6742323,6740030:6740492,6741911:6754771,6750987:6751441,6790915:6791212,6811912:6812437,6823971:6824349', 'assoc_mat': '6600533:papier:4209:6601474,6600540:papier:4209:6602161,6600552:papier:4209:6600771,6616168:papier:4209:6616739,6616961:papier:4209:6617710,6616963:papier:4209:6617534,6618302:papier:4209:6618973,6620037:papier:4209:6620407,6620443:papier:4209:6621480,6620448:papier:4209:6620774,6621640:papier:4209:6622068,6621646:papier:4209:6621932,6625237:papier:4209:6625404,6626722:papier:4209:6627042,6631064:papier:4209:6666560,6631190:papier:4209:6668133,6631196:papier:4209:6668203,6631480:papier:4209:6668997,6631482:papier:4209:6669282,6631491:papier:4209:6669400,6632580:papier:4209:6670442,6632661:papier:4209:6670550,6632883:papier:4209:6670895,6633864:papier:4209:6637128,6638162:papier:4209:6638496,6638777:papier:4209:6644338,6640593:papier:4209:6641078,6646444:papier:4209:6647274,6647214:papier:4209:6648128,6650509:papier:4209:6651923,6654838:papier:4209:6655481,6656897:papier:4209:6657574,6663620:papier:4209:6664005,6664426:papier:4209:6667526,6671806:papier:4209:6672175,6672700:papier:4209:6673389,6673893:papier:4'}, {'unwanted_material': 'papier', 'main_material': 'gm', 'pht_type': 4209, 'ratio': 0.9778679543860948, 'nb_photo': 9654, 'list_port_cont': '6846225,6863052,6869290,6869652,6886839,6890954,6894669,6908902,6914938,6917074,6920517,6922339,6960439,12107799,12108033,12108279,12108335,12108368,12108547,12108681,12151216', 'assoc_port': '12107418:12151216,12107420:12108681,12107421:12108547,12107422:12108368,12107424:12108279,12107425:12108335,12107428:12108033,12107430:12107799,6845636:6846225,6862271:6863052,6868823:6869290,6869543:6869652,6886556:6886839,6890813:6890954,6894304:6894669,6902262:6908902,6914405:6914938,6916368:6917074,6919130:6920517,6919131:6960439,6920918:6922339', 'assoc_mat': '12107418:papier:4209:12151216,12107420:papier:4209:12108681,12107421:papier:4209:12108547,12107422:papier:4209:12108368,12107424:papier:4209:12108279,12107425:papier:4209:12108335,12107428:papier:4209:12108033,12107430:papier:4209:12107799,6845636:papier:4209:6846225,6862271:papier:4209:6863052,6868823:papier:4209:6869290,6869543:papier:4209:6869652,6886556:papier:4209:6886839,6890813:papier:4209:6890954,6894304:papier:4209:6894669,6902262:papier:4209:6908902,6914405:papier:4209:6914938,6916368:papier:4209:6917074,6919130:papier:4209:6920517,6919131:papier:4209:6960439,6920918:papier:4209:6922339'}, {'unwanted_material': 'papier', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 0.01913239060931627, 'nb_photo': 173, 'list_port_cont': '6617263,6617672,6633555,6659520', 'assoc_port': '6616962:6617263,6616964:6617672,6631478:6633555,6652939:6659520', 'assoc_mat': '6616962:papier:4207:6617263,6616964:papier:4207:6617672,6631478:papier:4207:6633555,6652939:papier:4207:6659520'}, {'unwanted_material': 'papier', 'main_material': 'pehd_pp', 'pht_type': 4211, 'ratio': 0.02200696110253512, 'nb_photo': 44767, 'list_port_cont': '6600859,6600889,6601024,6601441,6601504,6602279,6602446,6602594,6603004,6603395,6605883,6606067,6607684,6608067,6608284,6609460,6610408,6610604,6610647,6611155,6613695,6614035,6614526,6615395,6615430,6615802,6616513,6617436,6618598,6618775,6618915,6620220,6620329,6620926,6621066,6621670,6621709,6621963,6621993,6622136,6622195,6622456,6624056,6625570,6626617,6626659,6627281,6628480,6629180,6629253,6634378,6634445,6634659,6634723,6634856,6635137,6635833,6638284,6638445,6639159,6640995,6642056,6642709,6648980,6650056,6650154,6650269,6650966,6653712,6658497,6664045,6666459,6668084,6668174,6669620,6672034,6674013,6674557,6674636,6674758,6674902,6675068,6675112,6675138,6675487,6676025,6676535,6676626,6677122,6677215,6677813,6678048,6678214,6678566,6678657,6678767,6678938,6678965,6679003,6679162,6679227,6681256,6687142,6691490,6691666,6692285,6693203,6693684,6693895,6694008,6694043,6694209,6694415,6695514,6697518,6698423,6698761,6698796,6699375,6699424,6700614,6700670,6704525,6705435,6706448,6706631,6706771,6707237,', 'assoc_port': '10844008:10846064,10844009:10845789,10844010:10846038,10844011:10845545,10844012:10845980,10844013:10845418,10844014:10845180,10844015:10845083,10844016:10845173,10844017:10845135,10844018:10844948,10844019:10845046,10844020:10844685,10844021:10844451,12107423:12108307,12107427:12108063,12107429:12107830,6600536:6601441,6600541:6601504,6600544:6600859,6600546:6601024,6600551:6600889,6601134:6602446,6601138:6602594,6601649:6602279,6602728:6603004,6602733:6603395,6604399:6608067,6605499:6610647,6605503:6605883,6605688:6606067,6606683:6607684,6607835:6610408,6607839:6608284,6609199:6609460,6610498:6610604,6610992:6611155,6613334:6613695,6613876:6614035,6614199:6614526,6614967:6615395,6614969:6615430,6615362:6615802,6616173:6616513,6616982:6617436,6618305:6618598,6618307:6618775,6618311:6618915,6620038:6620220,6620040:6620329,6620422:6621670,6620440:6621709,6620444:6621066,6620447:6620926,6621638:6624056,6621643:6622456,6621647:6622195,6621651:6622136,6621654:6621963,6621659:6621993,6625236:6625570,6626268:662661', 'assoc_mat': '10844008:papier:4211:10846064,10844009:papier:4211:10845789,10844010:papier:4211:10846038,10844011:papier:4211:10845545,10844012:papier:4211:10845980,10844013:papier:4211:10845418,10844014:papier:4211:10845180,10844015:papier:4211:10845083,10844016:papier:4211:10845173,10844017:papier:4211:10845135,10844018:papier:4211:10844948,10844019:papier:4211:10845046,10844020:papier:4211:10844685,10844021:papier:4211:10844451,12107423:papier:4211:12108307,12107427:papier:4211:12108063,12107429:papier:4211:12107830,6600536:papier:4211:6601441,6600541:papier:4211:6601504,6600544:papier:4211:6600859,6600546:papier:4211:6601024,6600551:papier:4211:6600889,6601134:papier:4211:6602446,6601138:papier:4211:6602594,6601649:papier:4211:6602279,6602728:papier:4211:6603004,6602733:papier:4211:6603395,6604399:papier:4211:6608067,6605499:papier:4211:6610647,6605503:papier:4211:6605883,6605688:papier:4211:6606067,6606683:papier:4211:6607684,6607835:papier:4211:6610408,6607839:papier:4211:6608284,6609199:papier:4211:6609460,6610498:pa'}, {'unwanted_material': 'papier', 'main_material': 'pet_clair', 'pht_type': 3327, 'ratio': 0.009355240101605987, 'nb_photo': 6285, 'list_port_cont': '6601213,6601256,6601317,6601373,6601553,6601698,6601785,6601845,6602306,6603618,6603848,6603983,6604941,6606282,6606355,6607130,6607397,6607894,6608325,6608588,6608678,6608962,6609907,6610050,6610277,6610916,6611080,6613729,6614150,6615896,6616066,6616196,6616978,6617467,6617840,6618171,6618951,6620513,6620986,6621120,6621143,6621171,6621389,6621444,6621532,6622103,6622164,6622319,6622375,6622434,6622526,6622660,6622747,6626370,6626972,6627003,6627196,6627833,6628017,6628555,6628622,6629355,6629386,6635801,6635866,6635899,6635944,6635981,6636042,6636111,6636140,6636285,6636315,6636430,6636597,6636684,6636728,6636793,6637051,6637686,6637707,6637760,6637847,6637947,6637985,6638092,6638415,6638592,6638709,6638831,6638953,6638977,6639183,6639295,6639358,6639648,6639762,6639839,6639905,6639970,6640128,6640718,6640743,6640775,6640957,6641216,6641307,6641324,6641487,6641516,6641659,6641814,6641948,6642020,6642091,6642283,6643241,6643369,6643482,6643610,6643638,6643667,6643692,6643717,6643898,6644077,6644463,6644658,', 'assoc_port': '6600535:6601256,6600537:6601698,6600543:6601213,6600545:6601373,6600547:6601553,6600550:6601785,6600553:6601317,6601140:6602306,6601199:6601845,6602727:6603848,6602729:6603983,6602732:6603618,6604400:6604941,6604702:6606355,6605500:6606282,6605502:6607130,6606682:6608325,6606685:6607894,6606687:6607397,6607836:6608588,6607838:6608678,6608144:6608962,6609197:6610050,6609198:6609907,6609963:6610277,6610497:6611080,6610499:6610916,6612953:6613729,6613333:6614150,6614966:6616196,6614968:6616066,6615360:6615896,6616171:6616978,6616960:6618171,6616966:6617467,6616967:6617840,6618310:6618951,6620036:6620513,6620039:6621389,6620042:6620986,6620404:6621143,6620441:6621444,6620445:6621171,6620446:6621532,6620449:6621120,6621639:6622660,6621642:6622747,6621645:6622526,6621650:6622375,6621652:6622434,6621655:6622164,6621656:6622103,6621661:6622319,6625901:6626370,6626270:6626972,6626272:6627003,6626275:6627196,6627097:6627833,6627099:6628017,6627946:6628555,6627948:6628622,6628988:6629355,6628991:6629386,6630847:6635944,', 'assoc_mat': '6600535:papier:3327:6601256,6600537:papier:3327:6601698,6600543:papier:3327:6601213,6600545:papier:3327:6601373,6600547:papier:3327:6601553,6600550:papier:3327:6601785,6600553:papier:3327:6601317,6601140:papier:3327:6602306,6601199:papier:3327:6601845,6602727:papier:3327:6603848,6602729:papier:3327:6603983,6602732:papier:3327:6603618,6604400:papier:3327:6604941,6604702:papier:3327:6606355,6605500:papier:3327:6606282,6605502:papier:3327:6607130,6606682:papier:3327:6608325,6606685:papier:3327:6607894,6606687:papier:3327:6607397,6607836:papier:3327:6608588,6607838:papier:3327:6608678,6608144:papier:3327:6608962,6609197:papier:3327:6610050,6609198:papier:3327:6609907,6609963:papier:3327:6610277,6610497:papier:3327:6611080,6610499:papier:3327:6610916,6612953:papier:3327:6613729,6613333:papier:3327:6614150,6614966:papier:3327:6616196,6614968:papier:3327:6616066,6615360:papier:3327:6615896,6616171:papier:3327:6616978,6616960:papier:3327:6618171,6616966:papier:3327:6617467,6616967:papier:3327:6617840,6618310:papier:3'}, {'unwanted_material': 'papier', 'main_material': 'pet_fonce', 'pht_type': 4200, 'ratio': 0.017125275841086585, 'nb_photo': 2971, 'list_port_cont': '6600926,6602063,6604875,6606104,6609174,6613071,6615626,6618500,6620184,6620854,6621908,6626783,6628360,6634243,6635396,6637073,6637446,6638360,6639247,6641571,6646008,6647325,6649284,6649479,6649902,6653435,6654683,6655706,6658468,6662396,6665198,6669579,6670065,6672619,6674516,6683662,6684471,6686799,6687236,6687458,6696447,6696824,6698461,6711553,6712279,6712781,6714496,6717599,6719829,6720164,6720215,6720241,6720368,6721253,6722530,6724154,6739279,6740796,6745518,6745791,6750249,6754202,6754551,6759426,6765269,6766705,6767366,6780400,6780521,6780722,6784029,6786845,6788639,6791340,6793690,6795542,6797664,6813924,6817658,6821374,6824105,6835188,6836541,6840208,6842437,6849226,6851792,6852378,6854525,6859024,6862734,6865779,6866332,6867973,6869258,6874411,6875759,6875982,6882729,6886818,6888094,6889509,6895296,6902512,6904831,6914440,6920757,6921627,6924261', 'assoc_port': '6600538:6600926,6601136:6602063,6604397:6604875,6605689:6606104,6608145:6609174,6612632:6613071,6615365:6615626,6618309:6618500,6620043:6620184,6620439:6620854,6621653:6621908,6626271:6626783,6627944:6628360,6630848:6646008,6631070:6649284,6631186:6634243,6631194:6649902,6631961:6655706,6632583:6662396,6632786:6635396,6632966:6670065,6635673:6637446,6635681:6637073,6637843:6638360,6638774:6639247,6641286:6641571,6646447:6647325,6648940:6649479,6650951:6653435,6654041:6654683,6657889:6658468,6664429:6665198,6668950:6669579,6671809:6672619,6673895:6674516,6681680:6683662,6683618:6684471,6685440:6720368,6685511:6720215,6686027:6719829,6686041:6720164,6686295:6687458,6686312:6687236,6686325:6686799,6688871:6714496,6690894:6698461,6693641:6696447,6696476:6696824,6710860:6711553,6711680:6712279,6712324:6712781,6716688:6717599,6718843:6720241,6720803:6721253,6722354:6722530,6723892:6724154,6738748:6739279,6740018:6740796,6740709:6745518,6744268:6745791,6748062:6750249,6753406:6754551,6753419:6754202,6759057:6759426,', 'assoc_mat': '6600538:papier:4200:6600926,6601136:papier:4200:6602063,6604397:papier:4200:6604875,6605689:papier:4200:6606104,6608145:papier:4200:6609174,6612632:papier:4200:6613071,6615365:papier:4200:6615626,6618309:papier:4200:6618500,6620043:papier:4200:6620184,6620439:papier:4200:6620854,6621653:papier:4200:6621908,6626271:papier:4200:6626783,6627944:papier:4200:6628360,6630848:papier:4200:6646008,6631070:papier:4200:6649284,6631186:papier:4200:6634243,6631194:papier:4200:6649902,6631961:papier:4200:6655706,6632583:papier:4200:6662396,6632786:papier:4200:6635396,6632966:papier:4200:6670065,6635673:papier:4200:6637446,6635681:papier:4200:6637073,6637843:papier:4200:6638360,6638774:papier:4200:6639247,6641286:papier:4200:6641571,6646447:papier:4200:6647325,6648940:papier:4200:6649479,6650951:papier:4200:6653435,6654041:papier:4200:6654683,6657889:papier:4200:6658468,6664429:papier:4200:6665198,6668950:papier:4200:6669579,6671809:papier:4200:6672619,6673895:papier:4200:6674516,6681680:papier:4200:6683662,6683618:papier:4'}, {'unwanted_material': 'pehd', 'main_material': 'ela', 'pht_type': 4203, 'ratio': 0.0013604158722732354, 'nb_photo': 67, 'list_port_cont': '6603441,6608813,6618332,6624169,6627324,6634752,6634796,6698371,6704167,6712710,6720530,6723225,6723402,6735152,6735445,6754074,6761147,6775031,6799271,6801313,6806359,6808097,6808736,6826372,6834093,6838765,6852167,6865667,6876014,6930485,6940839,10844181', 'assoc_port': '10844025:10844181,6602731:6603441,6608146:6608813,6617603:6618332,6620405:6624169,6626721:6627324,6630937:6634752,6631483:6634796,6638160:6704167,6653521:6723225,6664117:6735445,6671808:6834093,6685476:6799271,6686304:6801313,6690887:6735152,6696473:6698371,6712332:6712710,6718634:6720530,6722813:6723402,6753416:6754074,6760133:6761147,6765566:6808736,6774410:6775031,6786466:6808097,6793236:6806359,6825858:6826372,6837012:6838765,6851650:6852167,6865559:6865667,6875674:6876014,6894306:6930485,6900378:6940839', 'assoc_mat': '10844025:pehd:4203:10844181,6602731:pehd:4203:6603441,6608146:pehd:4203:6608813,6617603:pehd:4203:6618332,6620405:pehd:4203:6624169,6626721:pehd:4203:6627324,6630937:pehd:4203:6634752,6631483:pehd:4203:6634796,6638160:pehd:4203:6704167,6653521:pehd:4203:6723225,6664117:pehd:4203:6735445,6671808:pehd:4203:6834093,6685476:pehd:4203:6799271,6686304:pehd:4203:6801313,6690887:pehd:4203:6735152,6696473:pehd:4203:6698371,6712332:pehd:4203:6712710,6718634:pehd:4203:6720530,6722813:pehd:4203:6723402,6753416:pehd:4203:6754074,6760133:pehd:4203:6761147,6765566:pehd:4203:6808736,6774410:pehd:4203:6775031,6786466:pehd:4203:6808097,6793236:pehd:4203:6806359,6825858:pehd:4203:6826372,6837012:pehd:4203:6838765,6851650:pehd:4203:6852167,6865559:pehd:4203:6865667,6875674:pehd:4203:6876014,6894306:pehd:4203:6930485,6900378:pehd:4203:6940839'}, {'unwanted_material': 'pehd', 'main_material': 'emr', 'pht_type': 4209, 'ratio': 0.0004041124511179276, 'nb_photo': 6, 'list_port_cont': '6618980,6620778,6655493,6669280,6711051,6751445', 'assoc_port': '6618302:6618980,6620448:6620778,6631482:6669280,6654838:6655493,6709375:6711051,6750987:6751445', 'assoc_mat': '6618302:pehd:4209:6618980,6620448:pehd:4209:6620778,6631482:pehd:4209:6669280,6654838:pehd:4209:6655493,6709375:pehd:4209:6711051,6750987:pehd:4209:6751445'}, {'unwanted_material': 'pehd', 'main_material': 'gm', 'pht_type': 4209, 'ratio': 0.0005712244972110796, 'nb_photo': 6, 'list_port_cont': '6869288,6869648,6922350,12108027,12108673', 'assoc_port': '12107420:12108673,12107428:12108027,6868823:6869288,6869543:6869648,6920918:6922350', 'assoc_mat': '12107420:pehd:4209:12108673,12107428:pehd:4209:12108027,6868823:pehd:4209:6869288,6869543:pehd:4209:6869648,6920918:pehd:4209:6922350'}, {'unwanted_material': 'pehd', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 0.07610095728061055, 'nb_photo': 1, 'list_port_cont': '6659525', 'assoc_port': '6652939:6659525', 'assoc_mat': '6652939:pehd:4207:6659525'}, {'unwanted_material': 'pehd', 'main_material': 'pehd_pp', 'pht_type': 4211, 'ratio': 0.9648891206027819, 'nb_photo': 8269, 'list_port_cont': '6600597,6600702,6600852,6600891,6601022,6601052,6601428,6601500,6601604,6602281,6602444,6602601,6603006,6603409,6605890,6606075,6607690,6608072,6608288,6609448,6610185,6610407,6610605,6610648,6611149,6613701,6613906,6613939,6614041,6614531,6615390,6615428,6615558,6615799,6616519,6617435,6618606,6618771,6618913,6620221,6620341,6620928,6621057,6621666,6621699,6621790,6621962,6622001,6622037,6622126,6622206,6622461,6624054,6625571,6626612,6626650,6627283,6628486,6629182,6629248,6634392,6634439,6634652,6634721,6634852,6635131,6635834,6638285,6638453,6639157,6640992,6642047,6642713,6648978,6649961,6650055,6650160,6650275,6650956,6653710,6658507,6664051,6666446,6668093,6668166,6669619,6672027,6674019,6674406,6674558,6674637,6674764,6674895,6675069,6675098,6675131,6675486,6676018,6676531,6676620,6677123,6677226,6677805,6678033,6678221,6678316,6678581,6678659,6678689,6678763,6678928,6678955,6678997,6679159,6679231,6681253,6687144,6691496,6691661,6692281,6693207,6693677,6693893,6694000,6694040,6694208,6694413,6695519,', 'assoc_port': '10844008:10846067,10844009:10845792,10844010:10846032,10844011:10845548,10844012:10845975,10844013:10845405,10844014:10845186,10844015:10845082,10844016:10845169,10844017:10845131,10844018:10844955,10844019:10845040,10844020:10844684,10844021:10844450,12107423:12108306,12107427:12108068,12107429:12107833,6600532:6601052,6600536:6601428,6600541:6601500,6600544:6600852,6600546:6601022,6600548:6600702,6600551:6600891,6600554:6600597,6601134:6602444,6601138:6602601,6601142:6601604,6601649:6602281,6602728:6603006,6602733:6603409,6604399:6608072,6605499:6610648,6605503:6605890,6605688:6606075,6606683:6607690,6607835:6610407,6607837:6610185,6607839:6608288,6609199:6609448,6610498:6610605,6610992:6611149,6613334:6613701,6613876:6614041,6613877:6613939,6613878:6613906,6614199:6614531,6614967:6615390,6614969:6615428,6615340:6615558,6615362:6615799,6616173:6616519,6616982:6617435,6618305:6618606,6618307:6618771,6618311:6618913,6620038:6620221,6620040:6620341,6620422:6621666,6620440:6621699,6620444:6621057,6620447:662092', 'assoc_mat': '10844008:pehd:4211:10846067,10844009:pehd:4211:10845792,10844010:pehd:4211:10846032,10844011:pehd:4211:10845548,10844012:pehd:4211:10845975,10844013:pehd:4211:10845405,10844014:pehd:4211:10845186,10844015:pehd:4211:10845082,10844016:pehd:4211:10845169,10844017:pehd:4211:10845131,10844018:pehd:4211:10844955,10844019:pehd:4211:10845040,10844020:pehd:4211:10844684,10844021:pehd:4211:10844450,12107423:pehd:4211:12108306,12107427:pehd:4211:12108068,12107429:pehd:4211:12107833,6600532:pehd:4211:6601052,6600536:pehd:4211:6601428,6600541:pehd:4211:6601500,6600544:pehd:4211:6600852,6600546:pehd:4211:6601022,6600548:pehd:4211:6600702,6600551:pehd:4211:6600891,6600554:pehd:4211:6600597,6601134:pehd:4211:6602444,6601138:pehd:4211:6602601,6601142:pehd:4211:6601604,6601649:pehd:4211:6602281,6602728:pehd:4211:6603006,6602733:pehd:4211:6603409,6604399:pehd:4211:6608072,6605499:pehd:4211:6610648,6605503:pehd:4211:6605890,6605688:pehd:4211:6606075,6606683:pehd:4211:6607690,6607835:pehd:4211:6610407,6607837:pehd:4211:6610185,66'}, {'unwanted_material': 'pehd', 'main_material': 'pet_clair', 'pht_type': 3327, 'ratio': 0.0019293084660709505, 'nb_photo': 273, 'list_port_cont': '6601307,6601555,6601786,6602308,6603607,6603836,6604931,6606273,6606378,6607134,6607399,6607896,6608317,6608582,6609917,6610054,6610919,6611086,6613723,6616969,6621109,6621147,6621175,6621381,6621443,6622372,6622653,6622754,6626366,6626981,6628626,6629353,6629393,6635973,6636120,6636144,6636682,6637052,6637758,6638416,6638593,6638979,6639653,6639753,6639840,6639973,6640752,6640773,6640962,6641208,6641482,6641513,6641943,6642092,6643483,6643627,6643714,6643896,6645157,6645307,6645764,6648008,6648357,6648811,6649737,6652023,6652944,6654490,6655049,6656662,6657953,6663978,6670191,6671021,6672471,6673060,6674484,6675451,6675589,6676584,6681848,6682438,6684388,6686711,6687374,6687704,6688265,6689126,6689282,6689505,6690578,6690632,6692194,6692352,6692541,6692686,6693519,6694785,6696037,6697044,6697601,6697680,6698233,6698691,6698892,6698922,6699065,6710963,6711527,6712030,6712064,6712351,6712522,6712805,6712843,6713118,6713310,6717346,6720929,6721463,6723979,6724042,6725337,6725396,6727508,6740875,6741549,6742203,', 'assoc_port': '6600547:6601555,6600550:6601786,6600553:6601307,6601140:6602308,6602727:6603836,6602732:6603607,6604400:6604931,6604702:6606378,6605500:6606273,6605502:6607134,6606682:6608317,6606685:6607896,6606687:6607399,6607836:6608582,6609197:6610054,6609198:6609917,6610497:6611086,6610499:6610919,6612953:6613723,6616171:6616969,6620039:6621381,6620404:6621147,6620441:6621443,6620445:6621175,6620449:6621109,6621639:6622653,6621642:6622754,6621650:6622372,6625901:6626366,6626270:6626981,6627948:6628626,6628988:6629353,6628991:6629393,6630851:6635973,6630853:6636682,6630934:6637758,6631071:6638979,6631073:6639653,6631075:6639973,6631486:6641482,6631488:6640752,6631490:6640773,6631493:6640962,6631964:6642092,6631965:6641513,6632579:6645157,6632584:6645764,6632662:6643483,6632711:6643714,6632713:6648811,6632876:6643896,6632968:6645307,6633861:6637052,6635680:6636144,6635684:6636120,6637842:6638593,6637844:6638416,6638772:6639840,6638775:6639753,6640591:6641208,6641288:6643627,6641292:6641943,6646445:6648008,6647213:6648357,', 'assoc_mat': '6600547:pehd:3327:6601555,6600550:pehd:3327:6601786,6600553:pehd:3327:6601307,6601140:pehd:3327:6602308,6602727:pehd:3327:6603836,6602732:pehd:3327:6603607,6604400:pehd:3327:6604931,6604702:pehd:3327:6606378,6605500:pehd:3327:6606273,6605502:pehd:3327:6607134,6606682:pehd:3327:6608317,6606685:pehd:3327:6607896,6606687:pehd:3327:6607399,6607836:pehd:3327:6608582,6609197:pehd:3327:6610054,6609198:pehd:3327:6609917,6610497:pehd:3327:6611086,6610499:pehd:3327:6610919,6612953:pehd:3327:6613723,6616171:pehd:3327:6616969,6620039:pehd:3327:6621381,6620404:pehd:3327:6621147,6620441:pehd:3327:6621443,6620445:pehd:3327:6621175,6620449:pehd:3327:6621109,6621639:pehd:3327:6622653,6621642:pehd:3327:6622754,6621650:pehd:3327:6622372,6625901:pehd:3327:6626366,6626270:pehd:3327:6626981,6627948:pehd:3327:6628626,6628988:pehd:3327:6629353,6628991:pehd:3327:6629393,6630851:pehd:3327:6635973,6630853:pehd:3327:6636682,6630934:pehd:3327:6637758,6631071:pehd:3327:6638979,6631073:pehd:3327:6639653,6631075:pehd:3327:6639973,6631486:pe'}, {'unwanted_material': 'pehd', 'main_material': 'pet_fonce', 'pht_type': 4200, 'ratio': 0.0051100227990344554, 'nb_photo': 146, 'list_port_cont': '6604877,6609170,6613068,6615614,6618503,6620187,6620866,6621902,6628367,6634250,6637080,6637448,6641565,6653431,6654691,6655698,6658465,6662390,6665200,6669580,6670050,6672621,6674514,6683659,6684464,6687228,6696451,6698464,6711561,6712283,6712785,6714507,6717609,6719826,6720245,6720364,6721249,6740804,6745511,6745786,6750247,6754189,6754553,6759422,6765273,6766697,6780403,6780526,6780710,6786856,6788637,6791338,6793691,6795538,6797665,6821369,6824092,6842448,6849223,6851780,6852369,6854529,6859027,6862725,6866337,6867970,6869263,6875756,6882722,6888109,6895287,6902508,6914447,6920759,6921629,6924255', 'assoc_port': '6604397:6604877,6608145:6609170,6612632:6613068,6615365:6615614,6618309:6618503,6620043:6620187,6620439:6620866,6621653:6621902,6627944:6628367,6631186:6634250,6631961:6655698,6632583:6662390,6632966:6670050,6635673:6637448,6635681:6637080,6641286:6641565,6650951:6653431,6654041:6654691,6657889:6658465,6664429:6665200,6668950:6669580,6671809:6672621,6673895:6674514,6681680:6683659,6683618:6684464,6685440:6720364,6686027:6719826,6686312:6687228,6688871:6714507,6690894:6698464,6693641:6696451,6710860:6711561,6711680:6712283,6712324:6712785,6716688:6717609,6718843:6720245,6720803:6721249,6740018:6740804,6740709:6745511,6744268:6745786,6748062:6750247,6753406:6754553,6753419:6754189,6759057:6759422,6764848:6765273,6765563:6766697,6779960:6780710,6779977:6780526,6780017:6780403,6786463:6786856,6787690:6788637,6790918:6791338,6793238:6793691,6795258:6795538,6797266:6797665,6820776:6821369,6823753:6824092,6842061:6842448,6848832:6849223,6850353:6851780,6852123:6852369,6854184:6854529,6858797:6859027,6862270:6862725,', 'assoc_mat': '6604397:pehd:4200:6604877,6608145:pehd:4200:6609170,6612632:pehd:4200:6613068,6615365:pehd:4200:6615614,6618309:pehd:4200:6618503,6620043:pehd:4200:6620187,6620439:pehd:4200:6620866,6621653:pehd:4200:6621902,6627944:pehd:4200:6628367,6631186:pehd:4200:6634250,6631961:pehd:4200:6655698,6632583:pehd:4200:6662390,6632966:pehd:4200:6670050,6635673:pehd:4200:6637448,6635681:pehd:4200:6637080,6641286:pehd:4200:6641565,6650951:pehd:4200:6653431,6654041:pehd:4200:6654691,6657889:pehd:4200:6658465,6664429:pehd:4200:6665200,6668950:pehd:4200:6669580,6671809:pehd:4200:6672621,6673895:pehd:4200:6674514,6681680:pehd:4200:6683659,6683618:pehd:4200:6684464,6685440:pehd:4200:6720364,6686027:pehd:4200:6719826,6686312:pehd:4200:6687228,6688871:pehd:4200:6714507,6690894:pehd:4200:6698464,6693641:pehd:4200:6696451,6710860:pehd:4200:6711561,6711680:pehd:4200:6712283,6712324:pehd:4200:6712785,6716688:pehd:4200:6717609,6718843:pehd:4200:6720245,6720803:pehd:4200:6721249,6740018:pehd:4200:6740804,6740709:pehd:4200:6745511,6744268:pe'}, {'unwanted_material': 'pet_clair', 'main_material': 'ela', 'pht_type': 4203, 'ratio': 0.0005167916399878171, 'nb_photo': 10, 'list_port_cont': '6608803,6712721,6754068,6800312,6806350,6808098,6876008,6940836', 'assoc_port': '6608146:6608803,6685991:6800312,6712332:6712721,6753416:6754068,6786466:6808098,6793236:6806350,6875674:6876008,6900378:6940836', 'assoc_mat': '6608146:pet_clair:4203:6608803,6685991:pet_clair:4203:6800312,6712332:pet_clair:4203:6712721,6753416:pet_clair:4203:6754068,6786466:pet_clair:4203:6808098,6793236:pet_clair:4203:6806350,6875674:pet_clair:4203:6876008,6900378:pet_clair:4203:6940836'}, {'unwanted_material': 'pet_clair', 'main_material': 'emr', 'pht_type': 4209, 'ratio': 0.002615200546649331, 'nb_photo': 21, 'list_port_cont': '6600774,6602155,6638508,6669283,6673392,6694184,6695455,6712247,6723146,6740495,6742322,6751442,6754773', 'assoc_port': '6600540:6602155,6600552:6600774,6631482:6669283,6638162:6638508,6672700:6673392,6692502:6694184,6694740:6695455,6710867:6712247,6722817:6723146,6739465:6742322,6740030:6740495,6741911:6754773,6750987:6751442', 'assoc_mat': '6600540:pet_clair:4209:6602155,6600552:pet_clair:4209:6600774,6631482:pet_clair:4209:6669283,6638162:pet_clair:4209:6638508,6672700:pet_clair:4209:6673392,6692502:pet_clair:4209:6694184,6694740:pet_clair:4209:6695455,6710867:pet_clair:4209:6712247,6722817:pet_clair:4209:6723146,6739465:pet_clair:4209:6742322,6740030:pet_clair:4209:6740495,6741911:pet_clair:4209:6754773,6750987:pet_clair:4209:6751442'}, {'unwanted_material': 'pet_clair', 'main_material': 'gm', 'pht_type': 4209, 'ratio': 0.0001938470394354349, 'nb_photo': 4, 'list_port_cont': '6869295,6869655,6914936,6960440', 'assoc_port': '6868823:6869295,6869543:6869655,6914405:6914936,6919131:6960440', 'assoc_mat': '6868823:pet_clair:4209:6869295,6869543:pet_clair:4209:6869655,6914405:pet_clair:4209:6914936,6919131:pet_clair:4209:6960440'}, {'unwanted_material': 'pet_clair', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 0.0010334097253368944, 'nb_photo': 3, 'list_port_cont': '6617252,6617677,6633560', 'assoc_port': '6616962:6617252,6616964:6617677,6631478:6633560', 'assoc_mat': '6616962:pet_clair:4207:6617252,6616964:pet_clair:4207:6617677,6631478:pet_clair:4207:6633560'}, {'unwanted_material': 'pet_clair', 'main_material': 'pehd_pp', 'pht_type': 4211, 'ratio': 0.0015524153897367723, 'nb_photo': 1500, 'list_port_cont': '6600858,6600897,6601013,6601431,6602282,6602595,6603012,6603407,6606068,6607680,6608064,6608283,6609454,6610409,6610606,6610649,6611145,6614534,6615393,6615436,6615797,6616526,6617426,6618921,6620330,6620914,6621054,6621668,6621965,6621997,6622134,6622196,6622457,6624048,6625562,6626620,6626654,6627270,6628482,6629176,6629250,6634388,6634656,6634855,6635135,6635836,6638280,6638446,6639162,6640996,6642051,6642710,6650049,6650151,6650272,6650962,6658506,6664046,6666445,6668082,6668178,6669608,6672025,6674016,6674544,6674638,6674762,6675076,6675106,6675132,6675480,6676532,6676622,6677125,6677222,6677808,6678040,6678226,6678568,6678651,6678771,6678961,6678993,6679220,6681247,6687136,6691495,6691657,6692280,6693193,6693673,6693892,6694033,6694210,6694409,6695508,6697514,6698425,6698773,6698798,6699368,6699436,6705438,6706628,6706772,6707230,6709725,6711231,6711405,6711487,6712154,6712633,6712745,6713436,6713606,6713756,6714401,6716473,6716566,6717505,6717554,6718023,6718524,6719029,6719453,6719723,6720668,6720734,', 'assoc_port': '10844008:10846061,10844009:10845791,10844010:10846028,10844011:10845556,10844012:10845977,10844014:10845189,10844015:10845087,10844017:10845127,10844018:10844952,10844019:10845053,10844020:10844681,10844021:10844449,12107423:12108303,12107427:12108066,12107429:12107823,6600536:6601431,6600544:6600858,6600546:6601013,6600551:6600897,6601138:6602595,6601649:6602282,6602728:6603012,6602733:6603407,6604399:6608064,6605499:6610649,6605688:6606068,6606683:6607680,6607835:6610409,6607839:6608283,6609199:6609454,6610498:6610606,6610992:6611145,6614199:6614534,6614967:6615393,6614969:6615436,6615362:6615797,6616173:6616526,6616982:6617426,6618311:6618921,6620040:6620330,6620422:6621668,6620444:6621054,6620447:6620914,6621638:6624048,6621643:6622457,6621647:6622196,6621651:6622134,6621654:6621965,6621659:6621997,6625236:6625562,6626268:6626620,6626274:6626654,6627098:6627270,6627945:6628482,6628987:6629176,6628989:6629250,6630850:6634855,6630852:6674016,6630856:6634656,6630932:6674638,6630935:6674762,6630939:6675106,66', 'assoc_mat': '10844008:pet_clair:4211:10846061,10844009:pet_clair:4211:10845791,10844010:pet_clair:4211:10846028,10844011:pet_clair:4211:10845556,10844012:pet_clair:4211:10845977,10844014:pet_clair:4211:10845189,10844015:pet_clair:4211:10845087,10844017:pet_clair:4211:10845127,10844018:pet_clair:4211:10844952,10844019:pet_clair:4211:10845053,10844020:pet_clair:4211:10844681,10844021:pet_clair:4211:10844449,12107423:pet_clair:4211:12108303,12107427:pet_clair:4211:12108066,12107429:pet_clair:4211:12107823,6600536:pet_clair:4211:6601431,6600544:pet_clair:4211:6600858,6600546:pet_clair:4211:6601013,6600551:pet_clair:4211:6600897,6601138:pet_clair:4211:6602595,6601649:pet_clair:4211:6602282,6602728:pet_clair:4211:6603012,6602733:pet_clair:4211:6603407,6604399:pet_clair:4211:6608064,6605499:pet_clair:4211:6610649,6605688:pet_clair:4211:6606068,6606683:pet_clair:4211:6607680,6607835:pet_clair:4211:6610409,6607839:pet_clair:4211:6608283,6609199:pet_clair:4211:6609454,6610498:pet_clair:4211:6610606,6610992:pet_clair:4211:6611145,66'}, {'unwanted_material': 'pet_clair', 'main_material': 'pet_clair', 'pht_type': 3327, 'ratio': 0.9599310617320319, 'nb_photo': 267351, 'list_port_cont': '6601210,6601259,6601315,6601372,6601561,6601699,6601793,6601843,6602315,6603612,6603846,6603988,6604935,6606277,6606379,6607135,6607387,6607887,6608320,6608594,6608685,6608963,6609915,6610051,6610272,6610908,6611079,6613731,6614159,6615900,6616061,6616197,6616980,6617460,6617848,6618172,6618946,6620507,6620990,6621111,6621145,6621178,6621380,6621448,6621534,6622108,6622166,6622320,6622376,6622431,6622522,6622656,6622746,6626362,6626970,6627008,6627198,6627829,6628015,6628553,6628621,6629351,6629395,6635805,6635872,6635894,6635946,6635979,6636038,6636114,6636146,6636284,6636327,6636427,6636595,6636676,6636732,6636800,6637047,6637357,6637676,6637709,6637759,6637850,6637946,6637981,6638089,6638412,6638604,6638708,6638827,6638952,6638975,6639189,6639290,6639357,6639644,6639751,6639842,6639900,6639967,6640118,6640724,6640748,6640771,6640953,6641215,6641298,6641330,6641481,6641511,6641662,6641812,6641955,6642028,6642082,6642295,6643245,6643371,6643476,6643601,6643634,6643665,6643684,6643715,6643904,6644075,6644466,', 'assoc_port': '6600535:6601259,6600537:6601699,6600543:6601210,6600545:6601372,6600547:6601561,6600550:6601793,6600553:6601315,6601140:6602315,6601199:6601843,6602727:6603846,6602729:6603988,6602732:6603612,6604400:6604935,6604702:6606379,6605500:6606277,6605502:6607135,6606682:6608320,6606685:6607887,6606687:6607387,6607836:6608594,6607838:6608685,6608144:6608963,6609197:6610051,6609198:6609915,6609963:6610272,6610497:6611079,6610499:6610908,6612953:6613731,6613333:6614159,6614966:6616197,6614968:6616061,6615360:6615900,6616171:6616980,6616960:6618172,6616966:6617460,6616967:6617848,6618310:6618946,6620036:6620507,6620039:6621380,6620042:6620990,6620404:6621145,6620441:6621448,6620445:6621178,6620446:6621534,6620449:6621111,6621639:6622656,6621642:6622746,6621645:6622522,6621650:6622376,6621652:6622431,6621655:6622166,6621656:6622108,6621661:6622320,6625901:6626362,6626270:6626970,6626272:6627008,6626275:6627198,6627097:6627829,6627099:6628015,6627946:6628553,6627948:6628621,6628988:6629351,6628991:6629395,6630847:6635946,', 'assoc_mat': '6600535:pet_clair:3327:6601259,6600537:pet_clair:3327:6601699,6600543:pet_clair:3327:6601210,6600545:pet_clair:3327:6601372,6600547:pet_clair:3327:6601561,6600550:pet_clair:3327:6601793,6600553:pet_clair:3327:6601315,6601140:pet_clair:3327:6602315,6601199:pet_clair:3327:6601843,6602727:pet_clair:3327:6603846,6602729:pet_clair:3327:6603988,6602732:pet_clair:3327:6603612,6604400:pet_clair:3327:6604935,6604702:pet_clair:3327:6606379,6605500:pet_clair:3327:6606277,6605502:pet_clair:3327:6607135,6606682:pet_clair:3327:6608320,6606685:pet_clair:3327:6607887,6606687:pet_clair:3327:6607387,6607836:pet_clair:3327:6608594,6607838:pet_clair:3327:6608685,6608144:pet_clair:3327:6608963,6609197:pet_clair:3327:6610051,6609198:pet_clair:3327:6609915,6609963:pet_clair:3327:6610272,6610497:pet_clair:3327:6611079,6610499:pet_clair:3327:6610908,6612953:pet_clair:3327:6613731,6613333:pet_clair:3327:6614159,6614966:pet_clair:3327:6616197,6614968:pet_clair:3327:6616061,6615360:pet_clair:3327:6615900,6616171:pet_clair:3327:6616980,6'}, {'unwanted_material': 'pet_clair', 'main_material': 'pet_fonce', 'pht_type': 4200, 'ratio': 0.013850132418607056, 'nb_photo': 729, 'list_port_cont': '6600932,6602056,6604868,6606116,6609176,6613074,6615622,6618504,6620175,6620851,6621896,6626788,6628359,6634256,6635400,6637083,6637447,6638371,6639240,6641570,6646011,6647331,6649288,6649483,6649916,6653442,6654690,6655705,6658463,6662388,6665196,6669581,6670064,6672613,6674519,6683665,6684474,6686801,6687235,6687462,6696450,6696819,6698459,6711564,6712276,6712777,6714501,6717602,6719815,6720155,6720212,6720236,6720365,6721245,6722531,6724155,6739274,6740798,6745510,6745796,6750242,6754194,6754554,6759416,6765275,6766695,6767363,6780396,6780522,6780718,6784027,6786850,6788647,6791335,6793696,6795535,6797659,6813917,6817661,6821368,6824094,6835198,6836547,6840209,6842441,6849227,6851786,6852367,6854528,6859033,6862731,6865772,6866324,6867968,6869265,6874404,6875758,6875978,6882732,6886808,6888105,6889504,6895291,6900326,6902507,6904839,6914449,6920746,6921620,6924256', 'assoc_port': '6600538:6600932,6601136:6602056,6604397:6604868,6605689:6606116,6608145:6609176,6612632:6613074,6615365:6615622,6618309:6618504,6620043:6620175,6620439:6620851,6621653:6621896,6626271:6626788,6627944:6628359,6630848:6646011,6631070:6649288,6631186:6634256,6631194:6649916,6631961:6655705,6632583:6662388,6632786:6635400,6632966:6670064,6635673:6637447,6635681:6637083,6637843:6638371,6638774:6639240,6641286:6641570,6646447:6647331,6648940:6649483,6650951:6653442,6654041:6654690,6657889:6658463,6664429:6665196,6668950:6669581,6671809:6672613,6673895:6674519,6681680:6683665,6683618:6684474,6685440:6720365,6685511:6720212,6686027:6719815,6686041:6720155,6686295:6687462,6686312:6687235,6686325:6686801,6688871:6714501,6690894:6698459,6693641:6696450,6696476:6696819,6710860:6711564,6711680:6712276,6712324:6712777,6716688:6717602,6718843:6720236,6720803:6721245,6722354:6722531,6723892:6724155,6738748:6739274,6740018:6740798,6740709:6745510,6744268:6745796,6748062:6750242,6753406:6754554,6753419:6754194,6759057:6759416,', 'assoc_mat': '6600538:pet_clair:4200:6600932,6601136:pet_clair:4200:6602056,6604397:pet_clair:4200:6604868,6605689:pet_clair:4200:6606116,6608145:pet_clair:4200:6609176,6612632:pet_clair:4200:6613074,6615365:pet_clair:4200:6615622,6618309:pet_clair:4200:6618504,6620043:pet_clair:4200:6620175,6620439:pet_clair:4200:6620851,6621653:pet_clair:4200:6621896,6626271:pet_clair:4200:6626788,6627944:pet_clair:4200:6628359,6630848:pet_clair:4200:6646011,6631070:pet_clair:4200:6649288,6631186:pet_clair:4200:6634256,6631194:pet_clair:4200:6649916,6631961:pet_clair:4200:6655705,6632583:pet_clair:4200:6662388,6632786:pet_clair:4200:6635400,6632966:pet_clair:4200:6670064,6635673:pet_clair:4200:6637447,6635681:pet_clair:4200:6637083,6637843:pet_clair:4200:6638371,6638774:pet_clair:4200:6639240,6641286:pet_clair:4200:6641570,6646447:pet_clair:4200:6647331,6648940:pet_clair:4200:6649483,6650951:pet_clair:4200:6653442,6654041:pet_clair:4200:6654690,6657889:pet_clair:4200:6658463,6664429:pet_clair:4200:6665196,6668950:pet_clair:4200:6669581,6'}, {'unwanted_material': 'pet_fonce', 'main_material': 'ela', 'pht_type': 4203, 'ratio': 0.00022092315643821876, 'nb_photo': 2, 'list_port_cont': '6712712,6806360', 'assoc_port': '6712332:6712712,6793236:6806360', 'assoc_mat': '6712332:pet_fonce:4203:6712712,6793236:pet_fonce:4203:6806360'}, {'unwanted_material': 'pet_fonce', 'main_material': 'pehd_pp', 'pht_type': 4211, 'ratio': 0.0003846699616495868, 'nb_photo': 87, 'list_port_cont': '6600861,6603394,6607677,6615422,6622000,6622197,6624062,6627276,6628479,6629185,6634858,6635145,6672029,6674545,6675144,6675478,6677810,6678775,6691486,6694039,6698430,6699376,6699426,6707232,6719024,6720655,6721843,6723783,6724752,6724915,6725834,6730262,6732433,6741928,6743868,6751578,6751686,6754292,6756063,6768401,6769194,6775051,6780889,6782985,6783127,6789494,6789900,6792092,6794401,6795573,6800465,6800534,6800819,6801501,6808800,6808842,6835780,6855452,6869892,6885665,6917719,6920225,6922977,10844443', 'assoc_port': '10844021:10844443,6600544:6600861,6602733:6603394,6606683:6607677,6614969:6615422,6621638:6624062,6621647:6622197,6621659:6622000,6627098:6627276,6627945:6628479,6628987:6629185,6630850:6634858,6631069:6675478,6631193:6635145,6631960:6677810,6632714:6678775,6635676:6694039,6640592:6707232,6647212:6719024,6651292:6721843,6654038:6724915,6654837:6725834,6668952:6751578,6671805:6756063,6671810:6672029,6673889:6674545,6674723:6675144,6683614:6789900,6683620:6691486,6686021:6855452,6686031:6800465,6686094:6800534,6686298:6800819,6686318:6801501,6688870:6732433,6690893:6730262,6694730:6699426,6696471:6699376,6696477:6698430,6720298:6720655,6723498:6723783,6724591:6724752,6741314:6741928,6743337:6743868,6750985:6751686,6753415:6754292,6764851:6808842,6765559:6808800,6767894:6768401,6768944:6769194,6773721:6775051,6780010:6780889,6782241:6782985,6782244:6783127,6788947:6789494,6791774:6792092,6793940:6794401,6795260:6795573,6833511:6869892,6835299:6835780,6885269:6885665,6916370:6917719,6919132:6920225,6920914:692297', 'assoc_mat': '10844021:pet_fonce:4211:10844443,6600544:pet_fonce:4211:6600861,6602733:pet_fonce:4211:6603394,6606683:pet_fonce:4211:6607677,6614969:pet_fonce:4211:6615422,6621638:pet_fonce:4211:6624062,6621647:pet_fonce:4211:6622197,6621659:pet_fonce:4211:6622000,6627098:pet_fonce:4211:6627276,6627945:pet_fonce:4211:6628479,6628987:pet_fonce:4211:6629185,6630850:pet_fonce:4211:6634858,6631069:pet_fonce:4211:6675478,6631193:pet_fonce:4211:6635145,6631960:pet_fonce:4211:6677810,6632714:pet_fonce:4211:6678775,6635676:pet_fonce:4211:6694039,6640592:pet_fonce:4211:6707232,6647212:pet_fonce:4211:6719024,6651292:pet_fonce:4211:6721843,6654038:pet_fonce:4211:6724915,6654837:pet_fonce:4211:6725834,6668952:pet_fonce:4211:6751578,6671805:pet_fonce:4211:6756063,6671810:pet_fonce:4211:6672029,6673889:pet_fonce:4211:6674545,6674723:pet_fonce:4211:6675144,6683614:pet_fonce:4211:6789900,6683620:pet_fonce:4211:6691486,6686021:pet_fonce:4211:6855452,6686031:pet_fonce:4211:6800465,6686094:pet_fonce:4211:6800534,6686298:pet_fonce:4211:6800819'}, {'unwanted_material': 'pet_fonce', 'main_material': 'pet_clair', 'pht_type': 3327, 'ratio': 0.0027937857287839945, 'nb_photo': 263, 'list_port_cont': '6601312,6601378,6602302,6604937,6607386,6607897,6609918,6610056,6614156,6616198,6617469,6618949,6621166,6621524,6622171,6622318,6622432,6622523,6627007,6627194,6628022,6628558,6628620,6629360,6629385,6635890,6636150,6636335,6637041,6637956,6638951,6639300,6639360,6639649,6639843,6639963,6640116,6641206,6641660,6642031,6642088,6643666,6643686,6644074,6645311,6645758,6647413,6648013,6648348,6651389,6651678,6652033,6652947,6653022,6654605,6655887,6658048,6659096,6660216,6665644,6665949,6668610,6672473,6673067,6674828,6675455,6682558,6684379,6686720,6687693,6687751,6688499,6688987,6689537,6689587,6689850,6690097,6690214,6690635,6692361,6692530,6692691,6693861,6694779,6695712,6696111,6697041,6697340,6697715,6697768,6697941,6698112,6698730,6698987,6711529,6712340,6712870,6713125,6713218,6713281,6719368,6721992,6722018,6722072,6722229,6723374,6723733,6724035,6725340,6740139,6740418,6742670,6743702,6744133,6748415,6748972,6749009,6749528,6750026,6751763,6754264,6754530,6758447,6759452,6760150,6760421,6765840,6766308,', 'assoc_port': '6600545:6601378,6600553:6601312,6601140:6602302,6604400:6604937,6606685:6607897,6606687:6607386,6609197:6610056,6609198:6609918,6613333:6614156,6614966:6616198,6616966:6617469,6618310:6618949,6620445:6621166,6620446:6621524,6621645:6622523,6621652:6622432,6621655:6622171,6621661:6622318,6626272:6627007,6626275:6627194,6627099:6628022,6627946:6628558,6627948:6628620,6628988:6629360,6628991:6629385,6631066:6641660,6631073:6639649,6631075:6639963,6631076:6639360,6631185:6638951,6631476:6640116,6631964:6642088,6632584:6645758,6632785:6635890,6632788:6643666,6632880:6636335,6632882:6644074,6632968:6645311,6633861:6637041,6635680:6636150,6637237:6637956,6637846:6639300,6638772:6639843,6640591:6641206,6640596:6643686,6641258:6642031,6646445:6648013,6646448:6647413,6647213:6648348,6649832:6652033,6650508:6651389,6650511:6651678,6650952:6652947,6652019:6653022,6653519:6654605,6654835:6655887,6654836:6659096,6656899:6658048,6657892:6660216,6664425:6665644,6664427:6665949,6667559:6668610,6671807:6672473,6671811:6673067,', 'assoc_mat': '6600545:pet_fonce:3327:6601378,6600553:pet_fonce:3327:6601312,6601140:pet_fonce:3327:6602302,6604400:pet_fonce:3327:6604937,6606685:pet_fonce:3327:6607897,6606687:pet_fonce:3327:6607386,6609197:pet_fonce:3327:6610056,6609198:pet_fonce:3327:6609918,6613333:pet_fonce:3327:6614156,6614966:pet_fonce:3327:6616198,6616966:pet_fonce:3327:6617469,6618310:pet_fonce:3327:6618949,6620445:pet_fonce:3327:6621166,6620446:pet_fonce:3327:6621524,6621645:pet_fonce:3327:6622523,6621652:pet_fonce:3327:6622432,6621655:pet_fonce:3327:6622171,6621661:pet_fonce:3327:6622318,6626272:pet_fonce:3327:6627007,6626275:pet_fonce:3327:6627194,6627099:pet_fonce:3327:6628022,6627946:pet_fonce:3327:6628558,6627948:pet_fonce:3327:6628620,6628988:pet_fonce:3327:6629360,6628991:pet_fonce:3327:6629385,6631066:pet_fonce:3327:6641660,6631073:pet_fonce:3327:6639649,6631075:pet_fonce:3327:6639963,6631076:pet_fonce:3327:6639360,6631185:pet_fonce:3327:6638951,6631476:pet_fonce:3327:6640116,6631964:pet_fonce:3327:6642088,6632584:pet_fonce:3327:6645758,6'}, {'unwanted_material': 'pet_fonce', 'main_material': 'pet_fonce', 'pht_type': 4200, 'ratio': 0.9433959349191054, 'nb_photo': 1865, 'list_port_cont': '6600921,6602052,6604879,6606107,6609173,6613064,6615625,6618497,6620185,6620862,6621905,6626786,6628358,6634244,6635391,6637070,6637445,6638364,6639248,6641566,6646009,6647335,6649279,6649476,6649915,6653441,6654686,6655703,6658466,6662391,6665191,6669589,6670061,6672609,6674517,6683670,6684465,6686804,6687227,6687466,6696439,6696818,6698462,6711554,6712271,6712775,6714495,6717596,6719814,6720150,6720211,6720250,6720367,6721247,6722527,6724149,6739286,6740801,6745519,6745787,6750252,6754190,6754558,6759425,6765276,6766699,6767360,6780401,6780523,6780723,6784025,6786849,6788646,6791336,6793695,6795539,6797667,6813921,6817652,6821383,6824097,6835196,6836551,6840207,6842434,6849224,6851782,6852366,6854523,6859029,6862727,6865773,6866335,6867976,6869266,6874407,6875753,6875975,6882723,6886803,6888103,6889495,6895281,6900334,6902509,6904835,6914448,6920755,6921623,6924260', 'assoc_port': '6600538:6600921,6601136:6602052,6604397:6604879,6605689:6606107,6608145:6609173,6612632:6613064,6615365:6615625,6618309:6618497,6620043:6620185,6620439:6620862,6621653:6621905,6626271:6626786,6627944:6628358,6630848:6646009,6631070:6649279,6631186:6634244,6631194:6649915,6631961:6655703,6632583:6662391,6632786:6635391,6632966:6670061,6635673:6637445,6635681:6637070,6637843:6638364,6638774:6639248,6641286:6641566,6646447:6647335,6648940:6649476,6650951:6653441,6654041:6654686,6657889:6658466,6664429:6665191,6668950:6669589,6671809:6672609,6673895:6674517,6681680:6683670,6683618:6684465,6685440:6720367,6685511:6720211,6686027:6719814,6686041:6720150,6686295:6687466,6686312:6687227,6686325:6686804,6688871:6714495,6690894:6698462,6693641:6696439,6696476:6696818,6710860:6711554,6711680:6712271,6712324:6712775,6716688:6717596,6718843:6720250,6720803:6721247,6722354:6722527,6723892:6724149,6738748:6739286,6740018:6740801,6740709:6745519,6744268:6745787,6748062:6750252,6753406:6754558,6753419:6754190,6759057:6759425,', 'assoc_mat': '6600538:pet_fonce:4200:6600921,6601136:pet_fonce:4200:6602052,6604397:pet_fonce:4200:6604879,6605689:pet_fonce:4200:6606107,6608145:pet_fonce:4200:6609173,6612632:pet_fonce:4200:6613064,6615365:pet_fonce:4200:6615625,6618309:pet_fonce:4200:6618497,6620043:pet_fonce:4200:6620185,6620439:pet_fonce:4200:6620862,6621653:pet_fonce:4200:6621905,6626271:pet_fonce:4200:6626786,6627944:pet_fonce:4200:6628358,6630848:pet_fonce:4200:6646009,6631070:pet_fonce:4200:6649279,6631186:pet_fonce:4200:6634244,6631194:pet_fonce:4200:6649915,6631961:pet_fonce:4200:6655703,6632583:pet_fonce:4200:6662391,6632786:pet_fonce:4200:6635391,6632966:pet_fonce:4200:6670061,6635673:pet_fonce:4200:6637445,6635681:pet_fonce:4200:6637070,6637843:pet_fonce:4200:6638364,6638774:pet_fonce:4200:6639248,6641286:pet_fonce:4200:6641566,6646447:pet_fonce:4200:6647335,6648940:pet_fonce:4200:6649476,6650951:pet_fonce:4200:6653441,6654041:pet_fonce:4200:6654686,6657889:pet_fonce:4200:6658466,6664429:pet_fonce:4200:6665191,6668950:pet_fonce:4200:6669589,6'}, {'unwanted_material': 'pet_opaque', 'main_material': 'ela', 'pht_type': 4203, 'ratio': 0.0009264502462378221, 'nb_photo': 9, 'list_port_cont': '6608814,6660097,6712722,6735145,6799275,6808109,6869931', 'assoc_port': '6608146:6608814,6632879:6660097,6685476:6799275,6690887:6735145,6712332:6712722,6786466:6808109,6869544:6869931', 'assoc_mat': '6608146:pet_opaque:4203:6608814,6632879:pet_opaque:4203:6660097,6685476:pet_opaque:4203:6799275,6690887:pet_opaque:4203:6735145,6712332:pet_opaque:4203:6712722,6786466:pet_opaque:4203:6808109,6869544:pet_opaque:4203:6869931'}, {'unwanted_material': 'pet_opaque', 'main_material': 'emr', 'pht_type': 4209, 'ratio': 0.007255625347838711, 'nb_photo': 19, 'list_port_cont': '6616740,6617521,6620419,6621938,6627043,6638500,6668139,6668209,6670564,6670896,6678093,6740485,6791207', 'assoc_port': '6616168:6616740,6616963:6617521,6620037:6620419,6621646:6621938,6626722:6627043,6631190:6668139,6631196:6668209,6632661:6670564,6632883:6670896,6638162:6638500,6677866:6678093,6740030:6740485,6790915:6791207', 'assoc_mat': '6616168:pet_opaque:4209:6616740,6616963:pet_opaque:4209:6617521,6620037:pet_opaque:4209:6620419,6621646:pet_opaque:4209:6621938,6626722:pet_opaque:4209:6627043,6631190:pet_opaque:4209:6668139,6631196:pet_opaque:4209:6668209,6632661:pet_opaque:4209:6670564,6632883:pet_opaque:4209:6670896,6638162:pet_opaque:4209:6638500,6677866:pet_opaque:4209:6678093,6740030:pet_opaque:4209:6740485,6790915:pet_opaque:4209:6791207'}, {'unwanted_material': 'pet_opaque', 'main_material': 'pehd_pp', 'pht_type': 4211, 'ratio': 0.0016345171833525593, 'nb_photo': 222, 'list_port_cont': '6600901,6602283,6603013,6606069,6608294,6610401,6610657,6611146,6614528,6615400,6621062,6621675,6621998,6622129,6622205,6626613,6629184,6629244,6634651,6635837,6638286,6639164,6650157,6668179,6669616,6672038,6674023,6674634,6674773,6675099,6675136,6677119,6677811,6678215,6678578,6678957,6679224,6681250,6691510,6691659,6693900,6694213,6694417,6698434,6698768,6698799,6699430,6711411,6711493,6712146,6712497,6712754,6713439,6716561,6717501,6717546,6718028,6719452,6720657,6720722,6724914,6725690,6725833,6728841,6729870,6730329,6730727,6731863,6732437,6735376,6738126,6740205,6740607,6741938,6743382,6745286,6751579,6751673,6754142,6754990,6755968,6756060,6756975,6762171,6763524,6767274,6768410,6773018,6774679,6775056,6778932,6780264,6780486,6783061,6791499,6793831,6794248,6794400,6795572,6796823,6799103,6799441,6799779,6800492,6800530,6801272,6801402,6806174,6808133,6808682,6808713,6808832,6808873,6809086,6810005,6815419,6822330,6839899,6842610,6853846,6855228,6855448,6863478,6866679,6869888,6870654,6875922,6890225,', 'assoc_port': '10844011:10845551,10844021:10844440,6600551:6600901,6601649:6602283,6602728:6603013,6605499:6610657,6605688:6606069,6607835:6610401,6607839:6608294,6610992:6611146,6614199:6614528,6614967:6615400,6620422:6621675,6620444:6621062,6621647:6622205,6621651:6622129,6621659:6621998,6626268:6626613,6628987:6629184,6628989:6629244,6630852:6674023,6630856:6634651,6630932:6674634,6630935:6674773,6630939:6675099,6631489:6677119,6631960:6677811,6632585:6678215,6632660:6678578,6632877:6678957,6632963:6679224,6633862:6635837,6635671:6693900,6635682:6694213,6637236:6698768,6637845:6638286,6638776:6639164,6640595:6806174,6647215:6717546,6648944:6650157,6653523:6725690,6654038:6724914,6654837:6725833,6655426:6728841,6656895:6729870,6657891:6731863,6666361:6668179,6668952:6751579,6668953:6669616,6671805:6756060,6671810:6672038,6672701:6755968,6674723:6675136,6681005:6681250,6683620:6691510,6685431:6799103,6685494:6799441,6685525:6799779,6686006:6855228,6686021:6855448,6686094:6800530,6686269:6800492,6686302:6801272,6686308:6801', 'assoc_mat': '10844011:pet_opaque:4211:10845551,10844021:pet_opaque:4211:10844440,6600551:pet_opaque:4211:6600901,6601649:pet_opaque:4211:6602283,6602728:pet_opaque:4211:6603013,6605499:pet_opaque:4211:6610657,6605688:pet_opaque:4211:6606069,6607835:pet_opaque:4211:6610401,6607839:pet_opaque:4211:6608294,6610992:pet_opaque:4211:6611146,6614199:pet_opaque:4211:6614528,6614967:pet_opaque:4211:6615400,6620422:pet_opaque:4211:6621675,6620444:pet_opaque:4211:6621062,6621647:pet_opaque:4211:6622205,6621651:pet_opaque:4211:6622129,6621659:pet_opaque:4211:6621998,6626268:pet_opaque:4211:6626613,6628987:pet_opaque:4211:6629184,6628989:pet_opaque:4211:6629244,6630852:pet_opaque:4211:6674023,6630856:pet_opaque:4211:6634651,6630932:pet_opaque:4211:6674634,6630935:pet_opaque:4211:6674773,6630939:pet_opaque:4211:6675099,6631489:pet_opaque:4211:6677119,6631960:pet_opaque:4211:6677811,6632585:pet_opaque:4211:6678215,6632660:pet_opaque:4211:6678578,6632877:pet_opaque:4211:6678957,6632963:pet_opaque:4211:6679224,6633862:pet_opaque:4211:6635'}, {'unwanted_material': 'pet_opaque', 'main_material': 'pet_fonce', 'pht_type': 4200, 'ratio': 0.006625372408584668, 'nb_photo': 447, 'list_port_cont': '6600927,6602060,6604867,6606114,6609165,6613073,6615618,6618507,6620186,6620865,6621897,6626785,6628362,6634254,6635389,6637069,6637443,6638357,6639233,6641563,6646016,6647330,6649289,6649475,6649908,6653440,6654682,6655700,6658472,6662384,6665186,6669577,6670052,6672606,6674518,6683671,6684478,6686802,6687225,6687464,6696442,6696817,6698458,6711562,6712277,6712786,6714508,6717607,6719819,6720158,6720206,6720247,6720358,6721243,6722532,6724146,6739282,6740800,6745521,6745789,6750245,6754191,6754564,6759415,6765265,6766702,6767358,6780406,6780528,6780714,6784016,6786843,6788645,6791330,6793704,6795548,6797668,6817665,6821371,6824096,6835190,6840200,6842443,6849228,6851781,6852374,6854530,6859022,6862735,6865768,6866326,6867982,6869259,6874403,6875763,6882730,6886804,6888096,6889498,6895283,6900338,6902503,6904834,6914452,6920753,6921628,6924247', 'assoc_port': '6600538:6600927,6601136:6602060,6604397:6604867,6605689:6606114,6608145:6609165,6612632:6613073,6615365:6615618,6618309:6618507,6620043:6620186,6620439:6620865,6621653:6621897,6626271:6626785,6627944:6628362,6630848:6646016,6631070:6649289,6631186:6634254,6631194:6649908,6631961:6655700,6632583:6662384,6632786:6635389,6632966:6670052,6635673:6637443,6635681:6637069,6637843:6638357,6638774:6639233,6641286:6641563,6646447:6647330,6648940:6649475,6650951:6653440,6654041:6654682,6657889:6658472,6664429:6665186,6668950:6669577,6671809:6672606,6673895:6674518,6681680:6683671,6683618:6684478,6685440:6720358,6685511:6720206,6686027:6719819,6686041:6720158,6686295:6687464,6686312:6687225,6686325:6686802,6688871:6714508,6690894:6698458,6693641:6696442,6696476:6696817,6710860:6711562,6711680:6712277,6712324:6712786,6716688:6717607,6718843:6720247,6720803:6721243,6722354:6722532,6723892:6724146,6738748:6739282,6740018:6740800,6740709:6745521,6744268:6745789,6748062:6750245,6753406:6754564,6753419:6754191,6759057:6759415,', 'assoc_mat': '6600538:pet_opaque:4200:6600927,6601136:pet_opaque:4200:6602060,6604397:pet_opaque:4200:6604867,6605689:pet_opaque:4200:6606114,6608145:pet_opaque:4200:6609165,6612632:pet_opaque:4200:6613073,6615365:pet_opaque:4200:6615618,6618309:pet_opaque:4200:6618507,6620043:pet_opaque:4200:6620186,6620439:pet_opaque:4200:6620865,6621653:pet_opaque:4200:6621897,6626271:pet_opaque:4200:6626785,6627944:pet_opaque:4200:6628362,6630848:pet_opaque:4200:6646016,6631070:pet_opaque:4200:6649289,6631186:pet_opaque:4200:6634254,6631194:pet_opaque:4200:6649908,6631961:pet_opaque:4200:6655700,6632583:pet_opaque:4200:6662384,6632786:pet_opaque:4200:6635389,6632966:pet_opaque:4200:6670052,6635673:pet_opaque:4200:6637443,6635681:pet_opaque:4200:6637069,6637843:pet_opaque:4200:6638357,6638774:pet_opaque:4200:6639233,6641286:pet_opaque:4200:6641563,6646447:pet_opaque:4200:6647330,6648940:pet_opaque:4200:6649475,6650951:pet_opaque:4200:6653440,6654041:pet_opaque:4200:6654682,6657889:pet_opaque:4200:6658472,6664429:pet_opaque:4200:6665186,'}, {'unwanted_material': 'textiles_sanitaires', 'main_material': 'ela', 'pht_type': 4203, 'ratio': 5.317677982697793e-05, 'nb_photo': 1, 'list_port_cont': '6754069', 'assoc_port': '6753416:6754069', 'assoc_mat': '6753416:textiles_sanitaires:4203:6754069'}, {'unwanted_material': 'textiles_sanitaires', 'main_material': 'pehd_pp', 'pht_type': 4211, 'ratio': 0.00014015295179752374, 'nb_photo': 14, 'list_port_cont': '6608063,6675111,6678967,6709734,6720656,6724749,6725824,6735649,6787860,6791503,6813248,6828520,6855445,10845973', 'assoc_port': '10844012:10845973,6604399:6608063,6630939:6675111,6632877:6678967,6654837:6725824,6663625:6735649,6686021:6855445,6709374:6709734,6720298:6720656,6724591:6724749,6787210:6787860,6790919:6791503,6812962:6813248,6814154:6828520', 'assoc_mat': '10844012:textiles_sanitaires:4211:10845973,6604399:textiles_sanitaires:4211:6608063,6630939:textiles_sanitaires:4211:6675111,6632877:textiles_sanitaires:4211:6678967,6654837:textiles_sanitaires:4211:6725824,6663625:textiles_sanitaires:4211:6735649,6686021:textiles_sanitaires:4211:6855445,6709374:textiles_sanitaires:4211:6709734,6720298:textiles_sanitaires:4211:6720656,6724591:textiles_sanitaires:4211:6724749,6787210:textiles_sanitaires:4211:6787860,6790919:textiles_sanitaires:4211:6791503,6812962:textiles_sanitaires:4211:6813248,6814154:textiles_sanitaires:4211:6828520'}), 'main_stat': {'nb_photos': 29394}}, 'hostname': (('raspi-64',),), 'impurety_average_per_hashtag': [(('emr', '2022-08', 0.03139712425437559),), (('jrm', '2022-08', 0.00838254816722681),), (('aluminium', '2022-08', 0.006832126052700646),), (('pet_fonce', '2022-08', 0.012910461966287217),), (('gm', '2022-08', 0.009116560536537937),)]} ############################### TEST csv ################################ Removing /home/admin/workarea/git/Velours/python/prod/memo/sla_csv VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3980 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3980 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3980 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3980 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! {"input_values":[]} SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3994 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3994 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3994 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3994 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11488 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11496 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11497 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11492 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11492 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11495 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11495 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11489 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11489 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11575 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11575 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11491 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11490 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11490 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11498 send_mail_cod have less outputs used (0) than in the step definition (1) : some outputs may be not used ! Step 11499 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11491 doesn't seem to be define in the database( WARNING : type of input 3 of step 11490 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11488 doesn't seem to be define in the database( WARNING : type of input 2 of step 11492 doesn't seem to be define in the database( WARNING : output 1 of step 11488 have datatype=2 whereas input 1 of step 11495 have datatype=7 WARNING : type of output 2 of step 11495 doesn't seem to be define in the database( WARNING : type of input 1 of step 11489 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11491 have datatype=10 whereas input 3 of step 11498 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11575 doesn't seem to be define in the database( WARNING : output 1 of step 11489 have datatype=7 whereas input 2 of step 11575 have datatype=None WARNING : type of output 3 of step 11575 doesn't seem to be define in the database( WARNING : type of input 1 of step 11491 doesn't seem to be define in the database( WARNING : output 0 of step 11491 have datatype=10 whereas input 0 of step 11581 have datatype=18 WARNING : type of input 5 of step 11498 doesn't seem to be define in the database( WARNING : output 0 of step 11581 have datatype=11 whereas input 5 of step 11498 have datatype=None WARNING : type of output 1 of step 11496 doesn't seem to be define in the database( WARNING : type of input 3 of step 11492 doesn't seem to be define in the database( WARNING : type of output 1 of step 11497 doesn't seem to be define in the database( WARNING : type of input 3 of step 11492 doesn't seem to be define in the database( WARNING : output 0 of step 11495 have datatype=1 whereas input 0 of step 11489 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4209, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,metal,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'papier,background', 'hashtag_weights': {'barquette_opaque': 0.7, 'carton': 0.7, 'ela': 0.7, 'etiquette': 0.5, 'film_plastique': 0.5, 'kraft': 0.7, 'metal': 1.5, 'pehd': 0.7, 'pet_clair': 0.7, 'pet_opaque': 0.7, 'textiles_sanitaires': 0.5, 'pet_fonce': 0.7}, 'ETA': 600} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3993 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3993 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3993 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3993 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4207, 'hashtag_proportion': 'barquette_opaque,ela,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'carton,background', 'hashtag_weights': {'barquette_opaque': 1, 'ela': 1, 'etiquette': 1.0, 'film_plastique': 0.5, 'kraft': 1, 'metal': 3.0, 'papier': 1, 'pehd': 2, 'pet_clair': 2, 'pet_opaque': 2, 'textiles_sanitaires': 1.0, 'pet_fonce': 2}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3459 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3459 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3459 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3459 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3726, 'hashtag_proportion': 'Carton_brun,Carton_gris,Teint_Dans_La_Masse,autre_refus,cartonnette,kraft,metal,plastique', 'hashtag_parmi': 'papier,background', 'hashtag_weights': {'Carton_brun': 1.5, 'Carton_gris': 1.5, 'Teint_Dans_La_Masse': 1.0, 'autre_refus': 1.5, 'cartonnette': 1.0, 'kraft': 1.5, 'metal': 3, 'plastique': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3991 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3991 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3991 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3991 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11512 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11521 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11520 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11516 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11516 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11519 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11519 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11513 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11513 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11577 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11577 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11515 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11514 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11514 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11523 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11515 doesn't seem to be define in the database( WARNING : type of input 3 of step 11514 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11512 doesn't seem to be define in the database( WARNING : type of input 2 of step 11516 doesn't seem to be define in the database( WARNING : output 1 of step 11512 have datatype=2 whereas input 1 of step 11519 have datatype=7 WARNING : type of output 2 of step 11519 doesn't seem to be define in the database( WARNING : type of input 1 of step 11513 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11515 have datatype=10 whereas input 3 of step 11522 have datatype=6 WARNING : type of input 2 of step 11577 doesn't seem to be define in the database( WARNING : output 1 of step 11513 have datatype=7 whereas input 2 of step 11577 have datatype=None WARNING : type of output 3 of step 11577 doesn't seem to be define in the database( WARNING : type of input 1 of step 11515 doesn't seem to be define in the database( WARNING : output 0 of step 11515 have datatype=10 whereas input 0 of step 11583 have datatype=18 WARNING : type of input 5 of step 11522 doesn't seem to be define in the database( WARNING : output 0 of step 11583 have datatype=11 whereas input 5 of step 11522 have datatype=None WARNING : type of output 1 of step 11521 doesn't seem to be define in the database( WARNING : type of input 3 of step 11516 doesn't seem to be define in the database( WARNING : type of output 1 of step 11520 doesn't seem to be define in the database( WARNING : type of input 3 of step 11516 doesn't seem to be define in the database( WARNING : output 0 of step 11519 have datatype=1 whereas input 0 of step 11513 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4203, 'hashtag_proportion': 'barquette_opaque,carton,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'ela,background', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 1, 'etiquette': 0.5, 'film_plastique': 0.5, 'kraft': 0.8, 'metal': 2, 'papier': 0.8, 'pehd': 0.8, 'pet_clair': 0.8, 'pet_opaque': 0.8, 'textiles_sanitaires': 0.5, 'pet_fonce': 0.8}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3804 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3804 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3804 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3804 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11560 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11567 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11567 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11563 crop_condition is not consistent : 4 used against 2 in the step definition ! Step 11563 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11564 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11564 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11573 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11573 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11566 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11566 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 1 of step 11560 have datatype=2 whereas input 1 of step 11564 have datatype=7 WARNING : type of output 2 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11565 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11567 doesn't seem to be define in the database( WARNING : type of input 3 of step 11563 doesn't seem to be define in the database( WARNING : type of output 3 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11568 doesn't seem to be define in the database( WARNING : type of output 1 of step 11568 doesn't seem to be define in the database( WARNING : type of input 3 of step 11566 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11570 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11569 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11570 doesn't seem to be define in the database( WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11569 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11568 have datatype=10 whereas input 3 of step 11571 have datatype=6 WARNING : type of input 2 of step 11573 doesn't seem to be define in the database( WARNING : output 1 of step 11565 have datatype=7 whereas input 2 of step 11573 have datatype=None WARNING : type of output 3 of step 11573 doesn't seem to be define in the database( WARNING : type of input 3 of step 11568 doesn't seem to be define in the database( WARNING : output 0 of step 11568 have datatype=10 whereas input 0 of step 11587 have datatype=18 WARNING : type of input 5 of step 11571 doesn't seem to be define in the database( WARNING : output 0 of step 11587 have datatype=11 whereas input 5 of step 11571 have datatype=None WARNING : output 0 of step 11564 have datatype=1 whereas input 0 of step 11565 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3327, 'hashtag_proportion': 'autre,carton,metal,papier,pehd,pet_fonce', 'hashtag_parmi': 'pet_clair,bouchon,etiquette,barquette_avec_film,background', 'hashtag_weights': {'autre': 8.0, 'barquette_avec_film': 6, 'carton': 8.0, 'metal': 12, 'papier': 5, 'pehd': 8, 'pet_fonce': 8, 'bouchon': 8, 'etiquette': 8}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4322 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4322 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4322 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4322 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11978 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11987 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11986 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11982 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11982 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11985 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11985 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11979 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11979 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11990 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11990 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11981 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11980 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11980 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11989 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11981 doesn't seem to be define in the database( WARNING : type of input 3 of step 11980 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11978 doesn't seem to be define in the database( WARNING : type of input 2 of step 11982 doesn't seem to be define in the database( WARNING : output 1 of step 11978 have datatype=2 whereas input 1 of step 11985 have datatype=7 WARNING : type of output 2 of step 11985 doesn't seem to be define in the database( WARNING : type of input 1 of step 11979 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11981 have datatype=10 whereas input 3 of step 11988 have datatype=6 WARNING : type of input 2 of step 11990 doesn't seem to be define in the database( WARNING : output 1 of step 11979 have datatype=7 whereas input 2 of step 11990 have datatype=None WARNING : type of output 3 of step 11990 doesn't seem to be define in the database( WARNING : type of input 1 of step 11981 doesn't seem to be define in the database( WARNING : output 0 of step 11981 have datatype=10 whereas input 0 of step 11991 have datatype=18 WARNING : type of input 5 of step 11988 doesn't seem to be define in the database( WARNING : output 0 of step 11991 have datatype=11 whereas input 5 of step 11988 have datatype=None WARNING : type of output 1 of step 11987 doesn't seem to be define in the database( WARNING : type of input 3 of step 11982 doesn't seem to be define in the database( WARNING : type of output 1 of step 11986 doesn't seem to be define in the database( WARNING : type of input 3 of step 11982 doesn't seem to be define in the database( WARNING : output 0 of step 11985 have datatype=1 whereas input 0 of step 11979 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4461, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,pehd,kraft,metal,papier,pet_fonce,pet_clair,pet_opaque,textiles_sanitaires', 'hashtag_parmi': 'film_plastique', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 0.3, 'ela': 0.3, 'etiquette': 0.1, 'film_plastique': 0.1, 'kraft': 0.3, 'metal': 1.5, 'papier': 0.3, 'pet_clair': 0.3, 'pet_opaque': 0.3, 'textiles_sanitaires': 0.3, 'pet_fonce': 0.3}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3995 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3995 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3995 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3995 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11524 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11533 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11532 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11528 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11528 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11531 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11531 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11525 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11525 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11578 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11578 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11527 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11526 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11526 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11535 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11527 doesn't seem to be define in the database( WARNING : type of input 3 of step 11526 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11524 doesn't seem to be define in the database( WARNING : type of input 2 of step 11528 doesn't seem to be define in the database( WARNING : output 1 of step 11524 have datatype=2 whereas input 1 of step 11531 have datatype=7 WARNING : type of output 2 of step 11531 doesn't seem to be define in the database( WARNING : type of input 1 of step 11525 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11527 have datatype=10 whereas input 3 of step 11534 have datatype=6 WARNING : type of input 2 of step 11578 doesn't seem to be define in the database( WARNING : output 1 of step 11525 have datatype=7 whereas input 2 of step 11578 have datatype=None WARNING : type of output 3 of step 11578 doesn't seem to be define in the database( WARNING : type of input 1 of step 11527 doesn't seem to be define in the database( WARNING : output 0 of step 11527 have datatype=10 whereas input 0 of step 11584 have datatype=18 WARNING : type of input 5 of step 11534 doesn't seem to be define in the database( WARNING : output 0 of step 11584 have datatype=11 whereas input 5 of step 11534 have datatype=None WARNING : type of output 1 of step 11533 doesn't seem to be define in the database( WARNING : type of input 3 of step 11528 doesn't seem to be define in the database( WARNING : type of output 1 of step 11532 doesn't seem to be define in the database( WARNING : type of input 3 of step 11528 doesn't seem to be define in the database( WARNING : output 0 of step 11531 have datatype=1 whereas input 0 of step 11525 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4211, 'hashtag_proportion': 'barquette_opaque,carton,ela,film_plastique,kraft,metal,papier,pet_fonce,pet_clair,pet_opaque,textiles_sanitaires', 'hashtag_parmi': 'pehd,etiquette,background', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 0.3, 'ela': 0.3, 'etiquette': 0.1, 'film_plastique': 0.1, 'kraft': 0.3, 'metal': 1.5, 'papier': 0.3, 'pet_clair': 0.3, 'pet_opaque': 0.3, 'textiles_sanitaires': 0.3, 'pet_fonce': 0.3, 'background': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4153 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4153 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4153 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4153 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11548 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11556 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11557 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11552 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11552 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11555 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11555 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11580 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11580 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11551 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11550 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11550 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11559 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11551 doesn't seem to be define in the database( WARNING : type of input 3 of step 11550 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11548 doesn't seem to be define in the database( WARNING : type of input 2 of step 11552 doesn't seem to be define in the database( WARNING : output 1 of step 11548 have datatype=2 whereas input 1 of step 11555 have datatype=7 WARNING : type of output 2 of step 11555 doesn't seem to be define in the database( WARNING : type of input 1 of step 11549 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11551 have datatype=10 whereas input 3 of step 11558 have datatype=6 WARNING : type of input 2 of step 11580 doesn't seem to be define in the database( WARNING : output 1 of step 11549 have datatype=7 whereas input 2 of step 11580 have datatype=None WARNING : type of output 3 of step 11580 doesn't seem to be define in the database( WARNING : type of input 1 of step 11551 doesn't seem to be define in the database( WARNING : output 0 of step 11551 have datatype=10 whereas input 0 of step 11586 have datatype=18 WARNING : type of input 5 of step 11558 doesn't seem to be define in the database( WARNING : output 0 of step 11586 have datatype=11 whereas input 5 of step 11558 have datatype=None WARNING : type of output 1 of step 11556 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : type of output 1 of step 11557 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : output 0 of step 11555 have datatype=1 whereas input 0 of step 11549 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4200, 'hashtag_proportion': 'carton,ela,film_plastique,kraft,metal,papier,pehd,pet_opaque,textiles_sanitaires,barquette_opaque,pet_clair', 'hashtag_parmi': 'pet_fonce,etiquette,background', 'hashtag_weights': {'barquette_opaque': 1.5, 'carton': 2.5, 'ela': 1.5, 'etiquette': 1.5, 'film_plastique': 1, 'kraft': 1.5, 'metal': 3.0, 'papier': 1.2, 'pehd': 1.5, 'pet_clair': 1.5, 'pet_opaque': 1.5, 'textiles_sanitaires': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3992 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3992 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3992 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3992 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11536 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11545 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11544 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11540 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11540 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11543 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11543 merge_mask_thcl_custom have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 11537 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11579 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11579 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11539 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11538 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11538 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11547 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11539 doesn't seem to be define in the database( WARNING : type of input 3 of step 11538 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11536 doesn't seem to be define in the database( WARNING : type of input 2 of step 11540 doesn't seem to be define in the database( WARNING : output 1 of step 11536 have datatype=2 whereas input 1 of step 11543 have datatype=7 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11539 have datatype=10 whereas input 3 of step 11546 have datatype=6 WARNING : type of input 2 of step 11579 doesn't seem to be define in the database( WARNING : output 1 of step 11537 have datatype=7 whereas input 2 of step 11579 have datatype=None WARNING : type of output 3 of step 11579 doesn't seem to be define in the database( WARNING : type of input 1 of step 11539 doesn't seem to be define in the database( WARNING : output 0 of step 11539 have datatype=10 whereas input 0 of step 11585 have datatype=18 WARNING : type of input 5 of step 11546 doesn't seem to be define in the database( WARNING : output 0 of step 11585 have datatype=11 whereas input 5 of step 11546 have datatype=None WARNING : type of output 1 of step 11545 doesn't seem to be define in the database( WARNING : type of input 3 of step 11540 doesn't seem to be define in the database( WARNING : type of output 1 of step 11544 doesn't seem to be define in the database( WARNING : type of input 3 of step 11540 doesn't seem to be define in the database( WARNING : output 0 of step 11543 have datatype=1 whereas input 0 of step 11537 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4205, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'metal,background', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 1.5, 'ela': 1.5, 'etiquette': 1, 'film_plastique': 1, 'kraft': 1, 'papier': 1, 'pehd': 1.5, 'pet_clair': 1.5, 'pet_opaque': 1.5, 'textiles_sanitaires': 1.5, 'pet_fonce': 1.5}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3318 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3318 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3318 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3594, 'hashtag_proportion': 'papier,carton,metal,pet_clair,autre,pehd,pet_fonce', 'hashtag_parmi': 'refus,background', 'hashtag_weights': {'papier': 1, 'carton': 1, 'metal': 1, 'pet_clair': 1, 'autre': 1, 'pehd': 1, 'pet_fonce': 1, 'refus': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier TODO : Insert select and so on SELECT id, name, misc_info, datou_id_for_right FROM MTRPhoto.dashboard_places WHERE name="Romainville_Presse_1"; SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3980 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3980 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3980 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3980 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! {"input_values":[]} SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3994 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3994 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3994 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3994 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11488 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11496 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11497 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11492 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11492 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11495 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11495 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11489 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11489 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11575 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11575 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11491 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11490 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11490 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11498 send_mail_cod have less outputs used (0) than in the step definition (1) : some outputs may be not used ! Step 11499 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11491 doesn't seem to be define in the database( WARNING : type of input 3 of step 11490 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11488 doesn't seem to be define in the database( WARNING : type of input 2 of step 11492 doesn't seem to be define in the database( WARNING : output 1 of step 11488 have datatype=2 whereas input 1 of step 11495 have datatype=7 WARNING : type of output 2 of step 11495 doesn't seem to be define in the database( WARNING : type of input 1 of step 11489 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11491 have datatype=10 whereas input 3 of step 11498 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11575 doesn't seem to be define in the database( WARNING : output 1 of step 11489 have datatype=7 whereas input 2 of step 11575 have datatype=None WARNING : type of output 3 of step 11575 doesn't seem to be define in the database( WARNING : type of input 1 of step 11491 doesn't seem to be define in the database( WARNING : output 0 of step 11491 have datatype=10 whereas input 0 of step 11581 have datatype=18 WARNING : type of input 5 of step 11498 doesn't seem to be define in the database( WARNING : output 0 of step 11581 have datatype=11 whereas input 5 of step 11498 have datatype=None WARNING : type of output 1 of step 11496 doesn't seem to be define in the database( WARNING : type of input 3 of step 11492 doesn't seem to be define in the database( WARNING : type of output 1 of step 11497 doesn't seem to be define in the database( WARNING : type of input 3 of step 11492 doesn't seem to be define in the database( WARNING : output 0 of step 11495 have datatype=1 whereas input 0 of step 11489 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4209, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,metal,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'papier,background', 'hashtag_weights': {'barquette_opaque': 0.7, 'carton': 0.7, 'ela': 0.7, 'etiquette': 0.5, 'film_plastique': 0.5, 'kraft': 0.7, 'metal': 1.5, 'pehd': 0.7, 'pet_clair': 0.7, 'pet_opaque': 0.7, 'textiles_sanitaires': 0.5, 'pet_fonce': 0.7}, 'ETA': 600} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3993 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3993 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3993 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3993 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4207, 'hashtag_proportion': 'barquette_opaque,ela,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'carton,background', 'hashtag_weights': {'barquette_opaque': 1, 'ela': 1, 'etiquette': 1.0, 'film_plastique': 0.5, 'kraft': 1, 'metal': 3.0, 'papier': 1, 'pehd': 2, 'pet_clair': 2, 'pet_opaque': 2, 'textiles_sanitaires': 1.0, 'pet_fonce': 2}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3459 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3459 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3459 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3459 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3726, 'hashtag_proportion': 'Carton_brun,Carton_gris,Teint_Dans_La_Masse,autre_refus,cartonnette,kraft,metal,plastique', 'hashtag_parmi': 'papier,background', 'hashtag_weights': {'Carton_brun': 1.5, 'Carton_gris': 1.5, 'Teint_Dans_La_Masse': 1.0, 'autre_refus': 1.5, 'cartonnette': 1.0, 'kraft': 1.5, 'metal': 3, 'plastique': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3991 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3991 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3991 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3991 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11512 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11521 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11520 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11516 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11516 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11519 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11519 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11513 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11513 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11577 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11577 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11515 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11514 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11514 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11523 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11515 doesn't seem to be define in the database( WARNING : type of input 3 of step 11514 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11512 doesn't seem to be define in the database( WARNING : type of input 2 of step 11516 doesn't seem to be define in the database( WARNING : output 1 of step 11512 have datatype=2 whereas input 1 of step 11519 have datatype=7 WARNING : type of output 2 of step 11519 doesn't seem to be define in the database( WARNING : type of input 1 of step 11513 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11515 have datatype=10 whereas input 3 of step 11522 have datatype=6 WARNING : type of input 2 of step 11577 doesn't seem to be define in the database( WARNING : output 1 of step 11513 have datatype=7 whereas input 2 of step 11577 have datatype=None WARNING : type of output 3 of step 11577 doesn't seem to be define in the database( WARNING : type of input 1 of step 11515 doesn't seem to be define in the database( WARNING : output 0 of step 11515 have datatype=10 whereas input 0 of step 11583 have datatype=18 WARNING : type of input 5 of step 11522 doesn't seem to be define in the database( WARNING : output 0 of step 11583 have datatype=11 whereas input 5 of step 11522 have datatype=None WARNING : type of output 1 of step 11521 doesn't seem to be define in the database( WARNING : type of input 3 of step 11516 doesn't seem to be define in the database( WARNING : type of output 1 of step 11520 doesn't seem to be define in the database( WARNING : type of input 3 of step 11516 doesn't seem to be define in the database( WARNING : output 0 of step 11519 have datatype=1 whereas input 0 of step 11513 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4203, 'hashtag_proportion': 'barquette_opaque,carton,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'ela,background', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 1, 'etiquette': 0.5, 'film_plastique': 0.5, 'kraft': 0.8, 'metal': 2, 'papier': 0.8, 'pehd': 0.8, 'pet_clair': 0.8, 'pet_opaque': 0.8, 'textiles_sanitaires': 0.5, 'pet_fonce': 0.8}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3804 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3804 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3804 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3804 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11560 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11567 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11567 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11563 crop_condition is not consistent : 4 used against 2 in the step definition ! Step 11563 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11564 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11564 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11573 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11573 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11566 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11566 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 1 of step 11560 have datatype=2 whereas input 1 of step 11564 have datatype=7 WARNING : type of output 2 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11565 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11567 doesn't seem to be define in the database( WARNING : type of input 3 of step 11563 doesn't seem to be define in the database( WARNING : type of output 3 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11568 doesn't seem to be define in the database( WARNING : type of output 1 of step 11568 doesn't seem to be define in the database( WARNING : type of input 3 of step 11566 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11570 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11569 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11570 doesn't seem to be define in the database( WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11569 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11568 have datatype=10 whereas input 3 of step 11571 have datatype=6 WARNING : type of input 2 of step 11573 doesn't seem to be define in the database( WARNING : output 1 of step 11565 have datatype=7 whereas input 2 of step 11573 have datatype=None WARNING : type of output 3 of step 11573 doesn't seem to be define in the database( WARNING : type of input 3 of step 11568 doesn't seem to be define in the database( WARNING : output 0 of step 11568 have datatype=10 whereas input 0 of step 11587 have datatype=18 WARNING : type of input 5 of step 11571 doesn't seem to be define in the database( WARNING : output 0 of step 11587 have datatype=11 whereas input 5 of step 11571 have datatype=None WARNING : output 0 of step 11564 have datatype=1 whereas input 0 of step 11565 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3327, 'hashtag_proportion': 'autre,carton,metal,papier,pehd,pet_fonce', 'hashtag_parmi': 'pet_clair,bouchon,etiquette,barquette_avec_film,background', 'hashtag_weights': {'autre': 8.0, 'barquette_avec_film': 6, 'carton': 8.0, 'metal': 12, 'papier': 5, 'pehd': 8, 'pet_fonce': 8, 'bouchon': 8, 'etiquette': 8}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4322 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4322 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4322 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4322 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11978 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11987 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11986 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11982 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11982 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11985 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11985 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11979 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11979 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11990 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11990 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11981 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11980 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11980 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11989 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11981 doesn't seem to be define in the database( WARNING : type of input 3 of step 11980 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11978 doesn't seem to be define in the database( WARNING : type of input 2 of step 11982 doesn't seem to be define in the database( WARNING : output 1 of step 11978 have datatype=2 whereas input 1 of step 11985 have datatype=7 WARNING : type of output 2 of step 11985 doesn't seem to be define in the database( WARNING : type of input 1 of step 11979 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11981 have datatype=10 whereas input 3 of step 11988 have datatype=6 WARNING : type of input 2 of step 11990 doesn't seem to be define in the database( WARNING : output 1 of step 11979 have datatype=7 whereas input 2 of step 11990 have datatype=None WARNING : type of output 3 of step 11990 doesn't seem to be define in the database( WARNING : type of input 1 of step 11981 doesn't seem to be define in the database( WARNING : output 0 of step 11981 have datatype=10 whereas input 0 of step 11991 have datatype=18 WARNING : type of input 5 of step 11988 doesn't seem to be define in the database( WARNING : output 0 of step 11991 have datatype=11 whereas input 5 of step 11988 have datatype=None WARNING : type of output 1 of step 11987 doesn't seem to be define in the database( WARNING : type of input 3 of step 11982 doesn't seem to be define in the database( WARNING : type of output 1 of step 11986 doesn't seem to be define in the database( WARNING : type of input 3 of step 11982 doesn't seem to be define in the database( WARNING : output 0 of step 11985 have datatype=1 whereas input 0 of step 11979 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4461, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,pehd,kraft,metal,papier,pet_fonce,pet_clair,pet_opaque,textiles_sanitaires', 'hashtag_parmi': 'film_plastique', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 0.3, 'ela': 0.3, 'etiquette': 0.1, 'film_plastique': 0.1, 'kraft': 0.3, 'metal': 1.5, 'papier': 0.3, 'pet_clair': 0.3, 'pet_opaque': 0.3, 'textiles_sanitaires': 0.3, 'pet_fonce': 0.3}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3995 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3995 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3995 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3995 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11524 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11533 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11532 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11528 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11528 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11531 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11531 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11525 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11525 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11578 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11578 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11527 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11526 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11526 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11535 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11527 doesn't seem to be define in the database( WARNING : type of input 3 of step 11526 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11524 doesn't seem to be define in the database( WARNING : type of input 2 of step 11528 doesn't seem to be define in the database( WARNING : output 1 of step 11524 have datatype=2 whereas input 1 of step 11531 have datatype=7 WARNING : type of output 2 of step 11531 doesn't seem to be define in the database( WARNING : type of input 1 of step 11525 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11527 have datatype=10 whereas input 3 of step 11534 have datatype=6 WARNING : type of input 2 of step 11578 doesn't seem to be define in the database( WARNING : output 1 of step 11525 have datatype=7 whereas input 2 of step 11578 have datatype=None WARNING : type of output 3 of step 11578 doesn't seem to be define in the database( WARNING : type of input 1 of step 11527 doesn't seem to be define in the database( WARNING : output 0 of step 11527 have datatype=10 whereas input 0 of step 11584 have datatype=18 WARNING : type of input 5 of step 11534 doesn't seem to be define in the database( WARNING : output 0 of step 11584 have datatype=11 whereas input 5 of step 11534 have datatype=None WARNING : type of output 1 of step 11533 doesn't seem to be define in the database( WARNING : type of input 3 of step 11528 doesn't seem to be define in the database( WARNING : type of output 1 of step 11532 doesn't seem to be define in the database( WARNING : type of input 3 of step 11528 doesn't seem to be define in the database( WARNING : output 0 of step 11531 have datatype=1 whereas input 0 of step 11525 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4211, 'hashtag_proportion': 'barquette_opaque,carton,ela,film_plastique,kraft,metal,papier,pet_fonce,pet_clair,pet_opaque,textiles_sanitaires', 'hashtag_parmi': 'pehd,etiquette,background', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 0.3, 'ela': 0.3, 'etiquette': 0.1, 'film_plastique': 0.1, 'kraft': 0.3, 'metal': 1.5, 'papier': 0.3, 'pet_clair': 0.3, 'pet_opaque': 0.3, 'textiles_sanitaires': 0.3, 'pet_fonce': 0.3, 'background': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4153 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4153 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4153 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4153 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11548 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11556 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11557 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11552 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11552 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11555 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11555 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11580 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11580 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11551 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11550 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11550 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11559 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11551 doesn't seem to be define in the database( WARNING : type of input 3 of step 11550 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11548 doesn't seem to be define in the database( WARNING : type of input 2 of step 11552 doesn't seem to be define in the database( WARNING : output 1 of step 11548 have datatype=2 whereas input 1 of step 11555 have datatype=7 WARNING : type of output 2 of step 11555 doesn't seem to be define in the database( WARNING : type of input 1 of step 11549 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11551 have datatype=10 whereas input 3 of step 11558 have datatype=6 WARNING : type of input 2 of step 11580 doesn't seem to be define in the database( WARNING : output 1 of step 11549 have datatype=7 whereas input 2 of step 11580 have datatype=None WARNING : type of output 3 of step 11580 doesn't seem to be define in the database( WARNING : type of input 1 of step 11551 doesn't seem to be define in the database( WARNING : output 0 of step 11551 have datatype=10 whereas input 0 of step 11586 have datatype=18 WARNING : type of input 5 of step 11558 doesn't seem to be define in the database( WARNING : output 0 of step 11586 have datatype=11 whereas input 5 of step 11558 have datatype=None WARNING : type of output 1 of step 11556 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : type of output 1 of step 11557 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : output 0 of step 11555 have datatype=1 whereas input 0 of step 11549 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4200, 'hashtag_proportion': 'carton,ela,film_plastique,kraft,metal,papier,pehd,pet_opaque,textiles_sanitaires,barquette_opaque,pet_clair', 'hashtag_parmi': 'pet_fonce,etiquette,background', 'hashtag_weights': {'barquette_opaque': 1.5, 'carton': 2.5, 'ela': 1.5, 'etiquette': 1.5, 'film_plastique': 1, 'kraft': 1.5, 'metal': 3.0, 'papier': 1.2, 'pehd': 1.5, 'pet_clair': 1.5, 'pet_opaque': 1.5, 'textiles_sanitaires': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3992 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3992 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3992 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3992 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11536 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11545 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11544 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11540 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11540 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11543 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11543 merge_mask_thcl_custom have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 11537 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11579 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11579 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11539 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11538 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11538 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11547 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11539 doesn't seem to be define in the database( WARNING : type of input 3 of step 11538 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11536 doesn't seem to be define in the database( WARNING : type of input 2 of step 11540 doesn't seem to be define in the database( WARNING : output 1 of step 11536 have datatype=2 whereas input 1 of step 11543 have datatype=7 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11539 have datatype=10 whereas input 3 of step 11546 have datatype=6 WARNING : type of input 2 of step 11579 doesn't seem to be define in the database( WARNING : output 1 of step 11537 have datatype=7 whereas input 2 of step 11579 have datatype=None WARNING : type of output 3 of step 11579 doesn't seem to be define in the database( WARNING : type of input 1 of step 11539 doesn't seem to be define in the database( WARNING : output 0 of step 11539 have datatype=10 whereas input 0 of step 11585 have datatype=18 WARNING : type of input 5 of step 11546 doesn't seem to be define in the database( WARNING : output 0 of step 11585 have datatype=11 whereas input 5 of step 11546 have datatype=None WARNING : type of output 1 of step 11545 doesn't seem to be define in the database( WARNING : type of input 3 of step 11540 doesn't seem to be define in the database( WARNING : type of output 1 of step 11544 doesn't seem to be define in the database( WARNING : type of input 3 of step 11540 doesn't seem to be define in the database( WARNING : output 0 of step 11543 have datatype=1 whereas input 0 of step 11537 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4205, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'metal,background', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 1.5, 'ela': 1.5, 'etiquette': 1, 'film_plastique': 1, 'kraft': 1, 'papier': 1, 'pehd': 1.5, 'pet_clair': 1.5, 'pet_opaque': 1.5, 'textiles_sanitaires': 1.5, 'pet_fonce': 1.5}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3318 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3318 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3318 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3594, 'hashtag_proportion': 'papier,carton,metal,pet_clair,autre,pehd,pet_fonce', 'hashtag_parmi': 'refus,background', 'hashtag_weights': {'papier': 1, 'carton': 1, 'metal': 1, 'pet_clair': 1, 'autre': 1, 'pehd': 1, 'pet_fonce': 1, 'refus': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier create_report_from_API() got an unexpected keyword argument 'outfolder' ERROR csv FAILED [('memo', 'SUCCESS', True), ('one_day', 'FAILURE', False), ('get_data', 'SUCCESS', True), ('csv', 'FAILURE', False)] res_total : False #&_#_#&_# TEST memo SUCCEEDED #&_#_#&_# #&_#_#&_# TEST one_day FAILED #&_#_#&_# #&_#_#&_# TEST get_data SUCCEEDED #&_#_#&_# #&_#_#&_# TEST csv FAILED #&_#_#&_# #&_# TEST FAILED #&_# : prod/memo/memo #&_# /home/admin/workarea/git/Velours/python/tests/python_tests.py refs/heads/master_80aab10e0219982fef52d1eae72d1bddac86cb8e SQL :INSERT INTO MTRAdmin.monitor_sys (name, type, server, version_code, result_str, result_bool, lien , test_group ,test_name) VALUES ('python_test3','1','marlene','refs/heads/master_80aab10e0219982fef52d1eae72d1bddac86cb8e','{"memo": "success"}','1','http://marlene.fotonower-preprod.com/job/2025/April/14042025/python_test3//data_2/data_log/job/2025/April/14042025/python_test3/log-python3----short_python3--v--marlene-03:35:00.txt','sla_mensuel','memo'); /home/admin/workarea/git/Velours/python/tests/python_tests.py refs/heads/master_80aab10e0219982fef52d1eae72d1bddac86cb8e SQL :INSERT INTO MTRAdmin.monitor_sys (name, type, server, version_code, result_str, result_bool, lien , test_group ,test_name) VALUES ('python_test3','1','marlene','refs/heads/master_80aab10e0219982fef52d1eae72d1bddac86cb8e','{"one_day": "fail"}','0','http://marlene.fotonower-preprod.com/job/2025/April/14042025/python_test3//data_2/data_log/job/2025/April/14042025/python_test3/log-python3----short_python3--v--marlene-03:35:00.txt','sla_mensuel','one_day'); /home/admin/workarea/git/Velours/python/tests/python_tests.py refs/heads/master_80aab10e0219982fef52d1eae72d1bddac86cb8e SQL :INSERT INTO MTRAdmin.monitor_sys (name, type, server, version_code, result_str, result_bool, lien , test_group ,test_name) VALUES ('python_test3','1','marlene','refs/heads/master_80aab10e0219982fef52d1eae72d1bddac86cb8e','{"get_data": "success"}','1','http://marlene.fotonower-preprod.com/job/2025/April/14042025/python_test3//data_2/data_log/job/2025/April/14042025/python_test3/log-python3----short_python3--v--marlene-03:35:00.txt','sla_mensuel','get_data'); /home/admin/workarea/git/Velours/python/tests/python_tests.py refs/heads/master_80aab10e0219982fef52d1eae72d1bddac86cb8e SQL :INSERT INTO MTRAdmin.monitor_sys (name, type, server, version_code, result_str, result_bool, lien , test_group ,test_name) VALUES ('python_test3','1','marlene','refs/heads/master_80aab10e0219982fef52d1eae72d1bddac86cb8e','{"csv": "fail"}','0','http://marlene.fotonower-preprod.com/job/2025/April/14042025/python_test3//data_2/data_log/job/2025/April/14042025/python_test3/log-python3----short_python3--v--marlene-03:35:00.txt','sla_mensuel','csv'); #&_# END OF TEST #&_# : prod/memo/memo #&_# /usr/lib/python3/dist-packages/paramiko/transport.py:220: CryptographyDeprecationWarning: Blowfish has been deprecated "class": algorithms.Blowfish, Traceback (most recent call last): File "/home/admin/workarea/git/Velours/python/mtr/database_queries/general_queries.py", line 68, in select cursor.execute(query, args) File "/usr/local/lib/python3.8/dist-packages/MySQLdb/cursors.py", line 209, in execute res = self._query(query) File "/usr/local/lib/python3.8/dist-packages/MySQLdb/cursors.py", line 315, in _query db.query(q) File "/usr/local/lib/python3.8/dist-packages/MySQLdb/connections.py", line 239, in query _mysql.connection.query(self, query) MySQLdb._exceptions.OperationalError: (1114, "The table '/tmp/#sqla9606_364e8b_0' is full") During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/admin/workarea/git/Velours/python/tests/python_tests.py", line 245, in v, r = module_name.test(verbose=verbose, context=context) File "/home/admin/workarea/git/Velours/python/tests/cache_photo_data_test.py", line 109, in test title1, result1, res_bool1 = test_download_photos(cpd,verbose) File "/home/admin/workarea/git/Velours/python/tests/cache_photo_data_test.py", line 17, in test_download_photos dic_pid_path, dic_photo_missing, map_port_photo = cpd.load_photo_data(list_portfolio_id, size_photo="origin", File "/home/admin/workarea/git/Velours/python/mtr/database_queries/CachePhotoData_queries.py", line 560, in load_photo_data photo_urls, map_portfolio_photos = self.get_photo_infos(list_portfolio , list_photo_ids , limit , File "/home/admin/workarea/git/Velours/python/mtr/database_queries/CachePhotoData_queries.py", line 404, in get_photo_infos photo_urls_temp = self.spq.select_mtr_photos(limit, 0, 0, portfolio_id, File "/home/admin/workarea/git/Velours/python/mtr/database_queries/photo_retrieval_queries.py", line 276, in select_mtr_photos if self.query_limiter(query): File "/home/admin/workarea/git/Velours/python/mtr/database_queries/general_queries.py", line 176, in query_limiter res = self.select(query_select_info_schema) File "/home/admin/workarea/git/Velours/python/mtr/database_queries/general_queries.py", line 79, in select cursor.execute(query, args) File "/usr/local/lib/python3.8/dist-packages/MySQLdb/cursors.py", line 209, in execute res = self._query(query) File "/usr/local/lib/python3.8/dist-packages/MySQLdb/cursors.py", line 315, in _query db.query(q) File "/usr/local/lib/python3.8/dist-packages/MySQLdb/connections.py", line 239, in query _mysql.connection.query(self, query) MySQLdb._exceptions.OperationalError: (1114, "The table '/tmp/#sqla9606_36707d_0' is full") File "/home/admin/workarea/git/Velours/python/tests/python_tests.py", line 251, in traceback.print_stack() #######all_test_python_finish###### insert result in bdd : Test are not running on charlot, the path should be tested ! /data_2/data_log/job/2025/April/14042025/python_test3/output_tests_python-0503.html new path : /proc/648272/ 72.38user 49.22system 1:27:56elapsed 2%CPU (0avgtext+0avgdata 6434268maxresident)k 6727888inputs+42528outputs (15587major+6493909minor)pagefaults 0swaps