python /home/admin/mtr/script_for_cron.py -j coverage -m 9 -a '' -s coverage -M 0 -S 0 -U 100,100,120 import MySQLdb succeeded root_folder /data_2/data_log/job/2025/March/23032025/coverage/ git_velours : /home/admin/workarea/git/Velours/ out_folder_name htmlcov output_folder /data_2/data_log/job/2025/March/23032025/coverage/htmlcov new path : /data_2/data_log/job/2025/March/23032025/coverage/ command : coverage3 run /home/admin/workarea/git/Velours/python/tests/python_tests.py --short_python3 `cat ~/.fotonower_pass/bdd.py.pass` cat: /home/admin/.fotonower_pass/bdd.py.pass: Aucun fichier ou dossier de ce type import MySQLdb succeeded Import error (python version) python version = 3 warning , we can't find thcl infos in json_data warning , we can't find pdt infos in json_data python version used : 3 #&_# BEGIN OF TEST : tests/mask_test #&_# /home/admin/workarea/git/Velours/python/tests/mask_test.py Test mask-detection python version used : 3 ############################### TEST memory used ################################ free memory at begining : begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 9617 run mask_detect Inside batchDatouExec : verbose : False # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : mask_detect list_input_json : [] origin BFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 1 ; length of list_pids : 1 ; length of list_args : 1 time to download the photos : 0.2426621913909912 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : False number of steps : 1 step1:mask_detect Sun Mar 23 11:20:29 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 9617 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 /home/admin/workarea/git/Velours/python/tests/python_tests.py:11: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses import imp 2025-03-23 11:20:33.274843: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-03-23 11:20:33.303177: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-03-23 11:20:33.305029: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f6730000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-03-23 11:20:33.305086: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-03-23 11:20:33.308623: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-03-23 11:20:33.491956: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x2c323ba0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-03-23 11:20:33.492026: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-03-23 11:20:33.493523: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-03-23 11:20:33.493972: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-23 11:20:33.497006: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-23 11:20:33.499981: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-03-23 11:20:33.500566: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-03-23 11:20:33.503880: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-03-23 11:20:33.505023: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-03-23 11:20:33.509325: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-03-23 11:20:33.510749: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-03-23 11:20:33.510835: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-23 11:20:33.511603: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-03-23 11:20:33.511622: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-03-23 11:20:33.511631: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-03-23 11:20:33.513364: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 8754 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl454 thcls : [{'id': 454, 'mtr_user_id': 31, 'name': 'mask_coco_origin', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'backgroud,person,bicycle,car,motorcycle,airplane,bus,train,truck,boat,trafficlight,firehydrant,stopsign,parkingmeter,bench,bird,cat,dog,horse,sheep,cow,elephant,bear,zebra,giraffe,backpack,umbrella,handbag,tie,suitcase,frisbee,skis,snowboard,sportsball,kite,baseballbat,baseballglove,skateboard,surfboard,tennisracket,bottle,wineglass,cup,fork,knife,spoon,bowl,banana,apple,sandwich,orange,broccoli,carrot,hotdog,pizza,donut,cake,chair,couch,pottedplant,bed,diningtable,toilet,tv,laptop,mouse,remote,keyboard,cellphone,microwave,oven,toaster,sink,refrigerator,book,clock,vase,scissors,teddybear,hairdrier,toothbrush', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 445, 'photo_desc_type': 3473, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0'}] thcl {'id': 454, 'mtr_user_id': 31, 'name': 'mask_coco_origin', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'backgroud,person,bicycle,car,motorcycle,airplane,bus,train,truck,boat,trafficlight,firehydrant,stopsign,parkingmeter,bench,bird,cat,dog,horse,sheep,cow,elephant,bear,zebra,giraffe,backpack,umbrella,handbag,tie,suitcase,frisbee,skis,snowboard,sportsball,kite,baseballbat,baseballglove,skateboard,surfboard,tennisracket,bottle,wineglass,cup,fork,knife,spoon,bowl,banana,apple,sandwich,orange,broccoli,carrot,hotdog,pizza,donut,cake,chair,couch,pottedplant,bed,diningtable,toilet,tv,laptop,mouse,remote,keyboard,cellphone,microwave,oven,toaster,sink,refrigerator,book,clock,vase,scissors,teddybear,hairdrier,toothbrush', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 445, 'photo_desc_type': 3473, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 3473 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (3473, 'mask_coco_origin', 16384, 25088, 'mask_coco_origin', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2018, 3, 19, 10, 42, 21), datetime.datetime(2018, 3, 19, 10, 42, 21)) {'thcl': {'id': 454, 'mtr_user_id': 31, 'name': 'mask_coco_origin', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'backgroud,person,bicycle,car,motorcycle,airplane,bus,train,truck,boat,trafficlight,firehydrant,stopsign,parkingmeter,bench,bird,cat,dog,horse,sheep,cow,elephant,bear,zebra,giraffe,backpack,umbrella,handbag,tie,suitcase,frisbee,skis,snowboard,sportsball,kite,baseballbat,baseballglove,skateboard,surfboard,tennisracket,bottle,wineglass,cup,fork,knife,spoon,bowl,banana,apple,sandwich,orange,broccoli,carrot,hotdog,pizza,donut,cake,chair,couch,pottedplant,bed,diningtable,toilet,tv,laptop,mouse,remote,keyboard,cellphone,microwave,oven,toaster,sink,refrigerator,book,clock,vase,scissors,teddybear,hairdrier,toothbrush', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 445, 'photo_desc_type': 3473, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['backgroud', 'person', 'bicycle', 'car', 'motorcycle', 'airplane', 'bus', 'train', 'truck', 'boat', 'trafficlight', 'firehydrant', 'stopsign', 'parkingmeter', 'bench', 'bird', 'cat', 'dog', 'horse', 'sheep', 'cow', 'elephant', 'bear', 'zebra', 'giraffe', 'backpack', 'umbrella', 'handbag', 'tie', 'suitcase', 'frisbee', 'skis', 'snowboard', 'sportsball', 'kite', 'baseballbat', 'baseballglove', 'skateboard', 'surfboard', 'tennisracket', 'bottle', 'wineglass', 'cup', 'fork', 'knife', 'spoon', 'bowl', 'banana', 'apple', 'sandwich', 'orange', 'broccoli', 'carrot', 'hotdog', 'pizza', 'donut', 'cake', 'chair', 'couch', 'pottedplant', 'bed', 'diningtable', 'toilet', 'tv', 'laptop', 'mouse', 'remote', 'keyboard', 'cellphone', 'microwave', 'oven', 'toaster', 'sink', 'refrigerator', 'book', 'clock', 'vase', 'scissors', 'teddybear', 'hairdrier', 'toothbrush'], 'list_hashtags_csv': 'backgroud,person,bicycle,car,motorcycle,airplane,bus,train,truck,boat,trafficlight,firehydrant,stopsign,parkingmeter,bench,bird,cat,dog,horse,sheep,cow,elephant,bear,zebra,giraffe,backpack,umbrella,handbag,tie,suitcase,frisbee,skis,snowboard,sportsball,kite,baseballbat,baseballglove,skateboard,surfboard,tennisracket,bottle,wineglass,cup,fork,knife,spoon,bowl,banana,apple,sandwich,orange,broccoli,carrot,hotdog,pizza,donut,cake,chair,couch,pottedplant,bed,diningtable,toilet,tv,laptop,mouse,remote,keyboard,cellphone,microwave,oven,toaster,sink,refrigerator,book,clock,vase,scissors,teddybear,hairdrier,toothbrush', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 445, 'svm_hashtag_type_desc': 3473, 'photo_desc_type': 3473, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['backgroud', 'person', 'bicycle', 'car', 'motorcycle', 'airplane', 'bus', 'train', 'truck', 'boat', 'trafficlight', 'firehydrant', 'stopsign', 'parkingmeter', 'bench', 'bird', 'cat', 'dog', 'horse', 'sheep', 'cow', 'elephant', 'bear', 'zebra', 'giraffe', 'backpack', 'umbrella', 'handbag', 'tie', 'suitcase', 'frisbee', 'skis', 'snowboard', 'sportsball', 'kite', 'baseballbat', 'baseballglove', 'skateboard', 'surfboard', 'tennisracket', 'bottle', 'wineglass', 'cup', 'fork', 'knife', 'spoon', 'bowl', 'banana', 'apple', 'sandwich', 'orange', 'broccoli', 'carrot', 'hotdog', 'pizza', 'donut', 'cake', 'chair', 'couch', 'pottedplant', 'bed', 'diningtable', 'toilet', 'tv', 'laptop', 'mouse', 'remote', 'keyboard', 'cellphone', 'microwave', 'oven', 'toaster', 'sink', 'refrigerator', 'book', 'clock', 'vase', 'scissors', 'teddybear', 'hairdrier', 'toothbrush'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME mask_coco_origin NUM_CLASSES 81 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 2025-03-23 11:20:41.186072: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-03-23 11:20:41.186146: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-23 11:20:41.186163: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-23 11:20:41.186179: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-03-23 11:20:41.186194: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-03-23 11:20:41.186210: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-03-23 11:20:41.186224: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-03-23 11:20:41.186239: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-03-23 11:20:41.187299: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-03-23 11:20:41.188349: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-03-23 11:20:41.188383: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-23 11:20:41.188398: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-23 11:20:41.188412: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-03-23 11:20:41.188426: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-03-23 11:20:41.188440: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-03-23 11:20:41.188455: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-03-23 11:20:41.188469: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-03-23 11:20:41.189488: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-03-23 11:20:41.189515: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-03-23 11:20:41.189524: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-03-23 11:20:41.189532: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-03-23 11:20:41.190601: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 8754 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : mask_coco_origin model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-03-23 11:20:50.589611: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-23 11:20:50.790468: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/mask_coco_origin /data/models_weight/mask_coco_origin/mask_model.h5 size_local : 257557808 size in s3 : 257557808 create time local : 2021-08-09 05:27:17 create time in s3 : 2021-08-06 19:45:17 mask_model.h5 already exist and didn't need to update list_images length : 1 NEW PHOTO Processing 1 images image shape: (480, 640, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 89) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 Detection mask done ! Trying to reset tf kernel 44013 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 551 tf kernel not reseted sub process len(results) : 1 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 1 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5840 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl454 Catched exception ! Connect or reconnect ! thcls : [{'id': 454, 'mtr_user_id': 31, 'name': 'mask_coco_origin', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'backgroud,person,bicycle,car,motorcycle,airplane,bus,train,truck,boat,trafficlight,firehydrant,stopsign,parkingmeter,bench,bird,cat,dog,horse,sheep,cow,elephant,bear,zebra,giraffe,backpack,umbrella,handbag,tie,suitcase,frisbee,skis,snowboard,sportsball,kite,baseballbat,baseballglove,skateboard,surfboard,tennisracket,bottle,wineglass,cup,fork,knife,spoon,bowl,banana,apple,sandwich,orange,broccoli,carrot,hotdog,pizza,donut,cake,chair,couch,pottedplant,bed,diningtable,toilet,tv,laptop,mouse,remote,keyboard,cellphone,microwave,oven,toaster,sink,refrigerator,book,clock,vase,scissors,teddybear,hairdrier,toothbrush', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 445, 'photo_desc_type': 3473, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0'}] thcl {'id': 454, 'mtr_user_id': 31, 'name': 'mask_coco_origin', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'backgroud,person,bicycle,car,motorcycle,airplane,bus,train,truck,boat,trafficlight,firehydrant,stopsign,parkingmeter,bench,bird,cat,dog,horse,sheep,cow,elephant,bear,zebra,giraffe,backpack,umbrella,handbag,tie,suitcase,frisbee,skis,snowboard,sportsball,kite,baseballbat,baseballglove,skateboard,surfboard,tennisracket,bottle,wineglass,cup,fork,knife,spoon,bowl,banana,apple,sandwich,orange,broccoli,carrot,hotdog,pizza,donut,cake,chair,couch,pottedplant,bed,diningtable,toilet,tv,laptop,mouse,remote,keyboard,cellphone,microwave,oven,toaster,sink,refrigerator,book,clock,vase,scissors,teddybear,hairdrier,toothbrush', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 445, 'photo_desc_type': 3473, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 3473 ['backgroud', 'person', 'bicycle', 'car', 'motorcycle', 'airplane', 'bus', 'train', 'truck', 'boat', 'trafficlight', 'firehydrant', 'stopsign', 'parkingmeter', 'bench', 'bird', 'cat', 'dog', 'horse', 'sheep', 'cow', 'elephant', 'bear', 'zebra', 'giraffe', 'backpack', 'umbrella', 'handbag', 'tie', 'suitcase', 'frisbee', 'skis', 'snowboard', 'sportsball', 'kite', 'baseballbat', 'baseballglove', 'skateboard', 'surfboard', 'tennisracket', 'bottle', 'wineglass', 'cup', 'fork', 'knife', 'spoon', 'bowl', 'banana', 'apple', 'sandwich', 'orange', 'broccoli', 'carrot', 'hotdog', 'pizza', 'donut', 'cake', 'chair', 'couch', 'pottedplant', 'bed', 'diningtable', 'toilet', 'tv', 'laptop', 'mouse', 'remote', 'keyboard', 'cellphone', 'microwave', 'oven', 'toaster', 'sink', 'refrigerator', 'book', 'clock', 'vase', 'scissors', 'teddybear', 'hairdrier', 'toothbrush'] time for calcul the mask position with numpy : 0.0005464553833007812 nb_pixel_total : 15550 time to create 1 rle with old method : 0.03602480888366699 length of segment : 256 time for calcul the mask position with numpy : 0.002953052520751953 nb_pixel_total : 145331 time to create 1 rle with old method : 0.3212010860443115 length of segment : 371 time for calcul the mask position with numpy : 0.00028896331787109375 nb_pixel_total : 14254 time to create 1 rle with old method : 0.030183792114257812 length of segment : 151 time for calcul the mask position with numpy : 0.0001327991485595703 nb_pixel_total : 5614 time to create 1 rle with old method : 0.012728691101074219 length of segment : 48 time for calcul the mask position with numpy : 7.510185241699219e-05 nb_pixel_total : 1825 time to create 1 rle with old method : 0.0042989253997802734 length of segment : 39 time spent for convertir_results : 1.3225550651550293 time spend for datou_step_exec : 27.85885262489319 time spend to save output : 6.842613220214844e-05 total time spend for step 1 : 27.85892105102539 caffe_path_current : About to save ! 1 Inside saveOutput : final : True verbose : False eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 3317 chid ids of type : 445 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 0 begin to insert list_values into mtr_datou_result : length of list_values in save_final : 1 time used for this insertion : 0.01835346221923828 save missing photos in datou_result : After save, about to update current ! datou_cur_ids : [] len(datou.list_steps) : 1 output : {'957285035': [[(957285035, 492601069, 445, 0, 186, 22, 282, 0.99548894, [(140, 26, 6), (135, 27, 15), (133, 28, 18), (131, 29, 22), (127, 30, 27), (10, 31, 1), (121, 31, 34), (8, 32, 13), (27, 32, 3), (115, 32, 41), (7, 33, 52), (109, 33, 48), (6, 34, 70), (103, 34, 55), (5, 35, 154), (4, 36, 155), (3, 37, 156), (3, 38, 156), (3, 39, 156), (2, 40, 157), (2, 41, 157), (2, 42, 157), (2, 43, 157), (2, 44, 157), (2, 45, 157), (1, 46, 158), (1, 47, 158), (1, 48, 158), (1, 49, 157), (1, 50, 157), (1, 51, 156), (1, 52, 156), (1, 53, 155), (1, 54, 154), (1, 55, 152), (1, 56, 149), (1, 57, 145), (1, 58, 141), (1, 59, 136), (1, 60, 133), (1, 61, 130), (1, 62, 127), (1, 63, 126), (1, 64, 124), (1, 65, 123), (1, 66, 121), (1, 67, 120), (1, 68, 118), (1, 69, 117), (1, 70, 116), (1, 71, 115), (1, 72, 114), (1, 73, 113), (1, 74, 112), (1, 75, 111), (1, 76, 110), (1, 77, 108), (1, 78, 108), (1, 79, 107), (1, 80, 106), (1, 81, 105), (2, 82, 104), (2, 83, 103), (2, 84, 103), (2, 85, 102), (2, 86, 102), (2, 87, 101), (2, 88, 100), (2, 89, 99), (2, 90, 99), (2, 91, 98), (2, 92, 97), (2, 93, 96), (2, 94, 95), (2, 95, 93), (2, 96, 91), (2, 97, 90), (2, 98, 89), (2, 99, 87), (2, 100, 86), (2, 101, 86), (2, 102, 85), (2, 103, 84), (2, 104, 83), (2, 105, 83), (2, 106, 82), (2, 107, 81), (2, 108, 80), (2, 109, 80), (2, 110, 79), (2, 111, 78), (2, 112, 77), (2, 113, 76), (1, 114, 76), (1, 115, 75), (1, 116, 74), (1, 117, 73), (1, 118, 72), (1, 119, 71), (1, 120, 71), (1, 121, 70), (1, 122, 69), (1, 123, 69), (1, 124, 68), (1, 125, 68), (1, 126, 67), (1, 127, 67), (1, 128, 66), (1, 129, 66), (1, 130, 66), (1, 131, 65), (1, 132, 65), (1, 133, 64), (1, 134, 63), (1, 135, 63), (1, 136, 62), (1, 137, 61), (1, 138, 60), (1, 139, 60), (1, 140, 59), (1, 141, 58), (1, 142, 58), (1, 143, 57), (1, 144, 56), (1, 145, 56), (1, 146, 55), (1, 147, 54), (1, 148, 54), (1, 149, 53), (1, 150, 52), (1, 151, 52), (1, 152, 51), (1, 153, 50), (1, 154, 49), (1, 155, 48), (1, 156, 47), (1, 157, 46), (1, 158, 45), (1, 159, 45), (1, 160, 44), (1, 161, 43), (1, 162, 42), (1, 163, 41), (1, 164, 41), (1, 165, 40), (1, 166, 40), (1, 167, 39), (1, 168, 38), (1, 169, 37), (1, 170, 36), (1, 171, 35), (1, 172, 34), (1, 173, 34), (1, 174, 33), (1, 175, 33), (1, 176, 32), (1, 177, 32), (1, 178, 32), (1, 179, 32), (1, 180, 31), (1, 181, 31), (1, 182, 31), (1, 183, 30), (1, 184, 30), (1, 185, 30), (1, 186, 29), (1, 187, 29), (1, 188, 29), (1, 189, 28), (1, 190, 28), (1, 191, 27), (1, 192, 27), (1, 193, 26), (1, 194, 26), (1, 195, 26), (1, 196, 26), (1, 197, 26), (1, 198, 26), (1, 199, 26), (1, 200, 25), (1, 201, 25), (1, 202, 25), (1, 203, 25), (1, 204, 25), (1, 205, 25), (1, 206, 25), (1, 207, 25), (1, 208, 25), (1, 209, 25), (1, 210, 25), (1, 211, 25), (1, 212, 25), (1, 213, 25), (1, 214, 25), (1, 215, 25), (1, 216, 25), (1, 217, 25), (1, 218, 25), (1, 219, 25), (1, 220, 24), (1, 221, 24), (1, 222, 24), (1, 223, 24), (1, 224, 24), (1, 225, 24), (1, 226, 25), (1, 227, 25), (1, 228, 25), (2, 229, 24), (2, 230, 24), (2, 231, 24), (2, 232, 23), (2, 233, 23), (2, 234, 23), (2, 235, 23), (2, 236, 23), (2, 237, 23), (2, 238, 23), (2, 239, 23), (2, 240, 23), (2, 241, 23), (2, 242, 23), (2, 243, 23), (2, 244, 23), (2, 245, 23), (2, 246, 23), (2, 247, 23), (2, 248, 23), (2, 249, 24), (2, 250, 24), (2, 251, 23), (2, 252, 23), (2, 253, 23), (2, 254, 23), (2, 255, 23), (2, 256, 23), (2, 257, 23), (2, 258, 23), (2, 259, 23), (2, 260, 23), (2, 261, 23), (3, 262, 22), (3, 263, 22), (3, 264, 22), (3, 265, 22), (4, 266, 21), (4, 267, 21), (5, 268, 20), (5, 269, 20), (6, 270, 19), (7, 271, 17), (8, 272, 16), (8, 273, 16), (9, 274, 13), (11, 275, 9), (15, 276, 2)], ['16,276,8,273,3,265,2,261,2,229,1,228,1,114,2,113,2,82,1,81,1,46,3,37,8,32,20,32,21,33,58,33,59,34,75,34,76,35,102,35,115,32,126,31,135,27,145,26,152,29,158,35,158,48,154,54,141,58,128,61,119,67,105,81,103,86,96,94,89,98,81,109,71,119,65,132,60,138,52,151,45,158,40,166,34,172,29,188,26,193,25,200,25,219,24,220,24,270,23,273']), (957285035, 492601069, 445, 29, 591, 24, 419, 0.99237627, [(315, 37, 25), (272, 38, 86), (253, 39, 130), (238, 40, 151), (199, 41, 196), (189, 42, 213), (180, 43, 238), (175, 44, 250), (172, 45, 257), (169, 46, 266), (166, 47, 274), (162, 48, 284), (159, 49, 294), (157, 50, 304), (155, 51, 310), (153, 52, 317), (151, 53, 323), (149, 54, 330), (148, 55, 334), (146, 56, 337), (144, 57, 341), (142, 58, 344), (140, 59, 347), (138, 60, 350), (136, 61, 353), (134, 62, 356), (132, 63, 358), (130, 64, 361), (128, 65, 364), (126, 66, 367), (124, 67, 370), (122, 68, 373), (120, 69, 376), (118, 70, 379), (117, 71, 381), (115, 72, 385), (114, 73, 387), (113, 74, 389), (112, 75, 391), (112, 76, 393), (111, 77, 395), (110, 78, 397), (109, 79, 399), (109, 80, 400), (108, 81, 402), (107, 82, 404), (107, 83, 404), (106, 84, 406), (105, 85, 408), (105, 86, 409), (104, 87, 410), (104, 88, 411), (103, 89, 413), (102, 90, 415), (101, 91, 417), (100, 92, 420), (98, 93, 423), (97, 94, 426), (96, 95, 428), (94, 96, 431), (93, 97, 433), (92, 98, 435), (91, 99, 437), (90, 100, 439), (89, 101, 441), (89, 102, 441), (89, 103, 442), (89, 104, 443), (89, 105, 444), (89, 106, 444), (89, 107, 445), (89, 108, 446), (89, 109, 447), (89, 110, 448), (89, 111, 449), (89, 112, 450), (89, 113, 451), (89, 114, 453), (89, 115, 454), (89, 116, 455), (88, 117, 456), (88, 118, 457), (87, 119, 459), (87, 120, 459), (86, 121, 461), (85, 122, 462), (85, 123, 463), (84, 124, 464), (84, 125, 465), (83, 126, 466), (82, 127, 468), (82, 128, 468), (81, 129, 470), (80, 130, 471), (78, 131, 473), (76, 132, 476), (75, 133, 477), (73, 134, 480), (71, 135, 482), (70, 136, 484), (68, 137, 486), (67, 138, 488), (65, 139, 490), (64, 140, 492), (63, 141, 493), (61, 142, 496), (60, 143, 497), (59, 144, 499), (58, 145, 501), (58, 146, 501), (57, 147, 503), (57, 148, 504), (56, 149, 506), (56, 150, 507), (56, 151, 507), (55, 152, 509), (55, 153, 510), (54, 154, 511), (54, 155, 512), (54, 156, 513), (53, 157, 514), (53, 158, 514), (52, 159, 515), (52, 160, 516), (51, 161, 517), (51, 162, 517), (51, 163, 517), (50, 164, 518), (50, 165, 518), (49, 166, 519), (49, 167, 520), (48, 168, 521), (48, 169, 521), (47, 170, 522), (47, 171, 522), (46, 172, 523), (46, 173, 523), (46, 174, 523), (45, 175, 524), (45, 176, 523), (44, 177, 524), (44, 178, 524), (44, 179, 524), (43, 180, 525), (43, 181, 525), (42, 182, 525), (42, 183, 525), (42, 184, 525), (41, 185, 526), (41, 186, 526), (40, 187, 526), (39, 188, 526), (39, 189, 525), (38, 190, 526), (38, 191, 525), (37, 192, 525), (37, 193, 523), (36, 194, 523), (36, 195, 522), (36, 196, 522), (35, 197, 522), (35, 198, 521), (34, 199, 521), (34, 200, 521), (34, 201, 520), (34, 202, 520), (34, 203, 520), (34, 204, 519), (34, 205, 519), (33, 206, 520), (33, 207, 519), (33, 208, 519), (33, 209, 519), (33, 210, 518), (33, 211, 518), (33, 212, 518), (33, 213, 517), (32, 214, 518), (32, 215, 517), (32, 216, 517), (32, 217, 516), (32, 218, 515), (32, 219, 514), (32, 220, 513), (32, 221, 512), (32, 222, 511), (32, 223, 510), (32, 224, 508), (32, 225, 507), (32, 226, 505), (32, 227, 504), (32, 228, 503), (32, 229, 502), (32, 230, 502), (32, 231, 501), (32, 232, 500), (32, 233, 499), (32, 234, 498), (32, 235, 497), (31, 236, 496), (31, 237, 495), (31, 238, 494), (31, 239, 493), (31, 240, 491), (31, 241, 490), (31, 242, 488), (31, 243, 487), (31, 244, 486), (31, 245, 485), (31, 246, 483), (31, 247, 482), (31, 248, 480), (31, 249, 479), (31, 250, 477), (31, 251, 475), (31, 252, 473), (31, 253, 472), (31, 254, 470), (31, 255, 468), (31, 256, 467), (31, 257, 465), (31, 258, 464), (31, 259, 463), (31, 260, 462), (31, 261, 461), (31, 262, 459), (31, 263, 458), (31, 264, 456), (31, 265, 455), (31, 266, 453), (31, 267, 451), (31, 268, 449), (31, 269, 448), (31, 270, 447), (31, 271, 445), (31, 272, 444), (31, 273, 443), (32, 274, 441), (32, 275, 440), (32, 276, 438), (32, 277, 437), (32, 278, 435), (32, 279, 434), (32, 280, 432), (33, 281, 429), (33, 282, 427), (33, 283, 426), (33, 284, 424), (33, 285, 423), (34, 286, 421), (34, 287, 420), (34, 288, 419), (35, 289, 416), (35, 290, 415), (35, 291, 414), (36, 292, 411), (36, 293, 410), (37, 294, 407), (37, 295, 406), (38, 296, 403), (38, 297, 401), (39, 298, 399), (39, 299, 397), (41, 300, 394), (42, 301, 392), (43, 302, 389), (44, 303, 387), (45, 304, 385), (46, 305, 382), (47, 306, 380), (47, 307, 378), (48, 308, 376), (49, 309, 373), (50, 310, 370), (51, 311, 368), (51, 312, 367), (52, 313, 365), (54, 314, 362), (55, 315, 360), (56, 316, 359), (58, 317, 356), (61, 318, 352), (64, 319, 349), (67, 320, 345), (70, 321, 341), (73, 322, 338), (75, 323, 335), (78, 324, 332), (80, 325, 329), (82, 326, 327), (84, 327, 324), (86, 328, 322), (88, 329, 320), (90, 330, 317), (93, 331, 314), (96, 332, 311), (99, 333, 307), (102, 334, 304), (105, 335, 300), (108, 336, 297), (111, 337, 294), (113, 338, 291), (115, 339, 289), (117, 340, 286), (119, 341, 283), (121, 342, 281), (123, 343, 278), (125, 344, 275), (127, 345, 272), (129, 346, 269), (132, 347, 266), (135, 348, 262), (138, 349, 258), (141, 350, 255), (143, 351, 252), (145, 352, 250), (147, 353, 247), (149, 354, 245), (151, 355, 242), (152, 356, 241), (154, 357, 239), (156, 358, 237), (159, 359, 233), (161, 360, 231), (163, 361, 229), (165, 362, 227), (167, 363, 224), (169, 364, 222), (170, 365, 221), (172, 366, 219), (173, 367, 218), (174, 368, 216), (175, 369, 215), (177, 370, 213), (178, 371, 212), (180, 372, 209), (183, 373, 206), (185, 374, 204), (188, 375, 200), (191, 376, 197), (194, 377, 193), (196, 378, 191), (199, 379, 188), (201, 380, 185), (203, 381, 183), (205, 382, 180), (207, 383, 178), (208, 384, 176), (210, 385, 174), (212, 386, 171), (213, 387, 169), (215, 388, 166), (218, 389, 162), (221, 390, 158), (225, 391, 153), (228, 392, 149), (232, 393, 144), (235, 394, 140), (238, 395, 136), (241, 396, 133), (245, 397, 128), (248, 398, 124), (252, 399, 119), (257, 400, 113), (263, 401, 105), (272, 402, 94), (283, 403, 82), (297, 404, 65), (306, 405, 53), (313, 406, 38), (321, 407, 23)], ['321,407,296,403,263,401,215,388,206,382,178,371,168,363,140,349,110,336,90,330,77,323,56,316,39,299,31,273,31,236,34,199,42,184,58,145,79,131,89,116,89,101,104,88,115,72,159,49,180,43,199,41,237,41,272,38,339,37,382,39,402,43,460,50,481,55,543,116,556,143,566,156,568,167,566,186,554,199,548,216,528,235,496,256,471,275,460,281,414,315,403,339,392,355,383,385,369,400,358,405']), (957285035, 492601069, 445, 485, 636, 23, 174, 0.9711486, [(540, 24, 21), (626, 24, 3), (531, 25, 49), (594, 25, 40), (527, 26, 107), (523, 27, 111), (520, 28, 114), (517, 29, 118), (516, 30, 119), (515, 31, 120), (513, 32, 122), (512, 33, 123), (510, 34, 125), (509, 35, 126), (507, 36, 128), (506, 37, 129), (504, 38, 131), (503, 39, 132), (501, 40, 134), (500, 41, 135), (499, 42, 136), (498, 43, 137), (497, 44, 138), (496, 45, 139), (496, 46, 139), (495, 47, 140), (495, 48, 140), (494, 49, 141), (493, 50, 142), (492, 51, 143), (491, 52, 144), (491, 53, 144), (490, 54, 145), (490, 55, 145), (490, 56, 145), (490, 57, 146), (490, 58, 146), (490, 59, 146), (491, 60, 145), (491, 61, 145), (491, 62, 145), (492, 63, 144), (493, 64, 143), (494, 65, 142), (495, 66, 141), (496, 67, 139), (497, 68, 138), (498, 69, 138), (499, 70, 137), (500, 71, 136), (501, 72, 135), (503, 73, 133), (503, 74, 133), (505, 75, 131), (506, 76, 130), (507, 77, 129), (508, 78, 128), (509, 79, 127), (510, 80, 126), (511, 81, 125), (512, 82, 124), (513, 83, 123), (514, 84, 122), (515, 85, 121), (516, 86, 120), (517, 87, 119), (518, 88, 118), (519, 89, 117), (521, 90, 115), (521, 91, 115), (522, 92, 114), (523, 93, 113), (524, 94, 112), (525, 95, 111), (526, 96, 110), (527, 97, 109), (529, 98, 107), (530, 99, 106), (532, 100, 104), (533, 101, 103), (534, 102, 102), (535, 103, 101), (536, 104, 100), (538, 105, 98), (540, 106, 96), (541, 107, 95), (543, 108, 93), (546, 109, 90), (548, 110, 88), (549, 111, 87), (551, 112, 84), (552, 113, 83), (553, 114, 82), (555, 115, 80), (556, 116, 79), (556, 117, 79), (557, 118, 78), (558, 119, 77), (559, 120, 76), (560, 121, 75), (560, 122, 75), (561, 123, 74), (561, 124, 74), (561, 125, 74), (562, 126, 73), (562, 127, 73), (563, 128, 72), (563, 129, 72), (564, 130, 70), (564, 131, 70), (565, 132, 69), (565, 133, 68), (565, 134, 68), (565, 135, 67), (566, 136, 65), (566, 137, 64), (566, 138, 64), (566, 139, 62), (566, 140, 61), (566, 141, 59), (566, 142, 57), (566, 143, 56), (566, 144, 55), (566, 145, 54), (567, 146, 53), (567, 147, 52), (567, 148, 51), (568, 149, 50), (568, 150, 49), (568, 151, 48), (568, 152, 47), (569, 153, 45), (569, 154, 44), (570, 155, 42), (570, 156, 42), (570, 157, 41), (571, 158, 39), (571, 159, 39), (572, 160, 37), (572, 161, 37), (573, 162, 35), (573, 163, 34), (573, 164, 34), (574, 165, 32), (575, 166, 30), (577, 167, 28), (578, 168, 26), (581, 169, 22), (584, 170, 19), (587, 171, 15), (591, 172, 8)], ['598,172,591,172,586,170,578,168,573,164,573,162,568,152,568,149,566,145,566,136,565,132,561,125,560,121,556,116,547,109,543,108,536,104,531,99,527,97,491,62,490,54,495,48,496,45,501,40,514,32,517,29,531,25,539,25,540,24,560,24,561,25,579,25,580,26,593,26,594,25,633,25,634,29,634,56,635,57,635,111,634,112,634,129,632,134,629,138,623,141,619,145,617,149,611,155,608,161,604,166']), (957285035, 492601069, 445, 280, 481, 2, 55, 0.8294839, [(291, 3, 129), (284, 4, 146), (282, 5, 151), (281, 6, 154), (281, 7, 156), (281, 8, 157), (281, 9, 158), (281, 10, 160), (281, 11, 162), (281, 12, 165), (281, 13, 167), (281, 14, 169), (281, 15, 171), (281, 16, 173), (281, 17, 174), (281, 18, 175), (281, 19, 177), (281, 20, 178), (281, 21, 179), (281, 22, 180), (281, 23, 181), (281, 24, 182), (281, 25, 183), (281, 26, 184), (281, 27, 185), (281, 28, 185), (281, 29, 185), (282, 30, 185), (283, 31, 27), (337, 31, 131), (371, 32, 97), (401, 33, 68), (409, 34, 61), (419, 35, 52), (424, 36, 48), (429, 37, 44), (432, 38, 41), (434, 39, 40), (436, 40, 39), (438, 41, 37), (441, 42, 35), (444, 43, 32), (448, 44, 29), (452, 45, 25), (454, 46, 23), (459, 47, 17), (463, 48, 12), (468, 49, 5)], ['472,49,468,49,467,48,459,47,458,46,454,46,451,44,448,44,447,43,444,43,440,41,438,41,428,36,424,36,423,35,419,35,418,34,409,34,408,33,401,33,400,32,371,32,370,31,337,31,336,30,283,31,281,29,281,6,284,4,290,4,291,3,419,3,420,4,429,4,430,5,432,5,436,7,441,11,445,12,453,16,456,19,457,19,465,27,465,29,472,37,476,44,476,46']), (957285035, 492601069, 445, 456, 547, 6, 45, 0.73653996, [(482, 8, 19), (464, 9, 3), (481, 9, 44), (457, 10, 12), (479, 10, 51), (457, 11, 13), (476, 11, 56), (457, 12, 15), (475, 12, 65), (457, 13, 84), (457, 14, 85), (457, 15, 89), (457, 16, 89), (458, 17, 88), (459, 18, 87), (460, 19, 86), (461, 20, 80), (464, 21, 71), (466, 22, 63), (467, 23, 59), (468, 24, 55), (469, 25, 52), (469, 26, 51), (470, 27, 48), (471, 28, 46), (471, 29, 44), (472, 30, 42), (473, 31, 39), (473, 32, 38), (474, 33, 36), (475, 34, 33), (475, 35, 32), (476, 36, 30), (476, 37, 29), (477, 38, 26), (478, 39, 23), (479, 40, 20), (480, 41, 17), (488, 42, 5)], ['492,42,488,42,487,41,480,41,476,37,475,34,473,32,469,25,465,21,461,20,457,16,457,10,463,10,464,9,466,9,470,12,474,13,476,11,480,10,482,8,500,8,501,9,524,9,525,10,529,10,532,12,539,12,542,15,545,15,545,19,535,20,534,21,529,21,525,23,523,23,513,30,512,30,504,37,496,41,493,41'])], 'temp/1742725229_43872_957285035_a42482e51c93c8025d243dd179aee85b.jpg']} free memory after detection : begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5840 error , can't release the memory or there are other process who occupe the free memory ERROR test release memory FAILED ############################### TEST detect object ################################ run mask_detect Inside batchDatouExec : verbose : False # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : mask_detect list_input_json : [] origin BFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 1 ; length of list_pids : 1 ; length of list_args : 1 time to download the photos : 0.1994316577911377 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : False number of steps : 1 step1:mask_detect Sun Mar 23 11:21:01 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 5840 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-03-23 11:21:04.259291: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-03-23 11:21:04.271076: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-03-23 11:21:04.272440: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f6734000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-03-23 11:21:04.272476: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-03-23 11:21:04.274776: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-03-2025-03-23 11:21:13.464630: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-23 11:21:13.620969: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/mask_coco_origin /data/models_weight/mask_coco_origin/mask_model.h5 size_local : 257557808 size in s3 : 257557808 create time local : 2021-08-09 05:27:17 create time in s3 : 2021-08-06 19:45:17 mask_model.h5 already exist and didn't need to update list_images length : 1 NEW PHOTO Processing 1 images image shape: (720, 1280, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 89) min: 0.00000 max: 1280.00000 nb d'objets trouves : 4 Detection mask done ! Trying to reset tf kernel 46817 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 4328 tf kernel not reseted sub process len(results) : 1 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 1 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 9617 list_Values should be empty [] ['backgroud', 'person', 'bicycle', 'car', 'motorcycle', 'airplane', 'bus', 'train', 'truck', 'boat', 'trafficlight', 'firehydrant', 'stopsign', 'parkingmeter', 'bench', 'bird', 'cat', 'dog', 'horse', 'sheep', 'cow', 'elephant', 'bear', 'zebra', 'giraffe', 'backpack', 'umbrella', 'handbag', 'tie', 'suitcase', 'frisbee', 'skis', 'snowboard', 'sportsball', 'kite', 'baseballbat', 'baseballglove', 'skateboard', 'surfboard', 'tennisracket', 'bottle', 'wineglass', 'cup', 'fork', 'knife', 'spoon', 'bowl', 'banana', 'apple', 'sandwich', 'orange', 'broccoli', 'carrot', 'hotdog', 'pizza', 'donut', 'cake', 'chair', 'couch', 'pottedplant', 'bed', 'diningtable', 'toilet', 'tv', 'laptop', 'mouse', 'remote', 'keyboard', 'cellphone', 'microwave', 'oven', 'toaster', 'sink', 'refrigerator', 'book', 'clock', 'vase', 'scissors', 'teddybear', 'hairdrier', 'toothbrush'] time for calcul the mask position with numpy : 0.0004532337188720703 nb_pixel_total : 16902 time to create 1 rle with old method : 0.0359652042388916 length of segment : 107 time for calcul the mask position with numpy : 0.02043461799621582 nb_pixel_total : 480750 time to create 1 rle with new method : 0.025455236434936523 length of segment : 632 time for calcul the mask position with numpy : 0.0006501674652099609 nb_pixel_total : 36641 time to create 1 rle with old method : 0.08956313133239746 length of segment : 133 time for calcul the mask position with numpy : 0.00011491775512695312 nb_pixel_total : 4793 time to create 1 rle with old method : 0.011659860610961914 length of segment : 51 time spent for convertir_results : 0.4397704601287842 time spend for datou_step_exec : 18.6761212348938 time spend to save output : 3.528594970703125e-05 total time spend for step 1 : 18.676156520843506 caffe_path_current : About to save ! 1 Inside saveOutput : final : True verbose : False eke 12-6-18 : saveMask need to be cleaned for new output ! Catched exception ! Connect or reconnect ! Number saved : None batch 1 Loaded 404 chid ids of type : 445 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 0 begin to insert list_values into mtr_datou_result : length of list_values in save_final : 1 time used for this insertion : 0.013405799865722656 save missing photos in datou_result : After save, about to update current ! datou_cur_ids : [] len(datou.list_steps) : 1 output : {'917855882': [[(917855882, 492601069, 445, 1092, 1280, 0, 108, 0.9988373, [(1205, 1, 58), (1165, 2, 105), (1159, 3, 113), (1149, 4, 124), (1113, 5, 161), (1100, 6, 174), (1097, 7, 177), (1095, 8, 179), (1095, 9, 179), (1095, 10, 179), (1095, 11, 179), (1095, 12, 179), (1095, 13, 179), (1095, 14, 178), (1095, 15, 178), (1095, 16, 178), (1095, 17, 178), (1095, 18, 177), (1095, 19, 177), (1095, 20, 177), (1095, 21, 177), (1095, 22, 177), (1095, 23, 178), (1095, 24, 178), (1095, 25, 178), (1095, 26, 179), (1095, 27, 179), (1095, 28, 180), (1095, 29, 181), (1095, 30, 182), (1095, 31, 183), (1095, 32, 183), (1095, 33, 184), (1095, 34, 184), (1096, 35, 183), (1096, 36, 183), (1096, 37, 184), (1097, 38, 183), (1097, 39, 183), (1097, 40, 183), (1098, 41, 182), (1098, 42, 182), (1098, 43, 182), (1099, 44, 181), (1099, 45, 181), (1099, 46, 181), (1100, 47, 180), (1100, 48, 180), (1101, 49, 179), (1101, 50, 179), (1102, 51, 178), (1102, 52, 178), (1103, 53, 177), (1103, 54, 177), (1104, 55, 176), (1104, 56, 176), (1104, 57, 176), (1104, 58, 176), (1105, 59, 175), (1105, 60, 175), (1105, 61, 175), (1105, 62, 175), (1105, 63, 175), (1106, 64, 174), (1106, 65, 174), (1106, 66, 174), (1106, 67, 174), (1106, 68, 174), (1106, 69, 174), (1106, 70, 174), (1106, 71, 174), (1106, 72, 174), (1106, 73, 174), (1107, 74, 173), (1107, 75, 173), (1107, 76, 173), (1107, 77, 173), (1107, 78, 173), (1107, 79, 173), (1108, 80, 172), (1108, 81, 172), (1109, 82, 171), (1110, 83, 170), (1110, 84, 170), (1111, 85, 169), (1112, 86, 168), (1113, 87, 166), (1114, 88, 165), (1115, 89, 164), (1117, 90, 162), (1120, 91, 159), (1138, 92, 141), (1146, 93, 133), (1154, 94, 125), (1167, 95, 112), (1177, 96, 102), (1183, 97, 95), (1185, 98, 93), (1187, 99, 90), (1188, 100, 55), (1264, 100, 12), (1190, 101, 50), (1191, 102, 46), (1194, 103, 40), (1197, 104, 34), (1202, 105, 25), (1207, 106, 16)], ['1222,106,1207,106,1206,105,1197,104,1191,102,1182,96,1176,95,1167,95,1166,94,1154,94,1153,93,1146,93,1145,92,1137,91,1120,91,1115,89,1110,84,1107,79,1106,73,1106,64,1104,55,1099,46,1095,34,1095,8,1100,6,1112,6,1113,5,1148,5,1149,4,1158,4,1165,2,1204,2,1205,1,1262,1,1269,2,1273,5,1273,13,1271,18,1271,22,1273,27,1277,31,1279,37,1279,86,1278,87,1278,96,1275,100,1264,100,1263,99,1243,99,1230,104']), (917855882, 492601069, 445, 52, 1128, 16, 668, 0.9977489, [(711, 22, 22), (926, 22, 46), (608, 23, 146), (894, 23, 103), (598, 24, 234), (850, 24, 158), (589, 25, 428), (582, 26, 444), (574, 27, 459), (569, 28, 466), (565, 29, 472), (560, 30, 480), (555, 31, 487), (550, 32, 495), (544, 33, 503), (538, 34, 512), (532, 35, 520), (527, 36, 527), (523, 37, 534), (518, 38, 541), (514, 39, 548), (510, 40, 554), (506, 41, 561), (503, 42, 566), (499, 43, 572), (496, 44, 577), (493, 45, 582), (491, 46, 585), (488, 47, 590), (487, 48, 592), (485, 49, 595), (483, 50, 598), (482, 51, 600), (481, 52, 602), (480, 53, 603), (479, 54, 605), (478, 55, 606), (476, 56, 608), (475, 57, 610), (474, 58, 611), (473, 59, 613), (472, 60, 614), (470, 61, 616), (469, 62, 618), (468, 63, 619), (466, 64, 621), (465, 65, 623), (464, 66, 624), (462, 67, 626), (461, 68, 628), (459, 69, 630), (458, 70, 631), (456, 71, 633), (455, 72, 635), (453, 73, 637), (452, 74, 638), (451, 75, 639), (449, 76, 641), (448, 77, 642), (447, 78, 643), (446, 79, 644), (445, 80, 645), (444, 81, 646), (442, 82, 648), (441, 83, 649), (440, 84, 650), (439, 85, 651), (438, 86, 652), (437, 87, 653), (436, 88, 654), (435, 89, 655), (434, 90, 656), (433, 91, 657), (432, 92, 658), (431, 93, 659), (430, 94, 660), (429, 95, 661), (428, 96, 662), (427, 97, 663), (425, 98, 665), (423, 99, 667), (421, 100, 669), (419, 101, 671), (417, 102, 673), (413, 103, 677), (410, 104, 680), (405, 105, 685), (401, 106, 689), (397, 107, 693), (392, 108, 698), (387, 109, 703), (382, 110, 708), (377, 111, 713), (373, 112, 717), (369, 113, 721), (365, 114, 725), (362, 115, 728), (358, 116, 732), (356, 117, 734), (353, 118, 737), (351, 119, 739), (349, 120, 741), (346, 121, 744), (344, 122, 746), (342, 123, 748), (338, 124, 752), (335, 125, 755), (331, 126, 759), (327, 127, 763), (323, 128, 767), (319, 129, 770), (314, 130, 775), (308, 131, 781), (303, 132, 786), (294, 133, 795), (287, 134, 802), (279, 135, 810), (273, 136, 816), (267, 137, 822), (262, 138, 827), (258, 139, 831), (255, 140, 834), (252, 141, 837), (250, 142, 839), (247, 143, 842), (245, 144, 844), (242, 145, 847), (240, 146, 849), (237, 147, 852), (234, 148, 855), (230, 149, 859), (226, 150, 863), (220, 151, 869), (213, 152, 876), (207, 153, 882), (200, 154, 889), (193, 155, 896), (187, 156, 902), (184, 157, 905), (181, 158, 908), (178, 159, 911), (176, 160, 913), (174, 161, 915), (172, 162, 917), (170, 163, 919), (168, 164, 921), (167, 165, 922), (165, 166, 924), (164, 167, 925), (162, 168, 927), (161, 169, 928), (159, 170, 930), (157, 171, 932), (155, 172, 934), (153, 173, 935), (151, 174, 937), (148, 175, 940), (146, 176, 942), (144, 177, 944), (142, 178, 946), (140, 179, 948), (139, 180, 949), (137, 181, 951), (136, 182, 952), (134, 183, 954), (133, 184, 955), (132, 185, 956), (131, 186, 957), (130, 187, 958), (129, 188, 959), (128, 189, 960), (127, 190, 960), (126, 191, 961), (126, 192, 961), (125, 193, 962), (124, 194, 963), (123, 195, 964), (122, 196, 965), (122, 197, 965), (121, 198, 966), (120, 199, 967), (119, 200, 968), (118, 201, 969), (117, 202, 970), (116, 203, 971), (114, 204, 973), (113, 205, 973), (112, 206, 974), (111, 207, 975), (109, 208, 977), (108, 209, 978), (107, 210, 979), (106, 211, 980), (105, 212, 981), (104, 213, 982), (103, 214, 983), (102, 215, 984), (101, 216, 985), (101, 217, 984), (100, 218, 985), (100, 219, 985), (99, 220, 986), (98, 221, 987), (98, 222, 987), (97, 223, 988), (97, 224, 987), (96, 225, 988), (96, 226, 988), (95, 227, 989), (95, 228, 989), (94, 229, 990), (94, 230, 990), (94, 231, 990), (93, 232, 990), (93, 233, 990), (92, 234, 991), (92, 235, 991), (92, 236, 991), (91, 237, 992), (91, 238, 991), (91, 239, 991), (91, 240, 991), (91, 241, 990), (90, 242, 991), (90, 243, 990), (90, 244, 990), (90, 245, 989), (90, 246, 989), (89, 247, 990), (89, 248, 989), (89, 249, 989), (89, 250, 988), (89, 251, 988), (88, 252, 988), (88, 253, 988), (88, 254, 987), (88, 255, 986), (88, 256, 986), (87, 257, 986), (87, 258, 986), (87, 259, 985), (87, 260, 984), (87, 261, 983), (86, 262, 983), (86, 263, 983), (86, 264, 982), (86, 265, 981), (85, 266, 981), (85, 267, 980), (85, 268, 980), (84, 269, 980), (84, 270, 979), (84, 271, 979), (84, 272, 978), (83, 273, 979), (83, 274, 978), (83, 275, 977), (82, 276, 978), (82, 277, 977), (82, 278, 977), (81, 279, 977), (81, 280, 977), (81, 281, 977), (80, 282, 977), (80, 283, 977), (80, 284, 976), (79, 285, 977), (79, 286, 976), (79, 287, 976), (78, 288, 976), (78, 289, 976), (78, 290, 975), (77, 291, 976), (77, 292, 975), (77, 293, 975), (76, 294, 975), (76, 295, 975), (76, 296, 974), (75, 297, 975), (75, 298, 974), (74, 299, 975), (74, 300, 974), (74, 301, 974), (73, 302, 974), (73, 303, 974), (72, 304, 974), (72, 305, 974), (71, 306, 974), (71, 307, 973), (71, 308, 972), (70, 309, 972), (70, 310, 971), (70, 311, 970), (70, 312, 968), (69, 313, 968), (69, 314, 966), (69, 315, 964), (69, 316, 962), (68, 317, 961), (68, 318, 959), (68, 319, 958), (68, 320, 956), (67, 321, 955), (67, 322, 954), (67, 323, 952), (67, 324, 951), (66, 325, 951), (66, 326, 950), (66, 327, 948), (66, 328, 947), (65, 329, 947), (65, 330, 946), (65, 331, 946), (65, 332, 945), (65, 333, 944), (65, 334, 942), (65, 335, 941), (65, 336, 940), (65, 337, 939), (65, 338, 938), (64, 339, 937), (64, 340, 936), (64, 341, 934), (64, 342, 932), (64, 343, 930), (64, 344, 928), (64, 345, 926), (64, 346, 925), (64, 347, 923), (64, 348, 922), (64, 349, 920), (64, 350, 919), (63, 351, 919), (63, 352, 918), (63, 353, 917), (63, 354, 916), (63, 355, 915), (63, 356, 914), (63, 357, 912), (63, 358, 911), (63, 359, 910), (63, 360, 909), (63, 361, 908), (63, 362, 906), (63, 363, 905), (63, 364, 904), (63, 365, 902), (63, 366, 901), (63, 367, 899), (63, 368, 898), (63, 369, 896), (62, 370, 895), (62, 371, 893), (62, 372, 891), (62, 373, 890), (62, 374, 888), (62, 375, 887), (62, 376, 886), (62, 377, 885), (62, 378, 884), (62, 379, 883), (63, 380, 880), (63, 381, 879), (63, 382, 878), (63, 383, 877), (63, 384, 876), (63, 385, 875), (63, 386, 874), (63, 387, 873), (63, 388, 872), (64, 389, 870), (64, 390, 869), (64, 391, 868), (64, 392, 867), (64, 393, 865), (64, 394, 864), (64, 395, 863), (65, 396, 861), (65, 397, 860), (65, 398, 859), (65, 399, 858), (65, 400, 857), (65, 401, 856), (65, 402, 854), (65, 403, 853), (65, 404, 851), (65, 405, 850), (65, 406, 848), (66, 407, 846), (66, 408, 844), (66, 409, 843), (66, 410, 842), (66, 411, 841), (66, 412, 840), (66, 413, 838), (66, 414, 837), (66, 415, 836), (66, 416, 835), (66, 417, 835), (66, 418, 834), (66, 419, 833), (67, 420, 831), (67, 421, 830), (67, 422, 829), (67, 423, 829), (67, 424, 828), (67, 425, 827), (67, 426, 826), (67, 427, 825), (67, 428, 824), (68, 429, 822), (68, 430, 820), (68, 431, 819), (68, 432, 818), (68, 433, 816), (68, 434, 815), (68, 435, 813), (68, 436, 811), (69, 437, 809), (69, 438, 807), (69, 439, 806), (69, 440, 804), (69, 441, 803), (69, 442, 802), (69, 443, 800), (70, 444, 798), (70, 445, 797), (70, 446, 796), (70, 447, 796), (71, 448, 794), (71, 449, 794), (72, 450, 792), (72, 451, 792), (73, 452, 790), (73, 453, 789), (74, 454, 788), (74, 455, 787), (75, 456, 786), (75, 457, 785), (76, 458, 784), (76, 459, 783), (77, 460, 782), (77, 461, 781), (77, 462, 781), (78, 463, 779), (78, 464, 779), (79, 465, 777), (79, 466, 777), (79, 467, 776), (80, 468, 775), (80, 469, 774), (80, 470, 774), (81, 471, 772), (81, 472, 771), (82, 473, 770), (82, 474, 769), (83, 475, 767), (83, 476, 766), (83, 477, 766), (84, 478, 764), (84, 479, 763), (85, 480, 761), (85, 481, 760), (85, 482, 759), (86, 483, 757), (86, 484, 755), (87, 485, 753), (87, 486, 752), (87, 487, 751), (88, 488, 748), (88, 489, 747), (88, 490, 746), (89, 491, 744), (89, 492, 743), (90, 493, 741), (90, 494, 741), (91, 495, 739), (91, 496, 738), (92, 497, 737), (93, 498, 735), (94, 499, 733), (94, 500, 733), (95, 501, 731), (96, 502, 729), (97, 503, 728), (98, 504, 726), (99, 505, 724), (99, 506, 724), (100, 507, 722), (101, 508, 721), (102, 509, 719), (104, 510, 717), (105, 511, 715), (106, 512, 714), (107, 513, 712), (108, 514, 711), (110, 515, 708), (111, 516, 707), (113, 517, 704), (114, 518, 703), (115, 519, 701), (117, 520, 698), (118, 521, 697), (119, 522, 695), (121, 523, 693), (122, 524, 691), (124, 525, 689), (125, 526, 687), (126, 527, 685), (128, 528, 683), (129, 529, 681), (131, 530, 678), (132, 531, 676), (134, 532, 673), (135, 533, 672), (137, 534, 669), (138, 535, 667), (140, 536, 664), (141, 537, 662), (143, 538, 659), (144, 539, 657), (146, 540, 654), (148, 541, 651), (149, 542, 649), (151, 543, 645), (153, 544, 642), (154, 545, 640), (156, 546, 638), (158, 547, 635), (159, 548, 633), (161, 549, 630), (162, 550, 628), (164, 551, 626), (166, 552, 623), (167, 553, 621), (169, 554, 618), (170, 555, 617), (171, 556, 615), (173, 557, 613), (174, 558, 611), (176, 559, 608), (177, 560, 607), (178, 561, 605), (180, 562, 603), (181, 563, 601), (183, 564, 599), (184, 565, 598), (186, 566, 595), (189, 567, 592), (192, 568, 589), (195, 569, 585), (198, 570, 582), (201, 571, 579), (204, 572, 575), (206, 573, 573), (209, 574, 569), (212, 575, 566), (215, 576, 563), (218, 577, 559), (221, 578, 556), (223, 579, 553), (226, 580, 550), (228, 581, 547), (230, 582, 545), (232, 583, 542), (234, 584, 540), (235, 585, 539), (237, 586, 536), (238, 587, 534), (240, 588, 531), (242, 589, 528), (243, 590, 526), (245, 591, 523), (247, 592, 520), (249, 593, 516), (251, 594, 513), (253, 595, 510), (256, 596, 505), (258, 597, 501), (261, 598, 497), (263, 599, 493), (267, 600, 488), (271, 601, 482), (274, 602, 478), (278, 603, 473), (281, 604, 468), (284, 605, 464), (287, 606, 460), (290, 607, 456), (292, 608, 453), (295, 609, 449), (297, 610, 446), (300, 611, 442), (303, 612, 438), (305, 613, 434), (307, 614, 431), (310, 615, 427), (312, 616, 423), (315, 617, 418), (317, 618, 415), (320, 619, 410), (322, 620, 406), (325, 621, 401), (327, 622, 396), (330, 623, 390), (333, 624, 384), (335, 625, 379), (338, 626, 374), (341, 627, 369), (345, 628, 362), (349, 629, 356), (353, 630, 350), (357, 631, 344), (360, 632, 340), (364, 633, 334), (368, 634, 327), (373, 635, 320), (378, 636, 313), (383, 637, 305), (389, 638, 295), (395, 639, 282), (401, 640, 270), (408, 641, 256), (416, 642, 240), (432, 643, 216), (448, 644, 193), (465, 645, 169), (480, 646, 148), (495, 647, 126), (511, 648, 104), (526, 649, 82), (565, 650, 9)], ['526,649,416,642,341,627,289,606,263,599,220,577,186,566,102,509,91,496,70,447,63,388,65,329,86,265,91,237,101,216,134,183,187,156,225,151,279,135,302,133,341,124,358,116,416,103,483,50,506,41,608,23,754,24,893,24,926,22,996,23,1032,27,1066,41,1082,52,1089,72,1088,172,1082,237,1045,305,1019,322,1002,338,950,373,895,423,865,446,851,473,822,505,810,528,786,554,773,585,725,621,683,638,607,649']), (917855882, 492601069, 445, 0, 440, 0, 116, 0.9919408, [(127, 1, 141), (94, 2, 206), (384, 2, 2), (59, 3, 273), (340, 3, 57), (22, 4, 381), (19, 5, 387), (16, 6, 392), (15, 7, 394), (14, 8, 396), (14, 9, 397), (13, 10, 399), (12, 11, 400), (12, 12, 400), (11, 13, 402), (10, 14, 403), (11, 15, 403), (11, 16, 404), (12, 17, 403), (12, 18, 404), (12, 19, 405), (12, 20, 405), (12, 21, 406), (12, 22, 406), (12, 23, 407), (12, 24, 407), (12, 25, 408), (12, 26, 408), (12, 27, 408), (12, 28, 408), (12, 29, 409), (12, 30, 409), (12, 31, 409), (12, 32, 409), (12, 33, 409), (12, 34, 410), (12, 35, 410), (12, 36, 410), (12, 37, 410), (12, 38, 410), (12, 39, 410), (12, 40, 410), (12, 41, 411), (12, 42, 411), (12, 43, 411), (12, 44, 411), (12, 45, 411), (12, 46, 411), (12, 47, 410), (12, 48, 410), (12, 49, 410), (12, 50, 410), (12, 51, 410), (12, 52, 409), (12, 53, 408), (12, 54, 408), (12, 55, 407), (12, 56, 406), (12, 57, 404), (12, 58, 403), (11, 59, 403), (11, 60, 402), (11, 61, 401), (11, 62, 400), (11, 63, 400), (11, 64, 399), (11, 65, 398), (11, 66, 397), (11, 67, 397), (11, 68, 396), (11, 69, 395), (11, 70, 395), (11, 71, 394), (11, 72, 394), (11, 73, 394), (11, 74, 393), (11, 75, 393), (11, 76, 393), (11, 77, 393), (11, 78, 393), (11, 79, 393), (11, 80, 392), (10, 81, 394), (10, 82, 394), (10, 83, 395), (9, 84, 396), (9, 85, 261), (279, 85, 126), (9, 86, 75), (98, 86, 28), (142, 86, 117), (292, 86, 112), (9, 87, 71), (152, 87, 103), (294, 87, 110), (8, 88, 68), (161, 88, 91), (296, 88, 107), (8, 89, 63), (177, 89, 72), (297, 89, 106), (7, 90, 61), (205, 90, 40), (298, 90, 104), (7, 91, 57), (299, 91, 103), (6, 92, 54), (300, 92, 102), (6, 93, 50), (301, 93, 100), (7, 94, 46), (303, 94, 97), (7, 95, 44), (306, 95, 92), (7, 96, 42), (308, 96, 89), (7, 97, 40), (310, 97, 86), (7, 98, 38), (312, 98, 83), (8, 99, 34), (314, 99, 79), (8, 100, 32), (317, 100, 75), (8, 101, 29), (319, 101, 71), (13, 102, 19), (324, 102, 63), (20, 103, 6), (330, 103, 51), (337, 104, 37), (344, 105, 22), (352, 106, 3)], ['344,105,343,104,319,101,301,93,291,85,259,85,244,90,205,90,204,89,177,89,176,88,161,88,160,87,142,86,141,85,125,86,98,86,84,85,56,92,36,101,26,102,8,101,6,92,11,80,11,59,12,58,12,17,10,14,16,6,22,4,58,4,59,3,93,3,94,2,126,2,127,1,267,1,268,2,396,3,407,6,419,25,422,46,419,54,410,62,403,74,404,85,401,92,394,98,386,102,365,105']), (917855882, 492601069, 445, 390, 550, 0, 54, 0.9391315, [(414, 0, 7), (441, 0, 60), (508, 0, 28), (402, 1, 142), (401, 2, 146), (402, 3, 145), (404, 4, 143), (406, 5, 140), (408, 6, 137), (410, 7, 134), (411, 8, 132), (412, 9, 130), (413, 10, 127), (414, 11, 125), (415, 12, 123), (415, 13, 122), (416, 14, 120), (417, 15, 117), (417, 16, 116), (418, 17, 114), (418, 18, 113), (418, 19, 111), (418, 20, 109), (419, 21, 107), (419, 22, 105), (419, 23, 103), (419, 24, 102), (420, 25, 99), (420, 26, 97), (420, 27, 95), (420, 28, 94), (421, 29, 91), (421, 30, 90), (422, 31, 88), (422, 32, 88), (422, 33, 87), (423, 34, 84), (423, 35, 82), (423, 36, 81), (424, 37, 79), (424, 38, 77), (424, 39, 75), (424, 40, 73), (424, 41, 71), (425, 42, 67), (425, 43, 66), (426, 44, 62), (426, 45, 6), (433, 45, 52), (443, 46, 30), (450, 47, 1)], ['449,46,443,46,442,45,426,45,424,41,424,37,423,36,422,31,420,28,420,25,419,24,419,21,418,20,418,17,417,15,409,6,402,3,402,1,413,1,414,0,420,0,421,1,440,1,441,0,500,0,501,1,507,1,508,0,535,0,536,1,543,1,546,2,546,4,542,8,530,18,527,19,525,21,522,22,520,24,512,28,508,33,505,34,502,37,494,41,492,41,490,43,488,43,484,45,473,45,472,46'])], 'temp/1742725260_43872_917855882_da0fa7b7e6b5b551fe26c0ba8713276d.jpg']} ############################### TEST POLYGON ################################ Inside batchDatouExec : verbose : False # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : mask_detect list_input_json : [] origin BFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 1 ; length of list_pids : 1 ; length of list_args : 1 time to download the photos : 0.22787809371948242 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : False number of steps : 1 step1:mask_detect Sun Mar 23 11:21:21 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 9617 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-03-23 11:21:25.101701: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-03-23 11:21:25.127134: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-03-23 11:21:25.129208: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f672c000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-03-23 11:21:25.129255: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-03-23 11:21:25.132760: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-03-23 11:21:25.382219: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x2cf39ef0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-03-23 11:21:25.382282: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-03-23 11:21:25.383770: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-03-23 11:21:25.384229: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-23 11:21:25.408745: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-23 11:21:25.411814: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-03-23 11:21:25.412513: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-03-23 11:21:25.415861: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-03-23 11:21:25.417548: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-03-23 11:21:25.423042: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-03-23 11:21:25.424744: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-03-23 11:21:25.424874: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-23 11:21:25.425631: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-03-23 11:21:25.425646: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-03-23 11:21:25.425655: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-03-23 11:21:25.426914: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 8897 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-03-23 11:21:25.547910: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-03-23 11:21:25.548008: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-23 11:21:25.548031: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-23 11:21:25.548052: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-03-23 11:21:25.548071: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-03-23 11:21:25.548091: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-03-23 11:21:25.548110: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-03-23 11:21:25.548129: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-03-23 11:21:25.549407: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-03-23 11:21:25.550536: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-03-23 11:21:25.550579: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-23 11:21:25.550610: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-23 11:21:25.550627: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-03-23 11:21:25.550644: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-03-23 11:21:25.550661: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-03-23 11:21:25.550677: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-03-23 11:21:25.550694: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-03-23 11:21:25.551971: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-03-23 11:21:25.552005: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-03-23 11:21:25.552014: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-03-23 11:21:25.552022: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-03-23 11:21:25.553550: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 8897 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (3473, 'mask_coco_origin', 16384, 25088, 'mask_coco_origin', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2018, 3, 19, 10, 42, 21), datetime.datetime(2018, 3, 19, 10, 42, 21)) {'thcl': {'id': 454, 'mtr_user_id': 31, 'name': 'mask_coco_origin', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'backgroud,person,bicycle,car,motorcycle,airplane,bus,train,truck,boat,trafficlight,firehydrant,stopsign,parkingmeter,bench,bird,cat,dog,horse,sheep,cow,elephant,bear,zebra,giraffe,backpack,umbrella,handbag,tie,suitcase,frisbee,skis,snowboard,sportsball,kite,baseballbat,baseballglove,skateboard,surfboard,tennisracket,bottle,wineglass,cup,fork,knife,spoon,bowl,banana,apple,sandwich,orange,broccoli,carrot,hotdog,pizza,donut,cake,chair,couch,pottedplant,bed,diningtable,toilet,tv,laptop,mouse,remote,keyboard,cellphone,microwave,oven,toaster,sink,refrigerator,book,clock,vase,scissors,teddybear,hairdrier,toothbrush', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 445, 'photo_desc_type': 3473, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['backgroud', 'person', 'bicycle', 'car', 'motorcycle', 'airplane', 'bus', 'train', 'truck', 'boat', 'trafficlight', 'firehydrant', 'stopsign', 'parkingmeter', 'bench', 'bird', 'cat', 'dog', 'horse', 'sheep', 'cow', 'elephant', 'bear', 'zebra', 'giraffe', 'backpack', 'umbrella', 'handbag', 'tie', 'suitcase', 'frisbee', 'skis', 'snowboard', 'sportsball', 'kite', 'baseballbat', 'baseballglove', 'skateboard', 'surfboard', 'tennisracket', 'bottle', 'wineglass', 'cup', 'fork', 'knife', 'spoon', 'bowl', 'banana', 'apple', 'sandwich', 'orange', 'broccoli', 'carrot', 'hotdog', 'pizza', 'donut', 'cake', 'chair', 'couch', 'pottedplant', 'bed', 'diningtable', 'toilet', 'tv', 'laptop', 'mouse', 'remote', 'keyboard', 'cellphone', 'microwave', 'oven', 'toaster', 'sink', 'refrigerator', 'book', 'clock', 'vase', 'scissors', 'teddybear', 'hairdrier', 'toothbrush'], 'list_hashtags_csv': 'backgroud,person,bicycle,car,motorcycle,airplane,bus,train,truck,boat,trafficlight,firehydrant,stopsign,parkingmeter,bench,bird,cat,dog,horse,sheep,cow,elephant,bear,zebra,giraffe,backpack,umbrella,handbag,tie,suitcase,frisbee,skis,snowboard,sportsball,kite,baseballbat,baseballglove,skateboard,surfboard,tennisracket,bottle,wineglass,cup,fork,knife,spoon,bowl,banana,apple,sandwich,orange,broccoli,carrot,hotdog,pizza,donut,cake,chair,couch,pottedplant,bed,diningtable,toilet,tv,laptop,mouse,remote,keyboard,cellphone,microwave,oven,toaster,sink,refrigerator,book,clock,vase,scissors,teddybear,hairdrier,toothbrush', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 445, 'svm_hashtag_type_desc': 3473, 'photo_desc_type': 3473, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['backgroud', 'person', 'bicycle', 'car', 'motorcycle', 'airplane', 'bus', 'train', 'truck', 'boat', 'trafficlight', 'firehydrant', 'stopsign', 'parkingmeter', 'bench', 'bird', 'cat', 'dog', 'horse', 'sheep', 'cow', 'elephant', 'bear', 'zebra', 'giraffe', 'backpack', 'umbrella', 'handbag', 'tie', 'suitcase', 'frisbee', 'skis', 'snowboard', 'sportsball', 'kite', 'baseballbat', 'baseballglove', 'skateboard', 'surfboard', 'tennisracket', 'bottle', 'wineglass', 'cup', 'fork', 'knife', 'spoon', 'bowl', 'banana', 'apple', 'sandwich', 'orange', 'broccoli', 'carrot', 'hotdog', 'pizza', 'donut', 'cake', 'chair', 'couch', 'pottedplant', 'bed', 'diningtable', 'toilet', 'tv', 'laptop', 'mouse', 'remote', 'keyboard', 'cellphone', 'microwave', 'oven', 'toaster', 'sink', 'refrigerator', 'book', 'clock', 'vase', 'scissors', 'teddybear', 'hairdrier', 'toothbrush'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME mask_coco_origin NUM_CLASSES 81 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : mask_coco_origin model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-03-23 11:21:36.197793: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-23 11:21:36.339911: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/mask_coco_origin /data/models_weight/mask_coco_origin/mask_model.h5 size_local : 257557808 size in s3 : 257557808 create time local : 2021-08-09 05:27:17 create time in s3 : 2021-08-06 19:45:17 mask_model.h5 already exist and didn't need to update list_images length : 1 NEW PHOTO Processing 1 images image shape: (2448, 2448, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 89) min: 0.00000 max: 2448.00000 nb d'objets trouves : 1 Detection mask done ! Trying to reset tf kernel 48296 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 4328 tf kernel not reseted sub process len(results) : 1 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 1 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 9617 list_Values should be empty [] ['backgroud', 'person', 'bicycle', 'car', 'motorcycle', 'airplane', 'bus', 'train', 'truck', 'boat', 'trafficlight', 'firehydrant', 'stopsign', 'parkingmeter', 'bench', 'bird', 'cat', 'dog', 'horse', 'sheep', 'cow', 'elephant', 'bear', 'zebra', 'giraffe', 'backpack', 'umbrella', 'handbag', 'tie', 'suitcase', 'frisbee', 'skis', 'snowboard', 'sportsball', 'kite', 'baseballbat', 'baseballglove', 'skateboard', 'surfboard', 'tennisracket', 'bottle', 'wineglass', 'cup', 'fork', 'knife', 'spoon', 'bowl', 'banana', 'apple', 'sandwich', 'orange', 'broccoli', 'carrot', 'hotdog', 'pizza', 'donut', 'cake', 'chair', 'couch', 'pottedplant', 'bed', 'diningtable', 'toilet', 'tv', 'laptop', 'mouse', 'remote', 'keyboard', 'cellphone', 'microwave', 'oven', 'toaster', 'sink', 'refrigerator', 'book', 'clock', 'vase', 'scissors', 'teddybear', 'hairdrier', 'toothbrush'] time for calcul the mask position with numpy : 0.3958415985107422 nb_pixel_total : 3693365 time to create 1 rle with new method : 0.3667271137237549 length of segment : 2041 time spent for convertir_results : 2.086212158203125 time spend for datou_step_exec : 22.80564594268799 time spend to save output : 2.956390380859375e-05 total time spend for step 1 : 22.805675506591797 caffe_path_current : About to save ! 1 Inside saveOutput : final : True verbose : False eke 12-6-18 : saveMask need to be cleaned for new output ! Catched exception ! Connect or reconnect ! Number saved : None batch 1 Loaded 721 chid ids of type : 445 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 0 begin to insert list_values into mtr_datou_result : length of list_values in save_final : 1 time used for this insertion : 0.01671004295349121 save missing photos in datou_result : After save, about to update current ! datou_cur_ids : [] len(datou.list_steps) : 1 output : {'917877156': [[(917877156, 492601069, 445, 7, 2268, 118, 2241, 0.98500896, [(675, 120, 112), (520, 121, 481), (1050, 121, 381), (502, 122, 947), (486, 123, 981), (470, 124, 1015), (455, 125, 1046), (442, 126, 1092), (429, 127, 1136), (417, 128, 1168), (405, 129, 1187), (394, 130, 1205), (383, 131, 1222), (373, 132, 1239), (368, 133, 1250), (366, 134, 1258), (363, 135, 1266), (361, 136, 1274), (359, 137, 1281), (357, 138, 1288), (355, 139, 1295), (353, 140, 1302), (351, 141, 1309), (349, 142, 1315), (347, 143, 1320), (345, 144, 1326), (343, 145, 1331), (342, 146, 1335), (340, 147, 1340), (338, 148, 1345), (337, 149, 1349), (335, 150, 1354), (334, 151, 1358), (332, 152, 1363), (331, 153, 1366), (330, 154, 1370), (328, 155, 1374), (327, 156, 1378), (326, 157, 1381), (325, 158, 1385), (323, 159, 1389), (322, 160, 1393), (321, 161, 1397), (319, 162, 1402), (318, 163, 1406), (317, 164, 1410), (315, 165, 1415), (314, 166, 1419), (312, 167, 1424), (310, 168, 1429), (309, 169, 1434), (307, 170, 1439), (305, 171, 1444), (304, 172, 1448), (302, 173, 1453), (300, 174, 1458), (298, 175, 1463), (296, 176, 1469), (294, 177, 1474), (292, 178, 1480), (289, 179, 1487), (286, 180, 1493), (283, 181, 1500), (280, 182, 1508), (278, 183, 1514), (275, 184, 1521), (272, 185, 1529), (269, 186, 1536), (266, 187, 1544), (263, 188, 1552), (260, 189, 1561), (257, 190, 1569), (254, 191, 1579), (251, 192, 1588), (248, 193, 1597), (245, 194, 1606), (242, 195, 1615), (239, 196, 1624), (237, 197, 1631), (234, 198, 1640), (231, 199, 1648), (228, 200, 1657), (225, 201, 1665), (222, 202, 1673), (219, 203, 1681), (216, 204, 1689), (213, 205, 1694), (210, 206, 1699), (208, 207, 1702), (206, 208, 1706), (204, 209, 1710), (203, 210, 1712), (201, 211, 1716), (199, 212, 1719), (198, 213, 1721), (196, 214, 1725), (195, 215, 1727), (193, 216, 1730), (192, 217, 1733), (191, 218, 1735), (189, 219, 1738), (188, 220, 1740), (187, 221, 1742), (186, 222, 1744), (185, 223, 1746), (183, 224, 1749), (182, 225, 1751), (181, 226, 1753), (180, 227, 1755), (179, 228, 1757), (178, 229, 1759), (177, 230, 1761), (176, 231, 1762), (176, 232, 1763), (175, 233, 1765), (174, 234, 1767), (173, 235, 1768), (172, 236, 1770), (171, 237, 1772), (170, 238, 1774), (169, 239, 1775), (168, 240, 1777), (167, 241, 1779), (166, 242, 1781), (165, 243, 1783), (164, 244, 1785), (163, 245, 1787), (162, 246, 1789), (161, 247, 1791), (159, 248, 1794), (158, 249, 1796), (157, 250, 1798), (156, 251, 1800), (154, 252, 1803), (153, 253, 1805), (152, 254, 1807), (150, 255, 1810), (149, 256, 1812), (148, 257, 1815), (146, 258, 1818), (145, 259, 1820), (143, 260, 1823), (142, 261, 1826), (140, 262, 1829), (138, 263, 1833), (137, 264, 1835), (135, 265, 1839), (133, 266, 1842), (132, 267, 1845), (130, 268, 1849), (128, 269, 1852), (126, 270, 1856), (125, 271, 1859), (124, 272, 1862), (122, 273, 1865), (121, 274, 1868), (120, 275, 1871), (119, 276, 1873), (118, 277, 1876), (116, 278, 1879), (115, 279, 1881), (114, 280, 1884), (113, 281, 1886), (112, 282, 1888), (111, 283, 1890), (110, 284, 1892), (109, 285, 1895), (108, 286, 1897), (108, 287, 1898), (107, 288, 1900), (106, 289, 1902), (105, 290, 1904), (104, 291, 1906), (103, 292, 1908), (103, 293, 1909), (102, 294, 1910), (101, 295, 1912), (101, 296, 1913), (100, 297, 1915), (99, 298, 1917), (99, 299, 1918), (98, 300, 1919), (97, 301, 1921), (97, 302, 1922), (96, 303, 1924), (95, 304, 1925), (95, 305, 1926), (94, 306, 1928), (94, 307, 1928), (93, 308, 1930), (93, 309, 1930), (93, 310, 1931), (93, 311, 1931), (92, 312, 1933), (92, 313, 1933), (92, 314, 1934), (92, 315, 1934), (91, 316, 1936), (91, 317, 1936), (91, 318, 1937), (91, 319, 1937), (90, 320, 1939), (90, 321, 1939), (90, 322, 1940), (89, 323, 1941), (89, 324, 1942), (89, 325, 1943), (89, 326, 1943), (88, 327, 1945), (88, 328, 1945), (88, 329, 1946), (87, 330, 1948), (87, 331, 1948), (87, 332, 1949), (87, 333, 1949), (86, 334, 1951), (86, 335, 1952), (86, 336, 1952), (85, 337, 1954), (85, 338, 1955), (85, 339, 1955), (85, 340, 1956), (84, 341, 1958), (84, 342, 1959), (84, 343, 1959), (83, 344, 1961), (83, 345, 1962), (83, 346, 1963), (83, 347, 1963), (82, 348, 1965), (82, 349, 1966), (82, 350, 1967), (81, 351, 1969), (81, 352, 1970), (81, 353, 1970), (80, 354, 1972), (80, 355, 1973), (80, 356, 1974), (80, 357, 1975), (79, 358, 1977), (79, 359, 1978), (79, 360, 1979), (78, 361, 1981), (78, 362, 1982), (78, 363, 1983), (77, 364, 1985), (77, 365, 1986), (77, 366, 1987), (76, 367, 1989), (76, 368, 1990), (76, 369, 1991), (76, 370, 1992), (75, 371, 1994), (75, 372, 1995), (75, 373, 1996), (74, 374, 1998), (74, 375, 1999), (74, 376, 2000), (73, 377, 2002), (73, 378, 2003), (73, 379, 2004), (72, 380, 2005), (72, 381, 2006), (72, 382, 2007), (71, 383, 2009), (71, 384, 2009), (71, 385, 2010), (70, 386, 2012), (70, 387, 2012), (70, 388, 2013), (70, 389, 2013), (69, 390, 2015), (69, 391, 2015), (69, 392, 2016), (68, 393, 2017), (68, 394, 2018), (68, 395, 2019), (67, 396, 2020), (67, 397, 2021), (67, 398, 2021), (66, 399, 2023), (66, 400, 2023), (65, 401, 2025), (65, 402, 2025), (65, 403, 2026), (64, 404, 2027), (64, 405, 2028), (64, 406, 2028), (63, 407, 2030), (63, 408, 2030), (63, 409, 2031), (62, 410, 2032), (62, 411, 2033), (61, 412, 2034), (61, 413, 2034), (61, 414, 2035), (60, 415, 2036), (60, 416, 2037), (59, 417, 2038), (59, 418, 2039), (58, 419, 2040), (58, 420, 2041), (58, 421, 2041), (57, 422, 2042), (57, 423, 2043), (56, 424, 2044), (56, 425, 2045), (55, 426, 2046), (55, 427, 2047), (54, 428, 2048), (54, 429, 2048), (53, 430, 2050), (53, 431, 2050), (52, 432, 2052), (52, 433, 2052), (51, 434, 2053), (51, 435, 2054), (50, 436, 2055), (50, 437, 2055), (49, 438, 2057), (49, 439, 2057), (48, 440, 2059), (48, 441, 2059), (47, 442, 2060), (47, 443, 2061), (46, 444, 2062), (46, 445, 2062), (45, 446, 2064), (45, 447, 2064), (44, 448, 2065), (44, 449, 2066), (43, 450, 2067), (43, 451, 2068), (42, 452, 2069), (42, 453, 2069), (41, 454, 2071), (41, 455, 2071), (40, 456, 2072), (40, 457, 2073), (39, 458, 2074), (39, 459, 2074), (39, 460, 2074), (39, 461, 2075), (39, 462, 2075), (38, 463, 2076), (38, 464, 2077), (38, 465, 2077), (38, 466, 2077), (38, 467, 2078), (38, 468, 2078), (37, 469, 2079), (37, 470, 2080), (37, 471, 2080), (37, 472, 2080), (37, 473, 2081), (37, 474, 2081), (36, 475, 2082), (36, 476, 2083), (36, 477, 2083), (36, 478, 2083), (36, 479, 2084), (36, 480, 2084), (35, 481, 2085), (35, 482, 2086), (35, 483, 2086), (35, 484, 2087), (35, 485, 2087), (35, 486, 2087), (34, 487, 2089), (34, 488, 2089), (34, 489, 2089), (34, 490, 2090), (34, 491, 2090), (34, 492, 2091), (34, 493, 2091), (33, 494, 2093), (33, 495, 2093), (33, 496, 2093), (33, 497, 2094), (33, 498, 2094), (33, 499, 2095), (33, 500, 2095), (32, 501, 2097), (32, 502, 2097), (32, 503, 2098), (32, 504, 2098), (32, 505, 2099), (32, 506, 2099), (32, 507, 2100), (31, 508, 2101), (31, 509, 2102), (31, 510, 2102), (31, 511, 2103), (31, 512, 2103), (31, 513, 2104), (31, 514, 2104), (30, 515, 2106), (30, 516, 2106), (30, 517, 2107), (30, 518, 2108), (30, 519, 2108), (30, 520, 2109), (30, 521, 2109), (30, 522, 2110), (29, 523, 2112), (29, 524, 2112), (29, 525, 2113), (29, 526, 2114), (29, 527, 2114), (29, 528, 2115), (29, 529, 2116), (29, 530, 2116), (28, 531, 2118), (28, 532, 2119), (28, 533, 2120), (28, 534, 2120), (28, 535, 2121), (28, 536, 2121), (28, 537, 2121), (28, 538, 2122), (28, 539, 2122), (28, 540, 2122), (28, 541, 2123), (28, 542, 2123), (27, 543, 2124), (27, 544, 2125), (27, 545, 2125), (27, 546, 2125), (27, 547, 2126), (27, 548, 2126), (27, 549, 2126), (27, 550, 2127), (27, 551, 2127), (27, 552, 2127), (27, 553, 2128), (27, 554, 2128), (27, 555, 2128), (27, 556, 2128), (27, 557, 2129), (27, 558, 2129), (27, 559, 2129), (27, 560, 2130), (26, 561, 2131), (26, 562, 2131), (26, 563, 2131), (26, 564, 2132), (26, 565, 2132), (26, 566, 2132), (26, 567, 2132), (26, 568, 2133), (26, 569, 2133), (26, 570, 2133), (26, 571, 2133), (26, 572, 2134), (26, 573, 2134), (26, 574, 2134), (26, 575, 2135), (26, 576, 2135), (26, 577, 2135), (26, 578, 2135), (25, 579, 2136), (25, 580, 2137), (25, 581, 2137), (25, 582, 2137), (25, 583, 2137), (25, 584, 2138), (25, 585, 2138), (25, 586, 2138), (25, 587, 2138), (25, 588, 2139), (25, 589, 2139), (25, 590, 2139), (25, 591, 2139), (25, 592, 2140), (25, 593, 2140), (25, 594, 2140), (25, 595, 2140), (25, 596, 2140), (25, 597, 2141), (25, 598, 2141), (24, 599, 2142), (24, 600, 2142), (24, 601, 2142), (24, 602, 2143), (24, 603, 2143), (24, 604, 2143), (24, 605, 2143), (24, 606, 2143), (24, 607, 2144), (24, 608, 2144), (24, 609, 2144), (24, 610, 2144), (24, 611, 2144), (24, 612, 2144), (24, 613, 2145), (24, 614, 2145), (24, 615, 2145), (24, 616, 2145), (24, 617, 2145), (24, 618, 2145), (24, 619, 2145), (23, 620, 2146), (23, 621, 2146), (23, 622, 2146), (23, 623, 2146), (23, 624, 2146), (23, 625, 2146), (23, 626, 2146), (23, 627, 2146), (23, 628, 2146), (23, 629, 2147), (23, 630, 2147), (23, 631, 2147), (23, 632, 2147), (23, 633, 2147), (23, 634, 2147), (23, 635, 2147), (23, 636, 2147), (23, 637, 2147), (23, 638, 2147), (23, 639, 2147), (23, 640, 2147), (23, 641, 2147), (23, 642, 2147), (22, 643, 2148), (22, 644, 2148), (22, 645, 2149), (22, 646, 2149), (22, 647, 2149), (22, 648, 2149), (22, 649, 2149), (22, 650, 2149), (22, 651, 2149), (22, 652, 2149), (22, 653, 2149), (22, 654, 2149), (22, 655, 2149), (22, 656, 2149), (22, 657, 2149), (22, 658, 2149), (22, 659, 2149), (22, 660, 2149), (22, 661, 2149), (22, 662, 2150), (22, 663, 2150), (22, 664, 2150), (22, 665, 2150), (22, 666, 2150), (22, 667, 2150), (21, 668, 2151), (21, 669, 2151), (21, 670, 2151), (21, 671, 2151), (21, 672, 2151), (21, 673, 2151), (21, 674, 2151), (21, 675, 2151), (21, 676, 2151), (21, 677, 2151), (21, 678, 2151), (21, 679, 2152), (21, 680, 2152), (21, 681, 2152), (21, 682, 2152), (21, 683, 2152), (21, 684, 2152), (21, 685, 2152), (21, 686, 2152), (21, 687, 2152), (21, 688, 2152), (21, 689, 2152), (21, 690, 2152), (21, 691, 2152), (21, 692, 2152), (21, 693, 2152), (21, 694, 2152), (21, 695, 2152), (21, 696, 2151), (22, 697, 2150), (22, 698, 2150), (22, 699, 2150), (22, 700, 2150), (22, 701, 2150), (22, 702, 2150), (22, 703, 2150), (22, 704, 2150), (22, 705, 2150), (22, 706, 2150), (22, 707, 2150), (22, 708, 2150), (22, 709, 2150), (23, 710, 2149), (23, 711, 2149), (23, 712, 2149), (23, 713, 2149), (23, 714, 2149), (23, 715, 2149), (23, 716, 2149), (23, 717, 2149), (23, 718, 2148), (23, 719, 2148), (23, 720, 2148), (23, 721, 2148), (24, 722, 2147), (24, 723, 2147), (24, 724, 2147), (24, 725, 2147), (24, 726, 2147), (24, 727, 2147), (24, 728, 2147), (24, 729, 2147), (24, 730, 2147), (24, 731, 2147), (24, 732, 2147), (24, 733, 2147), (25, 734, 2146), (25, 735, 2146), (25, 736, 2146), (25, 737, 2146), (25, 738, 2146), (25, 739, 2146), (25, 740, 2145), (25, 741, 2145), (25, 742, 2145), (25, 743, 2145), (25, 744, 2145), (25, 745, 2145), (26, 746, 2144), (26, 747, 2144), (26, 748, 2144), (26, 749, 2144), (26, 750, 2144), (26, 751, 2144), (26, 752, 2144), (26, 753, 2144), (26, 754, 2144), (26, 755, 2144), (26, 756, 2144), (27, 757, 2143), (27, 758, 2143), (27, 759, 2143), (27, 760, 2143), (27, 761, 2142), (27, 762, 2142), (27, 763, 2142), (27, 764, 2142), (27, 765, 2142), (27, 766, 2142), (27, 767, 2142), (27, 768, 2142), (27, 769, 2142), (27, 770, 2142), (27, 771, 2142), (27, 772, 2142), (27, 773, 2142), (27, 774, 2142), (27, 775, 2142), (27, 776, 2142), (27, 777, 2142), (27, 778, 2142), (27, 779, 2142), (27, 780, 2141), (27, 781, 2141), (27, 782, 2141), (27, 783, 2141), (27, 784, 2141), (27, 785, 2141), (27, 786, 2141), (27, 787, 2141), (27, 788, 2141), (27, 789, 2141), (27, 790, 2141), (26, 791, 2142), (26, 792, 2142), (26, 793, 2142), (26, 794, 2142), (26, 795, 2142), (26, 796, 2142), (26, 797, 2142), (26, 798, 2142), (26, 799, 2141), (26, 800, 2141), (26, 801, 2141), (26, 802, 2141), (26, 803, 2141), (26, 804, 2141), (26, 805, 2141), (26, 806, 2141), (26, 807, 2141), (26, 808, 2141), (26, 809, 2141), (26, 810, 2141), (26, 811, 2141), (26, 812, 2141), (26, 813, 2141), (26, 814, 2141), (26, 815, 2141), (26, 816, 2141), (26, 817, 2140), (26, 818, 2140), (26, 819, 2140), (26, 820, 2140), (26, 821, 2140), (26, 822, 2140), (26, 823, 2140), (26, 824, 2140), (26, 825, 2140), (26, 826, 2140), (26, 827, 2140), (26, 828, 2140), (26, 829, 2140), (26, 830, 2140), (26, 831, 2140), (26, 832, 2140), (26, 833, 2140), (26, 834, 2139), (26, 835, 2139), (26, 836, 2139), (26, 837, 2139), (26, 838, 2139), (26, 839, 2139), (26, 840, 2138), (26, 841, 2138), (26, 842, 2138), (26, 843, 2137), (26, 844, 2137), (26, 845, 2137), (26, 846, 2136), (26, 847, 2136), (26, 848, 2135), (26, 849, 2135), (26, 850, 2135), (26, 851, 2134), (26, 852, 2134), (26, 853, 2133), (27, 854, 2132), (27, 855, 2131), (27, 856, 2131), (27, 857, 2130), (27, 858, 2130), (27, 859, 2130), (27, 860, 2129), (27, 861, 2129), (27, 862, 2128), (27, 863, 2128), (27, 864, 2127), (27, 865, 2127), (27, 866, 2126), (27, 867, 2126), (27, 868, 2125), (27, 869, 2125), (27, 870, 2124), (27, 871, 2123), (27, 872, 2123), (28, 873, 2121), (28, 874, 2121), (28, 875, 2120), (28, 876, 2120), (28, 877, 2119), (28, 878, 2118), (28, 879, 2118), (28, 880, 2117), (28, 881, 2117), (28, 882, 2116), (28, 883, 2116), (28, 884, 2115), (28, 885, 2115), (28, 886, 2114), (28, 887, 2113), (28, 888, 2113), (28, 889, 2112), (28, 890, 2112), (28, 891, 2111), (29, 892, 2110), (29, 893, 2109), (29, 894, 2109), (29, 895, 2108), (29, 896, 2108), (29, 897, 2108), (29, 898, 2107), (29, 899, 2107), (29, 900, 2106), (29, 901, 2106), (29, 902, 2105), (29, 903, 2105), (29, 904, 2104), (29, 905, 2104), (29, 906, 2104), (29, 907, 2103), (29, 908, 2103), (29, 909, 2102), (30, 910, 2101), (30, 911, 2101), (30, 912, 2100), (30, 913, 2100), (30, 914, 2099), (30, 915, 2099), (30, 916, 2099), (30, 917, 2099), (30, 918, 2098), (30, 919, 2098), (30, 920, 2098), (29, 921, 2099), (29, 922, 2098), (29, 923, 2098), (29, 924, 2098), (29, 925, 2098), (29, 926, 2097), (29, 927, 2097), (29, 928, 2097), (29, 929, 2097), (29, 930, 2097), (29, 931, 2096), (29, 932, 2096), (29, 933, 2096), (29, 934, 2096), (29, 935, 2095), (29, 936, 2095), (29, 937, 2095), (29, 938, 2095), (29, 939, 2095), (29, 940, 2094), (29, 941, 2094), (29, 942, 2094), (29, 943, 2094), (29, 944, 2093), (29, 945, 2093), (29, 946, 2093), (29, 947, 2093), (29, 948, 2093), (28, 949, 2093), (28, 950, 2093), (28, 951, 2093), (28, 952, 2093), (28, 953, 2093), (28, 954, 2092), (28, 955, 2092), (28, 956, 2092), (28, 957, 2092), (28, 958, 2092), (28, 959, 2091), (28, 960, 2091), (28, 961, 2091), (28, 962, 2091), (28, 963, 2091), (28, 964, 2090), (28, 965, 2090), (28, 966, 2090), (28, 967, 2090), (28, 968, 2090), (28, 969, 2089), (28, 970, 2089), (28, 971, 2089), (28, 972, 2089), (28, 973, 2089), (28, 974, 2089), (28, 975, 2088), (28, 976, 2088), (28, 977, 2088), (28, 978, 2088), (27, 979, 2089), (27, 980, 2089), (27, 981, 2088), (27, 982, 2088), (27, 983, 2088), (27, 984, 2088), (27, 985, 2088), (27, 986, 2088), (27, 987, 2087), (27, 988, 2087), (27, 989, 2087), (27, 990, 2087), (27, 991, 2086), (27, 992, 2086), (27, 993, 2086), (27, 994, 2086), (27, 995, 2085), (27, 996, 2085), (27, 997, 2085), (27, 998, 2084), (27, 999, 2084), (27, 1000, 2084), (28, 1001, 2082), (28, 1002, 2082), (28, 1003, 2082), (28, 1004, 2081), (28, 1005, 2081), (28, 1006, 2081), (28, 1007, 2080), (28, 1008, 2080), (28, 1009, 2080), (28, 1010, 2079), (28, 1011, 2079), (28, 1012, 2079), (28, 1013, 2078), (28, 1014, 2078), (28, 1015, 2077), (28, 1016, 2077), (28, 1017, 2077), (28, 1018, 2076), (28, 1019, 2076), (28, 1020, 2076), (28, 1021, 2075), (28, 1022, 2075), (28, 1023, 2074), (28, 1024, 2074), (28, 1025, 2074), (28, 1026, 2073), (28, 1027, 2073), (28, 1028, 2073), (28, 1029, 2072), (29, 1030, 2071), (29, 1031, 2070), (29, 1032, 2070), (29, 1033, 2070), (29, 1034, 2069), (29, 1035, 2069), (29, 1036, 2068), (29, 1037, 2068), (29, 1038, 2067), (29, 1039, 2067), (29, 1040, 2067), (29, 1041, 2066), (29, 1042, 2066), (29, 1043, 2065), (29, 1044, 2065), (29, 1045, 2064), (29, 1046, 2064), (29, 1047, 2063), (29, 1048, 2063), (29, 1049, 2063), (29, 1050, 2062), (29, 1051, 2062), (29, 1052, 2061), (29, 1053, 2061), (29, 1054, 2060), (29, 1055, 2060), (29, 1056, 2059), (29, 1057, 2059), (30, 1058, 2057), (30, 1059, 2057), (30, 1060, 2056), (30, 1061, 2056), (30, 1062, 2055), (30, 1063, 2055), (30, 1064, 2054), (30, 1065, 2054), (30, 1066, 2053), (30, 1067, 2052), (30, 1068, 2052), (30, 1069, 2051), (30, 1070, 2050), (30, 1071, 2049), (30, 1072, 2049), (30, 1073, 2048), (30, 1074, 2047), (30, 1075, 2046), (30, 1076, 2045), (30, 1077, 2044), (30, 1078, 2043), (30, 1079, 2042), (29, 1080, 2042), (29, 1081, 2041), (29, 1082, 2040), (29, 1083, 2039), (29, 1084, 2038), (29, 1085, 2037), (29, 1086, 2036), (29, 1087, 2035), (29, 1088, 2034), (29, 1089, 2033), (29, 1090, 2032), (29, 1091, 2031), (29, 1092, 2030), (29, 1093, 2029), (29, 1094, 2028), (29, 1095, 2027), (29, 1096, 2026), (29, 1097, 2026), (29, 1098, 2025), (29, 1099, 2024), (29, 1100, 2023), (29, 1101, 2022), (29, 1102, 2022), (29, 1103, 2021), (29, 1104, 2020), (29, 1105, 2019), (29, 1106, 2019), (29, 1107, 2018), (29, 1108, 2017), (29, 1109, 2016), (29, 1110, 2016), (29, 1111, 2015), (29, 1112, 2014), (29, 1113, 2014), (29, 1114, 2013), (29, 1115, 2013), (29, 1116, 2012), (29, 1117, 2011), (29, 1118, 2011), (29, 1119, 2010), (29, 1120, 2010), (29, 1121, 2009), (29, 1122, 2009), (29, 1123, 2008), (29, 1124, 2007), (29, 1125, 2007), (29, 1126, 2006), (29, 1127, 2006), (29, 1128, 2005), (29, 1129, 2005), (29, 1130, 2004), (29, 1131, 2004), (29, 1132, 2004), (29, 1133, 2003), (29, 1134, 2003), (28, 1135, 2003), (28, 1136, 2003), (28, 1137, 2002), (28, 1138, 2002), (28, 1139, 2001), (28, 1140, 2001), (28, 1141, 2001), (28, 1142, 2000), (28, 1143, 2000), (28, 1144, 2000), (28, 1145, 1999), (28, 1146, 1999), (28, 1147, 1999), (28, 1148, 1998), (28, 1149, 1998), (28, 1150, 1998), (29, 1151, 1996), (29, 1152, 1996), (29, 1153, 1996), (29, 1154, 1995), (29, 1155, 1995), (29, 1156, 1995), (29, 1157, 1994), (29, 1158, 1994), (29, 1159, 1994), (29, 1160, 1993), (29, 1161, 1993), (29, 1162, 1993), (29, 1163, 1992), (29, 1164, 1992), (29, 1165, 1991), (29, 1166, 1991), (29, 1167, 1991), (29, 1168, 1990), (29, 1169, 1990), (29, 1170, 1989), (29, 1171, 1989), (29, 1172, 1989), (29, 1173, 1988), (29, 1174, 1988), (29, 1175, 1987), (29, 1176, 1987), (29, 1177, 1987), (29, 1178, 1986), (29, 1179, 1986), (29, 1180, 1985), (29, 1181, 1985), (29, 1182, 1985), (29, 1183, 1984), (29, 1184, 1984), (29, 1185, 1983), (29, 1186, 1983), (29, 1187, 1982), (29, 1188, 1982), (29, 1189, 1981), (29, 1190, 1981), (29, 1191, 1981), (29, 1192, 1980), (29, 1193, 1980), (29, 1194, 1979), (29, 1195, 1979), (29, 1196, 1978), (29, 1197, 1978), (29, 1198, 1977), (29, 1199, 1977), (29, 1200, 1976), (29, 1201, 1976), (29, 1202, 1975), (29, 1203, 1975), (29, 1204, 1974), (29, 1205, 1974), (29, 1206, 1973), (29, 1207, 1972), (29, 1208, 1972), (29, 1209, 1971), (29, 1210, 1971), (29, 1211, 1970), (29, 1212, 1970), (29, 1213, 1969), (29, 1214, 1969), (29, 1215, 1968), (29, 1216, 1967), (29, 1217, 1967), (29, 1218, 1966), (29, 1219, 1965), (29, 1220, 1965), (29, 1221, 1964), (29, 1222, 1963), (29, 1223, 1963), (29, 1224, 1962), (29, 1225, 1961), (29, 1226, 1960), (29, 1227, 1960), (29, 1228, 1959), (29, 1229, 1958), (29, 1230, 1957), (29, 1231, 1956), (29, 1232, 1955), (29, 1233, 1955), (29, 1234, 1954), (29, 1235, 1953), (29, 1236, 1952), (29, 1237, 1951), (29, 1238, 1951), (29, 1239, 1950), (29, 1240, 1949), (29, 1241, 1948), (29, 1242, 1948), (29, 1243, 1947), (30, 1244, 1945), (30, 1245, 1945), (30, 1246, 1944), (30, 1247, 1943), (30, 1248, 1943), (30, 1249, 1942), (30, 1250, 1941), (30, 1251, 1941), (30, 1252, 1940), (30, 1253, 1940), (30, 1254, 1939), (30, 1255, 1938), (30, 1256, 1938), (30, 1257, 1937), (30, 1258, 1937), (30, 1259, 1936), (30, 1260, 1936), (30, 1261, 1935), (30, 1262, 1935), (30, 1263, 1934), (30, 1264, 1934), (30, 1265, 1933), (30, 1266, 1933), (30, 1267, 1932), (30, 1268, 1932), (30, 1269, 1931), (30, 1270, 1931), (30, 1271, 1930), (30, 1272, 1930), (30, 1273, 1929), (30, 1274, 1929), (30, 1275, 1929), (30, 1276, 1928), (30, 1277, 1928), (30, 1278, 1927), (30, 1279, 1927), (30, 1280, 1927), (30, 1281, 1926), (30, 1282, 1926), (30, 1283, 1925), (30, 1284, 1925), (30, 1285, 1925), (30, 1286, 1924), (30, 1287, 1924), (30, 1288, 1924), (30, 1289, 1923), (30, 1290, 1923), (30, 1291, 1923), (30, 1292, 1922), (30, 1293, 1922), (30, 1294, 1922), (30, 1295, 1921), (30, 1296, 1921), (30, 1297, 1921), (30, 1298, 1921), (30, 1299, 1920), (30, 1300, 1920), (30, 1301, 1920), (30, 1302, 1920), (30, 1303, 1920), (30, 1304, 1919), (30, 1305, 1919), (30, 1306, 1919), (30, 1307, 1919), (30, 1308, 1918), (30, 1309, 1918), (30, 1310, 1918), (30, 1311, 1918), (30, 1312, 1917), (31, 1313, 1916), (31, 1314, 1916), (31, 1315, 1916), (31, 1316, 1915), (31, 1317, 1915), (31, 1318, 1915), (31, 1319, 1915), (31, 1320, 1914), (31, 1321, 1914), (31, 1322, 1914), (31, 1323, 1914), (31, 1324, 1913), (31, 1325, 1913), (31, 1326, 1913), (31, 1327, 1912), (31, 1328, 1912), (31, 1329, 1912), (31, 1330, 1912), (31, 1331, 1911), (31, 1332, 1911), (31, 1333, 1911), (31, 1334, 1911), (31, 1335, 1910), (31, 1336, 1910), (31, 1337, 1910), (31, 1338, 1909), (31, 1339, 1909), (31, 1340, 1909), (32, 1341, 1908), (32, 1342, 1907), (32, 1343, 1907), (32, 1344, 1907), (32, 1345, 1907), (32, 1346, 1906), (32, 1347, 1906), (32, 1348, 1906), (32, 1349, 1905), (32, 1350, 1905), (32, 1351, 1905), (32, 1352, 1904), (32, 1353, 1904), (32, 1354, 1904), (32, 1355, 1904), (32, 1356, 1903), (32, 1357, 1903), (32, 1358, 1903), (32, 1359, 1902), (32, 1360, 1902), (32, 1361, 1902), (32, 1362, 1901), (32, 1363, 1901), (32, 1364, 1901), (32, 1365, 1900), (32, 1366, 1900), (33, 1367, 1899), (33, 1368, 1899), (33, 1369, 1898), (33, 1370, 1898), (33, 1371, 1897), (33, 1372, 1897), (33, 1373, 1896), (33, 1374, 1896), (33, 1375, 1895), (33, 1376, 1895), (33, 1377, 1894), (33, 1378, 1893), (33, 1379, 1893), (33, 1380, 1892), (33, 1381, 1892), (34, 1382, 1890), (34, 1383, 1890), (34, 1384, 1889), (34, 1385, 1888), (34, 1386, 1888), (34, 1387, 1887), (34, 1388, 1886), (34, 1389, 1886), (34, 1390, 1885), (34, 1391, 1884), (34, 1392, 1884), (34, 1393, 1883), (34, 1394, 1882), (34, 1395, 1882), (35, 1396, 1880), (35, 1397, 1879), (35, 1398, 1878), (35, 1399, 1878), (35, 1400, 1877), (35, 1401, 1876), (35, 1402, 1875), (35, 1403, 1874), (35, 1404, 1873), (35, 1405, 1872), (35, 1406, 1872), (35, 1407, 1871), (35, 1408, 1870), (35, 1409, 1869), (36, 1410, 1867), (36, 1411, 1866), (36, 1412, 1865), (36, 1413, 1864), (36, 1414, 1863), (36, 1415, 1862), (36, 1416, 1862), (36, 1417, 1861), (36, 1418, 1860), (36, 1419, 1859), (36, 1420, 1859), (36, 1421, 1858), (36, 1422, 1857), (37, 1423, 1855), (37, 1424, 1855), (37, 1425, 1854), (37, 1426, 1853), (37, 1427, 1853), (37, 1428, 1852), (37, 1429, 1851), (37, 1430, 1851), (37, 1431, 1850), (37, 1432, 1850), (37, 1433, 1849), (37, 1434, 1848), (38, 1435, 1847), (38, 1436, 1846), (38, 1437, 1846), (38, 1438, 1845), (38, 1439, 1845), (38, 1440, 1844), (38, 1441, 1844), (38, 1442, 1843), (38, 1443, 1843), (38, 1444, 1842), (38, 1445, 1842), (38, 1446, 1842), (38, 1447, 1841), (38, 1448, 1841), (38, 1449, 1841), (38, 1450, 1841), (38, 1451, 1840), (38, 1452, 1840), (38, 1453, 1840), (38, 1454, 1840), (39, 1455, 1839), (39, 1456, 1838), (39, 1457, 1838), (39, 1458, 1838), (39, 1459, 1838), (39, 1460, 1838), (39, 1461, 1837), (39, 1462, 1837), (39, 1463, 1837), (39, 1464, 1837), (39, 1465, 1836), (39, 1466, 1836), (39, 1467, 1836), (39, 1468, 1836), (39, 1469, 1836), (39, 1470, 1835), (39, 1471, 1835), (39, 1472, 1835), (39, 1473, 1835), (39, 1474, 1835), (39, 1475, 1834), (39, 1476, 1834), (39, 1477, 1834), (39, 1478, 1834), (39, 1479, 1834), (39, 1480, 1834), (39, 1481, 1833), (39, 1482, 1833), (39, 1483, 1833), (39, 1484, 1833), (39, 1485, 1833), (39, 1486, 1832), (39, 1487, 1832), (39, 1488, 1832), (39, 1489, 1832), (39, 1490, 1832), (39, 1491, 1831), (39, 1492, 1831), (39, 1493, 1831), (39, 1494, 1831), (39, 1495, 1831), (40, 1496, 1830), (40, 1497, 1829), (40, 1498, 1829), (40, 1499, 1829), (40, 1500, 1829), (40, 1501, 1829), (40, 1502, 1829), (40, 1503, 1828), (40, 1504, 1828), (40, 1505, 1828), (40, 1506, 1828), (40, 1507, 1828), (40, 1508, 1827), (40, 1509, 1827), (40, 1510, 1827), (40, 1511, 1827), (40, 1512, 1827), (40, 1513, 1827), (40, 1514, 1827), (40, 1515, 1826), (40, 1516, 1826), (40, 1517, 1826), (40, 1518, 1826), (40, 1519, 1826), (40, 1520, 1826), (40, 1521, 1825), (40, 1522, 1825), (40, 1523, 1825), (40, 1524, 1825), (40, 1525, 1825), (40, 1526, 1825), (40, 1527, 1825), (40, 1528, 1825), (40, 1529, 1824), (40, 1530, 1824), (40, 1531, 1824), (40, 1532, 1824), (40, 1533, 1824), (40, 1534, 1824), (40, 1535, 1824), (40, 1536, 1824), (40, 1537, 1823), (41, 1538, 1822), (41, 1539, 1822), (41, 1540, 1822), (41, 1541, 1822), (41, 1542, 1822), (41, 1543, 1822), (41, 1544, 1822), (41, 1545, 1821), (41, 1546, 1821), (41, 1547, 1821), (41, 1548, 1821), (41, 1549, 1821), (41, 1550, 1821), (41, 1551, 1821), (41, 1552, 1821), (41, 1553, 1820), (41, 1554, 1820), (41, 1555, 1820), (41, 1556, 1820), (41, 1557, 1820), (41, 1558, 1820), (41, 1559, 1820), (41, 1560, 1820), (41, 1561, 1819), (41, 1562, 1819), (41, 1563, 1819), (41, 1564, 1819), (41, 1565, 1819), (41, 1566, 1819), (41, 1567, 1819), (41, 1568, 1819), (41, 1569, 1818), (41, 1570, 1818), (41, 1571, 1818), (41, 1572, 1818), (41, 1573, 1818), (41, 1574, 1818), (41, 1575, 1818), (41, 1576, 1818), (41, 1577, 1817), (41, 1578, 1817), (41, 1579, 1817), (41, 1580, 1817), (41, 1581, 1817), (41, 1582, 1817), (42, 1583, 1816), (42, 1584, 1815), (42, 1585, 1815), (42, 1586, 1815), (42, 1587, 1815), (42, 1588, 1815), (42, 1589, 1815), (42, 1590, 1815), (42, 1591, 1815), (42, 1592, 1814), (42, 1593, 1814), (42, 1594, 1814), (42, 1595, 1814), (42, 1596, 1814), (42, 1597, 1814), (42, 1598, 1814), (42, 1599, 1814), (42, 1600, 1813), (42, 1601, 1813), (42, 1602, 1813), (42, 1603, 1813), (41, 1604, 1814), (41, 1605, 1814), (41, 1606, 1814), (41, 1607, 1814), (41, 1608, 1814), (41, 1609, 1813), (41, 1610, 1813), (41, 1611, 1813), (41, 1612, 1813), (41, 1613, 1813), (41, 1614, 1813), (41, 1615, 1813), (41, 1616, 1813), (41, 1617, 1813), (41, 1618, 1812), (41, 1619, 1812), (41, 1620, 1812), (41, 1621, 1812), (41, 1622, 1812), (41, 1623, 1812), (41, 1624, 1812), (41, 1625, 1812), (41, 1626, 1811), (40, 1627, 1812), (40, 1628, 1812), (40, 1629, 1812), (40, 1630, 1812), (40, 1631, 1812), (40, 1632, 1812), (40, 1633, 1812), (40, 1634, 1811), (40, 1635, 1811), (40, 1636, 1811), (40, 1637, 1811), (40, 1638, 1811), (40, 1639, 1811), (40, 1640, 1811), (40, 1641, 1811), (40, 1642, 1810), (40, 1643, 1810), (40, 1644, 1810), (40, 1645, 1810), (40, 1646, 1810), (40, 1647, 1810), (40, 1648, 1810), (40, 1649, 1809), (40, 1650, 1809), (40, 1651, 1809), (39, 1652, 1810), (39, 1653, 1810), (39, 1654, 1810), (39, 1655, 1810), (39, 1656, 1810), (39, 1657, 1809), (39, 1658, 1809), (39, 1659, 1809), (39, 1660, 1809), (39, 1661, 1809), (39, 1662, 1809), (39, 1663, 1809), (39, 1664, 1808), (39, 1665, 1808), (39, 1666, 1808), (39, 1667, 1808), (39, 1668, 1808), (39, 1669, 1808), (39, 1670, 1808), (39, 1671, 1807), (39, 1672, 1807), (39, 1673, 1807), (39, 1674, 1807), (39, 1675, 1806), (39, 1676, 1806), (39, 1677, 1806), (40, 1678, 1805), (40, 1679, 1804), (40, 1680, 1804), (40, 1681, 1804), (40, 1682, 1804), (40, 1683, 1803), (41, 1684, 1802), (41, 1685, 1802), (41, 1686, 1802), (41, 1687, 1801), (41, 1688, 1801), (41, 1689, 1801), (42, 1690, 1800), (42, 1691, 1799), (42, 1692, 1799), (42, 1693, 1799), (42, 1694, 1798), (42, 1695, 1798), (43, 1696, 1797), (43, 1697, 1797), (43, 1698, 1796), (43, 1699, 1796), (43, 1700, 1796), (43, 1701, 1795), (44, 1702, 1794), (44, 1703, 1794), (44, 1704, 1793), (44, 1705, 1793), (44, 1706, 1793), (44, 1707, 1793), (45, 1708, 1791), (45, 1709, 1791), (45, 1710, 1791), (45, 1711, 1790), (45, 1712, 1790), (45, 1713, 1790), (46, 1714, 1788), (46, 1715, 1788), (46, 1716, 1788), (46, 1717, 1787), (46, 1718, 1787), (47, 1719, 1785), (47, 1720, 1785), (47, 1721, 1785), (47, 1722, 1784), (47, 1723, 1784), (48, 1724, 1783), (48, 1725, 1782), (48, 1726, 1782), (48, 1727, 1782), (48, 1728, 1781), (49, 1729, 1780), (49, 1730, 1779), (49, 1731, 1779), (49, 1732, 1779), (49, 1733, 1778), (50, 1734, 1777), (50, 1735, 1776), (50, 1736, 1776), (50, 1737, 1776), (51, 1738, 1774), (51, 1739, 1774), (51, 1740, 1773), (51, 1741, 1773), (51, 1742, 1772), (52, 1743, 1771), (52, 1744, 1771), (52, 1745, 1770), (52, 1746, 1770), (52, 1747, 1769), (52, 1748, 1769), (52, 1749, 1768), (52, 1750, 1768), (52, 1751, 1768), (53, 1752, 1766), (53, 1753, 1766), (53, 1754, 1765), (53, 1755, 1765), (53, 1756, 1765), (53, 1757, 1764), (53, 1758, 1764), (53, 1759, 1763), (53, 1760, 1763), (53, 1761, 1763), (53, 1762, 1762), (53, 1763, 1762), (53, 1764, 1762), (53, 1765, 1761), (53, 1766, 1761), (53, 1767, 1760), (53, 1768, 1760), (53, 1769, 1760), (53, 1770, 1759), (53, 1771, 1759), (53, 1772, 1759), (53, 1773, 1758), (53, 1774, 1758), (53, 1775, 1758), (53, 1776, 1757), (53, 1777, 1757), (53, 1778, 1757), (53, 1779, 1756), (53, 1780, 1756), (53, 1781, 1756), (53, 1782, 1755), (53, 1783, 1755), (53, 1784, 1755), (53, 1785, 1754), (53, 1786, 1754), (53, 1787, 1754), (53, 1788, 1753), (53, 1789, 1753), (53, 1790, 1753), (53, 1791, 1753), (53, 1792, 1752), (53, 1793, 1752), (53, 1794, 1752), (53, 1795, 1751), (53, 1796, 1751), (53, 1797, 1751), (53, 1798, 1750), (53, 1799, 1750), (53, 1800, 1750), (53, 1801, 1750), (53, 1802, 1749), (53, 1803, 1749), (53, 1804, 1749), (53, 1805, 1748), (53, 1806, 1748), (53, 1807, 1748), (53, 1808, 1748), (53, 1809, 1747), (53, 1810, 1747), (53, 1811, 1747), (53, 1812, 1746), (53, 1813, 1746), (54, 1814, 1745), (54, 1815, 1745), (54, 1816, 1744), (54, 1817, 1744), (54, 1818, 1744), (54, 1819, 1744), (54, 1820, 1743), (54, 1821, 1743), (54, 1822, 1743), (54, 1823, 1743), (54, 1824, 1742), (54, 1825, 1742), (55, 1826, 1741), (55, 1827, 1740), (56, 1828, 1739), (56, 1829, 1739), (57, 1830, 1737), (57, 1831, 1737), (58, 1832, 1736), (58, 1833, 1735), (59, 1834, 1734), (59, 1835, 1734), (60, 1836, 1732), (60, 1837, 1732), (61, 1838, 1731), (61, 1839, 1730), (61, 1840, 1730), (62, 1841, 1729), (62, 1842, 1728), (63, 1843, 1727), (63, 1844, 1726), (64, 1845, 1725), (64, 1846, 1725), (65, 1847, 1723), (65, 1848, 1723), (66, 1849, 1722), (66, 1850, 1721), (67, 1851, 1720), (67, 1852, 1720), (67, 1853, 1719), (68, 1854, 1718), (68, 1855, 1718), (69, 1856, 1716), (69, 1857, 1716), (70, 1858, 1714), (70, 1859, 1714), (71, 1860, 1713), (71, 1861, 1712), (71, 1862, 1712), (72, 1863, 1710), (72, 1864, 1710), (73, 1865, 1709), (73, 1866, 1708), (74, 1867, 1707), (74, 1868, 1707), (75, 1869, 1705), (75, 1870, 1705), (75, 1871, 1704), (76, 1872, 1703), (76, 1873, 1703), (77, 1874, 1701), (77, 1875, 1701), (78, 1876, 1699), (78, 1877, 1699), (78, 1878, 1699), (79, 1879, 1697), (79, 1880, 1697), (80, 1881, 1695), (80, 1882, 1695), (81, 1883, 1693), (81, 1884, 1693), (81, 1885, 1693), (82, 1886, 1691), (82, 1887, 1691), (83, 1888, 1689), (83, 1889, 1689), (84, 1890, 1687), (84, 1891, 1687), (84, 1892, 1687), (85, 1893, 1685), (85, 1894, 1685), (86, 1895, 1683), (86, 1896, 1683), (86, 1897, 1682), (87, 1898, 1681), (87, 1899, 1680), (88, 1900, 1679), (88, 1901, 1678), (88, 1902, 1678), (89, 1903, 1676), (89, 1904, 1676), (89, 1905, 1676), (90, 1906, 1674), (90, 1907, 1674), (91, 1908, 1672), (91, 1909, 1672), (91, 1910, 1671), (92, 1911, 1669), (92, 1912, 1669), (93, 1913, 1667), (93, 1914, 1667), (93, 1915, 1666), (94, 1916, 1665), (94, 1917, 1664), (95, 1918, 1663), (95, 1919, 1662), (96, 1920, 1661), (96, 1921, 1660), (96, 1922, 1659), (97, 1923, 1658), (97, 1924, 1657), (98, 1925, 1656), (98, 1926, 1655), (99, 1927, 1653), (99, 1928, 1653), (100, 1929, 1651), (100, 1930, 1651), (101, 1931, 1649), (101, 1932, 1648), (102, 1933, 1647), (102, 1934, 1646), (103, 1935, 1644), (103, 1936, 1644), (104, 1937, 1642), (104, 1938, 1641), (105, 1939, 1640), (105, 1940, 1639), (106, 1941, 1637), (107, 1942, 1635), (107, 1943, 1635), (108, 1944, 1633), (108, 1945, 1632), (109, 1946, 1630), (110, 1947, 1628), (110, 1948, 1628), (111, 1949, 1626), (111, 1950, 1625), (112, 1951, 1623), (113, 1952, 1622), (113, 1953, 1621), (114, 1954, 1619), (115, 1955, 1617), (115, 1956, 1617), (116, 1957, 1615), (117, 1958, 1613), (118, 1959, 1611), (118, 1960, 1611), (119, 1961, 1609), (120, 1962, 1607), (121, 1963, 1605), (121, 1964, 78), (214, 1964, 1512), (122, 1965, 66), (221, 1965, 1504), (123, 1966, 54), (228, 1966, 1496), (124, 1967, 44), (235, 1967, 1489), (125, 1968, 34), (242, 1968, 1481), (126, 1969, 24), (249, 1969, 1473), (126, 1970, 16), (257, 1970, 1465), (127, 1971, 8), (264, 1971, 1457), (272, 1972, 1448), (279, 1973, 1440), (287, 1974, 1432), (293, 1975, 1425), (297, 1976, 1420), (302, 1977, 1414), (307, 1978, 1408), (312, 1979, 1402), (318, 1980, 1395), (324, 1981, 1388), (330, 1982, 1381), (336, 1983, 1374), (342, 1984, 1367), (349, 1985, 1359), (357, 1986, 1350), (365, 1987, 1340), (372, 1988, 1332), (375, 1989, 1328), (380, 1990, 1322), (384, 1991, 1317), (388, 1992, 1311), (392, 1993, 1306), (397, 1994, 1300), (401, 1995, 1294), (405, 1996, 1289), (410, 1997, 1283), (415, 1998, 1276), (420, 1999, 1270), (424, 2000, 1264), (429, 2001, 1258), (435, 2002, 1250), (440, 2003, 1244), (445, 2004, 1237), (450, 2005, 1231), (455, 2006, 1224), (460, 2007, 1218), (465, 2008, 1211), (470, 2009, 1204), (476, 2010, 1196), (481, 2011, 1190), (486, 2012, 1183), (491, 2013, 1176), (497, 2014, 1168), (502, 2015, 1161), (508, 2016, 1073), (513, 2017, 1064), (519, 2018, 1054), (525, 2019, 1044), (531, 2020, 1034), (536, 2021, 1025), (541, 2022, 1016), (546, 2023, 1008), (551, 2024, 999), (556, 2025, 990), (560, 2026, 983), (565, 2027, 974), (569, 2028, 967), (574, 2029, 958), (578, 2030, 951), (583, 2031, 942), (587, 2032, 935), (591, 2033, 928), (595, 2034, 920), (599, 2035, 913), (603, 2036, 906), (607, 2037, 899), (611, 2038, 892), (614, 2039, 883), (617, 2040, 870), (619, 2041, 857), (622, 2042, 844), (624, 2043, 833), (627, 2044, 820), (629, 2045, 809), (631, 2046, 797), (633, 2047, 787), (635, 2048, 781), (638, 2049, 775), (640, 2050, 770), (642, 2051, 765), (643, 2052, 761), (645, 2053, 756), (647, 2054, 751), (648, 2055, 747), (650, 2056, 742), (652, 2057, 736), (654, 2058, 731), (656, 2059, 726), (658, 2060, 720), (660, 2061, 715), (662, 2062, 709), (664, 2063, 704), (666, 2064, 698), (668, 2065, 692), (670, 2066, 686), (673, 2067, 679), (675, 2068, 673), (678, 2069, 666), (680, 2070, 660), (683, 2071, 652), (685, 2072, 644), (688, 2073, 636), (691, 2074, 628), (694, 2075, 619), (698, 2076, 610), (703, 2077, 599), (707, 2078, 589), (712, 2079, 579), (716, 2080, 569), (721, 2081, 558), (725, 2082, 548), (729, 2083, 537), (734, 2084, 526), (738, 2085, 517), (742, 2086, 507), (747, 2087, 497), (751, 2088, 488), (755, 2089, 479), (759, 2090, 470), (763, 2091, 461), (767, 2092, 452), (772, 2093, 443), (775, 2094, 435), (779, 2095, 427), (782, 2096, 419), (785, 2097, 412), (789, 2098, 404), (792, 2099, 397), (795, 2100, 390), (798, 2101, 383), (801, 2102, 376), (805, 2103, 370), (808, 2104, 364), (811, 2105, 359), (814, 2106, 354), (817, 2107, 349), (820, 2108, 343), (824, 2109, 337), (827, 2110, 332), (830, 2111, 327), (833, 2112, 322), (836, 2113, 317), (839, 2114, 312), (842, 2115, 307), (845, 2116, 302), (848, 2117, 297), (851, 2118, 292), (854, 2119, 288), (857, 2120, 283), (860, 2121, 278), (863, 2122, 273), (866, 2123, 269), (869, 2124, 264), (872, 2125, 260), (874, 2126, 256), (877, 2127, 251), (880, 2128, 246), (883, 2129, 242), (886, 2130, 237), (889, 2131, 232), (893, 2132, 226), (896, 2133, 221), (899, 2134, 216), (902, 2135, 210), (906, 2136, 204), (909, 2137, 199), (913, 2138, 193), (916, 2139, 187), (920, 2140, 181), (924, 2141, 174), (928, 2142, 166), (932, 2143, 154), (936, 2144, 142), (946, 2145, 124), (956, 2146, 106), (967, 2147, 87), (978, 2148, 67), (989, 2149, 48), (1001, 2150, 27), (1013, 2151, 6)], ['1001,2150,936,2144,788,2097,694,2075,610,2037,371,1987,213,1963,127,1971,96,1922,54,1825,53,1752,39,1677,39,1455,29,1243,27,543,39,458,93,308,126,270,210,206,291,179,373,132,520,121,1430,121,1584,128,1663,142,1768,178,1904,204,2011,293,2098,420,2148,535,2168,613,2165,833,2128,914,2112,994,2078,1072,2044,1109,1997,1214,1958,1273,1931,1368,1879,1444,1846,1670,1770,1892,1706,1986,1662,2015,1581,2015,1496,2039,1420,2046,1339,2070,1177,2101,1093,2142'])], 'temp/1742725281_43872_917877156_a9c2d4b99270c9302def4ed40606e685.jpg']} nb pixel non reg : 3692295 nb pixel common : 3690006 proportion of common points : 0.9993800603689575 #&_# TEST FAILED #&_# : tests/mask_test #&_# #&_# END OF TEST #&_# : tests/mask_test #&_# #&_# BEGIN OF TEST : tests/datou_test #&_# /home/admin/workarea/git/Velours/python/tests/datou_test.py Datou All Test python version used : 3 ############################### TEST sam ################################ TEST SAM Inside batchDatouExec : verbose : False # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : sam list_input_json : [] origin BFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 1 ; length of list_pids : 1 ; length of list_args : 1 time to download the photos : 0.26218724250793457 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! WARNING : we have an input that is not a photo, we should get rid of it Calling datou_exec Inside datou_exec : verbose : False number of steps : 1 step1:sam Sun Mar 23 11:22:06 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step sam ! Inside sam : nb paths : 1 (640, 960, 3) time for calcul the mask position with numpy : 0.00202178955078125 nb_pixel_total : 5614 time to create 1 rle with old method : 0.012491464614868164 time for calcul the mask position with numpy : 0.0038726329803466797 nb_pixel_total : 3763 time to create 1 rle with old method : 0.00825190544128418 time for calcul the mask position with numpy : 0.0013298988342285156 nb_pixel_total : 3914 time to create 1 rle with old method : 0.008394241333007812 time for calcul the mask position with numpy : 0.0013628005981445312 nb_pixel_total : 13942 time to create 1 rle with old method : 0.02967047691345215 time for calcul the mask position with numpy : 0.0015130043029785156 nb_pixel_total : 16420 time to create 1 rle with old method : 0.035537004470825195 time for calcul the mask position with numpy : 0.0014045238494873047 nb_pixel_total : 7637 time to create 1 rle with old method : 0.016609668731689453 time for calcul the mask position with numpy : 0.0017447471618652344 nb_pixel_total : 84036 time to create 1 rle with old method : 0.17598772048950195 time for calcul the mask position with numpy : 0.001558542251586914 nb_pixel_total : 29419 time to create 1 rle with old method : 0.06354975700378418 time for calcul the mask position with numpy : 0.00144195556640625 nb_pixel_total : 2440 time to create 1 rle with old method : 0.00541996955871582 time for calcul the mask position with numpy : 0.0013179779052734375 nb_pixel_total : 2941 time to create 1 rle with old method : 0.006667137145996094 time for calcul the mask position with numpy : 0.0014622211456298828 nb_pixel_total : 5329 time to create 1 rle with old method : 0.011962890625 time for calcul the mask position with numpy : 0.0014584064483642578 nb_pixel_total : 6623 time to create 1 rle with old method : 0.015698671340942383 time for calcul the mask position with numpy : 0.001462697982788086 nb_pixel_total : 13124 time to create 1 rle with old method : 0.02801966667175293 time for calcul the mask position with numpy : 0.0013356208801269531 nb_pixel_total : 4273 time to create 1 rle with old method : 0.00953221321105957 time for calcul the mask position with numpy : 0.0014557838439941406 nb_pixel_total : 2370 time to create 1 rle with old method : 0.00524139404296875 time for calcul the mask position with numpy : 0.0014019012451171875 nb_pixel_total : 1220 time to create 1 rle with old method : 0.0027687549591064453 time for calcul the mask position with numpy : 0.0013670921325683594 nb_pixel_total : 10711 time to create 1 rle with old method : 0.02248358726501465 time for calcul the mask position with numpy : 0.0014445781707763672 nb_pixel_total : 16344 time to create 1 rle with old method : 0.036815643310546875 time for calcul the mask position with numpy : 0.001453399658203125 nb_pixel_total : 887 time to create 1 rle with old method : 0.0019884109497070312 time for calcul the mask position with numpy : 0.0014634132385253906 nb_pixel_total : 2079 time to create 1 rle with old method : 0.004725933074951172 time for calcul the mask position with numpy : 0.0014286041259765625 nb_pixel_total : 10609 time to create 1 rle with old method : 0.023156404495239258 time for calcul the mask position with numpy : 0.0013396739959716797 nb_pixel_total : 4281 time to create 1 rle with old method : 0.009847879409790039 time for calcul the mask position with numpy : 0.0013606548309326172 nb_pixel_total : 5478 time to create 1 rle with old method : 0.012205123901367188 time for calcul the mask position with numpy : 0.0014095306396484375 nb_pixel_total : 11921 time to create 1 rle with old method : 0.02630305290222168 time for calcul the mask position with numpy : 0.0013437271118164062 nb_pixel_total : 735 time to create 1 rle with old method : 0.0018033981323242188 time for calcul the mask position with numpy : 0.0013408660888671875 nb_pixel_total : 8602 time to create 1 rle with old method : 0.018199443817138672 time for calcul the mask position with numpy : 0.0013966560363769531 nb_pixel_total : 1713 time to create 1 rle with old method : 0.003759145736694336 time for calcul the mask position with numpy : 0.0013055801391601562 nb_pixel_total : 1342 time to create 1 rle with old method : 0.0030782222747802734 time for calcul the mask position with numpy : 0.0013725757598876953 nb_pixel_total : 3554 time to create 1 rle with old method : 0.007744789123535156 time for calcul the mask position with numpy : 0.0013384819030761719 nb_pixel_total : 2728 time to create 1 rle with old method : 0.005986690521240234 time for calcul the mask position with numpy : 0.0014328956604003906 nb_pixel_total : 27953 time to create 1 rle with old method : 0.060665130615234375 time for calcul the mask position with numpy : 0.001377105712890625 nb_pixel_total : 9871 time to create 1 rle with old method : 0.022269010543823242 time for calcul the mask position with numpy : 0.0013823509216308594 nb_pixel_total : 13146 time to create 1 rle with old method : 0.02945566177368164 time for calcul the mask position with numpy : 0.0013496875762939453 nb_pixel_total : 2783 time to create 1 rle with old method : 0.0062351226806640625 time for calcul the mask position with numpy : 0.0013473033905029297 nb_pixel_total : 344 time to create 1 rle with old method : 0.0007698535919189453 time for calcul the mask position with numpy : 0.001336812973022461 nb_pixel_total : 3329 time to create 1 rle with old method : 0.007472038269042969 time for calcul the mask position with numpy : 0.0014181137084960938 nb_pixel_total : 1025 time to create 1 rle with old method : 0.002287149429321289 time for calcul the mask position with numpy : 0.0014028549194335938 nb_pixel_total : 1648 time to create 1 rle with old method : 0.0037784576416015625 time for calcul the mask position with numpy : 0.0015408992767333984 nb_pixel_total : 38807 time to create 1 rle with old method : 0.0850515365600586 time for calcul the mask position with numpy : 0.0014657974243164062 nb_pixel_total : 1504 time to create 1 rle with old method : 0.0033996105194091797 time for calcul the mask position with numpy : 0.0014078617095947266 nb_pixel_total : 4103 time to create 1 rle with old method : 0.009179115295410156 time for calcul the mask position with numpy : 0.0013768672943115234 nb_pixel_total : 1252 time to create 1 rle with old method : 0.0028307437896728516 time for calcul the mask position with numpy : 0.0014202594757080078 nb_pixel_total : 3919 time to create 1 rle with old method : 0.008974552154541016 time for calcul the mask position with numpy : 0.0013446807861328125 nb_pixel_total : 4177 time to create 1 rle with old method : 0.009477376937866211 time for calcul the mask position with numpy : 0.0014300346374511719 nb_pixel_total : 14690 time to create 1 rle with old method : 0.032823801040649414 time for calcul the mask position with numpy : 0.0014121532440185547 nb_pixel_total : 1743 time to create 1 rle with old method : 0.003986358642578125 time for calcul the mask position with numpy : 0.0013813972473144531 nb_pixel_total : 875 time to create 1 rle with old method : 0.0020568370819091797 time for calcul the mask position with numpy : 0.0014119148254394531 nb_pixel_total : 861 time to create 1 rle with old method : 0.0020475387573242188 time for calcul the mask position with numpy : 0.0014102458953857422 nb_pixel_total : 589 time to create 1 rle with old method : 0.0013511180877685547 time for calcul the mask position with numpy : 0.0013394355773925781 nb_pixel_total : 2387 time to create 1 rle with old method : 0.005336761474609375 time for calcul the mask position with numpy : 0.0013363361358642578 nb_pixel_total : 2324 time to create 1 rle with old method : 0.005272388458251953 time for calcul the mask position with numpy : 0.001425027847290039 nb_pixel_total : 576 time to create 1 rle with old method : 0.0013239383697509766 time for calcul the mask position with numpy : 0.0013434886932373047 nb_pixel_total : 2032 time to create 1 rle with old method : 0.004684925079345703 time for calcul the mask position with numpy : 0.0013189315795898438 nb_pixel_total : 1672 time to create 1 rle with old method : 0.003983020782470703 time for calcul the mask position with numpy : 0.0013856887817382812 nb_pixel_total : 693 time to create 1 rle with old method : 0.0017244815826416016 time for calcul the mask position with numpy : 0.0013301372528076172 nb_pixel_total : 2408 time to create 1 rle with old method : 0.00591731071472168 time for calcul the mask position with numpy : 0.0014066696166992188 nb_pixel_total : 8351 time to create 1 rle with old method : 0.019106388092041016 time for calcul the mask position with numpy : 0.001355886459350586 nb_pixel_total : 337 time to create 1 rle with old method : 0.0008203983306884766 time for calcul the mask position with numpy : 0.0013206005096435547 nb_pixel_total : 1056 time to create 1 rle with old method : 0.002458810806274414 time for calcul the mask position with numpy : 0.0013358592987060547 nb_pixel_total : 2770 time to create 1 rle with old method : 0.0062143802642822266 time for calcul the mask position with numpy : 0.0013728141784667969 nb_pixel_total : 592 time to create 1 rle with old method : 0.0014200210571289062 time for calcul the mask position with numpy : 0.0013108253479003906 nb_pixel_total : 1208 time to create 1 rle with old method : 0.002652883529663086 time for calcul the mask position with numpy : 0.0013892650604248047 nb_pixel_total : 16679 time to create 1 rle with old method : 0.03656315803527832 time for calcul the mask position with numpy : 0.0013642311096191406 nb_pixel_total : 8637 time to create 1 rle with old method : 0.01904606819152832 time for calcul the mask position with numpy : 0.0013821125030517578 nb_pixel_total : 3117 time to create 1 rle with old method : 0.006874799728393555 time for calcul the mask position with numpy : 0.001340627670288086 nb_pixel_total : 1075 time to create 1 rle with old method : 0.0024671554565429688 time for calcul the mask position with numpy : 0.001384735107421875 nb_pixel_total : 7497 time to create 1 rle with old method : 0.01648569107055664 time for calcul the mask position with numpy : 0.0016765594482421875 nb_pixel_total : 39086 time to create 1 rle with old method : 0.08388948440551758 time for calcul the mask position with numpy : 0.001344919204711914 nb_pixel_total : 877 time to create 1 rle with old method : 0.0020492076873779297 time for calcul the mask position with numpy : 0.0014829635620117188 nb_pixel_total : 5091 time to create 1 rle with old method : 0.01161646842956543 time for calcul the mask position with numpy : 0.0013170242309570312 nb_pixel_total : 1441 time to create 1 rle with old method : 0.0033800601959228516 time for calcul the mask position with numpy : 0.0013272762298583984 nb_pixel_total : 3900 time to create 1 rle with old method : 0.008581876754760742 time for calcul the mask position with numpy : 0.0015411376953125 nb_pixel_total : 18582 time to create 1 rle with old method : 0.04494524002075195 time for calcul the mask position with numpy : 0.0016400814056396484 nb_pixel_total : 1513 time to create 1 rle with old method : 0.004927873611450195 time for calcul the mask position with numpy : 0.0016503334045410156 nb_pixel_total : 9079 time to create 1 rle with old method : 0.029181480407714844 time for calcul the mask position with numpy : 0.0015921592712402344 nb_pixel_total : 267 time to create 1 rle with old method : 0.0009105205535888672 time for calcul the mask position with numpy : 0.0015954971313476562 nb_pixel_total : 713 time to create 1 rle with old method : 0.0025217533111572266 time for calcul the mask position with numpy : 0.0015823841094970703 nb_pixel_total : 901 time to create 1 rle with old method : 0.00302886962890625 time for calcul the mask position with numpy : 0.0015981197357177734 nb_pixel_total : 3166 time to create 1 rle with old method : 0.010300397872924805 time for calcul the mask position with numpy : 0.0015840530395507812 nb_pixel_total : 834 time to create 1 rle with old method : 0.0028083324432373047 time for calcul the mask position with numpy : 0.0016460418701171875 nb_pixel_total : 9717 time to create 1 rle with old method : 0.022404909133911133 time for calcul the mask position with numpy : 0.001352071762084961 nb_pixel_total : 616 time to create 1 rle with old method : 0.0013873577117919922 time for calcul the mask position with numpy : 0.0014622211456298828 nb_pixel_total : 7385 time to create 1 rle with old method : 0.016777992248535156 time for calcul the mask position with numpy : 0.001377105712890625 nb_pixel_total : 248 time to create 1 rle with old method : 0.0006518363952636719 time for calcul the mask position with numpy : 0.0013959407806396484 nb_pixel_total : 221 time to create 1 rle with old method : 0.0005409717559814453 time for calcul the mask position with numpy : 0.0013461112976074219 nb_pixel_total : 1633 time to create 1 rle with old method : 0.003728151321411133 time for calcul the mask position with numpy : 0.001422882080078125 nb_pixel_total : 1035 time to create 1 rle with old method : 0.0023679733276367188 time for calcul the mask position with numpy : 0.0013821125030517578 nb_pixel_total : 596 time to create 1 rle with old method : 0.0015168190002441406 time for calcul the mask position with numpy : 0.0014040470123291016 nb_pixel_total : 965 time to create 1 rle with old method : 0.002298593521118164 time for calcul the mask position with numpy : 0.0014226436614990234 nb_pixel_total : 1097 time to create 1 rle with old method : 0.0026140213012695312 time for calcul the mask position with numpy : 0.0013780593872070312 nb_pixel_total : 300 time to create 1 rle with old method : 0.0008449554443359375 time for calcul the mask position with numpy : 0.001434326171875 nb_pixel_total : 914 time to create 1 rle with old method : 0.002284526824951172 time for calcul the mask position with numpy : 0.0014166831970214844 nb_pixel_total : 2656 time to create 1 rle with old method : 0.006305694580078125 time for calcul the mask position with numpy : 0.001428365707397461 nb_pixel_total : 2206 time to create 1 rle with old method : 0.005203962326049805 time for calcul the mask position with numpy : 0.001432180404663086 nb_pixel_total : 1122 time to create 1 rle with old method : 0.002616405487060547 time for calcul the mask position with numpy : 0.0013613700866699219 nb_pixel_total : 946 time to create 1 rle with old method : 0.002321958541870117 time for calcul the mask position with numpy : 0.0013272762298583984 nb_pixel_total : 1326 time to create 1 rle with old method : 0.0031926631927490234 time for calcul the mask position with numpy : 0.0013861656188964844 nb_pixel_total : 475 time to create 1 rle with old method : 0.0011668205261230469 time for calcul the mask position with numpy : 0.0013206005096435547 nb_pixel_total : 1438 time to create 1 rle with old method : 0.0034775733947753906 time for calcul the mask position with numpy : 0.0013866424560546875 nb_pixel_total : 884 time to create 1 rle with old method : 0.002093791961669922 time for calcul the mask position with numpy : 0.0013117790222167969 nb_pixel_total : 828 time to create 1 rle with old method : 0.0019707679748535156 batch 1 Loaded 101 chid ids of type : 4677 Number RLEs to save : 9307 TO DO : save crop sub photo not yet done ! Inside saveOutput : final : True verbose : False saveOutput not yet implemented for datou_step.type : sam we use saveGeneral [1189321094] Looping around the photos to save general results len do output : 1 /1189321094Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4573', None, None, None, None, None, None, None, None) ('4573', None, '1189321094', None, None, None, None, None, None) begin to insert list_values into mtr_datou_result : length of list_values in save_final : 3 time used for this insertion : 0.013643980026245117 save_final save missing photos in datou_result : time spend for datou_step_exec : 10.500006914138794 time spend to save output : 0.013950586318969727 total time spend for step 1 : 10.513957500457764 caffe_path_current : About to save ! 2 After save, about to update current ! datou_cur_ids : [] len(datou.list_steps) : 1 output : {'1189321094': [[, , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , ], 'temp/1742725325_43872_1189321094_9626af7f95d010f2a4fd524688d4ea22_76896585.png']} nb_objects detect : 101 ############################### TEST frcnn ################################ Inside batchDatouExec : verbose : False # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : frcnn list_input_json : [] origin BFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 1 ; length of list_pids : 1 ; length of list_args : 1 time to download the photos : 1.147829294204712 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : False number of steps : 1 step1:frcnn Sun Mar 23 11:22:17 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step Faster rcnn ! To loadFromThcl() model_param file didn't exist model_name : detection_plaque_valcor_010622 model_type : caffe_faster_rcnn list file need : ['caffemodel', 'test.prototxt'] file exist in s3 : ['caffemodel', 'test.prototxt'] file manque in s3 : [] local folder : /data/models_weight/detection_plaque_valcor_010622 /data/models_weight/detection_plaque_valcor_010622/caffemodel size_local : 349723073 size in s3 : 349723073 create time local : 2022-07-12 14:12:27 create time in s3 : 2022-06-01 15:05:56 caffemodel already exist and didn't need to update /data/models_weight/detection_plaque_valcor_010622/test.prototxt size_local : 7163 size in s3 : 7163 create time local : 2022-07-12 14:12:27 create time in s3 : 2022-06-01 15:05:55 test.prototxt already exist and didn't need to update prototxt : /data/models_weight/detection_plaque_valcor_010622/test.prototxt caffemodel : /data/models_weight/detection_plaque_valcor_010622/caffemodel Loaded network /data/models_weight/detection_plaque_valcor_010622/caffemodel About to compute detect_faster_rcnn : len(args) : 1 Inside frcnn step exec : nb paths : 1 image_path : temp/1742725336_43872_917754606_35f3c9ae49686a6be16030c6ec25c9ee.jpg image_size (600, 800, 3) [[[ 4 6 6] [ 5 7 7] [ 6 8 8] ... [207 215 214] [206 214 213] [206 214 213]] [[ 4 6 6] [ 5 7 7] [ 6 8 8] ... [207 215 214] [206 214 213] [206 214 213]] [[ 4 6 6] [ 5 7 7] [ 6 8 8] ... [207 215 214] [206 214 213] [206 214 213]] ... [[ 14 16 16] [ 13 15 15] [ 11 13 13] ... [198 206 205] [198 206 205] [198 206 205]] [[ 16 18 18] [ 14 16 16] [ 11 13 13] ... [206 214 213] [206 214 213] [206 214 213]] [[ 13 15 15] [ 12 14 14] [ 9 11 11] ... [210 218 217] [210 218 217] [210 218 217]]] Detection took 0.088s for 300 object proposals len de result frcnn : 1 time spend for datou_step_exec : 3.884028911590576 time spend to save output : 9.369850158691406e-05 total time spend for step 1 : 3.884122610092163 caffe_path_current : About to save ! 1 Inside saveOutput : final : True verbose : False Inside saveFrcnn : final : True verbose : False threshold to save the result : 0.1 Warning : no hashtag_ids to insert in the database final : True begin to insert list_values into mtr_datou_result : length of list_values in save_final : 1 time used for this insertion : 0.498394250869751 [917754606] Looping around the photos to save general results len do output : 1 /0 before output type Managing all output in save final without adding information in the mtr_datou_result ('4184', None, None, None, None, None, None, None, None) ('4184', None, '917754606', None, None, None, None, None, None) begin to insert list_values into mtr_datou_result : length of list_values in save_final : 1 time used for this insertion : 0.06439208984375 save_final save missing photos in datou_result : After save, about to update current ! datou_cur_ids : [] len(datou.list_steps) : 1 output : {0: [[(0, 493029425, 4370, 374, 430, 293, 317, 0.063837335, None), (0, 493029425, 4370, 382, 552, 297, 344, 0.052210014, None), (0, 493029425, 4370, 345, 468, 272, 320, 0.012270998, None)], 'temp/1742725336_43872_917754606_35f3c9ae49686a6be16030c6ec25c9ee.jpg']} ############################### TEST thcl ################################ TEST THCL Inside batchDatouExec : verbose : False # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : step 1 thcl is not linked in the step_by_step architecture ! WARNING : step 2 argmax is not linked in the step_by_step architecture ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! DataTypes for each output/input checked ! List Step Type Loaded in datou : thcl, argmax list_input_json : [] origin BFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 1 ; length of list_pids : 1 ; length of list_args : 1 time to download the photos : 0.41501474380493164 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : False number of steps : 2 step1:thcl Sun Mar 23 11:22:22 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step Thcl ! we are using the classfication for only one thcl 355 time to import caffe and check if the image exist : 0.024745941162109375 time to convert the images to numpy array : 0.0009410381317138672 total time to convert the images to numpy array : 0.025980234146118164 list photo_ids error: [] list photo_ids correct : [916235064] number of photos to traite : 1 try to delete the photos incorrect in DB tagging for thcl : 355 To do loadFromThcl(), then load ParamDescType : thcl355 thcls : [{'id': 355, 'mtr_user_id': 31, 'name': 'car_360_1027', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'c_elysee_1027_gao__port_506302,mokka_1027_gao__port_506374,captur_1027_gao__port_506399,sorento_1027_gao__port_506192,navara_1027_gao__port_506205,xc90_1027_gao__port_506350,saxo_1027_gao__port_506052,trafic_1027_gao__port_506295,punto_evo_1027_gao__port_506066,5_1027_gao__port_506117,250_1027_gao__port_506065,d_max_1027_gao__port_506125,panamera_1027_gao__port_506387,alhambra_1027_gao__port_506381,x6_1027_gao__port_506349,vitara_1027_gao__port_506328,fiesta_1027_gao__port_506377,qashqai_1027_gao__port_506286,147_1027_gao__port_506124,c5_1027_gao__port_506172,q5_1027_gao__port_506206,giulia_1027_gao__port_506178,karl_1027_gao__port_506371,mehari_1027_gao__port_506076,911_1027_gao__port_506114,508_1027_gao__port_506329,idea_1027_gao__port_506122,megane_1027_gao__port_506220,ghibli_1027_gao__port_506174,touareg_1027_gao__port_506224,i10_1027_gao__port_506232,jumper_1027_gao__port_506234,classe_clk_1027_gao__port_506173,kuga_1027_gao__port_506181,ct_1027_gao__port_506323,leon_1027_gao__port_506326,ds5_1027_gao__port_506376,cordoba_1027_gao__port_506048,classe_cla_1027_gao__port_506400,jumpy_1027_gao__port_506179,avensis_1027_gao__port_506311,juke_1027_gao__port_506325,4008_1027_gao__port_506402,190_series_1027_gao__port_506051,serie_3_1027_gao__port_506294,q7_1027_gao__port_506318,glc_1027_gao__port_506303,grand_vitara_1027_gao__port_506175,s40_1027_gao__port_506099,toledo_1027_gao__port_506061,5008_1027_gao__port_506337,continental_1027_gao__port_506250,coupe_1027_gao__port_506082,iq_1027_gao__port_506166,407_1027_gao__port_506133,touran_1027_gao__port_506308,300c_1027_gao__port_506078,classe_gl_1027_gao__port_506340,vivaro_1027_gao__port_506310,sl_1027_gao__port_506100,elise_1027_gao__port_506121,1007_1027_gao__port_506070,i40_1027_gao__port_506218,bipper_tepee_1027_gao__port_506227,focus_1027_gao__port_506272,primera_1027_gao__port_506147,r4_1027_gao__port_506160,a8_1027_gao__port_506265,boxer_1027_gao__port_506202,s5_1027_gao__port_506222,r21_1027_gao__port_506093,c3_1027_gao__port_506257,santa_fe_1027_gao__port_506208,m4_1027_gao__port_506344,safrane_1027_gao__port_506077,classe_gle_1027_gao__port_506395,0_1027_gao__port_506094,ix35_1027_gao__port_506219,carens_1027_gao__port_506298,classe_a_1027_gao__port_506339,ix20_1027_gao__port_506343,note_1027_gao__port_506365,a5_1027_gao__port_506200,sx4_1027_gao__port_506348,sandero_1027_gao__port_506198,3008_1027_gao__port_506385,q50_1027_gao__port_506239,latitude_1027_gao__port_506236,v40_1027_gao__port_506391,xsara_1027_gao__port_506087,grand_c_max_1027_gao__port_506342,swift_1027_gao__port_506149,serie_1_1027_gao__port_506184,xc70_1027_gao__port_506393,master_1027_gao__port_506203,clio_1027_gao__port_506280,duster_1027_gao__port_506216,traveller_1027_gao__port_506403,tipo_1027_gao__port_506355,rav_4_1027_gao__port_506332,coccinelle_1027_gao__port_506259,spacetourer_1027_gao__port_506401,xe_1027_gao__port_506357,ds3_1027_gao__port_506324,mx_5_1027_gao__port_506098,land_cruiser_1027_gao__port_506315,classe_b_1027_gao__port_506335,806_1027_gao__port_506088,rx_8_1027_gao__port_506046,spark_1027_gao__port_506185,6_1027_gao__port_506171,bravo_1027_gao__port_506080,nx_1027_gao__port_506345,sharan_1027_gao__port_506347,x_type_1027_gao__port_506067,jimny_1027_gao__port_506233,wrangler_1027_gao__port_506225,c_crosser_1027_gao__port_506312,v70_1027_gao__port_506278,classe_e_1027_gao__port_506300,classe_v_1027_gao__port_506258,m3_1027_gao__port_506182,abarth_500_1027_gao__port_506226,serie_6_1027_gao__port_506262,modus_1027_gao__port_506146,3_1027_gao__port_506113,405_1027_gao__port_506108,allroad_1027_gao__port_506297,auris_1027_gao__port_506322,galaxy_1027_gao__port_506143,giulietta_1027_gao__port_506363,106_1027_gao__port_506073,classe_m_1027_gao__port_506154,espace_1027_gao__port_506313,panda_1027_gao__port_506189,rcz_1027_gao__port_506197,4007_1027_gao__port_506162,classe_cl_1027_gao__port_506249,leaf_1027_gao__port_506139,octavia_1027_gao__port_506237,ds4_1027_gao__port_506336,freelander_1027_gao__port_506084,evasion_1027_gao__port_506109,punto_1027_gao__port_506106,2cv_1027_gao__port_506045,x4_1027_gao__port_506392,antara_1027_gao__port_506247,murano_1027_gao__port_506316,alto_1027_gao__port_506201,meriva_1027_gao__port_506353,orlando_1027_gao__port_506305,new_beetle_1027_gao__port_506050,306_1027_gao__port_506145,tiguan_1027_gao__port_506362,s_type_1027_gao__port_506101,c1_1027_gao__port_506128,vectra_1027_gao__port_506044,outlander_1027_gao__port_506317,307_1027_gao__port_506074,a6_s6_1027_gao__port_506134,nemo_combi_1027_gao__port_506196,berlingo_1027_gao__port_506194,partner_1027_gao__port_506285,cayenne_1027_gao__port_506177,quattroporte_1027_gao__port_506240,c_max_1027_gao__port_506282,fabia_1027_gao__port_506396,cx_3_1027_gao__port_506281,x_trail_1027_gao__port_506264,scirocco_1027_gao__port_506276,matiz_1027_gao__port_506144,tigra_1027_gao__port_506069,escort_1027_gao__port_506091,c2_1027_gao__port_506081,mini_1027_gao__port_506168,i30_1027_gao__port_506291,picanto_1027_gao__port_506238,mito_1027_gao__port_506072,impreza_1027_gao__port_506085,kangoo_1027_gao__port_506235,a4_1027_gao__port_506193,cayman_1027_gao__port_506268,sportage_1027_gao__port_506148,up_1027_gao__port_506356,optima_1027_gao__port_506386,defender_1027_gao__port_506229,serie_2_1027_gao__port_506256,edge_1027_gao__port_506187,r19_1027_gao__port_506110,jetta_1027_gao__port_506304,eos_1027_gao__port_506115,accord_1027_gao__port_506214,yaris_1027_gao__port_506334,classe_cls_1027_gao__port_506289,polo_1027_gao__port_506361,serie_4_1027_gao__port_506366,mini_cabriolet_1027_gao__port_506204,prius_1027_gao__port_506190,lodgy_1027_gao__port_506188,serie_7_1027_gao__port_506307,c15_1027_gao__port_506055,kadjar_1027_gao__port_506389,insignia_1027_gao__port_506364,308_1027_gao__port_506279,roomster_1027_gao__port_506241,80_1027_gao__port_506057,309_1027_gao__port_506063,tucson_1027_gao__port_506320,x3_1027_gao__port_506212,xf_1027_gao__port_506263,2008_1027_gao__port_506394,passat_1027_gao__port_506306,compass_1027_gao__port_506260,twingo_1027_gao__port_506309,micra_1027_gao__port_506221,golf_1027_gao__port_506155,soul_1027_gao__port_506176,rapid_1027_gao__port_506398,forester_1027_gao__port_506360,slk_1027_gao__port_506210,forfour_1027_gao__port_506341,serie_5_1027_gao__port_506209,xj_1027_gao__port_506170,pajero_1027_gao__port_506097,agila_1027_gao__port_506119,a6_1027_gao__port_506163,fox_1027_gao__port_506092,boxster_1027_gao__port_506267,altea_1027_gao__port_506246,samurai_1027_gao__port_506047,trax_1027_gao__port_506296,getz_1027_gao__port_506058,cherokee_1027_gao__port_506269,koleos_1027_gao__port_506378,z_series_1027_gao__port_506123,ecosport_1027_gao__port_506271,space_star_1027_gao__port_506277,rs3_sportback_1027_gao__port_506207,civic_1027_gao__port_506141,talisman_1027_gao__port_506390,f_pace_1027_gao__port_506314,classe_c_1027_gao__port_506299,tt_1027_gao__port_506075,pathfinder_1027_gao__port_506183,156_1027_gao__port_506157,cx_5_1027_gao__port_506228,scenic_1027_gao__port_506255,yeti_1027_gao__port_506358,mustang_1027_gao__port_506053,stilo_1027_gao__port_506060,ateca_1027_gao__port_506382,fiorino_1027_gao__port_506217,classe_glk_1027_gao__port_506290,fortwo_1027_gao__port_506230,cruze_1027_gao__port_506186,107_1027_gao__port_506213,aygo_1027_gao__port_506248,rx_1027_gao__port_506354,500_1027_gao__port_506245,bora_1027_gao__port_506104,transit_1027_gao__port_506111,pt_cruiser_1027_gao__port_506054,patrol_1027_gao__port_506068,r8_1027_gao__port_506156,xm_1027_gao__port_506102,s60_1027_gao__port_506191,aveo_1027_gao__port_506158,captiva_1027_gao__port_506159,ax_1027_gao__port_506153,rexton_1027_gao__port_506107,camaro_1027_gao__port_506056,ypsilon_1027_gao__port_506131,delta_1027_gao__port_506165,c4_1027_gao__port_506370,zx_1027_gao__port_506161,verso_1027_gao__port_506242,superb_1027_gao__port_506327,r5_1027_gao__port_506253,caddy_1027_gao__port_506330,x5_1027_gao__port_506243,f_type_1027_gao__port_506231,fusion_1027_gao__port_506096,dokker_1027_gao__port_506331,205_1027_gao__port_506062,macan_1027_gao__port_506195,tourneo_1027_gao__port_506369,108_1027_gao__port_506384,9_3_1027_gao__port_506071,mondeo_1027_gao__port_506116,cr_v_1027_gao__port_506164,c30_1027_gao__port_506090,pulsar_1027_gao__port_506397,ibiza_1027_gao__port_506273,a1_1027_gao__port_506338,matrix_1027_gao__port_506140,carnival_1027_gao__port_506136,xantia_1027_gao__port_506086,terrano_1027_gao__port_506083,q3_1027_gao__port_506275,hr_v_1027_gao__port_506283,expert_1027_gao__port_506142,multivan_1027_gao__port_506383,venga_1027_gao__port_506380,scudo_1027_gao__port_506129,laguna_1027_gao__port_506368,vel_satis_1027_gao__port_506130,b_max_1027_gao__port_506367,ignis_1027_gao__port_506292,159_1027_gao__port_506064,grande_punto_1027_gao__port_506138,logan_1027_gao__port_506167,s_max_1027_gao__port_506223,caravelle_1027_gao__port_506351,adam_1027_gao__port_506079,406_1027_gao__port_506132,q30_1027_gao__port_506293,almera_1027_gao__port_506089,corsa_1027_gao__port_506095,corolla_1027_gao__port_506120,xc60_1027_gao__port_506388,viano_1027_gao__port_506211,pro_cee_d_1027_gao__port_506274,a3_1027_gao__port_506321,v50_1027_gao__port_506150,voyager_1027_gao__port_506169,corvette_1027_gao__port_506049,rio_1027_gao__port_506379,jazz_1027_gao__port_506252,200_1027_gao__port_506112,tts_1027_gao__port_506199,zafira_1027_gao__port_506287,asx_1027_gao__port_506266,607_1027_gao__port_506118,207_1027_gao__port_506103,classe_s_1027_gao__port_506301,c6_1027_gao__port_506105,express_1027_gao__port_506137,classe_gla_1027_gao__port_506352,v60_1027_gao__port_506333,ka_1027_gao__port_506180,range_rover_1027_gao__port_506254,discovery_1027_gao__port_506375,classe_r_1027_gao__port_506270,transporter_1027_gao__port_506319,cee_d_1027_gao__port_506288,zoe_1027_gao__port_506244,i20_1027_gao__port_506284,gtv_1027_gao__port_506059,s4_avant_1027_gao__port_506261,x1_1027_gao__port_506372,autres_1027_gao__port_506127,208_1027_gao__port_506359,c8_1027_gao__port_506135,astra_1027_gao__port_506215,2_1027_gao__port_506151,doblo_1027_gao__port_506251,807_1027_gao__port_506152,206_1027_gao__port_506126,a7_1027_gao__port_506373,renegade_1027_gao__port_506346', 'svm_portfolios_learning': '506302,506374,506399,506192,506205,506350,506052,506295,506066,506117,506065,506125,506387,506381,506349,506328,506377,506286,506124,506172,506206,506178,506371,506076,506114,506329,506122,506220,506174,506224,506232,506234,506173,506181,506323,506326,506376,506048,506400,506179,506311,506325,506402,506051,506294,506318,506303,506175,506099,506061,506337,506250,506082,506166,506133,506308,506078,506340,506310,506100,506121,506070,506218,506227,506272,506147,506160,506265,506202,506222,506093,506257,506208,506344,506077,506395,506094,506219,506298,506339,506343,506365,506200,506348,506198,506385,506239,506236,506391,506087,506342,506149,506184,506393,506203,506280,506216,506403,506355,506332,506259,506401,506357,506324,506098,506315,506335,506088,506046,506185,506171,506080,506345,506347,506067,506233,506225,506312,506278,506300,506258,506182,506226,506262,506146,506113,506108,506297,506322,506143,506363,506073,506154,506313,506189,506197,506162,506249,506139,506237,506336,506084,506109,506106,506045,506392,506247,506316,506201,506353,506305,506050,506145,506362,506101,506128,506044,506317,506074,506134,506196,506194,506285,506177,506240,506282,506396,506281,506264,506276,506144,506069,506091,506081,506168,506291,506238,506072,506085,506235,506193,506268,506148,506356,506386,506229,506256,506187,506110,506304,506115,506214,506334,506289,506361,506366,506204,506190,506188,506307,506055,506389,506364,506279,506241,506057,506063,506320,506212,506263,506394,506306,506260,506309,506221,506155,506176,506398,506360,506210,506341,506209,506170,506097,506119,506163,506092,506267,506246,506047,506296,506058,506269,506378,506123,506271,506277,506207,506141,506390,506314,506299,506075,506183,506157,506228,506255,506358,506053,506060,506382,506217,506290,506230,506186,506213,506248,506354,506245,506104,506111,506054,506068,506156,506102,506191,506158,506159,506153,506107,506056,506131,506165,506370,506161,506242,506327,506253,506330,506243,506231,506096,506331,506062,506195,506369,506384,506071,506116,506164,506090,506397,506273,506338,506140,506136,506086,506083,506275,506283,506142,506383,506380,506129,506368,506130,506367,506292,506064,506138,506167,506223,506351,506079,506132,506293,506089,506095,506120,506388,506211,506274,506321,506150,506169,506049,506379,506252,506112,506199,506287,506266,506118,506103,506301,506105,506137,506352,506333,506180,506254,506375,506270,506319,506288,506244,506284,506059,506261,506372,506127,506359,506135,506215,506151,506251,506152,506126,506373,506346', 'photo_hashtag_type': 332, 'photo_desc_type': 3390, 'type_classification': 'caffe', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0'}] thcl {'id': 355, 'mtr_user_id': 31, 'name': 'car_360_1027', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'c_elysee_1027_gao__port_506302,mokka_1027_gao__port_506374,captur_1027_gao__port_506399,sorento_1027_gao__port_506192,navara_1027_gao__port_506205,xc90_1027_gao__port_506350,saxo_1027_gao__port_506052,trafic_1027_gao__port_506295,punto_evo_1027_gao__port_506066,5_1027_gao__port_506117,250_1027_gao__port_506065,d_max_1027_gao__port_506125,panamera_1027_gao__port_506387,alhambra_1027_gao__port_506381,x6_1027_gao__port_506349,vitara_1027_gao__port_506328,fiesta_1027_gao__port_506377,qashqai_1027_gao__port_506286,147_1027_gao__port_506124,c5_1027_gao__port_506172,q5_1027_gao__port_506206,giulia_1027_gao__port_506178,karl_1027_gao__port_506371,mehari_1027_gao__port_506076,911_1027_gao__port_506114,508_1027_gao__port_506329,idea_1027_gao__port_506122,megane_1027_gao__port_506220,ghibli_1027_gao__port_506174,touareg_1027_gao__port_506224,i10_1027_gao__port_506232,jumper_1027_gao__port_506234,classe_clk_1027_gao__port_506173,kuga_1027_gao__port_506181,ct_1027_gao__port_506323,leon_1027_gao__port_506326,ds5_1027_gao__port_506376,cordoba_1027_gao__port_506048,classe_cla_1027_gao__port_506400,jumpy_1027_gao__port_506179,avensis_1027_gao__port_506311,juke_1027_gao__port_506325,4008_1027_gao__port_506402,190_series_1027_gao__port_506051,serie_3_1027_gao__port_506294,q7_1027_gao__port_506318,glc_1027_gao__port_506303,grand_vitara_1027_gao__port_506175,s40_1027_gao__port_506099,toledo_1027_gao__port_506061,5008_1027_gao__port_506337,continental_1027_gao__port_506250,coupe_1027_gao__port_506082,iq_1027_gao__port_506166,407_1027_gao__port_506133,touran_1027_gao__port_506308,300c_1027_gao__port_506078,classe_gl_1027_gao__port_506340,vivaro_1027_gao__port_506310,sl_1027_gao__port_506100,elise_1027_gao__port_506121,1007_1027_gao__port_506070,i40_1027_gao__port_506218,bipper_tepee_1027_gao__port_506227,focus_1027_gao__port_506272,primera_1027_gao__port_506147,r4_1027_gao__port_506160,a8_1027_gao__port_506265,boxer_1027_gao__port_506202,s5_1027_gao__port_506222,r21_1027_gao__port_506093,c3_1027_gao__port_506257,santa_fe_1027_gao__port_506208,m4_1027_gao__port_506344,safrane_1027_gao__port_506077,classe_gle_1027_gao__port_506395,0_1027_gao__port_506094,ix35_1027_gao__port_506219,carens_1027_gao__port_506298,classe_a_1027_gao__port_506339,ix20_1027_gao__port_506343,note_1027_gao__port_506365,a5_1027_gao__port_506200,sx4_1027_gao__port_506348,sandero_1027_gao__port_506198,3008_1027_gao__port_506385,q50_1027_gao__port_506239,latitude_1027_gao__port_506236,v40_1027_gao__port_506391,xsara_1027_gao__port_506087,grand_c_max_1027_gao__port_506342,swift_1027_gao__port_506149,serie_1_1027_gao__port_506184,xc70_1027_gao__port_506393,master_1027_gao__port_506203,clio_1027_gao__port_506280,duster_1027_gao__port_506216,traveller_1027_gao__port_506403,tipo_1027_gao__port_506355,rav_4_1027_gao__port_506332,coccinelle_1027_gao__port_506259,spacetourer_1027_gao__port_506401,xe_1027_gao__port_506357,ds3_1027_gao__port_506324,mx_5_1027_gao__port_506098,land_cruiser_1027_gao__port_506315,classe_b_1027_gao__port_506335,806_1027_gao__port_506088,rx_8_1027_gao__port_506046,spark_1027_gao__port_506185,6_1027_gao__port_506171,bravo_1027_gao__port_506080,nx_1027_gao__port_506345,sharan_1027_gao__port_506347,x_type_1027_gao__port_506067,jimny_1027_gao__port_506233,wrangler_1027_gao__port_506225,c_crosser_1027_gao__port_506312,v70_1027_gao__port_506278,classe_e_1027_gao__port_506300,classe_v_1027_gao__port_506258,m3_1027_gao__port_506182,abarth_500_1027_gao__port_506226,serie_6_1027_gao__port_506262,modus_1027_gao__port_506146,3_1027_gao__port_506113,405_1027_gao__port_506108,allroad_1027_gao__port_506297,auris_1027_gao__port_506322,galaxy_1027_gao__port_506143,giulietta_1027_gao__port_506363,106_1027_gao__port_506073,classe_m_1027_gao__port_506154,espace_1027_gao__port_506313,panda_1027_gao__port_506189,rcz_1027_gao__port_506197,4007_1027_gao__port_506162,classe_cl_1027_gao__port_506249,leaf_1027_gao__port_506139,octavia_1027_gao__port_506237,ds4_1027_gao__port_506336,freelander_1027_gao__port_506084,evasion_1027_gao__port_506109,punto_1027_gao__port_506106,2cv_1027_gao__port_506045,x4_1027_gao__port_506392,antara_1027_gao__port_506247,murano_1027_gao__port_506316,alto_1027_gao__port_506201,meriva_1027_gao__port_506353,orlando_1027_gao__port_506305,new_beetle_1027_gao__port_506050,306_1027_gao__port_506145,tiguan_1027_gao__port_506362,s_type_1027_gao__port_506101,c1_1027_gao__port_506128,vectra_1027_gao__port_506044,outlander_1027_gao__port_506317,307_1027_gao__port_506074,a6_s6_1027_gao__port_506134,nemo_combi_1027_gao__port_506196,berlingo_1027_gao__port_506194,partner_1027_gao__port_506285,cayenne_1027_gao__port_506177,quattroporte_1027_gao__port_506240,c_max_1027_gao__port_506282,fabia_1027_gao__port_506396,cx_3_1027_gao__port_506281,x_trail_1027_gao__port_506264,scirocco_1027_gao__port_506276,matiz_1027_gao__port_506144,tigra_1027_gao__port_506069,escort_1027_gao__port_506091,c2_1027_gao__port_506081,mini_1027_gao__port_506168,i30_1027_gao__port_506291,picanto_1027_gao__port_506238,mito_1027_gao__port_506072,impreza_1027_gao__port_506085,kangoo_1027_gao__port_506235,a4_1027_gao__port_506193,cayman_1027_gao__port_506268,sportage_1027_gao__port_506148,up_1027_gao__port_506356,optima_1027_gao__port_506386,defender_1027_gao__port_506229,serie_2_1027_gao__port_506256,edge_1027_gao__port_506187,r19_1027_gao__port_506110,jetta_1027_gao__port_506304,eos_1027_gao__port_506115,accord_1027_gao__port_506214,yaris_1027_gao__port_506334,classe_cls_1027_gao__port_506289,polo_1027_gao__port_506361,serie_4_1027_gao__port_506366,mini_cabriolet_1027_gao__port_506204,prius_1027_gao__port_506190,lodgy_1027_gao__port_506188,serie_7_1027_gao__port_506307,c15_1027_gao__port_506055,kadjar_1027_gao__port_506389,insignia_1027_gao__port_506364,308_1027_gao__port_506279,roomster_1027_gao__port_506241,80_1027_gao__port_506057,309_1027_gao__port_506063,tucson_1027_gao__port_506320,x3_1027_gao__port_506212,xf_1027_gao__port_506263,2008_1027_gao__port_506394,passat_1027_gao__port_506306,compass_1027_gao__port_506260,twingo_1027_gao__port_506309,micra_1027_gao__port_506221,golf_1027_gao__port_506155,soul_1027_gao__port_506176,rapid_1027_gao__port_506398,forester_1027_gao__port_506360,slk_1027_gao__port_506210,forfour_1027_gao__port_506341,serie_5_1027_gao__port_506209,xj_1027_gao__port_506170,pajero_1027_gao__port_506097,agila_1027_gao__port_506119,a6_1027_gao__port_506163,fox_1027_gao__port_506092,boxster_1027_gao__port_506267,altea_1027_gao__port_506246,samurai_1027_gao__port_506047,trax_1027_gao__port_506296,getz_1027_gao__port_506058,cherokee_1027_gao__port_506269,koleos_1027_gao__port_506378,z_series_1027_gao__port_506123,ecosport_1027_gao__port_506271,space_star_1027_gao__port_506277,rs3_sportback_1027_gao__port_506207,civic_1027_gao__port_506141,talisman_1027_gao__port_506390,f_pace_1027_gao__port_506314,classe_c_1027_gao__port_506299,tt_1027_gao__port_506075,pathfinder_1027_gao__port_506183,156_1027_gao__port_506157,cx_5_1027_gao__port_506228,scenic_1027_gao__port_506255,yeti_1027_gao__port_506358,mustang_1027_gao__port_506053,stilo_1027_gao__port_506060,ateca_1027_gao__port_506382,fiorino_1027_gao__port_506217,classe_glk_1027_gao__port_506290,fortwo_1027_gao__port_506230,cruze_1027_gao__port_506186,107_1027_gao__port_506213,aygo_1027_gao__port_506248,rx_1027_gao__port_506354,500_1027_gao__port_506245,bora_1027_gao__port_506104,transit_1027_gao__port_506111,pt_cruiser_1027_gao__port_506054,patrol_1027_gao__port_506068,r8_1027_gao__port_506156,xm_1027_gao__port_506102,s60_1027_gao__port_506191,aveo_1027_gao__port_506158,captiva_1027_gao__port_506159,ax_1027_gao__port_506153,rexton_1027_gao__port_506107,camaro_1027_gao__port_506056,ypsilon_1027_gao__port_506131,delta_1027_gao__port_506165,c4_1027_gao__port_506370,zx_1027_gao__port_506161,verso_1027_gao__port_506242,superb_1027_gao__port_506327,r5_1027_gao__port_506253,caddy_1027_gao__port_506330,x5_1027_gao__port_506243,f_type_1027_gao__port_506231,fusion_1027_gao__port_506096,dokker_1027_gao__port_506331,205_1027_gao__port_506062,macan_1027_gao__port_506195,tourneo_1027_gao__port_506369,108_1027_gao__port_506384,9_3_1027_gao__port_506071,mondeo_1027_gao__port_506116,cr_v_1027_gao__port_506164,c30_1027_gao__port_506090,pulsar_1027_gao__port_506397,ibiza_1027_gao__port_506273,a1_1027_gao__port_506338,matrix_1027_gao__port_506140,carnival_1027_gao__port_506136,xantia_1027_gao__port_506086,terrano_1027_gao__port_506083,q3_1027_gao__port_506275,hr_v_1027_gao__port_506283,expert_1027_gao__port_506142,multivan_1027_gao__port_506383,venga_1027_gao__port_506380,scudo_1027_gao__port_506129,laguna_1027_gao__port_506368,vel_satis_1027_gao__port_506130,b_max_1027_gao__port_506367,ignis_1027_gao__port_506292,159_1027_gao__port_506064,grande_punto_1027_gao__port_506138,logan_1027_gao__port_506167,s_max_1027_gao__port_506223,caravelle_1027_gao__port_506351,adam_1027_gao__port_506079,406_1027_gao__port_506132,q30_1027_gao__port_506293,almera_1027_gao__port_506089,corsa_1027_gao__port_506095,corolla_1027_gao__port_506120,xc60_1027_gao__port_506388,viano_1027_gao__port_506211,pro_cee_d_1027_gao__port_506274,a3_1027_gao__port_506321,v50_1027_gao__port_506150,voyager_1027_gao__port_506169,corvette_1027_gao__port_506049,rio_1027_gao__port_506379,jazz_1027_gao__port_506252,200_1027_gao__port_506112,tts_1027_gao__port_506199,zafira_1027_gao__port_506287,asx_1027_gao__port_506266,607_1027_gao__port_506118,207_1027_gao__port_506103,classe_s_1027_gao__port_506301,c6_1027_gao__port_506105,express_1027_gao__port_506137,classe_gla_1027_gao__port_506352,v60_1027_gao__port_506333,ka_1027_gao__port_506180,range_rover_1027_gao__port_506254,discovery_1027_gao__port_506375,classe_r_1027_gao__port_506270,transporter_1027_gao__port_506319,cee_d_1027_gao__port_506288,zoe_1027_gao__port_506244,i20_1027_gao__port_506284,gtv_1027_gao__port_506059,s4_avant_1027_gao__port_506261,x1_1027_gao__port_506372,autres_1027_gao__port_506127,208_1027_gao__port_506359,c8_1027_gao__port_506135,astra_1027_gao__port_506215,2_1027_gao__port_506151,doblo_1027_gao__port_506251,807_1027_gao__port_506152,206_1027_gao__port_506126,a7_1027_gao__port_506373,renegade_1027_gao__port_506346', 'svm_portfolios_learning': '506302,506374,506399,506192,506205,506350,506052,506295,506066,506117,506065,506125,506387,506381,506349,506328,506377,506286,506124,506172,506206,506178,506371,506076,506114,506329,506122,506220,506174,506224,506232,506234,506173,506181,506323,506326,506376,506048,506400,506179,506311,506325,506402,506051,506294,506318,506303,506175,506099,506061,506337,506250,506082,506166,506133,506308,506078,506340,506310,506100,506121,506070,506218,506227,506272,506147,506160,506265,506202,506222,506093,506257,506208,506344,506077,506395,506094,506219,506298,506339,506343,506365,506200,506348,506198,506385,506239,506236,506391,506087,506342,506149,506184,506393,506203,506280,506216,506403,506355,506332,506259,506401,506357,506324,506098,506315,506335,506088,506046,506185,506171,506080,506345,506347,506067,506233,506225,506312,506278,506300,506258,506182,506226,506262,506146,506113,506108,506297,506322,506143,506363,506073,506154,506313,506189,506197,506162,506249,506139,506237,506336,506084,506109,506106,506045,506392,506247,506316,506201,506353,506305,506050,506145,506362,506101,506128,506044,506317,506074,506134,506196,506194,506285,506177,506240,506282,506396,506281,506264,506276,506144,506069,506091,506081,506168,506291,506238,506072,506085,506235,506193,506268,506148,506356,506386,506229,506256,506187,506110,506304,506115,506214,506334,506289,506361,506366,506204,506190,506188,506307,506055,506389,506364,506279,506241,506057,506063,506320,506212,506263,506394,506306,506260,506309,506221,506155,506176,506398,506360,506210,506341,506209,506170,506097,506119,506163,506092,506267,506246,506047,506296,506058,506269,506378,506123,506271,506277,506207,506141,506390,506314,506299,506075,506183,506157,506228,506255,506358,506053,506060,506382,506217,506290,506230,506186,506213,506248,506354,506245,506104,506111,506054,506068,506156,506102,506191,506158,506159,506153,506107,506056,506131,506165,506370,506161,506242,506327,506253,506330,506243,506231,506096,506331,506062,506195,506369,506384,506071,506116,506164,506090,506397,506273,506338,506140,506136,506086,506083,506275,506283,506142,506383,506380,506129,506368,506130,506367,506292,506064,506138,506167,506223,506351,506079,506132,506293,506089,506095,506120,506388,506211,506274,506321,506150,506169,506049,506379,506252,506112,506199,506287,506266,506118,506103,506301,506105,506137,506352,506333,506180,506254,506375,506270,506319,506288,506244,506284,506059,506261,506372,506127,506359,506135,506215,506151,506251,506152,506126,506373,506346', 'photo_hashtag_type': 332, 'photo_desc_type': 3390, 'type_classification': 'caffe', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 3390 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (3390, 'car_360_1027', 16384, 25088, 'car_360_1027', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2017, 10, 28, 12, 29, 27), datetime.datetime(2017, 10, 28, 12, 29, 27)) To loadFromThcl() : net_3390 begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 5520 max_wait_temp : 1 max_wait : 0 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (3390, 'car_360_1027', 16384, 25088, 'car_360_1027', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2017, 10, 28, 12, 29, 27), datetime.datetime(2017, 10, 28, 12, 29, 27)) None mean_file_type : mean_file_path : prototxt_file_path : model : car_360_1027 Inside get_net Inside get_net before cache_data_model model_param file didn't exist Inside get_net before CDM.load_model_par_type model_name : car_360_1027 model_type : caffe list file need : ['caffemodel', 'deploy_conv_normal.prototxt', 'deploy_fc.prototxt', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file exist in s3 : ['caffemodel', 'deploy_conv_normal.prototxt', 'deploy_fc.prototxt', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file manque in s3 : [] local folder : /data/models_weight/car_360_1027 /data/models_weight/car_360_1027/caffemodel size_local : 542944640 size in s3 : 542944640 create time local : 2021-08-09 05:28:34 create time in s3 : 2021-08-06 17:57:43 caffemodel already exist and didn't need to update /data/models_weight/car_360_1027/deploy_conv_normal.prototxt size_local : 4626 size in s3 : 4626 create time local : 2021-08-09 05:28:34 create time in s3 : 2021-08-06 17:57:42 deploy_conv_normal.prototxt already exist and didn't need to update /data/models_weight/car_360_1027/deploy_fc.prototxt size_local : 1132 size in s3 : 1132 create time local : 2021-08-09 05:28:34 create time in s3 : 2021-08-06 17:57:43 deploy_fc.prototxt already exist and didn't need to update /data/models_weight/car_360_1027/deploy.prototxt size_local : 5654 size in s3 : 5654 create time local : 2021-08-09 05:28:34 create time in s3 : 2021-08-06 17:57:42 deploy.prototxt already exist and didn't need to update /data/models_weight/car_360_1027/mean.npy size_local : 1572944 size in s3 : 1572944 create time local : 2021-08-09 05:28:34 create time in s3 : 2021-08-06 17:57:55 mean.npy already exist and didn't need to update /data/models_weight/car_360_1027/synset_words.txt size_local : 13687 size in s3 : 13687 create time local : 2021-08-09 05:28:34 create time in s3 : 2021-08-06 17:57:43 synset_words.txt already exist and didn't need to update Inside get_net after CDM.load_model_par_type After if not only_with_local_cache: /home/admin/workarea/install/darknet/:/home/admin/workarea/git/Velours/python:/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python:/home/admin/mtr/.credentials:/home/admin/workarea/install/caffe/python:/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools/:/home/admin/workarea/git/fotonowerpip/:/home/admin/workarea/install/segment-anything:/home/admin//workarea/git/pyfvs/ Here before set mode gpu Doing nothing but we could set mode gpu after set mode gpu prototxt_filename : /data/models_weight/car_360_1027/deploy.prototxt caffemodel_filename : /data/models_weight/car_360_1027/caffemodel now we set caffe to gpu mode before predict begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 5520 max_wait_temp : 1 max_wait : 0 dict_keys(['pool5', 'prob']) time used to do the prepocess of the images : 0.011879444122314453 time used to do the prediction : 0.06412982940673828 save descriptor for thcl : 355 time to traite the descriptors : 0.05962657928466797 Catched exception ! Connect or reconnect ! storage_type for insertDescriptorsMulti : 1 To insert : 916235064 time to insert the descriptors : 1.1091699600219727 Inside saveOutput : final : False verbose : False time used to find the portfolios of the photos SAVE THCL : begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 0 time used for this insertion : 7.62939453125e-06 save missing photos in datou_result : time spend for datou_step_exec : 6.853132724761963 time spend to save output : 1.7547376155853271 total time spend for step 1 : 8.60787034034729 step2:argmax Sun Mar 23 11:22:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou_step Argmax ! calculate argmax for thcl : 355 Inside saveOutput : final : True verbose : False photo_id : 916235064 output[photo_id] : [('916235064', 'c15_1027_gao__port_506055', 0.01771451, 332, '355'), 'temp/1742725342_43872_916235064_6293d1bb790dc6902450e7c572b7d10b.jpg'] begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 1 time used for this insertion : 0.013741254806518555 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 1 time used for this insertion : 0.02041792869567871 len list_finale : 1, len picture : 1 begin to insert list_values into mtr_datou_result : length of list_values in save_final : 1 time used for this insertion : 0.01306915283203125 saving photo_ids in datou_result photo id not in port begin to insert list_values into mtr_datou_result : length of list_values in save_final : 0 time used for this insertion : 4.0531158447265625e-06 save missing photos in datou_result : time spend for datou_step_exec : 0.0002868175506591797 time spend to save output : 0.04754233360290527 total time spend for step 2 : 0.04782915115356445 caffe_path_current : About to save ! 2 After save, about to update current ! datou_cur_ids : [] len(datou.list_steps) : 2 output : {'916235064': [('916235064', 'c15_1027_gao__port_506055', 0.01771451, 332, '355'), 'temp/1742725342_43872_916235064_6293d1bb790dc6902450e7c572b7d10b.jpg']} ############################### TEST tfhub2 ################################ TEST TFHUB2 ######################## test with use_multi_inputs=0 ######################## Inside batchDatouExec : verbose : False # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : step 12835 tfhub_classification2 is not linked in the step_by_step architecture ! WARNING : step 12836 argmax is not linked in the step_by_step architecture ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! DataTypes for each output/input checked ! List Step Type Loaded in datou : tfhub_classification2, argmax list_input_json : [] origin BBBFFFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 3 ; length of list_pids : 3 ; length of list_args : 3 time to download the photos : 0.19708871841430664 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : False number of steps : 2 step1:tfhub_classification2 Sun Mar 23 11:22:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou_step TFHub with tf2 ! we are using the classfication for only one thcl 3609 begin to check gpu status inside check gpu memory 2025-03-23 11:22:34.749556: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-03-23 11:22:34.750185: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-03-23 11:22:34.750273: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-23 11:22:34.750332: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-23 11:22:34.751997: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-03-23 11:22:34.752101: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-03-23 11:22:34.753886: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-03-23 11:22:34.754857: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-03-23 11:22:34.758357: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-03-23 11:22:34.759459: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-03-23 11:22:34.759848: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-03-23 11:22:34.795123: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-03-23 11:22:34.797176: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f6494000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-03-23 11:22:34.797222: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-03-23 11:22:34.801010: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x309fc4f0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-03-23 11:22:34.801050: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-03-23 11:22:34.802228: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-03-23 11:22:34.802460: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-23 11:22:34.802497: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-23 11:22:34.802660: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-03-23 11:22:34.802701: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-03-23 11:22:34.802748: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-03-23 11:22:34.802804: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-03-23 11:22:34.802856: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-03-23 11:22:34.804502: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-03-23 11:22:34.804583: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-23 11:22:34.804652: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-03-23 11:22:34.804669: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-03-23 11:22:34.804687: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-03-23 11:22:34.806389: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 3096 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) l 3637 free memory gpu now : 5520 max_wait_temp : 1 max_wait : 5 1 Physical GPUs, 1 Logical GPUs tagging for thcl : 3609 To do loadFromThcl(), then load ParamDescType : thcl3609 thcls : [{'id': 3609, 'mtr_user_id': 31, 'name': 'tfhub_19_06_2023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'jrm,pcm,pcnc,pehd,tapis_vide', 'svm_portfolios_learning': '9336903,9336904,9336905,9336906,9336909', 'photo_hashtag_type': 4674, 'photo_desc_type': 5832, 'type_classification': 'tf_classification2', 'hashtag_id_list': '495916461,560181804,1284539308,628944319,2107748999'}] thcl {'id': 3609, 'mtr_user_id': 31, 'name': 'tfhub_19_06_2023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'jrm,pcm,pcnc,pehd,tapis_vide', 'svm_portfolios_learning': '9336903,9336904,9336905,9336906,9336909', 'photo_hashtag_type': 4674, 'photo_desc_type': 5832, 'type_classification': 'tf_classification2', 'hashtag_id_list': '495916461,560181804,1284539308,628944319,2107748999'} Update svm_hashtag_type_desc : 5832 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5832, 'tfhub_19_06_2023', 1280, 1280, 'tfhub_19_06_2023', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2023, 6, 19, 12, 55, 22), datetime.datetime(2023, 6, 19, 12, 55, 22)) model_name : tfhub_19_06_2023 model_param file didn't exist model_name : tfhub_19_06_2023 model_type : tf_classification2 list file need : ['Confusion_Matrix.png', 'Precision_Recall_jrm.jpg', 'Precision_Recall_pcm.jpg', 'Precision_Recall_pcnc.jpg', 'Precision_Recall_pehd.jpg', 'Precision_Recall_tapis_vide.jpg', 'Result_Summary.txt', 'checkpoint', 'model_checkpoint.ckpt.data-00000-of-00002', 'model_checkpoint.ckpt.data-00001-of-00002', 'model_checkpoint.ckpt.index', 'model_weights.h5'] file exist in s3 : ['Confusion_Matrix.png', 'Precision_Recall_jrm.jpg', 'Precision_Recall_pcm.jpg', 'Precision_Recall_pcnc.jpg', 'Precision_Recall_pehd.jpg', 'Precision_Recall_tapis_vide.jpg', 'Result_Summary.txt', 'checkpoint', 'model_checkpoint.ckpt.data-00000-of-00002', 'model_checkpoint.ckpt.data-00001-of-00002', 'model_checkpoint.ckpt.index', 'model_weights.h5'] file manque in s3 : [] 2025-03-23 11:22:43.518774: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.02G (3246391296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-23 11:22:43.519420: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.72G (2921752064 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-23 11:22:43.520026: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629576704 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-23 11:22:43.520651: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.20G (2366618880 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory local folder : /data/models_weight/tfhub_19_06_2023 /data/models_weight/tfhub_19_06_2023/Confusion_Matrix.png size_local : 57753 size in s3 : 57753 create time local : 2023-06-22 17:09:38 create time in s3 : 2023-06-19 10:55:15 Confusion_Matrix.png already exist and didn't need to update /data/models_weight/tfhub_19_06_2023/Precision_Recall_jrm.jpg size_local : 79724 size in s3 : 79724 create time local : 2023-06-22 17:09:38 create time in s3 : 2023-06-19 10:55:20 Precision_Recall_jrm.jpg already exist and didn't need to update /data/models_weight/tfhub_19_06_2023/Precision_Recall_pcm.jpg size_local : 83556 size in s3 : 83556 create time local : 2023-06-22 17:09:38 create time in s3 : 2023-06-19 10:55:15 Precision_Recall_pcm.jpg already exist and didn't need to update /data/models_weight/tfhub_19_06_2023/Precision_Recall_pcnc.jpg size_local : 74107 size in s3 : 74107 create time local : 2023-06-22 17:09:38 create time in s3 : 2023-06-19 10:55:20 Precision_Recall_pcnc.jpg already exist and didn't need to update /data/models_weight/tfhub_19_06_2023/Precision_Recall_pehd.jpg size_local : 72705 size in s3 : 72705 create time local : 2023-06-22 17:09:39 create time in s3 : 2023-06-19 10:55:20 Precision_Recall_pehd.jpg already exist and didn't need to update /data/models_weight/tfhub_19_06_2023/Precision_Recall_tapis_vide.jpg size_local : 70874 size in s3 : 70874 create time local : 2023-06-22 17:09:39 create time in s3 : 2023-06-19 10:55:15 Precision_Recall_tapis_vide.jpg already exist and didn't need to update /data/models_weight/tfhub_19_06_2023/Result_Summary.txt size_local : 642 size in s3 : 642 create time local : 2023-06-22 17:09:39 create time in s3 : 2023-06-19 10:55:22 Result_Summary.txt already exist and didn't need to update /data/models_weight/tfhub_19_06_2023/checkpoint size_local : 99 size in s3 : 99 create time local : 2023-06-22 17:09:39 create time in s3 : 2023-06-19 10:55:22 checkpoint already exist and didn't need to update /data/models_weight/tfhub_19_06_2023/model_checkpoint.ckpt.data-00000-of-00002 size_local : 216488 size in s3 : 216488 create time local : 2023-06-22 17:09:39 create time in s3 : 2023-06-19 10:55:22 model_checkpoint.ckpt.data-00000-of-00002 already exist and didn't need to update /data/models_weight/tfhub_19_06_2023/model_checkpoint.ckpt.data-00001-of-00002 size_local : 32279708 size in s3 : 32279708 create time local : 2023-06-22 17:09:40 create time in s3 : 2023-06-19 10:55:21 model_checkpoint.ckpt.data-00001-of-00002 already exist and didn't need to update /data/models_weight/tfhub_19_06_2023/model_checkpoint.ckpt.index size_local : 43546 size in s3 : 43546 create time local : 2023-06-22 17:09:40 create time in s3 : 2023-06-19 10:55:22 model_checkpoint.ckpt.index already exist and didn't need to update /data/models_weight/tfhub_19_06_2023/model_weights.h5 size_local : 16499144 size in s3 : 16499144 create time local : 2023-06-22 17:09:40 create time in s3 : 2023-06-19 10:55:15 model_weights.h5 already exist and didn't need to update ERROR in datou_step_exec, will save and exit ! assertion failed: [0] [Op:Assert] name: EagerVariableNameReuse File "/home/admin/workarea/git/Velours/python/mtr/datou/datou_lib.py", line 2329, in datou_exec output = datou_step_exec(sNext, args, cache, context, map_info, verbose, mtr_user_id) File "/home/admin/workarea/git/Velours/python/mtr/datou/datou_lib.py", line 2523, in datou_step_exec return lib_process.datou_step_tfhub2(param, json_param, args, cache, context, map_info, verbose) File "/home/admin/workarea/git/Velours/python/mtr/datou/lib_step_exec/lib_step_process.py", line 3138, in datou_step_tfhub2 this_model = model_evaluator(model_name, model_type=model_type, fc_size=fc_size,use_multi_inputs=use_multi_inputs) File "/home/admin/workarea/git/Velours/python/mtr/tfhub2/evaluate.py", line 156, in __init__ self.model, _, _ = create_tfhub_model(module_handle=self.tfhub_module, File "/home/admin/workarea/git/Velours/python/mtr/tfhub2/evaluate.py", line 77, in create_tfhub_model hub.KerasLayer(module_handle, trainable=do_fine_tuning, name="module"), File "/home/admin/.local/lib/python3.8/site-packages/tensorflow_hub/keras_layer.py", line 152, in __init__ self._func = load_module(handle, tags, self._load_options) File "/home/admin/.local/lib/python3.8/site-packages/tensorflow_hub/keras_layer.py", line 421, in load_module return module_v2.load(handle, tags=tags, options=set_load_options) File "/home/admin/.local/lib/python3.8/site-packages/tensorflow_hub/module_v2.py", line 106, in load obj = tf.compat.v1.saved_model.load_v2(module_path, tags=tags) File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/saved_model/load.py", line 578, in load return load_internal(export_dir, tags) File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/saved_model/load.py", line 602, in load_internal loader = loader_cls(object_graph_proto, File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/saved_model/load.py", line 123, in __init__ self._load_all() File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/saved_model/load.py", line 134, in _load_all self._load_nodes() File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/saved_model/load.py", line 264, in _load_nodes node, setter = self._recreate(proto, node_id) File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/saved_model/load.py", line 370, in _recreate return factory[kind]() File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/saved_model/load.py", line 363, in "variable": lambda: self._recreate_variable(proto.variable), File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/saved_model/load.py", line 426, in _recreate_variable return variables.Variable( File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/variables.py", line 261, in __call__ return cls._variable_v2_call(*args, **kwargs) File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/variables.py", line 243, in _variable_v2_call return previous_getter( File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/variables.py", line 66, in getter return captured_getter(captured_previous, **kwargs) File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/saved_model/load.py", line 418, in uninitialized_variable_creator return resource_variable_ops.UninitializedVariable(**kwargs) File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/variables.py", line 263, in __call__ return super(VariableMetaclass, cls).__call__(*args, **kwargs) File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/resource_variable_ops.py", line 1795, in __init__ handle = _variable_handle_from_shape_and_dtype( File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/resource_variable_ops.py", line 174, in _variable_handle_from_shape_and_dtype gen_logging_ops._assert( # pylint: disable=protected-access File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/gen_logging_ops.py", line 55, in _assert _ops.raise_from_not_ok_status(e, name) File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/ops.py", line 6653, in raise_from_not_ok_status six.raise_from(core._status_to_exception(e.code, message), None) File "", line 3, in raise_from [1171252764, 1171252487, 1171252784] begin to insert list_values into mtr_datou_result : length of list_values in save_final : 3 time used for this insertion : 0.11571121215820312 save_final ERROR in last step tfhub_classification2, assertion failed: [0] [Op:Assert] name: EagerVariableNameReuse time spend for datou_step_exec : 12.312360048294067 time spend to save output : 0.1247868537902832 total time spend for step 0 : 12.43714690208435 need to delete datou_research and reload, so keep current state 1 caffe_path_current : About to save ! 2 After save, about to update current ! datou_cur_ids : [] len(datou.list_steps) : 2 output : None probably due to empty image bug ERROR expected : {'1171252784': [(1171252784, 'jrm', 0.9677492, 4674, '3609'), 'temp/1687511175_1882837_1171252784_5a3c5d3bb155a7a116f67ded51bffb59.jpg'], '1171252764': [(1171252764, 'jrm', 0.9853587, 4674, '3609'), 'temp/1687511175_1882837_1171252764_29d5179a892cc50aadc9d67245534b59.jpg'], '1171252487': [(1171252487, 'jrm', 0.9262757, 4674, '3609'), 'temp/1687511175_1882837_1171252487_5ebdd6b0a6bb39942a3808ed114806de.jpg']} got : None ######################## test with use_multi_inputs=1 ######################## Inside batchDatouExec : verbose : False # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : step 12927 tfhub_classification2 is not linked in the step_by_step architecture ! WARNING : step 12928 argmax is not linked in the step_by_step architecture ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! DataTypes for each output/input checked ! List Step Type Loaded in datou : tfhub_classification2, argmax list_input_json : [] origin BBBFFFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 3 ; length of list_pids : 3 ; length of list_args : 3 time to download the photos : 0.4851677417755127 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : False number of steps : 2 step1:tfhub_classification2 Sun Mar 23 11:22:44 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou_step TFHub with tf2 ! we are using the classfication for only one thcl 3655 begin to check gpu status inside check gpu memory havn't enough memory gpu , need / 3096 l 3632 free memory gpu now : 7 wait 20 seconds inside check gpu memory l 3637 free memory gpu now : 3418 max_wait_temp : 2 max_wait : 5 1 Physical GPUs, 1 Logical GPUs tagging for thcl : 3655 To do loadFromThcl(), then load ParamDescType : thcl3655 thcls : [{'id': 3655, 'mtr_user_id': 31, 'name': 'tfhub_18_7_2023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'pcm,pcnc,jrm,pehd,tapis_vide', 'svm_portfolios_learning': '9336904,9336905,9336903,9336906,9336909', 'photo_hashtag_type': 4723, 'photo_desc_type': 5862, 'type_classification': 'tf_classification2', 'hashtag_id_list': '560181804,1284539308,495916461,628944319,2107748999'}] thcl {'id': 3655, 'mtr_user_id': 31, 'name': 'tfhub_18_7_2023', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'pcm,pcnc,jrm,pehd,tapis_vide', 'svm_portfolios_learning': '9336904,9336905,9336903,9336906,9336909', 'photo_hashtag_type': 4723, 'photo_desc_type': 5862, 'type_classification': 'tf_classification2', 'hashtag_id_list': '560181804,1284539308,495916461,628944319,2107748999'} Update svm_hashtag_type_desc : 5862 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5862, 'tfhub_18_7_2023', 1280, 1280, 'tfhub_18_7_2023', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2023, 7, 18, 22, 46, 29), datetime.datetime(2023, 7, 18, 22, 46, 29)) model_name : tfhub_18_7_2023 model_param file didn't exist model_name : tfhub_18_7_2023 model_type : tf_classification2 list file need : ['Confusion_Matrix.png', 'Precision_Recall_jrm.jpg', 'Precision_Recall_pcm.jpg', 'Precision_Recall_pcnc.jpg', 'Precision_Recall_pehd.jpg', 'Precision_Recall_tapis_vide.jpg', 'Result_Summary.txt', 'checkpoint', 'model_checkpoint.ckpt.data-00000-of-00002', 'model_checkpoint.ckpt.data-00001-of-00002', 'model_checkpoint.ckpt.index', 'model_weights.h5'] file exist in s3 : ['Confusion_Matrix.png', 'Precision_Recall_jrm.jpg', 'Precision_Recall_pcm.jpg', 'Precision_Recall_pcnc.jpg', 'Precision_Recall_pehd.jpg', 'Precision_Recall_tapis_vide.jpg', 'Result_Summary.txt', 'checkpoint', 'model_checkpoint.ckpt.data-00000-of-00002', 'model_checkpoint.ckpt.data-00001-of-00002', 'model_checkpoint.ckpt.index', 'model_weights.h5'] file manque in s3 : [] 2025-03-23 11:23:20.908583: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/tfhub_18_7_2023 /data/models_weight/tfhub_18_7_2023/Confusion_Matrix.png size_local : 54360 size in s3 : 54360 create time local : 2023-08-11 11:22:56 create time in s3 : 2023-07-18 20:46:28 Confusion_Matrix.png already exist and didn't need to update /data/models_weight/tfhub_18_7_2023/Precision_Recall_jrm.jpg size_local : 72583 size in s3 : 72583 create time local : 2023-08-11 11:22:56 create time in s3 : 2023-07-18 20:46:23 Precision_Recall_jrm.jpg already exist and didn't need to update /data/models_weight/tfhub_18_7_2023/Precision_Recall_pcm.jpg size_local : 81681 size in s3 : 81681 create time local : 2023-08-11 11:22:56 create time in s3 : 2023-07-18 20:46:17 Precision_Recall_pcm.jpg already exist and didn't need to update /data/models_weight/tfhub_18_7_2023/Precision_Recall_pcnc.jpg size_local : 79510 size in s3 : 79510 create time local : 2023-08-11 11:22:56 create time in s3 : 2023-07-18 20:46:23 Precision_Recall_pcnc.jpg already exist and didn't need to update /data/models_weight/tfhub_18_7_2023/Precision_Recall_pehd.jpg size_local : 59936 size in s3 : 59936 create time local : 2023-08-11 11:22:57 create time in s3 : 2023-07-18 20:46:23 Precision_Recall_pehd.jpg already exist and didn't need to update /data/models_weight/tfhub_18_7_2023/Precision_Recall_tapis_vide.jpg size_local : 78974 size in s3 : 78974 create time local : 2023-08-11 11:22:57 create time in s3 : 2023-07-18 20:46:17 Precision_Recall_tapis_vide.jpg already exist and didn't need to update /data/models_weight/tfhub_18_7_2023/Result_Summary.txt size_local : 642 size in s3 : 642 create time local : 2023-08-11 11:22:57 create time in s3 : 2023-07-18 20:46:23 Result_Summary.txt already exist and didn't need to update /data/models_weight/tfhub_18_7_2023/checkpoint size_local : 99 size in s3 : 99 create time local : 2023-08-11 11:22:57 create time in s3 : 2023-07-18 20:46:23 checkpoint already exist and didn't need to update /data/models_weight/tfhub_18_7_2023/model_checkpoint.ckpt.data-00000-of-00002 size_local : 216529 size in s3 : 216529 create time local : 2023-08-11 11:22:57 create time in s3 : 2023-07-18 20:46:17 model_checkpoint.ckpt.data-00000-of-00002 already exist and didn't need to update /data/models_weight/tfhub_18_7_2023/model_checkpoint.ckpt.data-00001-of-00002 size_local : 32279748 size in s3 : 32279748 create time local : 2023-08-11 11:22:58 create time in s3 : 2023-07-18 20:46:19 model_checkpoint.ckpt.data-00001-of-00002 already exist and didn't need to update /data/models_weight/tfhub_18_7_2023/model_checkpoint.ckpt.index size_local : 43546 size in s3 : 43546 create time local : 2023-08-11 11:22:58 create time in s3 : 2023-07-18 20:46:19 model_checkpoint.ckpt.index already exist and didn't need to update /data/models_weight/tfhub_18_7_2023/model_weights.h5 size_local : 16500868 size in s3 : 16500868 create time local : 2023-08-11 11:22:58 create time in s3 : 2023-07-18 20:46:18 model_weights.h5 already exist and didn't need to update desc size : 1280 Model: "model" __________________________________________________________________________________________________ Layer (type) Output Shape Param # Connected to ================================================================================================== input_2 (InputLayer) [(None, 224, 224, 3) 0 __________________________________________________________________________________________________ input_3 (InputLayer) [(None, 1)] 0 __________________________________________________________________________________________________ module (KerasLayer) (None, 1280) 4049564 input_2[0][0] __________________________________________________________________________________________________ concatenate (Concatenate) (None, 1281) 0 input_3[0][0] module[0][0] __________________________________________________________________________________________________ tfhub_18_7_2023dense (Dense) (None, 5) 6410 concatenate[0][0] ================================================================================================== Total params: 4,055,974 Trainable params: 0 Non-trainable params: 4,055,974 __________________________________________________________________________________________________ Loading Weights... time used to create the model : 11.364130735397339 time used to load_weights : 0.17367982864379883 found 3 data found 0 labels begin to do the prediction : time used to do the prediction : 2.6229560375213623 (3,) (3, 5) (3, 1280) shape of features : (3, 1280) shape of new features : (1, 3, 1280) save descriptor for thcl : 3655 time to traite the descriptors : 0.03927445411682129 storage_type for insertDescriptorsMulti : 3 To insert : 1171275372 To insert : 1171275314 To insert : 1171291875 time to insert the descriptors : 1.8335988521575928 Inside saveOutput : final : False verbose : False saveOutput not yet implemented for datou_step.type : tfhub_classification2 we use saveGeneral [1171275372, 1171275314, 1171291875] Looping around the photos to save general results len do output : 3 /1171275372Didn't retrieve data . /1171275314Didn't retrieve data . /1171291875Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4621', None, None, None, None, None, None, None, None) ('4621', None, '1171275372', None, None, None, None, None, None) ('4621', None, None, None, None, None, None, None, None) ('4621', None, '1171275314', None, None, None, None, None, None) ('4621', None, None, None, None, None, None, None, None) ('4621', None, '1171291875', None, None, None, None, None, None) begin to insert list_values into mtr_datou_result : length of list_values in save_final : 6 time used for this insertion : 0.01232767105102539 save_final save missing photos in datou_result : time spend for datou_step_exec : 41.343602418899536 time spend to save output : 0.012870073318481445 total time spend for step 1 : 41.35647249221802 step2:argmax Sun Mar 23 11:23:25 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou_step Argmax ! calculate argmax for thcl : 3655 Inside saveOutput : final : True verbose : False photo_id : 1171275372 output[photo_id] : [(1171275372, 'tapis_vide', 0.96738523, 4723, '3655'), 'temp/1742725364_43872_1171275372_76d81364ff7df843bff095f45c07ba35.jpg'] photo_id : 1171275314 output[photo_id] : [(1171275314, 'tapis_vide', 0.9652456, 4723, '3655'), 'temp/1742725364_43872_1171275314_6e0a72c8fa00d5e4b018bd689b547133.jpg'] photo_id : 1171291875 output[photo_id] : [(1171291875, 'tapis_vide', 0.9706839, 4723, '3655'), 'temp/1742725364_43872_1171291875_b62cd9e0d976b143f86fe82d072798c0.jpg'] begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 3 time used for this insertion : 0.8088347911834717 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 3 time used for this insertion : 0.03572583198547363 len list_finale : 3, len picture : 3 begin to insert list_values into mtr_datou_result : length of list_values in save_final : 3 time used for this insertion : 1.3903436660766602 saving photo_ids in datou_result photo id not in port photo id not in port photo id not in port begin to insert list_values into mtr_datou_result : length of list_values in save_final : 0 time used for this insertion : 5.4836273193359375e-06 save missing photos in datou_result : time spend for datou_step_exec : 0.00022220611572265625 time spend to save output : 2.2400689125061035 total time spend for step 2 : 2.240291118621826 caffe_path_current : About to save ! 2 After save, about to update current ! datou_cur_ids : [] len(datou.list_steps) : 2 output : {'1171275372': [(1171275372, 'tapis_vide', 0.96738523, 4723, '3655'), 'temp/1742725364_43872_1171275372_76d81364ff7df843bff095f45c07ba35.jpg'], '1171275314': [(1171275314, 'tapis_vide', 0.9652456, 4723, '3655'), 'temp/1742725364_43872_1171275314_6e0a72c8fa00d5e4b018bd689b547133.jpg'], '1171291875': [(1171291875, 'tapis_vide', 0.9706839, 4723, '3655'), 'temp/1742725364_43872_1171291875_b62cd9e0d976b143f86fe82d072798c0.jpg']} --------------------- test with use_multi_inputs=1 is succeded ------------------- ERROR tfhub2 FAILED ############################### TEST ordonner ################################ To do loadFromThcl(), then load ParamDescType : thcl358 thcls : [{'id': 358, 'mtr_user_id': 31, 'name': 'car_orientation_0111', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'FirstUploadExperveo_vignette__port_505674,CAR_EXTERIEUR_Roue__port_503398,FirstUploadExperveo_carrosseriegrosplan_VIndanslamoquette__port_506486,FirstUploadExperveo_carrosseriegrosplan_siegegrosplan__port_506485,CAR_EXTERIEUR_Cote_droit_axe_avant__port_504465,CAR_EXTERIEUR_Cote_gauche_axe_arriere__port_504198,CAR_EXTERIEUR_Face_avant_axe_droit__port_504451,CAR_EXTERIEUR_angle_avant_gauche_axe_avant__port_504235,FirstUploadExperveo_vin__port_505675,CAR_EXTERIEUR_cote_droite__port_504108,CAR_INTERIEUR_avant_volant_class_6_levierdevitesse__port_506565,FirstUploadExperveo_carrosseriegrosplan_carrosserie__port_506483,CAR_EXTERIEUR_Angle_arriere_gauche_axe_arriere__port_504201,cartegrise_orientation__port_505064,CAR_EXTERIEUR_Angle_arriere_droit_axe_arriere__port_504217,CAR_INTERIEUR_avant_vue-arriere_class_1__port_506531,CAR_EXTERIEUR_Face_arriere_axe_droit__port_504218,CAR_EXTERIEUR_Cote_droit_axe_arriere__port_504214,CAR_EXTERIEUR_Angle_avant_droit__port_504087,FirstUploadExperveo_carrosseriegrosplan_morceauderoue__port_506484,CAR_INTERIEUR_avant_volant_class_6_class_2__port_506563,CAR_EXTERIEUR_Angle_arriere_droit__port_504160,CAR_EXTERIEUR_arriere__port_504184,CAR_INTERIEUR_avant_volant_class_6_boutonrond__port_506562,INTERIEUR_Compteur_kilometrique__port_503644,CAR_INTERIEUR_avant_vue_gauche_habitacle_class_1__port_506494,CAR_EXTERIEUR_Angle_arriere_gauche__port_504170,CAR_EXTERIEUR_Angle_avant_droit_axe_arriere__port_504226,CAR_EXTERIEUR_Face_arriere_axe_gauche__port_504202,CAR_EXTERIEUR_moteur__port_503704,FirstUploadExperveo_carrosseriegrosplan_class_6__port_506487,CAR_INTERIEUR_siege_arriere_class_1__port_506551,CAR_EXTERIEUR_avant__port_504146,CAR_EXTERIEUR_Angle_arriere_droit_axe_droit__port_504215,CAR_EXTERIEUR_Angle_avant_droit_axe_droit__port_504225,CAR_INTERIEUR_avant_volant_class_6_ecrangrosplan__port_506564,FirstUploadExperveo_carrosseriegrosplan_moteurgrosplanetdegat__port_506482,CAR_INTERIEUR_coffre__port_503412,FirstUploadExperveo_rouetranche__port_505677,UploadPhotoImmatBest_class_1__port_505051,CAR_INTERIEUR_avant_vue-arriere_class_2__port_506532,CAR_EXTERIEUR_angle_avant_gauche__port_504098,CAR_EXTERIEUR_face_avant_axe_gauche__port_504236,CAR_INTERIEUR_avant_vue_droite_habitacle_class_1__port_506540,CAR_EXTERIEUR_cote_gauche_axe_avant__port_504233,CAR_EXTERIEUR_roue_de_secour__port_503763,CAR_EXTERIEUR_Angle_arriere_gauche_axe_gauche__port_504199,CAR_EXTERIEUR_cote_gauche__port_504017,CAR_INTERIEUR_avant_volant_class_1__port_506503,CAR_INTERIEUR_avant_volant_class_2__port_506504,CAR_EXTERIEUR_angle_avant_gauche_axe_gauche__port_504234', 'svm_portfolios_learning': '505674,503398,506486,506485,504465,504198,504451,504235,505675,504108,506565,506483,504201,505064,504217,506531,504218,504214,504087,506484,506563,504160,504184,506562,503644,506494,504170,504226,504202,503704,506487,506551,504146,504215,504225,506564,506482,503412,505677,505051,506532,504098,504236,506540,504233,503763,504199,504017,506503,506504,504234', 'photo_hashtag_type': 337, 'photo_desc_type': 3392, 'type_classification': 'caffe', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0'}] thcl {'id': 358, 'mtr_user_id': 31, 'name': 'car_orientation_0111', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'FirstUploadExperveo_vignette__port_505674,CAR_EXTERIEUR_Roue__port_503398,FirstUploadExperveo_carrosseriegrosplan_VIndanslamoquette__port_506486,FirstUploadExperveo_carrosseriegrosplan_siegegrosplan__port_506485,CAR_EXTERIEUR_Cote_droit_axe_avant__port_504465,CAR_EXTERIEUR_Cote_gauche_axe_arriere__port_504198,CAR_EXTERIEUR_Face_avant_axe_droit__port_504451,CAR_EXTERIEUR_angle_avant_gauche_axe_avant__port_504235,FirstUploadExperveo_vin__port_505675,CAR_EXTERIEUR_cote_droite__port_504108,CAR_INTERIEUR_avant_volant_class_6_levierdevitesse__port_506565,FirstUploadExperveo_carrosseriegrosplan_carrosserie__port_506483,CAR_EXTERIEUR_Angle_arriere_gauche_axe_arriere__port_504201,cartegrise_orientation__port_505064,CAR_EXTERIEUR_Angle_arriere_droit_axe_arriere__port_504217,CAR_INTERIEUR_avant_vue-arriere_class_1__port_506531,CAR_EXTERIEUR_Face_arriere_axe_droit__port_504218,CAR_EXTERIEUR_Cote_droit_axe_arriere__port_504214,CAR_EXTERIEUR_Angle_avant_droit__port_504087,FirstUploadExperveo_carrosseriegrosplan_morceauderoue__port_506484,CAR_INTERIEUR_avant_volant_class_6_class_2__port_506563,CAR_EXTERIEUR_Angle_arriere_droit__port_504160,CAR_EXTERIEUR_arriere__port_504184,CAR_INTERIEUR_avant_volant_class_6_boutonrond__port_506562,INTERIEUR_Compteur_kilometrique__port_503644,CAR_INTERIEUR_avant_vue_gauche_habitacle_class_1__port_506494,CAR_EXTERIEUR_Angle_arriere_gauche__port_504170,CAR_EXTERIEUR_Angle_avant_droit_axe_arriere__port_504226,CAR_EXTERIEUR_Face_arriere_axe_gauche__port_504202,CAR_EXTERIEUR_moteur__port_503704,FirstUploadExperveo_carrosseriegrosplan_class_6__port_506487,CAR_INTERIEUR_siege_arriere_class_1__port_506551,CAR_EXTERIEUR_avant__port_504146,CAR_EXTERIEUR_Angle_arriere_droit_axe_droit__port_504215,CAR_EXTERIEUR_Angle_avant_droit_axe_droit__port_504225,CAR_INTERIEUR_avant_volant_class_6_ecrangrosplan__port_506564,FirstUploadExperveo_carrosseriegrosplan_moteurgrosplanetdegat__port_506482,CAR_INTERIEUR_coffre__port_503412,FirstUploadExperveo_rouetranche__port_505677,UploadPhotoImmatBest_class_1__port_505051,CAR_INTERIEUR_avant_vue-arriere_class_2__port_506532,CAR_EXTERIEUR_angle_avant_gauche__port_504098,CAR_EXTERIEUR_face_avant_axe_gauche__port_504236,CAR_INTERIEUR_avant_vue_droite_habitacle_class_1__port_506540,CAR_EXTERIEUR_cote_gauche_axe_avant__port_504233,CAR_EXTERIEUR_roue_de_secour__port_503763,CAR_EXTERIEUR_Angle_arriere_gauche_axe_gauche__port_504199,CAR_EXTERIEUR_cote_gauche__port_504017,CAR_INTERIEUR_avant_volant_class_1__port_506503,CAR_INTERIEUR_avant_volant_class_2__port_506504,CAR_EXTERIEUR_angle_avant_gauche_axe_gauche__port_504234', 'svm_portfolios_learning': '505674,503398,506486,506485,504465,504198,504451,504235,505675,504108,506565,506483,504201,505064,504217,506531,504218,504214,504087,506484,506563,504160,504184,506562,503644,506494,504170,504226,504202,503704,506487,506551,504146,504215,504225,506564,506482,503412,505677,505051,506532,504098,504236,506540,504233,503763,504199,504017,506503,506504,504234', 'photo_hashtag_type': 337, 'photo_desc_type': 3392, 'type_classification': 'caffe', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 3392 ['FirstUploadExperveo_vignette__port_505674', 'CAR_EXTERIEUR_Roue__port_503398', 'FirstUploadExperveo_carrosseriegrosplan_VIndanslamoquette__port_506486', 'FirstUploadExperveo_carrosseriegrosplan_siegegrosplan__port_506485', 'CAR_EXTERIEUR_Cote_droit_axe_avant__port_504465', 'CAR_EXTERIEUR_Cote_gauche_axe_arriere__port_504198', 'CAR_EXTERIEUR_Face_avant_axe_droit__port_504451', 'CAR_EXTERIEUR_angle_avant_gauche_axe_avant__port_504235', 'FirstUploadExperveo_vin__port_505675', 'CAR_EXTERIEUR_cote_droite__port_504108', 'CAR_INTERIEUR_avant_volant_class_6_levierdevitesse__port_506565', 'FirstUploadExperveo_carrosseriegrosplan_carrosserie__port_506483', 'CAR_EXTERIEUR_Angle_arriere_gauche_axe_arriere__port_504201', 'cartegrise_orientation__port_505064', 'CAR_EXTERIEUR_Angle_arriere_droit_axe_arriere__port_504217', 'CAR_INTERIEUR_avant_vue-arriere_class_1__port_506531', 'CAR_EXTERIEUR_Face_arriere_axe_droit__port_504218', 'CAR_EXTERIEUR_Cote_droit_axe_arriere__port_504214', 'CAR_EXTERIEUR_Angle_avant_droit__port_504087', 'FirstUploadExperveo_carrosseriegrosplan_morceauderoue__port_506484', 'CAR_INTERIEUR_avant_volant_class_6_class_2__port_506563', 'CAR_EXTERIEUR_Angle_arriere_droit__port_504160', 'CAR_EXTERIEUR_arriere__port_504184', 'CAR_INTERIEUR_avant_volant_class_6_boutonrond__port_506562', 'INTERIEUR_Compteur_kilometrique__port_503644', 'CAR_INTERIEUR_avant_vue_gauche_habitacle_class_1__port_506494', 'CAR_EXTERIEUR_Angle_arriere_gauche__port_504170', 'CAR_EXTERIEUR_Angle_avant_droit_axe_arriere__port_504226', 'CAR_EXTERIEUR_Face_arriere_axe_gauche__port_504202', 'CAR_EXTERIEUR_moteur__port_503704', 'FirstUploadExperveo_carrosseriegrosplan_class_6__port_506487', 'CAR_INTERIEUR_siege_arriere_class_1__port_506551', 'CAR_EXTERIEUR_avant__port_504146', 'CAR_EXTERIEUR_Angle_arriere_droit_axe_droit__port_504215', 'CAR_EXTERIEUR_Angle_avant_droit_axe_droit__port_504225', 'CAR_INTERIEUR_avant_volant_class_6_ecrangrosplan__port_506564', 'FirstUploadExperveo_carrosseriegrosplan_moteurgrosplanetdegat__port_506482', 'CAR_INTERIEUR_coffre__port_503412', 'FirstUploadExperveo_rouetranche__port_505677', 'UploadPhotoImmatBest_class_1__port_505051', 'CAR_INTERIEUR_avant_vue-arriere_class_2__port_506532', 'CAR_EXTERIEUR_angle_avant_gauche__port_504098', 'CAR_EXTERIEUR_face_avant_axe_gauche__port_504236', 'CAR_INTERIEUR_avant_vue_droite_habitacle_class_1__port_506540', 'CAR_EXTERIEUR_cote_gauche_axe_avant__port_504233', 'CAR_EXTERIEUR_roue_de_secour__port_503763', 'CAR_EXTERIEUR_Angle_arriere_gauche_axe_gauche__port_504199', 'CAR_EXTERIEUR_cote_gauche__port_504017', 'CAR_INTERIEUR_avant_volant_class_1__port_506503', 'CAR_INTERIEUR_avant_volant_class_2__port_506504', 'CAR_EXTERIEUR_angle_avant_gauche_axe_gauche__port_504234'] 51 51 thcl : 358 photo_hashtag_type : 337 ############################### TEST rotate ################################ test rotate only Inside batchDatouExec : verbose : False # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : rotate list_input_json : [] origin BFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 1 ; length of list_pids : 1 ; length of list_args : 1 time to download the photos : 0.13741827011108398 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : False number of steps : 1 step1:rotate Sun Mar 23 11:23:43 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou_step_rotate ! We are in a linear step without datou_depend ! rotate photos of 90,180,270 degres batch 1 Loaded 0 chid ids of type : 0 map_chi of length : 0 Needs to change image size ! Needs to change image size ! Needs to change image size ! About to upload 3 photos upload in portfolio : 551782 init cache_photo without model_param we have 3 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1742725424_43872 we have uploaded 3 photos in the portfolio 551782 time of upload the photos Elapsed time : 1.1782479286193848 Len new_chis : 3 Len list_new_chi_with_photo_id : 0 of type : 0 time spend for datou_step_exec : 1.5509765148162842 time spend to save output : 3.2901763916015625e-05 total time spend for step 1 : 1.5510094165802002 caffe_path_current : About to save ! 1 Inside saveOutput : final : True verbose : False saveOutput not yet implemented for datou_step.type : rotate we use saveGeneral [917849322] Looping around the photos to save general results len do output : 3 /1346581184Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1346581185Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1346581186Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('230', None, None, None, None, None, None, None, None) ('230', None, '917849322', None, None, None, None, None, None) begin to insert list_values into mtr_datou_result : length of list_values in save_final : 10 time used for this insertion : 0.012433052062988281 save_final save missing photos in datou_result : After save, about to update current ! datou_cur_ids : [] len(datou.list_steps) : 1 output : {1346581184: ['917849322', 'temp/1742725423_43872_917849322_2bd260e91e91df8378dde8bb8b8c454890.jpg', []], 1346581185: ['917849322', 'temp/1742725423_43872_917849322_2bd260e91e91df8378dde8bb8b8c4548180.jpg', []], 1346581186: ['917849322', 'temp/1742725423_43872_917849322_2bd260e91e91df8378dde8bb8b8c4548270.jpg', []]} test rotate only is a success ! test rotate conditionnel Inside batchDatouExec : verbose : False # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! DataTypes for each output/input checked ! List Step Type Loaded in datou : thcl, argmax, rotate list_input_json : [] origin BFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 1 ; length of list_pids : 1 ; length of list_args : 1 time to download the photos : 0.1760573387145996 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : False number of steps : 3 step1:thcl Sun Mar 23 11:23:45 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step Thcl ! we are using the classfication for only one thcl 500 time to import caffe and check if the image exist : 0.00025725364685058594 time to convert the images to numpy array : 1.329908847808838 total time to convert the images to numpy array : 1.330596685409546 list photo_ids error: [] list photo_ids correct : [917849322] number of photos to traite : 1 try to delete the photos incorrect in DB tagging for thcl : 500 To do loadFromThcl(), then load ParamDescType : thcl500 thcls : [{'id': 500, 'mtr_user_id': 31, 'name': 'orientation_carte_grise_all_2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'carteGrisesVerticales__port_549774,cartegrise_90deg__port_550987,cartesGrisesEnvers__port_549765,portfolio_270deg__port_550988', 'svm_portfolios_learning': '549774,550987,549765,550988', 'photo_hashtag_type': 507, 'photo_desc_type': 3517, 'type_classification': 'caffe', 'hashtag_id_list': '0,0,0,0'}] thcl {'id': 500, 'mtr_user_id': 31, 'name': 'orientation_carte_grise_all_2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'carteGrisesVerticales__port_549774,cartegrise_90deg__port_550987,cartesGrisesEnvers__port_549765,portfolio_270deg__port_550988', 'svm_portfolios_learning': '549774,550987,549765,550988', 'photo_hashtag_type': 507, 'photo_desc_type': 3517, 'type_classification': 'caffe', 'hashtag_id_list': '0,0,0,0'} Update svm_hashtag_type_desc : 3517 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (3517, 'orientation_carte_grise_all_2', 16384, 25088, 'orientation_carte_grise_all_2', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2018, 4, 18, 20, 4, 34), datetime.datetime(2018, 4, 18, 20, 4, 34)) To loadFromThcl() : net_3517 begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 2964 max_wait_temp : 1 max_wait : 0 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (3517, 'orientation_carte_grise_all_2', 16384, 25088, 'orientation_carte_grise_all_2', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2018, 4, 18, 20, 4, 34), datetime.datetime(2018, 4, 18, 20, 4, 34)) None mean_file_type : mean_file_path : prototxt_file_path : model : orientation_carte_grise_all_2 Inside get_net Inside get_net before cache_data_model model_param file didn't exist Inside get_net before CDM.load_model_par_type model_name : orientation_carte_grise_all_2 model_type : caffe list file need : ['caffemodel', 'deploy_conv_normal.prototxt', 'deploy_fc.prototxt', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file exist in s3 : ['caffemodel', 'deploy_conv_normal.prototxt', 'deploy_fc.prototxt', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file manque in s3 : [] local folder : /data/models_weight/orientation_carte_grise_all_2 /data/models_weight/orientation_carte_grise_all_2/caffemodel size_local : 537110520 size in s3 : 537110520 create time local : 2021-08-09 05:29:00 create time in s3 : 2021-08-06 20:07:17 caffemodel already exist and didn't need to update /data/models_weight/orientation_carte_grise_all_2/deploy_conv_normal.prototxt size_local : 4626 size in s3 : 4626 create time local : 2021-08-09 05:29:00 create time in s3 : 2021-08-06 20:07:16 deploy_conv_normal.prototxt already exist and didn't need to update /data/models_weight/orientation_carte_grise_all_2/deploy_fc.prototxt size_local : 1130 size in s3 : 1130 create time local : 2021-08-09 05:29:00 create time in s3 : 2021-08-06 20:07:16 deploy_fc.prototxt already exist and didn't need to update /data/models_weight/orientation_carte_grise_all_2/deploy.prototxt size_local : 5653 size in s3 : 5653 create time local : 2021-08-09 05:29:00 create time in s3 : 2021-08-06 20:07:16 deploy.prototxt already exist and didn't need to update /data/models_weight/orientation_carte_grise_all_2/mean.npy size_local : 1572992 size in s3 : 1572992 create time local : 2021-08-09 05:29:00 create time in s3 : 2021-08-06 20:07:31 mean.npy already exist and didn't need to update /data/models_weight/orientation_carte_grise_all_2/synset_words.txt size_local : 159 size in s3 : 159 create time local : 2021-08-09 05:29:00 create time in s3 : 2021-08-06 20:07:16 synset_words.txt already exist and didn't need to update Inside get_net after CDM.load_model_par_type After if not only_with_local_cache: /home/admin/workarea/install/darknet/:/home/admin/workarea/git/Velours/python:/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python:/home/admin/mtr/.credentials:/home/admin/workarea/install/caffe/python:/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools/:/home/admin/workarea/git/fotonowerpip/:/home/admin/workarea/install/segment-anything:/home/admin//workarea/git/pyfvs/ Here before set mode gpu Doing nothing but we could set mode gpu after set mode gpu prototxt_filename : /data/models_weight/orientation_carte_grise_all_2/deploy.prototxt caffemodel_filename : /data/models_weight/orientation_carte_grise_all_2/caffemodel now we set caffe to gpu mode before predict begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 2964 max_wait_temp : 1 max_wait : 0 dict_keys(['pool5', 'prob']) time used to do the prepocess of the images : 2.3262619972229004 time used to do the prediction : 0.20450782775878906 save descriptor for thcl : 500 time to traite the descriptors : 0.061743974685668945 storage_type for insertDescriptorsMulti : 1 To insert : 917849322 time to insert the descriptors : 0.5083811283111572 time spend for datou_step_exec : 9.203087568283081 time spend to save output : 7.128715515136719e-05 total time spend for step 1 : 9.203158855438232 step2:argmax Sun Mar 23 11:23:54 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou_step Argmax ! calculate argmax for thcl : 500 time spend for datou_step_exec : 0.00024318695068359375 time spend to save output : 5.888938903808594e-05 total time spend for step 2 : 0.0003020763397216797 step3:rotate Sun Mar 23 11:23:54 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou_step_rotate ! We are in a datou with depends ! angle_condi : {'carteGrisesVerticales__port_549774': 0, 'cartegrise_90deg__port_550987': 270, 'portfolio_270deg__port_550988': 90, 'cartesGrisesEnvers__port_549765': 180} rotate photos for hashtag carteGrisesVerticales__port_549774 of 0 degres 1 photos founded : [917849322] batch 1 Loaded 0 chid ids of type : 0 map_chi of length : 0 Needs to change image size ! About to upload 1 photos upload in portfolio : 551782 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1742725435_43872 we have uploaded 1 photos in the portfolio 551782 time of upload the photos Elapsed time : 0.5999250411987305 Len new_chis : 1 Len list_new_chi_with_photo_id : 0 of type : 0 rotate photos for hashtag cartegrise_90deg__port_550987 of 270 degres 0 photos founded : [] rotate photos for hashtag portfolio_270deg__port_550988 of 90 degres 0 photos founded : [] rotate photos for hashtag cartesGrisesEnvers__port_549765 of 180 degres 0 photos founded : [] time spend for datou_step_exec : 0.7030375003814697 time spend to save output : 3.075599670410156e-05 total time spend for step 3 : 0.7030682563781738 caffe_path_current : About to save ! 1 Inside saveOutput : final : True verbose : False saveOutput not yet implemented for datou_step.type : rotate we use saveGeneral [917849322] Looping around the photos to save general results len do output : 1 /1346581191Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('233', None, None, None, None, None, None, None, None) ('233', None, '917849322', None, None, None, None, None, None) begin to insert list_values into mtr_datou_result : length of list_values in save_final : 4 time used for this insertion : 0.013092517852783203 save_final save missing photos in datou_result : After save, about to update current ! datou_cur_ids : [] len(datou.list_steps) : 3 output : {1346581191: ['917849322', 'temp/1742725425_43872_917849322_2bd260e91e91df8378dde8bb8b8c45480.jpg', []]} ############################### TEST data_augmentation_ellipse_varroa_tile_rotate ################################ # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : step 316 crop is not linked in the step_by_step architecture ! Step 318 rotate have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 318 rotate have less outputs used (0) than in the step definition (3) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! DataTypes for each output/input checked ! Unexpected type seems boolean for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : DATA AUGMENTATION ELLIPSE VARROA TILE ROTATE Inside batchDatouExec : verbose : False # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : step 316 crop is not linked in the step_by_step architecture ! Step 318 rotate have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 318 rotate have less outputs used (0) than in the step definition (3) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! DataTypes for each output/input checked ! List Step Type Loaded in datou : crop, tile, rotate list_input_json : [] origin BFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 1 ; length of list_pids : 1 ; length of list_args : 1 time to download the photos : 0.13027095794677734 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : False number of steps : 3 step1:crop Sun Mar 23 11:23:55 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou_step Crop ! param_json : {'hashtag_id_ellipse': 2087736828, 'photo_hashtag_type_from_ellipse': 520, 'token': '78d09a0790ec6ecbf119343125a81fdc', 'portfolio_name': 'crop_detect_varroa', 'photo_hashtag_type': 407, 'feed_id_new_photos_not_used': 549103, 'host': 'www.fotonower.com', 'margin': 8, 'upload_type': 'python'} margin_type : margin margin_value : [8, 8, 8, 8] Loading chi in step crop with photo_hashtag_type : 407 Loading chi in step crop for list_pids : 1 ! batch 1 Loaded 4 chid ids of type : 407 +WARNING : Unexpected points, we should remove this data for chi_id : 8165075, for now we just ignore these empty polygon points +WARNING : Unexpected points, we should remove this data for chi_id : 8165076, for now we just ignore these empty polygon points +WARNING : Unexpected points, we should remove this data for chi_id : 8165077, for now we just ignore these empty polygon points +WARNING : Unexpected points, we should remove this data for chi_id : 8165078, for now we just ignore these empty polygon points WARNING : margin is only used for type bib ! map_result returned by crop_photo_return_map_crop : length : 4 Here we crop with rles About to insert : list_path_to_insert length 4 new photo from crops ! About to upload 4 photos https://marlene.fotonower.com/api/v1/secured/portfolio/new?name=crop_detect_varroa&access_token=78d09a0790ec6ecbf119343125a81fdc upload in portfolio : 21619195 init cache_photo without model_param we have 4 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1742725438_43872 we have uploaded 4 photos in the portfolio 21619195 time of upload the photos Elapsed time : 4.036333322525024 Now we prepare data that will be used for ellipse search ! About to compute ellipse and record with type : 520 score : 5120 strategy_opt : 5| | arg_min : 1.9500000000000002 min_score : 2311 | arg_min : -30.0 min_score : 1968 | arg_min : 17.8125 min_score : 1614 | arg_min : 31.875 min_score : 1105 | arg_min : 28.5 min_score : 1105 arg_min : 1.9500000000000002 min_score : 1105 arg_min : 25.0 min_score : 1088 arg_min : 24.9375 min_score : 979 arg_min : 31.875 min_score : 979 arg_min : 28.5 min_score : 979 yc : 31.875 xc : 24.9375 angle : 25.0 radius : 28.5 excentricity : 1.9500000000000002 yc : 31.875 xc : 24.9375 angle : 25.0 radius : 28.5 excentricity : 1.9500000000000002 Now saving polygons points : 1| batch 1 Loaded 1 chid ids of type : 520 CHI and polygons saved ! score : 5362 strategy_opt : 5| | arg_min : 1.9500000000000002 min_score : 2281 | arg_min : -10.0 min_score : 2127 | arg_min : 25.0 min_score : 2127 | arg_min : 30.9375 min_score : 714 | arg_min : 25.0 min_score : 714 arg_min : 1.9500000000000002 min_score : 714 arg_min : -5.0 min_score : 668 arg_min : 23.4375 min_score : 655 arg_min : 29.53125 min_score : 631 arg_min : 25.0 min_score : 631 yc : 29.53125 xc : 23.4375 angle : -5.0 radius : 25.0 excentricity : 1.9500000000000002 yc : 29.53125 xc : 23.4375 angle : -5.0 radius : 25.0 excentricity : 1.9500000000000002 Now saving polygons points : 1| batch 1 Loaded 2 chid ids of type : 520 + CHI and polygons saved ! score : 4603 strategy_opt : 5| | arg_min : 1.85 min_score : 2981 | arg_min : -50.0 min_score : 1356 | arg_min : 30.28125 min_score : 1079 | arg_min : 23.625 min_score : 995 | arg_min : 27.0 min_score : 995 arg_min : 1.6500000000000001 min_score : 961 arg_min : -70.0 min_score : 852 arg_min : 28.6875 min_score : 847 arg_min : 23.625 min_score : 847 arg_min : 27.0 min_score : 847 yc : 23.625 xc : 28.6875 angle : -70.0 radius : 27.0 excentricity : 1.6500000000000001 yc : 23.625 xc : 28.6875 angle : -70.0 radius : 27.0 excentricity : 1.6500000000000001 Now saving polygons points : 1| batch 1 Loaded 3 chid ids of type : 520 ++ CHI and polygons saved ! score : 7970 strategy_opt : 5| | arg_min : 1.9500000000000002 min_score : 1576 | arg_min : 40.0 min_score : 632 | arg_min : 20.15625 min_score : 561 | arg_min : 26.0 min_score : 561 | arg_min : 26.0 min_score : 561 arg_min : 1.8 min_score : 520 arg_min : 40.0 min_score : 520 arg_min : 18.8125 min_score : 494 arg_min : 26.0 min_score : 494 arg_min : 26.0 min_score : 494 yc : 26.0 xc : 18.8125 angle : 40.0 radius : 26.0 excentricity : 1.8 yc : 26.0 xc : 18.8125 angle : 40.0 radius : 26.0 excentricity : 1.8 Now saving polygons points : 1| batch 1 Loaded 4 chid ids of type : 520 +++ CHI and polygons saved ! ['temp/1742725435_43872_937852786_7d9a231a08a1c63d0868e56a5361bf67_bib_crop_8165075_0_ellipsebest.jpg', 'temp/1742725435_43872_937852786_7d9a231a08a1c63d0868e56a5361bf67_bib_crop_8165075_0_varroa_with_ellipsebest.jpg', 'temp/1742725435_43872_937852786_7d9a231a08a1c63d0868e56a5361bf67_bib_crop_8165076_0_ellipsebest.jpg', 'temp/1742725435_43872_937852786_7d9a231a08a1c63d0868e56a5361bf67_bib_crop_8165076_0_varroa_with_ellipsebest.jpg', 'temp/1742725435_43872_937852786_7d9a231a08a1c63d0868e56a5361bf67_bib_crop_8165077_0_ellipsebest.jpg', 'temp/1742725435_43872_937852786_7d9a231a08a1c63d0868e56a5361bf67_bib_crop_8165077_0_varroa_with_ellipsebest.jpg', 'temp/1742725435_43872_937852786_7d9a231a08a1c63d0868e56a5361bf67_bib_crop_8165078_0_ellipsebest.jpg', 'temp/1742725435_43872_937852786_7d9a231a08a1c63d0868e56a5361bf67_bib_crop_8165078_0_varroa_with_ellipsebest.jpg'] About to upload 8 photos https://marlene.fotonower.com/api/v1/secured/portfolio/new?access_token=78d09a0790ec6ecbf119343125a81fdc upload in portfolio : 21619196 Result OK ! uploaded one batch 0 Elapsed time : 19.19441556930542 time spend for datou_step_exec : 27.910010814666748 time spend to save output : 1.8358230590820312e-05 total time spend for step 1 : 27.91002917289734 step2:tile Sun Mar 23 11:24:23 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure verbose : False param_json : {'photo_tile_type': 17, 'whiten': True, 'remove_crop_border': True, 'minimal_size_crop_border': 900, 'stride': 240, 'crop_hashtag_type_tiled': 521, 'ETA': 86400, 'new_width': 480, 'new_height': 480, 'token': '78d09a0790ec6ecbf119343125a81fdc', 'portfolio_name': 'tile_taggage_varroa', 'crop_hashtag_type': 520, 'host': 'www.fotonower.com', 'arg_aux_upload': {'type_upload': 'python'}} type(crop_hashtag_type) : type(crop_hashtag_type_tiled) : We consider crop_hashtag_type is an integer ! map_chi_type_to_chi_type_cropped : {520: 521} TO DEPRECATE VR 14-6-18 map_filenames : {937852786: 'temp/1742725435_43872_937852786_7d9a231a08a1c63d0868e56a5361bf67.jpg'} list_pids : 1 list_pids : 2 list_subpids to replace list_pids : 0 batch 1 Loaded 4 chid ids of type : 520 ++++https://marlene.fotonower.com/api/v1/secured/portfolio/new?name=tile_taggage_varroa&access_token=78d09a0790ec6ecbf119343125a81fdc created feed_id_new_photos : 21619197 with name tile_taggage_varroa feed_id_new_photos : 21619197 filename : temp/1742725435_43872_937852786_7d9a231a08a1c63d0868e56a5361bf67.jpg photo_id : 937852786 height_image_input : 480 width_image_input : 480 new_width : 480 new_height : 480 stride : 240 stride_relative : 0.1 chi to copy from the main photo to the tiled photo input_chi_for_this_image_as_chi : 4 list_bib_to_crops : 1 [(0, 480, 0, 480, 0)] new_crops_tiles : 1 crop_transformed : 4 batch 1 Loaded 1 chid ids of type : 17 treat the image : temp/1742725435_43872_937852786_7d9a231a08a1c63d0868e56a5361bf67.jpg , 0 before upload mediasElapsed time : 0.009816646575927734 on upload les photos avec python init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1742725470_43872 we have uploaded 1 photos in the portfolio 21619197 Importing ! upload mediasElapsed time : 0.6285607814788818 , 0Saving 4 CHIs. batch 1 Loaded 4 chid ids of type : 521 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! end of tileElapsed time : 0.8145782947540283 time spend for datou_step_exec : 7.420750856399536 time spend to save output : 3.123283386230469e-05 total time spend for step 2 : 7.420782089233398 step3:rotate Sun Mar 23 11:24:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou_step_rotate ! Warning, new_feed_id is empty ! We are in a datou with depends ! rotate photos of 0,15,30,45,60,75,90,105,120,135,150,165,180,195,210,225,240,255,270,285,300,315,330,345 degres batch 1 Loaded 4 chid ids of type : 521 ++++++++ map_chi of length : 1 https://marlene.fotonower.com/api/v1/secured/portfolio/new?name=rotate_data_augmentation_varroa_480_ellipse_320&access_token=78d09a0790ec6ecbf119343125a81fdc feed_id_new_photos : 21619198 Needs to change image size ! time for calcul the mask position with numpy : 0.0005373954772949219 nb_pixel_total : 1389 time to create 1 rle with old method : 0.003099679946899414 .time for calcul the mask position with numpy : 0.00037479400634765625 nb_pixel_total : 1157 time to create 1 rle with old method : 0.002649545669555664 . crop are not in the shrunk photo ! crop are not in the shrunk photo ! Needs to change image size ! time for calcul the mask position with numpy : 0.0004887580871582031 nb_pixel_total : 694 time to create 1 rle with old method : 0.0027179718017578125 On the border Smaller than minimal size ! time for calcul the mask position with numpy : 0.0004124641418457031 nb_pixel_total : 1162 time to create 1 rle with old method : 0.003316640853881836 . crop are not in the shrunk photo ! crop are not in the shrunk photo ! Needs to change image size ! time for calcul the mask position with numpy : 0.0004074573516845703 nb_pixel_total : 221 time to create 1 rle with old method : 0.0007190704345703125 On the border Smaller than minimal size ! time for calcul the mask position with numpy : 0.0003714561462402344 nb_pixel_total : 1155 time to create 1 rle with old method : 0.003479480743408203 . crop are not in the shrunk photo ! crop are not in the shrunk photo ! Needs to change image size ! time for calcul the mask position with numpy : 0.0003895759582519531 nb_pixel_total : 143 time to create 1 rle with old method : 0.0004494190216064453 On the border Smaller than minimal size ! time for calcul the mask position with numpy : 0.0003674030303955078 nb_pixel_total : 1161 time to create 1 rle with old method : 0.002643108367919922 . crop are not in the shrunk photo ! crop are not in the shrunk photo ! Needs to change image size ! time for calcul the mask position with numpy : 0.0004398822784423828 nb_pixel_total : 414 time to create 1 rle with old method : 0.0010597705841064453 On the border Smaller than minimal size ! time for calcul the mask position with numpy : 0.0003829002380371094 nb_pixel_total : 1159 time to create 1 rle with old method : 0.002790689468383789 . crop are not in the shrunk photo ! On the border Smaller than minimal size ! Needs to change image size ! time for calcul the mask position with numpy : 0.00043654441833496094 nb_pixel_total : 1204 time to create 1 rle with old method : 0.002791881561279297 On the border Smaller than minimal size ! time for calcul the mask position with numpy : 0.0003750324249267578 nb_pixel_total : 1157 time to create 1 rle with old method : 0.0026569366455078125 . crop are not in the shrunk photo ! time for calcul the mask position with numpy : 0.0004119873046875 nb_pixel_total : 264 time to create 1 rle with old method : 0.0007441043853759766 On the border Smaller than minimal size ! Needs to change image size ! time for calcul the mask position with numpy : 0.00045037269592285156 nb_pixel_total : 1389 time to create 1 rle with old method : 0.003276348114013672 .time for calcul the mask position with numpy : 0.000362396240234375 nb_pixel_total : 1157 time to create 1 rle with old method : 0.0028488636016845703 . crop are not in the shrunk photo ! crop are not in the shrunk photo ! Needs to change image size ! time for calcul the mask position with numpy : 0.00040221214294433594 nb_pixel_total : 694 time to create 1 rle with old method : 0.002249002456665039 On the border Smaller than minimal size ! time for calcul the mask position with numpy : 0.0003650188446044922 nb_pixel_total : 1162 time to create 1 rle with old method : 0.003458261489868164 . crop are not in the shrunk photo ! crop are not in the shrunk photo ! Needs to change image size ! time for calcul the mask position with numpy : 0.0003998279571533203 nb_pixel_total : 221 time to create 1 rle with old method : 0.0007481575012207031 On the border Smaller than minimal size ! time for calcul the mask position with numpy : 0.0003604888916015625 nb_pixel_total : 1155 time to create 1 rle with old method : 0.00339508056640625 . crop are not in the shrunk photo ! crop are not in the shrunk photo ! Needs to change image size ! time for calcul the mask position with numpy : 0.0004699230194091797 nb_pixel_total : 143 time to create 1 rle with old method : 0.0004885196685791016 On the border Smaller than minimal size ! time for calcul the mask position with numpy : 0.0003788471221923828 nb_pixel_total : 1160 time to create 1 rle with old method : 0.0034933090209960938 . crop are not in the shrunk photo ! crop are not in the shrunk photo ! Needs to change image size ! time for calcul the mask position with numpy : 0.0004019737243652344 nb_pixel_total : 414 time to create 1 rle with old method : 0.0012307167053222656 On the border Smaller than minimal size ! time for calcul the mask position with numpy : 0.0003561973571777344 nb_pixel_total : 1159 time to create 1 rle with old method : 0.002663850784301758 . crop are not in the shrunk photo ! crop are not in the shrunk photo ! time for calcul the mask position with numpy : 0.0003371238708496094 nb_pixel_total : 1 time to create 1 rle with old method : 2.4080276489257812e-05 Needs to change image size ! time for calcul the mask position with numpy : 0.00042819976806640625 nb_pixel_total : 1204 time to create 1 rle with old method : 0.0028934478759765625 On the border Smaller than minimal size ! time for calcul the mask position with numpy : 0.0003619194030761719 nb_pixel_total : 1158 time to create 1 rle with old method : 0.002743244171142578 . crop are not in the shrunk photo ! time for calcul the mask position with numpy : 0.0003445148468017578 nb_pixel_total : 264 time to create 1 rle with old method : 0.0007336139678955078 On the border Smaller than minimal size ! Needs to change image size ! time for calcul the mask position with numpy : 0.00041222572326660156 nb_pixel_total : 1389 time to create 1 rle with old method : 0.0033702850341796875 .time for calcul the mask position with numpy : 0.00035762786865234375 nb_pixel_total : 1157 time to create 1 rle with old method : 0.0026886463165283203 . crop are not in the shrunk photo ! crop are not in the shrunk photo ! Needs to change image size ! time for calcul the mask position with numpy : 0.0004341602325439453 nb_pixel_total : 727 time to create 1 rle with old method : 0.0018455982208251953 On the border Smaller than minimal size ! time for calcul the mask position with numpy : 0.000362396240234375 nb_pixel_total : 1162 time to create 1 rle with old method : 0.002739429473876953 . crop are not in the shrunk photo ! crop are not in the shrunk photo ! Needs to change image size ! time for calcul the mask position with numpy : 0.0003600120544433594 nb_pixel_total : 250 time to create 1 rle with old method : 0.0006923675537109375 On the border Smaller than minimal size ! time for calcul the mask position with numpy : 0.00036072731018066406 nb_pixel_total : 1155 time to create 1 rle with old method : 0.0027637481689453125 . crop are not in the shrunk photo ! crop are not in the shrunk photo ! Needs to change image size ! time for calcul the mask position with numpy : 0.0004355907440185547 nb_pixel_total : 169 time to create 1 rle with old method : 0.0006146430969238281 On the border Smaller than minimal size ! time for calcul the mask position with numpy : 0.0003643035888671875 nb_pixel_total : 1161 time to create 1 rle with old method : 0.0035262107849121094 . crop are not in the shrunk photo ! crop are not in the shrunk photo ! Needs to change image size ! time for calcul the mask position with numpy : 0.0004000663757324219 nb_pixel_total : 450 time to create 1 rle with old method : 0.0011806488037109375 On the border Smaller than minimal size ! time for calcul the mask position with numpy : 0.0003592967987060547 nb_pixel_total : 1159 time to create 1 rle with old method : 0.0027518272399902344 . crop are not in the shrunk photo ! crop are not in the shrunk photo ! time for calcul the mask position with numpy : 0.00033974647521972656 nb_pixel_total : 1 time to create 1 rle with old method : 2.47955322265625e-05 Needs to change image size ! time for calcul the mask position with numpy : 0.00044989585876464844 nb_pixel_total : 1237 time to create 1 rle with old method : 0.0035581588745117188 On the border Smaller than minimal size ! time for calcul the mask position with numpy : 0.0003647804260253906 nb_pixel_total : 1158 time to create 1 rle with old method : 0.003342151641845703 . crop are not in the shrunk photo ! time for calcul the mask position with numpy : 0.00033664703369140625 nb_pixel_total : 234 time to create 1 rle with old method : 0.0006852149963378906 On the border Smaller than minimal size ! Needs to change image size ! time for calcul the mask position with numpy : 0.0004165172576904297 nb_pixel_total : 1389 time to create 1 rle with old method : 0.0038890838623046875 .time for calcul the mask position with numpy : 0.0003681182861328125 nb_pixel_total : 1157 time to create 1 rle with old method : 0.003347158432006836 . crop are not in the shrunk photo ! crop are not in the shrunk photo ! Needs to change image size ! time for calcul the mask position with numpy : 0.00040602684020996094 nb_pixel_total : 727 time to create 1 rle with old method : 0.0017991065979003906 On the border Smaller than minimal size ! time for calcul the mask position with numpy : 0.0003788471221923828 nb_pixel_total : 1162 time to create 1 rle with old method : 0.0027306079864501953 . crop are not in the shrunk photo ! crop are not in the shrunk photo ! Needs to change image size ! time for calcul the mask position with numpy : 0.00039505958557128906 nb_pixel_total : 250 time to create 1 rle with old method : 0.00083160400390625 On the border Smaller than minimal size ! time for calcul the mask position with numpy : 0.0003631114959716797 nb_pixel_total : 1155 time to create 1 rle with old method : 0.0033278465270996094 . crop are not in the shrunk photo ! crop are not in the shrunk photo ! Needs to change image size ! time for calcul the mask position with numpy : 0.0004086494445800781 nb_pixel_total : 169 time to create 1 rle with old method : 0.0005655288696289062 On the border Smaller than minimal size ! time for calcul the mask position with numpy : 0.0003662109375 nb_pixel_total : 1161 time to create 1 rle with old method : 0.0033838748931884766 . crop are not in the shrunk photo ! crop are not in the shrunk photo ! Needs to change image size ! time for calcul the mask position with numpy : 0.000392913818359375 nb_pixel_total : 450 time to create 1 rle with old method : 0.0011775493621826172 On the border Smaller than minimal size ! time for calcul the mask position with numpy : 0.0003669261932373047 nb_pixel_total : 1159 time to create 1 rle with old method : 0.002752542495727539 . crop are not in the shrunk photo ! On the border Smaller than minimal size ! Needs to change image size ! time for calcul the mask position with numpy : 0.0004303455352783203 nb_pixel_total : 1237 time to create 1 rle with old method : 0.0029494762420654297 On the border Smaller than minimal size ! time for calcul the mask position with numpy : 0.0003707408905029297 nb_pixel_total : 1157 time to create 1 rle with old method : 0.027919292449951172 . crop are not in the shrunk photo ! time for calcul the mask position with numpy : 0.0003402233123779297 nb_pixel_total : 234 time to create 1 rle with old method : 0.0006661415100097656 On the border Smaller than minimal size ! About to upload 24 photos upload in portfolio : 21619198 init cache_photo without model_param we have 24 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1742725473_43872 we have uploaded 24 photos in the portfolio 21619198 time of upload the photos Elapsed time : 9.560282707214355 Len new_chis : 24 Len list_new_chi_with_photo_id : 28 of type : 529 batch 1 Loaded 28 chid ids of type : 529 Number RLEs to save : 1197 TO DO : save crop sub photo not yet done ! batch 1 Loaded 28 chid ids of type : 529 ++++++++++++++++++++++++++++Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! batch 1 Loaded 28 chid ids of type : 529 ++++++++++++++++++++++++++++Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! batch 1 Loaded 28 chid ids of type : 529 ++++++++++++++++++++++++++++Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! batch 1 Loaded 28 chid ids of type : 529 ++++++++++++++++++++++++++++Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! batch 1 Loaded 28 chid ids of type : 529 ++++++++++++++++++++++++++++Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! batch 1 Loaded 28 chid ids of type : 529 ++++++++++++++++++++++++++++Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! batch 1 Loaded 28 chid ids of type : 529 ++++++++++++++++++++++++++++Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! batch 1 Loaded 28 chid ids of type : 529 ++++++++++++++++++++++++++++Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! batch 1 Loaded 28 chid ids of type : 529 ++++++++++++++++++++++++++++Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! batch 1 Loaded 28 chid ids of type : 529 ++++++++++++++++++++++++++++Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! batch 1 Loaded 28 chid ids of type : 529 ++++++++++++++++++++++++++++Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! batch 1 Loaded 28 chid ids of type : 529 ++++++++++++++++++++++++++++Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! batch 1 Loaded 28 chid ids of type : 529 ++++++++++++++++++++++++++++Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! batch 1 Loaded 28 chid ids of type : 529 ++++++++++++++++++++++++++++Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! batch 1 Loaded 28 chid ids of type : 529 ++++++++++++++++++++++++++++Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! batch 1 Loaded 28 chid ids of type : 529 ++++++++++++++++++++++++++++Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! batch 1 Loaded 28 chid ids of type : 529 ++++++++++++++++++++++++++++Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! batch 1 Loaded 28 chid ids of type : 529 ++++++++++++++++++++++++++++Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! batch 1 Loaded 28 chid ids of type : 529 ++++++++++++++++++++++++++++Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! batch 1 Loaded 28 chid ids of type : 529 ++++++++++++++++++++++++++++Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! batch 1 Loaded 28 chid ids of type : 529 ++++++++++++++++++++++++++++Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! batch 1 Loaded 28 chid ids of type : 529 ++++++++++++++++++++++++++++Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! batch 1 Loaded 28 chid ids of type : 529 ++++++++++++++++++++++++++++Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! time spend for datou_step_exec : 13.437661170959473 time spend to save output : 9.584426879882812e-05 total time spend for step 3 : 13.437757015228271 caffe_path_current : About to save ! 1 Inside saveOutput : final : True verbose : False saveOutput not yet implemented for datou_step.type : rotate we use saveGeneral [937852786, 937852786, '1346581218'] Looping around the photos to save general results len do output : 24 /1346581220Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1346581221Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1346581222Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1346581223Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1346581224Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1346581225Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1346581226Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1346581229Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1346581230Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1346581231Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1346581232Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1346581233Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1346581234Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1346581235Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1346581236Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1346581237Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1346581238Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1346581239Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1346581240Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1346581241Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1346581242Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1346581243Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1346581244Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1346581245Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('243', None, None, None, None, None, None, None, None) ('243', None, '937852786', None, None, None, None, None, None) ('243', None, None, None, None, None, None, None, None) ('243', None, '937852786', None, None, None, None, None, None) ('243', None, None, None, None, None, None, None, None) ('243', None, '1346581218', None, None, None, None, None, None) begin to insert list_values into mtr_datou_result : length of list_values in save_final : 75 time used for this insertion : 1.0602855682373047 save_final save missing photos in datou_result : After save, about to update current ! datou_cur_ids : [] len(datou.list_steps) : 3 output : {1346581220: ['937852786', 'temp/1742725435_43872_937852786_7d9a231a08a1c63d0868e56a5361bf67_00.jpg', [, ]], 1346581221: ['937852786', 'temp/1742725435_43872_937852786_7d9a231a08a1c63d0868e56a5361bf67_015.jpg', []], 1346581222: ['937852786', 'temp/1742725435_43872_937852786_7d9a231a08a1c63d0868e56a5361bf67_030.jpg', []], 1346581223: ['937852786', 'temp/1742725435_43872_937852786_7d9a231a08a1c63d0868e56a5361bf67_045.jpg', []], 1346581224: ['937852786', 'temp/1742725435_43872_937852786_7d9a231a08a1c63d0868e56a5361bf67_060.jpg', []], 1346581225: ['937852786', 'temp/1742725435_43872_937852786_7d9a231a08a1c63d0868e56a5361bf67_075.jpg', []], 1346581226: ['937852786', 'temp/1742725435_43872_937852786_7d9a231a08a1c63d0868e56a5361bf67_090.jpg', [, ]], 1346581229: ['937852786', 'temp/1742725435_43872_937852786_7d9a231a08a1c63d0868e56a5361bf67_0105.jpg', []], 1346581230: ['937852786', 'temp/1742725435_43872_937852786_7d9a231a08a1c63d0868e56a5361bf67_0120.jpg', []], 1346581231: ['937852786', 'temp/1742725435_43872_937852786_7d9a231a08a1c63d0868e56a5361bf67_0135.jpg', []], 1346581232: ['937852786', 'temp/1742725435_43872_937852786_7d9a231a08a1c63d0868e56a5361bf67_0150.jpg', []], 1346581233: ['937852786', 'temp/1742725435_43872_937852786_7d9a231a08a1c63d0868e56a5361bf67_0165.jpg', []], 1346581234: ['937852786', 'temp/1742725435_43872_937852786_7d9a231a08a1c63d0868e56a5361bf67_0180.jpg', [, ]], 1346581235: ['937852786', 'temp/1742725435_43872_937852786_7d9a231a08a1c63d0868e56a5361bf67_0195.jpg', []], 1346581236: ['937852786', 'temp/1742725435_43872_937852786_7d9a231a08a1c63d0868e56a5361bf67_0210.jpg', []], 1346581237: ['937852786', 'temp/1742725435_43872_937852786_7d9a231a08a1c63d0868e56a5361bf67_0225.jpg', []], 1346581238: ['937852786', 'temp/1742725435_43872_937852786_7d9a231a08a1c63d0868e56a5361bf67_0240.jpg', []], 1346581239: ['937852786', 'temp/1742725435_43872_937852786_7d9a231a08a1c63d0868e56a5361bf67_0255.jpg', []], 1346581240: ['937852786', 'temp/1742725435_43872_937852786_7d9a231a08a1c63d0868e56a5361bf67_0270.jpg', [, ]], 1346581241: ['937852786', 'temp/1742725435_43872_937852786_7d9a231a08a1c63d0868e56a5361bf67_0285.jpg', []], 1346581242: ['937852786', 'temp/1742725435_43872_937852786_7d9a231a08a1c63d0868e56a5361bf67_0300.jpg', []], 1346581243: ['937852786', 'temp/1742725435_43872_937852786_7d9a231a08a1c63d0868e56a5361bf67_0315.jpg', []], 1346581244: ['937852786', 'temp/1742725435_43872_937852786_7d9a231a08a1c63d0868e56a5361bf67_0330.jpg', []], 1346581245: ['937852786', 'temp/1742725435_43872_937852786_7d9a231a08a1c63d0868e56a5361bf67_0345.jpg', []]} list chi : [[, ], [], [], [], [], [], [, ], [], [], [], [], [], [, ], [], [], [], [], [], [, ], [], [], [], [], []] ############################### TEST flip ################################ t Inside batchDatouExec : verbose : False # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : flip list_input_json : [] origin BFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 1 ; length of list_pids : 1 ; length of list_args : 1 time to download the photos : 0.16144132614135742 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : False number of steps : 1 step1:flip Sun Mar 23 11:24:48 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou_step_flip ! We are in a linear step without datou_depend ! batch 1 Loaded 6 chid ids of type : 741 +++++WARNING : Unexpected points, we should remove this data for chi_id : 18344210, for now we just ignore these empty polygon points + map_chi_objs of length : 1 photo_id in download_rotate_and_save : 911785586 list_chi_loc : 6 Vertical flip of photo 911785586 Horizontal flip of photo 911785586 About to upload 2 photos upload in portfolio : 1090565 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1742725488_43872 we have uploaded 2 photos in the portfolio 1090565 time of upload the photos Elapsed time : 0.7838561534881592 Len new_chis : 12 Len list_new_chi_with_photo_id : 12 of type : 741 batch 1 Loaded 12 chid ids of type : 741 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! time spend for datou_step_exec : 0.8942575454711914 time spend to save output : 6.341934204101562e-05 total time spend for step 1 : 0.8943209648132324 caffe_path_current : About to save ! 1 Inside saveOutput : final : True verbose : False saveOutput not yet implemented for datou_step.type : flip we use saveGeneral [911785586] Looping around the photos to save general results len do output : 2 /1346581248 /1346581249 before output type Managing all output in save final without adding information in the mtr_datou_result ('571', None, None, None, None, None, None, None, None) ('571', None, '911785586', None, None, None, None, None, None) begin to insert list_values into mtr_datou_result : length of list_values in save_final : 1 time used for this insertion : 0.012808561325073242 save_final save missing photos in datou_result : After save, about to update current ! datou_cur_ids : [] len(datou.list_steps) : 1 output : {'1346581248': ['911785586', 'temp/1742725488_43872_911785586_d8582feabcd359151ff718b5832248c7-big_flip_vert.jpg', [, , , , , ]], '1346581249': ['911785586', 'temp/1742725488_43872_911785586_d8582feabcd359151ff718b5832248c7-big_flip_hori.jpg', [, , , , , ]]} ############################### TEST crop_rles ################################ # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! Unexpected type seems boolean for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : TEST CROP RLES Inside batchDatouExec : verbose : False # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : crop list_input_json : [] origin BFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 1 ; length of list_pids : 1 ; length of list_args : 1 time to download the photos : 0.11287117004394531 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : False number of steps : 1 step1:crop Sun Mar 23 11:24:49 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou_step Crop ! param_json : {'photo_hashtag_type': 755, 'token': '78d09a0790ec6ecbf119343125a81fdc', 'feed_id_new_photos': 0, 'host': 'www.fotonower.com', 'crop_type': 'rle', 'margin_relative': 0.1, 'min_score': 0.3, 'upload,type': 'python'} margin_type : margin_relative margin_value : [0.1, 0.1, 0.1, 0.1] Loading chi in step crop with photo_hashtag_type : 755 Loading chi in step crop for list_pids : 1 ! batch 1 Loaded 8 chid ids of type : 755 ++++++++WARNING : margin is only used for type bib ! we have both polygon and rles we have both polygon and rles we have both polygon and rles we have both polygon and rles we have both polygon and rles we have both polygon and rles we have both polygon and rles we have both polygon and rles map_result returned by crop_photo_return_map_crop : length : 8 Here we crop with rles About to insert : list_path_to_insert length 8 new photo from crops ! About to upload 8 photos https://marlene.fotonower.com/api/v1/secured/portfolio/new?access_token=78d09a0790ec6ecbf119343125a81fdc upload in portfolio : 21619199 Result OK ! uploaded one batch 0 Elapsed time : 19.360915422439575 Now we prepare data that will be used for ellipse search ! time spend for datou_step_exec : 19.8739652633667 time spend to save output : 3.075599670410156e-05 total time spend for step 1 : 19.873996019363403 caffe_path_current : About to save ! 1 Inside saveOutput : final : True verbose : False saveOutput not yet implemented for datou_step.type : crop we use saveGeneral [950103132] Looping around the photos to save general results len do output : 8 /1346581252Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1346581254Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1346581256Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1346581257Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1346581259Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1346581260Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1346581261Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1346581263Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('686', None, None, None, None, None, None, None, None) ('686', None, '950103132', None, None, None, None, None, None) begin to insert list_values into mtr_datou_result : length of list_values in save_final : 25 time used for this insertion : 1.3471717834472656 save_final save missing photos in datou_result : After save, about to update current ! datou_cur_ids : [] len(datou.list_steps) : 1 output : {'1346581252': ['950103132', 'temp/1742725489_43872_950103132_4f47bd527301396b0a701a1b4183ba00_rle_crop_1947670931_0.jpg', (183, 199, 15, 41)], '1346581254': ['950103132', 'temp/1742725489_43872_950103132_4f47bd527301396b0a701a1b4183ba00_rle_crop_1947670932_0.jpg', (38, 85, 113, 140)], '1346581256': ['950103132', 'temp/1742725489_43872_950103132_4f47bd527301396b0a701a1b4183ba00_rle_crop_1947670933_0.jpg', (168, 194, 141, 151)], '1346581257': ['950103132', 'temp/1742725489_43872_950103132_4f47bd527301396b0a701a1b4183ba00_rle_crop_1947670934_0.jpg', (47, 101, 16, 110)], '1346581259': ['950103132', 'temp/1742725489_43872_950103132_4f47bd527301396b0a701a1b4183ba00_rle_crop_1947670935_0.jpg', (175, 199, 104, 111)], '1346581260': ['950103132', 'temp/1742725489_43872_950103132_4f47bd527301396b0a701a1b4183ba00_rle_crop_1947670936_0.jpg', (86, 130, 184, 196)], '1346581261': ['950103132', 'temp/1742725489_43872_950103132_4f47bd527301396b0a701a1b4183ba00_rle_crop_1947670937_0.jpg', (79, 195, 0, 61)], '1346581263': ['950103132', 'temp/1742725489_43872_950103132_4f47bd527301396b0a701a1b4183ba00_rle_crop_1947670938_0.jpg', (131, 155, 181, 195)]} 8 ############################### TEST angular_coeff ################################ t Inside batchDatouExec : verbose : False # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : angular_coeff list_input_json : [] origin BFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 1 ; length of list_pids : 1 ; length of list_args : 1 time to download the photos : 0.476137638092041 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : False number of steps : 1 step1:angular_coeff Sun Mar 23 11:25:11 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec beginning of step detection filter param_json : {'input_type': 846, 'output_type': -1, 'orientation_type': 872, 'ref_crop_type': 846, 'condition_crop': 'car', 'criteria_crop': 'center_rect', 'crops_coeffs': {'CAR_EXTERIEUR_angle_avant_droit.*': {'aile-avant': [[15, 0.0], [240, 0.0], [285, 1.0], [345, 1.0]], 'capot': [[45, 1.0], [60, 0.5], [270, 0.0], [315, 1.0], [360, 1.0]]}}} angular_coefficients_to_crops batch 1 Loaded 19 chid ids of type : 846 treating photo 932296368 time spend for datou_step_exec : 2.355701446533203 time spend to save output : 0.00010776519775390625 total time spend for step 1 : 2.355809211730957 caffe_path_current : About to save ! 0 After save, about to update current ! datou_cur_ids : [] len(datou.list_steps) : 1 output : {932296368: ([(932296368, 2106233860, 846, 1066, 1277, 93, 340, 0.31964028378983567, 0, []), (932296368, 2106233860, 846, 434, 690, 218, 498, 0.7170410105787726, 0, []), (932296368, 503548896, 846, 902, 1111, 466, 576, 0.31724966, 769189715, []), (932296368, 599722655, 846, 523, 1100, 152, 337, 0.98039776, 0, []), (932296368, 492601069, 846, 143, 1190, 90, 695, 0.9696157, 769189717, []), (932296368, 492601069, 846, 0, 408, 246, 719, 0.9431181, 769189718, []), (932296368, 2096875722, 846, 567, 964, 162, 215, 0.55490255, 769189721, []), (932296368, 2096875709, 846, 437, 939, 24, 198, 0.9983077, 769189723, []), (932296368, 2096875709, 846, 1004, 1263, 28, 144, 0.9485744, 769189724, []), (932296368, 624624117, 846, 595, 1122, 331, 640, 0.99100167, 769189725, []), (932296368, 492624020, 846, 585, 874, 308, 393, 0.78697366, 769189727, []), (932296368, 2096875719, 846, 943, 1100, 428, 547, 0.96733797, 769189729, []), (932296368, 492654799, 846, 253, 467, 35, 441, 0.99621326, 769189730, []), (932296368, 492689227, 846, 1118, 1264, 270, 438, 0.9901647, 769189732, []), (932296368, 492689227, 846, 486, 671, 378, 690, 0.98789483, 769189733, []), (932296368, 492689227, 846, 161, 255, 229, 409, 0.70801014, 769189734, []), (932296368, 492925064, 846, 261, 421, 27, 193, 0.92215157, 769189737, []), (932296368, 492925064, 846, 873, 1045, 46, 156, 0.7535122, 769189738, []), (932296368, 492925064, 846, 1090, 1279, 20, 107, 0.45259848, 769189739, [])],)} test angular coeff is a success ! ############################### TEST detection_filter_by_crop ################################ t Inside batchDatouExec : verbose : False # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : detection_filter_by_crop list_input_json : [] origin BFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 1 ; length of list_pids : 1 ; length of list_args : 1 time to download the photos : 0.1514277458190918 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : False number of steps : 1 step1:detection_filter_by_crop Sun Mar 23 11:25:13 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec beginning of step detection filter param_json : {'input_type': 631, 'output_type': -1, 'condition_type': 445, 'condition_crop': 'car', 'criteria_crop': 'center_rect', 'min_surface_ratio': 0.7} conditional_crop_copy batch 1 Loaded 3 chid ids of type : 445 +++batch 1 Loaded 35 chid ids of type : 631 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++batch 1 Loaded 3 chid ids of type : 445 +++ treating photo 946711423 time spend for datou_step_exec : 2.8403475284576416 time spend to save output : 0.00011706352233886719 total time spend for step 1 : 2.8404645919799805 caffe_path_current : About to save ! 0 After save, about to update current ! datou_cur_ids : [] len(datou.list_steps) : 1 output : {946711423: ([(946711423, 624624117, 631, 226, 569, 252, 425, 0.99812776, 1947740368, ['395,419,341,419,340,418,316,418,315,417,306,417,305,416,293,415,290,413,284,412,283,411,280,411,272,407,264,405,258,400,254,398,250,394,244,391,242,389,242,386,239,380,240,368,239,367,239,347,238,346,238,331,237,330,237,327,238,326,237,314,239,311,239,308,237,304,238,302,243,298,244,296,244,292,246,291,250,291,251,290,259,290,260,289,264,289,265,288,269,288,271,290,273,294,278,299,280,300,285,300,286,301,293,301,294,302,302,304,305,307,309,308,312,310,314,310,317,312,335,312,336,313,343,313,344,314,370,314,371,315,381,315,382,314,389,313,393,311,405,309,406,308,408,308,412,306,414,304,417,304,421,307,426,308,427,309,433,309,434,310,464,309,467,306,471,304,476,304,477,303,489,303,490,302,494,302,495,301,500,301,501,300,515,300,516,299,519,298,522,292,525,290,533,290,534,291,540,291,541,290,543,290,547,288,550,285,550,285,552,289,552,291,553,292,553,313,552,314,552,324,550,328,550,333,549,334,549,336,544,346,543,353,539,361,532,368,531,368,527,372,519,374,509,379,503,384,499,385,498,386,496,386,492,388,490,390,486,392,484,392,479,396,475,397,474,398,472,398,471,399,469,399,462,403,460,403,459,404,457,404,456,405,454,405,450,407,448,407,443,410,425,413,424,414,422,414,416,417,404,417,403,418,396,418']), (946711423, 492689227, 631, 162, 245, 233, 396, 0.99702626, 1947740369, ['215,393,206,393,202,390,200,390,192,383,191,380,187,375,184,369,184,367,180,360,180,358,179,357,177,349,175,347,174,339,172,336,171,330,170,329,169,324,168,323,168,313,167,312,167,304,166,303,166,298,165,297,165,288,164,287,165,286,165,272,166,271,166,268,167,267,167,263,168,262,169,254,173,249,177,247,178,247,181,251,184,251,184,252,187,255,189,255,193,259,193,261,195,263,195,264,201,270,203,278,207,282,208,289,211,293,211,296,213,299,214,304,215,305,216,312,219,316,219,319,220,320,220,325,222,329,222,335,223,336,223,338,225,342,225,349,226,350,226,359,227,360,227,366,228,367,228,371,231,375,231,382,227,385,226,388,225,389,223,388,219,392,216,392']), (946711423, 492654799, 631, 96, 172, 39, 261, 0.9928518, 1947740370, ['143,252,143,249,141,246,140,246,138,248,138,251,137,250,137,248,135,246,134,246,132,248,127,244,124,244,122,241,122,236,121,235,121,232,118,229,117,225,116,224,116,212,113,209,115,207,116,201,111,194,110,184,106,178,107,154,108,152,112,148,113,144,112,143,112,138,110,136,108,136,107,135,103,128,103,124,102,123,102,121,103,120,103,118,106,115,106,106,107,105,110,104,113,101,117,93,117,71,114,65,116,61,116,59,117,58,117,55,118,54,119,49,122,45,122,44,124,42,150,42,151,43,153,43,153,47,152,48,152,50,154,52,155,56,156,57,156,85,155,86,155,95,154,96,154,98,155,99,155,105,156,106,155,107,155,116,157,120,159,121,159,123,156,127,156,134,157,135,157,138,156,139,156,141,154,145,152,147,150,151,149,159,148,160,148,164,149,165,149,174,148,175,148,197,149,198,149,215,150,216,150,241,149,242,149,245,148,247,146,245,144,247', '122,147,121,138,120,141,119,142,119,144,118,145,121,148']), (946711423, 2096875719, 631, 468, 555, 292, 365, 0.9830025, 1947740372, ['491,350,489,350,488,349,487,350,483,350,480,348,480,341,482,339,482,337,485,334,487,334,491,330,494,330,495,328,498,326,501,326,503,324,507,325,509,323,514,321,516,319,518,321,520,321,521,319,522,319,524,321,527,321,530,317,530,315,531,314,535,313,540,309,543,310,544,311,542,313,542,314,544,316,541,318,541,322,536,322,535,323,533,323,532,322,528,322,527,321,524,321,522,323,518,322,516,324,517,327,516,328,512,327,510,329,512,332,513,332,515,330,516,331,516,333,514,332,511,333,511,336,514,337,516,336,516,339,515,339,513,338,511,340,512,341,512,342,510,343,507,343,502,347,500,347,497,349,492,349', '514,325,515,324,513,322,512,322,511,325,512,326', '522,327,521,327,521,326,522,325']), (946711423, 599722655, 631, 176, 535, 138, 264, 0.9818268, 1947740373, ['453,253,413,253,412,252,387,252,386,250,386,248,383,246,379,245,376,243,361,243,361,240,362,239,359,238,358,237,356,237,355,236,352,236,351,235,333,235,332,234,329,234,329,233,331,231,331,229,329,228,328,224,330,222,330,221,324,218,308,219,307,218,302,218,298,216,288,217,287,218,285,218,283,220,283,221,287,224,295,225,295,225,294,226,289,226,288,227,283,227,282,228,273,228,272,229,271,228,259,228,258,227,254,227,253,226,247,225,247,225,251,221,248,218,243,216,247,213,248,213,249,212,248,211,246,211,245,210,241,210,240,209,237,209,236,208,231,207,230,206,228,202,224,201,223,200,221,200,220,199,214,198,213,195,211,193,208,193,203,189,203,184,201,181,201,176,198,171,199,170,199,158,203,154,205,153,205,151,206,149,209,149,210,148,225,148,226,147,283,147,284,148,287,148,288,147,305,147,306,148,312,148,313,147,354,147,355,146,428,146,429,147,433,147,434,148,437,148,438,149,451,149,457,156,459,162,462,165,464,166,471,166,472,165,477,165,480,167,480,171,486,175,488,175,489,176,502,176,503,178,503,180,509,185,509,189,512,193,512,199,513,200,513,203,514,204,514,210,513,211,514,217,512,221,513,222,513,225,510,229,510,235,507,237,504,238,502,243,490,243,489,244,485,244,484,245,480,245,479,246,463,246,462,247,460,247,458,249,457,252,454,252', '528,212,528,207,526,206,524,203,526,203,527,202,528,202', '299,215,302,212,299,211,298,210,291,210,290,211,281,212,286,215,290,215,291,216', '375,242,376,240,375,238,363,239,368,242,371,242,372,243']), (946711423, 492844413, 631, 89, 163, 93, 144, 0.9772748, 1947740375, ['159,142,153,141,151,139,148,138,145,135,141,133,139,133,138,132,131,132,130,131,125,131,124,130,121,130,120,129,116,129,115,128,112,128,108,126,106,126,100,123,98,121,94,113,94,104,97,101,103,98,105,98,106,97,110,97,111,96,116,96,117,95,132,95,133,96,139,97,141,99,144,100,149,105,150,107,154,108,155,113,157,115,158,115,160,118,160,120,161,121,161,133,160,134,160,140']), (946711423, 2096875709, 631, 185, 431, 39, 136, 0.97171515, 1947740377, ['331,134,287,134,286,133,284,133,283,134,272,134,271,133,264,133,263,134,258,134,257,133,254,133,253,132,236,132,235,131,225,131,224,132,223,131,213,131,212,130,208,130,207,129,204,129,203,128,199,127,193,121,192,117,189,113,189,110,188,109,187,93,186,92,187,91,187,89,186,88,186,65,185,64,186,63,186,61,185,60,185,48,186,47,186,42,187,40,232,40,233,41,248,41,249,42,281,43,282,44,290,44,291,45,300,45,301,46,308,46,309,47,314,47,315,48,322,49,328,53,334,54,336,56,339,57,344,62,349,64,351,66,353,67,356,67,358,69,359,72,363,76,367,78,369,80,379,91,380,93,383,94,390,100,393,101,395,103,396,106,399,109,402,110,406,115,408,115,410,117,410,120,412,123,411,127,409,129,399,129,398,130,395,130,394,131,378,131,377,132,368,132,367,131,346,131,345,132,342,132,341,133,332,133']), (946711423, 2096875722, 631, 198, 395, 118, 142, 0.9699756, 1947740378, ['328,137,251,137,250,136,249,137,241,137,240,136,219,136,218,135,213,135,212,134,206,133,205,132,201,131,200,130,200,122,201,121,205,121,206,122,222,122,226,124,239,124,240,125,369,125,370,124,371,125,389,125,391,127,391,133,390,134,386,134,385,135,380,135,379,134,375,134,374,135,341,135,340,136,329,136']), (946711423, 499500794, 631, 93, 107, 127, 146, 0.9574813, 1947740379, ['101,143,98,143,95,139,95,131,97,129,100,129,101,133,102,134,102,136,103,137,103,140']), (946711423, 492925064, 631, 71, 125, 36, 95, 0.95296955, 1947740380, ['104,92,96,92,93,90,91,90,86,86,83,85,83,84,81,82,80,82,75,77,75,75,74,74,74,66,75,65,75,62,77,60,77,58,80,55,80,54,83,51,83,50,88,45,94,44,95,43,99,43,100,42,113,42,117,45,117,47,116,48,116,51,115,52,114,59,113,60,112,65,111,66,111,69,110,70,110,75,109,76,109,83,108,84,108,86,109,87,108,89']), (946711423, 492925064, 631, 101, 167, 38, 127, 0.9508439, 1947740381, ['154,117,152,115,152,112,150,110,148,106,148,104,145,101,143,100,138,100,137,99,135,99,133,95,131,95,126,93,126,91,128,88,128,83,129,82,129,70,127,68,127,66,128,65,125,61,127,59,127,56,129,52,129,49,130,47,135,42,144,42,148,45,151,49,151,60,152,61,152,75,153,76,153,80,155,83,155,87,156,88,156,105,155,106,156,107,156,110,154,112,156,116', '109,100,108,100,107,99,109,97']), (946711423, 492624020, 631, 249, 400, 219, 316, 0.8792459, 1947740382, ['395,313,390,313,386,311,384,312,381,312,376,309,358,308,357,307,354,307,353,306,350,306,349,307,345,305,343,303,341,304,337,304,334,302,325,302,324,301,315,300,313,298,313,297,310,295,304,295,300,293,295,293,291,288,289,287,283,287,281,285,281,283,278,280,274,280,272,279,272,276,270,273,270,270,269,268,266,265,265,265,264,264,264,262,261,260,260,258,260,256,261,255,259,252,259,248,258,246,255,244,256,241,252,239,251,238,251,226,265,226,266,227,268,227,272,232,276,232,277,233,279,233,281,234,283,237,285,238,290,239,293,241,296,241,304,246,312,247,316,251,318,252,320,252,326,255,328,255,337,260,342,260,343,261,345,261,349,264,351,264,355,266,357,268,364,271,366,273,370,275,374,275,376,276,377,279,379,281,383,282,384,283,386,283,387,286,390,289,390,290,394,294,396,294,398,296,398,308,397,309,397,311']), (946711423, 503548896, 631, 302, 540, 339, 403, 0.7406652, 1947740386, ['442,401,372,401,372,397,370,395,369,392,366,390,367,389,366,386,357,386,354,384,350,384,349,383,320,383,319,382,320,378,318,376,318,374,314,370,309,370,308,369,306,369,305,363,305,357,306,356,306,353,307,353,308,354,313,354,314,355,315,354,320,354,321,353,331,353,332,354,335,354,336,355,339,355,340,356,379,356,380,357,406,357,407,356,409,356,410,357,474,357,475,356,482,356,484,357,485,356,488,356,493,353,501,354,502,353,506,353,507,352,517,352,518,351,522,351,525,347,527,346,530,347,530,349,533,351,530,355,528,355,527,356,515,356,509,359,508,361,505,362,503,365,497,368,494,372,490,373,489,374,492,376,495,376,493,377,488,378,490,380,495,380,497,381,497,381,487,382,485,385,476,387,469,392,466,392,465,393,460,393,456,396,453,397,451,399,443,400', '519,353,518,352,517,353,518,354']), (946711423, 2106233860, 631, 53, 85, 75, 182, 0.73015845, 1947740387, ['70,147,68,145,65,139,65,137,62,132,61,128,57,126,56,124,56,121,54,119,54,110,56,108,56,103,59,100,60,101,61,100,61,96,63,93,63,89,66,84,65,83,65,80,66,78,68,78,68,79,70,80,70,83,74,87,74,90,75,91,75,100,77,102,77,105,75,106,75,125,76,126,77,125,77,125,77,128,76,129,77,131,77,136,75,139,75,143,78,145,76,146,71,146', '61,107,60,106,59,107,60,108', '77,134,76,131,75,134,76,135']), (946711423, 2096875717, 631, 477, 510, 220, 243, 0.69028217, 1947740388, ['501,241,493,241,489,239,488,237,487,237,480,232,479,230,479,226,484,222,487,222,488,223,492,224,496,228,497,228,497,229,502,234,502,235,504,236,504,240,502,240']), (946711423, 2096875712, 631, 309, 326, 382, 404, 0.6633776, 1947740390, ['309,383,309,382,311,382', '325,385,324,383,319,383,318,382,325,382', '320,400,311,400,309,398,309,385,310,386,311,385,315,385,316,384,318,384,319,385,322,385,325,387,325,398,323,398']), (946711423, 2096875719, 631, 427, 553, 258, 315, 0.6446218, 1947740391, ['531,284,526,284,525,283,525,281,523,279,522,280,519,281,521,282,521,283,519,284,518,283,519,281,515,279,516,277,515,276,513,276,512,277,513,279,511,280,507,279,505,276,504,279,497,279,496,278,495,279,485,279,484,280,480,280,479,281,481,283,482,283,482,283,469,283,468,284,438,284,436,283,440,279,446,279,447,278,456,278,458,276,457,275,457,275,467,275,468,274,490,274,491,273,494,273,496,271,496,269,499,268,501,266,503,265,506,265,510,263,514,263,516,261,520,259,544,259,544,259,543,260,545,262,548,262,550,263,550,276,549,277,547,277,540,282,538,282,537,283,532,283']), (946711423, 2106233861, 631, 144, 267, 181, 307, 0.63958377, 1947740392, ['212,251,209,251,208,250,203,251,201,250,201,249,195,243,189,242,188,241,185,241,184,240,182,236,180,236,179,235,173,235,172,234,170,235,164,235,163,234,163,232,162,231,163,217,166,217,168,218,170,215,171,210,172,209,173,209,176,212,178,210,178,208,181,203,186,203,188,201,193,201,194,202,195,201,201,201,202,202,204,202,205,201,209,201,210,202,212,202,215,200,217,200,220,202,221,201,227,201,231,205,231,206,234,209,235,209,235,210,238,213,238,224,234,228,235,232,234,233,228,234,225,237,224,241,222,242,216,242,209,246,211,248,212,248,213,250', '221,228,220,227,219,228,220,229', '224,238,224,237,221,235,217,237,219,239']), (946711423, 2096875712, 631, 285, 433, 343, 377, 0.61493844, 1947740393, ['431,376,286,376,285,375,285,368,286,367,286,362,287,361,287,359,291,359,297,362,306,363,307,364,312,364,313,365,322,366,323,367,331,366,332,368,334,368,335,369,338,368,337,366,336,366,337,365,336,364,327,364,325,361,319,361,317,357,317,356,318,355,325,355,326,353,331,353,333,351,332,350,330,350,328,348,326,348,325,347,319,347,315,345,306,345,305,344,297,344,299,344,300,343,431,343,432,344,432,353,431,354,431,358,430,359,430,365,427,365,425,363,424,363,422,364,421,366,418,366,413,369,404,370,409,371,409,371,399,371,398,372,395,373,419,374,420,373,426,372,428,370,428,367,429,367,430,368,429,369,430,370,430,373,431,374', '381,373,378,372,377,371,356,371,356,371,359,370,347,369,345,367,343,367,342,368,343,369,341,370,354,371,354,371,352,372,353,373,359,373,360,374']), (946711423, 2106233860, 631, 146, 287, 140, 311, 0.54784286, 1947740394, ['234,254,227,254,221,251,219,248,215,253,212,253,210,252,206,247,203,247,198,243,197,243,194,239,189,238,186,236,182,236,181,235,167,235,164,233,164,228,159,227,158,226,158,219,159,218,159,213,162,207,162,205,169,192,169,186,170,185,172,185,177,179,175,175,173,173,177,171,181,171,182,170,184,170,187,167,187,164,188,163,188,161,199,161,202,164,205,165,207,167,209,167,212,165,215,165,216,168,218,170,219,170,221,168,221,164,220,163,220,161,222,161,223,160,230,160,231,159,242,159,244,158,247,161,248,161,247,162,246,168,248,172,248,174,253,176,254,180,253,182,249,182,247,185,249,188,253,188,254,189,254,194,249,194,247,196,247,198,249,200,252,200,253,199,255,202,255,205,254,206,254,208,250,207,249,206,246,209,246,210,249,214,252,212,254,212,254,214,255,215,255,217,254,218,254,221,252,221,249,219,247,221,247,225,249,228,250,228,252,226,253,224,253,224,253,229,252,229,251,228,249,228,247,230,247,233,246,234,246,237,245,238,245,240,243,244,243,247,239,251,237,251', '230,167,229,166,227,167,228,168']), (946711423, 495920967, 631, 202, 524, 112, 333, 0.45109355, 1947740396, ['483,289,483,286,482,285,482,283,480,279,480,274,476,270,472,268,465,268,464,269,459,269,458,268,454,268,453,267,437,267,436,268,428,268,427,269,418,269,417,270,414,270,410,266,410,265,416,262,418,262,421,260,423,260,425,259,426,257,424,255,422,255,419,253,417,253,416,252,412,251,410,250,410,249,412,249,413,248,415,248,416,247,422,246,428,243,429,242,428,241,424,240,423,239,420,239,419,238,390,238,389,237,386,237,385,236,369,236,368,235,363,234,363,233,364,232,364,230,366,226,365,225,357,220,344,220,341,218,339,218,339,218,342,212,342,210,336,207,327,207,326,206,319,206,318,205,314,205,313,204,297,204,291,207,288,210,288,212,291,217,290,220,288,222,284,224,282,224,278,227,273,228,271,230,270,235,265,239,262,236,261,232,263,228,266,226,261,224,256,219,256,210,249,206,242,205,237,202,234,195,226,186,227,184,227,180,228,179,225,175,225,174,222,171,225,165,227,163,229,158,230,157,232,156,235,156,236,155,239,155,240,154,245,154,246,155,254,155,255,156,258,156,259,157,268,157,269,156,272,156,273,155,280,155,281,156,298,156,300,155,301,156,307,156,308,157,311,157,318,152,322,151,323,150,333,150,338,146,339,146,342,143,343,143,346,140,357,140,362,136,366,134,368,134,369,133,373,133,374,132,377,132,378,131,388,131,389,130,410,130,411,131,417,131,428,140,432,142,434,142,435,143,443,145,446,147,448,147,451,154,453,156,457,158,462,159,463,160,466,160,467,161,472,162,474,163,474,164,481,171,489,175,491,175,492,176,494,176,495,177,499,178,500,179,502,184,507,189,517,194,518,195,514,201,514,203,518,207,519,209,518,214,515,218,517,227,515,229,515,231,514,232,515,236,518,239,518,252,519,253,519,263,518,264,518,267,517,269,514,272,512,273,512,274,506,280,500,277,498,273,496,272,493,272,491,274,491,278,490,279,490,281', '312,179,311,178,308,179,309,180', '268,269,264,269,259,266,259,262,261,258,261,250,265,245,269,250,270,257,274,260,278,265,275,267,269,268', '414,281,401,281,414,281']), (946711423, 2096875722, 631, 433, 558, 248, 286, 0.44133398, 1947740397, ['492,272,474,272,473,271,468,271,465,269,460,269,460,268,465,266,467,266,468,265,470,265,471,264,475,264,476,263,479,263,480,262,486,262,487,261,491,261,492,260,495,260,496,259,502,259,506,257,510,257,514,255,517,255,518,254,530,253,531,252,535,252,536,251,538,251,539,252,543,252,544,253,547,253,549,251,553,251,555,253,555,267,552,270,550,270,550,269,548,267,547,267,547,267,548,266,547,265,545,266,540,266,539,264,530,264,529,263,524,263,519,266,513,266,510,268,507,268,506,269,499,270,498,271,493,271', '438,279,435,279,435,273,436,272,448,271,449,272,448,274,443,274,440,277,440,278']), (946711423, 492654799, 631, 399, 569, 68, 251, 0.41876298, 1947740399, []), (946711423, 492624020, 631, 420, 552, 244, 293, 0.35962066, 1947740400, ['474,289,453,289,452,288,439,288,437,286,431,286,427,284,423,284,422,283,422,275,427,275,428,273,430,272,435,272,436,271,438,271,442,269,447,269,450,267,454,267,460,264,464,264,467,262,483,261,484,260,488,260,489,259,494,259,495,258,502,258,503,257,505,257,509,255,512,255,516,252,520,252,521,251,526,250,530,248,534,248,535,247,546,247,547,248,549,248,549,250,550,251,550,266,551,267,551,275,550,276,550,278,549,279,549,281,537,282,535,284,528,284,527,285,504,285,503,286,495,286,492,288,488,287,487,288,475,288']), (946711423, 503548896, 631, 301, 540, 339, 403, 0.740756, 3140491551, ['442,401,371,401,371,397,366,390,365,386,356,386,353,384,348,383,319,383,319,378,314,370,310,370,305,368,304,357,305,353,330,353,339,356,378,356,379,357,474,357,475,356,488,356,493,353,501,354,507,352,517,352,522,351,527,346,530,347,533,351,530,355,527,356,515,356,505,362,503,365,497,368,494,372,489,374,492,376,488,378,490,380,495,380,487,382,485,385,476,387,469,392,461,393,456,395,451,399,447,399', '519,353,518,352,517,353,518,354'])],)} test detection filter by crop is a success ! ############################### TEST detection_filter_by_classif ################################ t Inside batchDatouExec : verbose : False # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : detection_filter_by_classif list_input_json : [] origin we have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB time to download the photos : 0.004738330841064453 About to test input to load Calling datou_exec Inside datou_exec : verbose : False number of steps : 1 step1:detection_filter_by_classif Sun Mar 23 11:25:18 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec beginning of step detection filter with classification results param_json : {'input_type': 631, 'output_type': 816, 'condition_type': 872, 'crops_ok': {'CAR_DOCUMENT.*': {}, 'CAR_INTERIEUR.*': {}, 'CAR_EXTERIEUR_angle_avant_droit.*': {'Retroviseur': 2, 'Roue': 2, 'Capot': 1, 'Pare-brise': 1, 'vitre': 10, 'phare': 2, 'Feu-antibrouillard': 2, 'poignee': 2, 'porte': 2, 'calandre': 1, 'logo-marque': 1, 'Plaque-immatriculation': 1, 'Essuie-glace': 1, 'pare-choc': 1, 'toit': 1, 'logo-roue': 1, 'aile-avant': 1}}, 'separation': {'CAR_EXTERIEUR_avant.*': {'pare-choc': ['pare-chocs-avant'], 'phare': ['phare-gauche', 'a-droite-de', 'phare-droit']}, 'CAR_EXTERIEUR_angle_avant_droit.*': {'pare-choc': ['pare-chocs-avant'], 'phare': ['phare-droite', 'a-gauche-de', 'phare-gauche'], 'porte': ['porte-avant', 'a-droite-de', 'porte-arriere']}}} conditional_crop_by_classif_copy batch 1 Loaded 35 chid ids of type : 631 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ treating photo 946711423 batch 1 Loaded 0 chid ids of type : 0 batch 1 Loaded 23 chid ids of type : 816 Number RLEs to save : 1600 TO DO : save crop sub photo not yet done ! time spend for datou_step_exec : 2.556211233139038 time spend to save output : 0.00011420249938964844 total time spend for step 1 : 2.5563254356384277 caffe_path_current : About to save ! 0 After save, about to update current ! test detection filter by classif is a success ! ############################### TEST blur_detection ################################ t Inside batchDatouExec : verbose : False # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : blur_detection list_input_json : [] origin BFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 1 ; length of list_pids : 1 ; length of list_args : 1 time to download the photos : 0.5906145572662354 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : False number of steps : 1 step1:blur_detection Sun Mar 23 11:25:21 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec inside step blur_detection methode: ratio et variance treat image : temp/1742725521_43872_930729675_b2d2beaaee733d521cbb0c9800a29073.jpg resize: (600, 800) 930729675 12.961859636534896 time spend for datou_step_exec : 0.3331611156463623 time spend to save output : 9.322166442871094e-05 total time spend for step 1 : 0.333254337310791 caffe_path_current : About to save ! 0 After save, about to update current ! datou_cur_ids : [] len(datou.list_steps) : 1 output : {930729675: [(930729675, 12.961859636534896, 492688767)]} {930729675: [(930729675, 12.961859636534896, 492688767)]} ############################### TEST detect_point_224x224 ################################ test_detect_point_224x224 Inside batchDatouExec : verbose : False # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : step 4589 thcl is not linked in the step_by_step architecture ! WARNING : step 4590 argmax is not linked in the step_by_step architecture ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! DataTypes for each output/input checked ! List Step Type Loaded in datou : thcl, argmax list_input_json : [] origin BBBBBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFFBFBFBFBFBFFFBFFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 64 ; length of list_pids : 64 ; length of list_args : 64 time to download the photos : 2.249098300933838 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : False number of steps : 2 step1:thcl Sun Mar 23 11:25:24 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step Thcl ! we are using the classfication for only one thcl 1528 time to import caffe and check if the image exist : 0.0020477771759033203 time to convert the images to numpy array : 0.00940561294555664 time to import caffe and check if the image exist : 0.00445866584777832 time to convert the images to numpy array : 0.04354977607727051 time to import caffe and check if the image exist : 0.010666370391845703 time to convert the images to numpy array : 0.049867868423461914 time to import caffe and check if the image exist : 0.0057981014251708984 time to convert the images to numpy array : 0.05808305740356445 time to import caffe and check if the image exist : 0.005986452102661133 time to convert the images to numpy array : 0.058061838150024414 time to import caffe and check if the image exist : 0.014615774154663086 time to convert the images to numpy array : 0.04996919631958008 time to import caffe and check if the image exist : 0.01648998260498047 time to convert the images to numpy array : 0.04835796356201172 time to import caffe and check if the image exist : 0.015970468521118164 time to convert the images to numpy array : 0.05346226692199707 time to import caffe and check if the image exist : 0.020128726959228516 time to convert the images to numpy array : 0.04698753356933594 time to import caffe and check if the image exist : 0.01580357551574707 time to convert the images to numpy array : 0.05285382270812988 total time to convert the images to numpy array : 0.07090210914611816 list photo_ids error: [] list photo_ids correct : [987515187, 987515192, 987515193, 987515195, 987515196, 987515198, 987515200, 987515201, 987515209, 987515211, 987515212, 987515213, 987515215, 987515216, 987515217, 987515246, 987515247, 987515248, 987515249, 987515250, 987515207, 987515208, 987515219, 987515220, 987515222, 987515223, 987515188, 987515189, 987515190, 987515237, 987515238, 987515175, 987515176, 987515177, 987515178, 987515179, 987515180, 987515181, 987515182, 987515183, 987515184, 987515185, 987515186, 987515239, 987515240, 987515241, 987515242, 987515243, 987515244, 987515245, 987515230, 987515231, 987515232, 987515233, 987515234, 987515235, 987515236, 987515202, 987515204, 987515205, 987515224, 987515226, 987515227, 987515228] number of photos to traite : 64 try to delete the photos incorrect in DB tagging for thcl : 1528 To do loadFromThcl(), then load ParamDescType : thcl1528 thcls : [{'id': 1528, 'mtr_user_id': 31, 'name': 'learn_refus_upm_blanches_1924', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Autre_Environement,Carton,Kraft,Lointain_Papier_Magazine,Metal,Papier_Magazine,Plastique,Sol_Environement,Teint_Dans_La_Masse,autre_refus', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 1927, 'photo_desc_type': 4421, 'type_classification': 'caffe', 'hashtag_id_list': '2107752388,492774966,493202403,2107752389,492628673,2107752386,492725882,2107752387,2107752385,2107752406'}] thcl {'id': 1528, 'mtr_user_id': 31, 'name': 'learn_refus_upm_blanches_1924', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Autre_Environement,Carton,Kraft,Lointain_Papier_Magazine,Metal,Papier_Magazine,Plastique,Sol_Environement,Teint_Dans_La_Masse,autre_refus', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 1927, 'photo_desc_type': 4421, 'type_classification': 'caffe', 'hashtag_id_list': '2107752388,492774966,493202403,2107752389,492628673,2107752386,492725882,2107752387,2107752385,2107752406'} Update svm_hashtag_type_desc : 4421 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (4421, 'learn_refus_upm_blanches_1924', 16384, 25088, 'learn_refus_upm_blanches_1924', 'res5b', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2019, 10, 22, 17, 39, 25), datetime.datetime(2019, 10, 22, 17, 39, 25)) To loadFromThcl() : net_4421 begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 2964 max_wait_temp : 1 max_wait : 0 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (4421, 'learn_refus_upm_blanches_1924', 16384, 25088, 'learn_refus_upm_blanches_1924', 'res5b', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2019, 10, 22, 17, 39, 25), datetime.datetime(2019, 10, 22, 17, 39, 25)) None mean_file_type : mean_file_path : prototxt_file_path : model : learn_refus_upm_blanches_1924 Inside get_net Inside get_net before cache_data_model model_param file didn't exist Inside get_net before CDM.load_model_par_type model_name : learn_refus_upm_blanches_1924 model_type : caffe list file need : ['caffemodel', 'deploy_conv_normal.prototxt', 'deploy_fc.prototxt', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file exist in s3 : ['caffemodel', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file manque in s3 : ['deploy_conv_normal.prototxt', 'deploy_fc.prototxt'] local folder : /data/models_weight/learn_refus_upm_blanches_1924 /data/models_weight/learn_refus_upm_blanches_1924/caffemodel size_local : 45774543 size in s3 : 45774543 create time local : 2021-08-09 05:29:53 create time in s3 : 2021-08-06 19:36:04 caffemodel already exist and didn't need to update /data/models_weight/learn_refus_upm_blanches_1924/deploy.prototxt size_local : 17312 size in s3 : 17312 create time local : 2021-08-09 05:29:53 create time in s3 : 2021-08-06 19:36:03 deploy.prototxt already exist and didn't need to update /data/models_weight/learn_refus_upm_blanches_1924/mean.npy size_local : 1572992 size in s3 : 1572992 create time local : 2021-08-09 05:29:53 create time in s3 : 2021-08-06 19:36:05 mean.npy already exist and didn't need to update /data/models_weight/learn_refus_upm_blanches_1924/synset_words.txt size_local : 218 size in s3 : 218 create time local : 2021-08-09 05:29:53 create time in s3 : 2021-08-06 19:36:04 synset_words.txt already exist and didn't need to update Inside get_net after CDM.load_model_par_type After if not only_with_local_cache: /home/admin/workarea/install/darknet/:/home/admin/workarea/git/Velours/python:/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python:/home/admin/mtr/.credentials:/home/admin/workarea/install/caffe/python:/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools/:/home/admin/workarea/git/fotonowerpip/:/home/admin/workarea/install/segment-anything:/home/admin//workarea/git/pyfvs/ Here before set mode gpu Doing nothing but we could set mode gpu after set mode gpu prototxt_filename : /data/models_weight/learn_refus_upm_blanches_1924/deploy.prototxt caffemodel_filename : /data/models_weight/learn_refus_upm_blanches_1924/caffemodel now we set caffe to gpu mode before predict begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 2964 max_wait_temp : 1 max_wait : 0 dict_keys(['res5b', 'prob']) time used to do the prepocess of the images : 0.05860781669616699 time used to do the prediction : 0.33327555656433105 save descriptor for thcl : 1528 time to traite the descriptors : 4.299133062362671 storage_type for insertDescriptorsMulti : 1 To insert : 987515187 To insert : 987515192 To insert : 987515193 To insert : 987515195 To insert : 987515196 To insert : 987515198 To insert : 987515200 To insert : 987515201 To insert : 987515209 To insert : 987515211 To insert : 987515212 To insert : 987515213 To insert : 987515215 To insert : 987515216 To insert : 987515217 To insert : 987515246 To insert : 987515247 To insert : 987515248 To insert : 987515249 To insert : 987515250 To insert : 987515207 To insert : 987515208 To insert : 987515219 To insert : 987515220 To insert : 987515222 To insert : 987515223 To insert : 987515188 To insert : 987515189 To insert : 987515190 To insert : 987515237 To insert : 987515238 To insert : 987515175 To insert : 987515176 To insert : 987515177 To insert : 987515178 To insert : 987515179 To insert : 987515180 To insert : 987515181 To insert : 987515182 To insert : 987515183 To insert : 987515184 To insert : 987515185 To insert : 987515186 To insert : 987515239 To insert : 987515240 To insert : 987515241 To insert : 987515242 To insert : 987515243 To insert : 987515244 To insert : 987515245 To insert : 987515230 To insert : 987515231 To insert : 987515232 To insert : 987515233 To insert : 987515234 To insert : 987515235 To insert : 987515236 To insert : 987515202 To insert : 987515204 To insert : 987515205 To insert : 987515224 To insert : 987515226 To insert : 987515227 To insert : 987515228 time to insert the descriptors : 17.82598090171814 time spend for datou_step_exec : 26.290209770202637 time spend to save output : 7.43865966796875e-05 total time spend for step 1 : 26.290284156799316 step2:argmax Sun Mar 23 11:25:50 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou_step Argmax ! calculate argmax for thcl : 1528 time spend for datou_step_exec : 0.0009000301361083984 time spend to save output : 2.765655517578125e-05 total time spend for step 2 : 0.0009276866912841797 caffe_path_current : About to save ! 0 After save, about to update current ! datou_cur_ids : [] len(datou.list_steps) : 2 output : {'987515187': [('987515187', 'Carton', 0.9811152, 1927, '1528'), 'temp/1742725522_43872_987515187_9f62f98efd3caca0b9c17d27f5c70440.jpg'], '987515192': [('987515192', 'Papier_Magazine', 0.99991095, 1927, '1528'), 'temp/1742725522_43872_987515192_b661073b218f5f056833d6af1c617153.jpg'], '987515193': [('987515193', 'Papier_Magazine', 0.9993961, 1927, '1528'), 'temp/1742725522_43872_987515193_1a97fceb4dcbf5821d783b2e00b52fe6.jpg'], '987515195': [('987515195', 'Carton', 0.98464507, 1927, '1528'), 'temp/1742725522_43872_987515195_30ccb89dfe410c445878a7f2819ddc36.jpg'], '987515196': [('987515196', 'Carton', 0.9846421, 1927, '1528'), 'temp/1742725522_43872_987515196_30ccb89dfe410c445878a7f2819ddc36.jpg'], '987515198': [('987515198', 'Carton', 0.966042, 1927, '1528'), 'temp/1742725522_43872_987515198_599e80f444c876f407e94b533c89360b.jpg'], '987515200': [('987515200', 'Carton', 0.98597866, 1927, '1528'), 'temp/1742725522_43872_987515200_978964436b5d5fb0eeda17e3bfafe889.jpg'], '987515201': [('987515201', 'Carton', 0.9954461, 1927, '1528'), 'temp/1742725522_43872_987515201_b224d2acdc7fa2bbb134c09db6bca7ce.jpg'], '987515209': [('987515209', 'Carton', 0.96782, 1927, '1528'), 'temp/1742725522_43872_987515209_02dfe1ae39f51994652f4a8538844aea.jpg'], '987515211': [('987515211', 'Carton', 0.97338134, 1927, '1528'), 'temp/1742725522_43872_987515211_72cc7664d45bd40477351b9b764f1500.jpg'], '987515212': [('987515212', 'Carton', 0.98688656, 1927, '1528'), 'temp/1742725522_43872_987515212_b0a038fcb9678ebfd60d9b1f6ec1fc17.jpg'], '987515213': [('987515213', 'Carton', 0.9869083, 1927, '1528'), 'temp/1742725522_43872_987515213_b0a038fcb9678ebfd60d9b1f6ec1fc17.jpg'], '987515215': [('987515215', 'Papier_Magazine', 0.99392104, 1927, '1528'), 'temp/1742725522_43872_987515215_902ef348a7eebb9a8b87f42927347936.jpg'], '987515216': [('987515216', 'Papier_Magazine', 0.97745365, 1927, '1528'), 'temp/1742725522_43872_987515216_4f7dc21f1d2cd3fcabadc4a6755921e1.jpg'], '987515217': [('987515217', 'Carton', 0.52896744, 1927, '1528'), 'temp/1742725522_43872_987515217_78877bb2c5760be28518d17f77d1c609.jpg'], '987515246': [('987515246', 'Carton', 0.99923193, 1927, '1528'), 'temp/1742725522_43872_987515246_671a708f67f2efa19004b8257fc7b9c8.jpg'], '987515247': [('987515247', 'Carton', 0.9996691, 1927, '1528'), 'temp/1742725522_43872_987515247_e47b65403df916ba909bc9c439b0af73.jpg'], '987515248': [('987515248', 'Carton', 0.9812263, 1927, '1528'), 'temp/1742725522_43872_987515248_a70ad88462a22fb62a120721a42b2d42.jpg'], '987515249': [('987515249', 'Carton', 0.98130935, 1927, '1528'), 'temp/1742725522_43872_987515249_a70ad88462a22fb62a120721a42b2d42.jpg'], '987515250': [('987515250', 'Carton', 0.980793, 1927, '1528'), 'temp/1742725522_43872_987515250_b2827c9639df69656f23abcc7f2f82d9.jpg'], '987515207': [('987515207', 'Papier_Magazine', 0.8738379, 1927, '1528'), 'temp/1742725522_43872_987515207_de216ddb041e249524b0fb2b949064a5.jpg'], '987515208': [('987515208', 'Carton', 0.9917326, 1927, '1528'), 'temp/1742725522_43872_987515208_a2b90cb74908aa64bbc4aae58f0c5ae8.jpg'], '987515219': [('987515219', 'Carton', 0.9993679, 1927, '1528'), 'temp/1742725522_43872_987515219_c2d417a5ba6ccf7c84527636f8d5eef9.jpg'], '987515220': [('987515220', 'Carton', 0.9963728, 1927, '1528'), 'temp/1742725522_43872_987515220_e729f316c4c3b32049adfbaaa336d95c.jpg'], '987515222': [('987515222', 'Carton', 0.99746907, 1927, '1528'), 'temp/1742725522_43872_987515222_067a027bc7402f969b6277d0dcb47eaa.jpg'], '987515223': [('987515223', 'Carton', 0.9920448, 1927, '1528'), 'temp/1742725522_43872_987515223_ebb57f09941cd11d7ee45a9368a883c1.jpg'], '987515188': [('987515188', 'Carton', 0.9956481, 1927, '1528'), 'temp/1742725522_43872_987515188_4116f9906657a69bb76c2fda982037b9.jpg'], '987515189': [('987515189', 'Carton', 0.9977908, 1927, '1528'), 'temp/1742725522_43872_987515189_8e8590a26f72249d4c2116dffd0cf668.jpg'], '987515190': [('987515190', 'Carton', 0.9763816, 1927, '1528'), 'temp/1742725522_43872_987515190_d56932bfc6ba2a8c974c691108755017.jpg'], '987515237': [('987515237', 'Carton', 0.7701946, 1927, '1528'), 'temp/1742725522_43872_987515237_1183dfa371a457f11ce2b622c7cf9467.jpg'], '987515238': [('987515238', 'Carton', 0.99957377, 1927, '1528'), 'temp/1742725522_43872_987515238_e6292cb81e05894cfeb4b99f21a1d3f8.jpg'], '987515175': [('987515175', 'Papier_Magazine', 0.9998141, 1927, '1528'), 'temp/1742725522_43872_987515175_8b398cba2f448622cd9657f5eb3f9796.jpg'], '987515176': [('987515176', 'Papier_Magazine', 0.9998124, 1927, '1528'), 'temp/1742725522_43872_987515176_8b398cba2f448622cd9657f5eb3f9796.jpg'], '987515177': [('987515177', 'Papier_Magazine', 0.97714007, 1927, '1528'), 'temp/1742725522_43872_987515177_4a54e9967227806219ddf45d256539d8.jpg'], '987515178': [('987515178', 'Carton', 0.8577351, 1927, '1528'), 'temp/1742725522_43872_987515178_298b3d2bfe0fda6787b59a78e2e68867.jpg'], '987515179': [('987515179', 'Carton', 0.9268545, 1927, '1528'), 'temp/1742725522_43872_987515179_f7d4d1757a470f4c96dc3541eac88b9e.jpg'], '987515180': [('987515180', 'Carton', 0.99004424, 1927, '1528'), 'temp/1742725522_43872_987515180_776a5d7d8486ee2961bbe3a0d90f95b5.jpg'], '987515181': [('987515181', 'Carton', 0.9977787, 1927, '1528'), 'temp/1742725522_43872_987515181_1738c2798fb31152809ecb443ac286d6.jpg'], '987515182': [('987515182', 'Carton', 0.99242496, 1927, '1528'), 'temp/1742725522_43872_987515182_fe7f29bf6d13e08c3e985f91b5232178.jpg'], '987515183': [('987515183', 'Papier_Magazine', 0.99999213, 1927, '1528'), 'temp/1742725522_43872_987515183_6aab9ca0421398b4899892c10c2594c6.jpg'], '987515184': [('987515184', 'Papier_Magazine', 0.99973184, 1927, '1528'), 'temp/1742725522_43872_987515184_19c8c2177209a285df6014d95fe53f2c.jpg'], '987515185': [('987515185', 'Papier_Magazine', 0.7981237, 1927, '1528'), 'temp/1742725522_43872_987515185_e172d54457cabee9d7f02ee1300f3ae9.jpg'], '987515186': [('987515186', 'Carton', 0.9847317, 1927, '1528'), 'temp/1742725522_43872_987515186_797def426440b544aa80dbd63a19234a.jpg'], '987515239': [('987515239', 'Carton', 0.99978334, 1927, '1528'), 'temp/1742725522_43872_987515239_b3fa6f29636080b5138c8d8c33fea309.jpg'], '987515240': [('987515240', 'Carton', 0.9995198, 1927, '1528'), 'temp/1742725522_43872_987515240_7829b9b15f1bf128ea4e2c1a39b9f0dd.jpg'], '987515241': [('987515241', 'Carton', 0.9821285, 1927, '1528'), 'temp/1742725522_43872_987515241_073420d938f5f010ffd5b4353c064e09.jpg'], '987515242': [('987515242', 'Carton', 0.93586427, 1927, '1528'), 'temp/1742725522_43872_987515242_327abb5215d6fd1f0aad51f53ed8c324.jpg'], '987515243': [('987515243', 'Papier_Magazine', 0.8743573, 1927, '1528'), 'temp/1742725522_43872_987515243_4375283f3bc5cdaa431c2fc6f17f53a4.jpg'], '987515244': [('987515244', 'Papier_Magazine', 0.8175597, 1927, '1528'), 'temp/1742725522_43872_987515244_419530eaef5ef868f75c758b94eea4b4.jpg'], '987515245': [('987515245', 'Carton', 0.8659064, 1927, '1528'), 'temp/1742725522_43872_987515245_757d9d208d5bd4375c5f21f68b699148.jpg'], '987515230': [('987515230', 'Carton', 0.999406, 1927, '1528'), 'temp/1742725522_43872_987515230_846ad925884264181565c81d152a2e94.jpg'], '987515231': [('987515231', 'Carton', 0.9994211, 1927, '1528'), 'temp/1742725522_43872_987515231_dbf4cafa71b6db4771c5c8f0c25e9cda.jpg'], '987515232': [('987515232', 'Carton', 0.99924564, 1927, '1528'), 'temp/1742725522_43872_987515232_38db7950cdb3c674ee0ad65915b021f3.jpg'], '987515233': [('987515233', 'Carton', 0.9834209, 1927, '1528'), 'temp/1742725522_43872_987515233_a92514bed0e8c5724f2d032d3ab1e2ad.jpg'], '987515234': [('987515234', 'Carton', 0.94483715, 1927, '1528'), 'temp/1742725522_43872_987515234_2eca3480aed0f8b876242675ad99b666.jpg'], '987515235': [('987515235', 'Papier_Magazine', 0.8919634, 1927, '1528'), 'temp/1742725522_43872_987515235_87075955a2f76b3948b47ffe1825ecd9.jpg'], '987515236': [('987515236', 'Papier_Magazine', 0.53620285, 1927, '1528'), 'temp/1742725522_43872_987515236_8b44a98b1aceadad73ed000d65836a9a.jpg'], '987515202': [('987515202', 'Carton', 0.9911049, 1927, '1528'), 'temp/1742725522_43872_987515202_3314bd90d1404f31b827d8925abf2d62.jpg'], '987515204': [('987515204', 'Papier_Magazine', 0.99507576, 1927, '1528'), 'temp/1742725522_43872_987515204_9779c4f9d44360a9c80499e3b01e8a09.jpg'], '987515205': [('987515205', 'Papier_Magazine', 0.9908572, 1927, '1528'), 'temp/1742725522_43872_987515205_fd4b136d0b3a9a1a347942d7191f6fea.jpg'], '987515224': [('987515224', 'Carton', 0.90851814, 1927, '1528'), 'temp/1742725522_43872_987515224_e8747b400e713ecbd08d5b75db4d7568.jpg'], '987515226': [('987515226', 'Papier_Magazine', 0.9869805, 1927, '1528'), 'temp/1742725522_43872_987515226_a18048dca1a77ae086b62cf07759f704.jpg'], '987515227': [('987515227', 'Papier_Magazine', 0.900328, 1927, '1528'), 'temp/1742725522_43872_987515227_e9c45a0e576ec9e44c1379c3fc5fec7c.jpg'], '987515228': [('987515228', 'Papier_Magazine', 0.51978695, 1927, '1528'), 'temp/1742725522_43872_987515228_9f1759f20c9e603bccb9f9879d2f0d54.jpg']} Inside batchDatouExec : verbose : False # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : detect_points list_input_json : [] origin BFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 1 ; length of list_pids : 1 ; length of list_args : 1 time to download the photos : 0.10054969787597656 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : False number of steps : 1 step1:detect_points Sun Mar 23 11:25:50 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step predict points ! Inside try reload ! gpu_mode in detect_points : 1 To load net FromThcl() model_param file didn't exist model_name : learn_refus_upm_blanches_1924 model_type : caffe list file need : ['caffemodel', 'deploy_conv_normal.prototxt', 'deploy_fc.prototxt', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file exist in s3 : ['caffemodel', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file manque in s3 : ['deploy_conv_normal.prototxt', 'deploy_fc.prototxt'] local folder : /data/models_weight/learn_refus_upm_blanches_1924 /data/models_weight/learn_refus_upm_blanches_1924/caffemodel size_local : 45774543 size in s3 : 45774543 create time local : 2021-08-09 05:29:53 create time in s3 : 2021-08-06 19:36:04 caffemodel already exist and didn't need to update /data/models_weight/learn_refus_upm_blanches_1924/deploy.prototxt size_local : 17312 size in s3 : 17312 create time local : 2021-08-09 05:29:53 create time in s3 : 2021-08-06 19:36:03 deploy.prototxt already exist and didn't need to update /data/models_weight/learn_refus_upm_blanches_1924/mean.npy size_local : 1572992 size in s3 : 1572992 create time local : 2021-08-09 05:29:53 create time in s3 : 2021-08-06 19:36:05 mean.npy already exist and didn't need to update /data/models_weight/learn_refus_upm_blanches_1924/synset_words.txt size_local : 218 size in s3 : 218 create time local : 2021-08-09 05:29:53 create time in s3 : 2021-08-06 19:36:04 synset_words.txt already exist and didn't need to update reshape net's input to : (224, 224) origin shape : (10, 3, 224, 224) after reshape : (1, 3, 224, 224) [('data', (1, 3, 224, 224)), ('conv1', (1, 64, 112, 112)), ('pool1', (1, 64, 56, 56)), ('pool1_pool1_0_split_0', (1, 64, 56, 56)), ('pool1_pool1_0_split_1', (1, 64, 56, 56)), ('res2a_branch1', (1, 64, 56, 56)), ('res2a_branch2a', (1, 64, 56, 56)), ('res2a_branch2b', (1, 64, 56, 56)), ('res2a', (1, 64, 56, 56)), ('res2a_res2a_relu_0_split_0', (1, 64, 56, 56)), ('res2a_res2a_relu_0_split_1', (1, 64, 56, 56)), ('res2b_branch2a', (1, 64, 56, 56)), ('res2b_branch2b', (1, 64, 56, 56)), ('res2b', (1, 64, 56, 56)), ('res2b_res2b_relu_0_split_0', (1, 64, 56, 56)), ('res2b_res2b_relu_0_split_1', (1, 64, 56, 56)), ('res3a_branch1', (1, 128, 28, 28)), ('res3a_branch2a', (1, 128, 28, 28)), ('res3a_branch2b', (1, 128, 28, 28)), ('res3a', (1, 128, 28, 28)), ('res3a_res3a_relu_0_split_0', (1, 128, 28, 28)), ('res3a_res3a_relu_0_split_1', (1, 128, 28, 28)), ('res3b_branch2a', (1, 128, 28, 28)), ('res3b_branch2b', (1, 128, 28, 28)), ('res3b', (1, 128, 28, 28)), ('res3b_res3b_relu_0_split_0', (1, 128, 28, 28)), ('res3b_res3b_relu_0_split_1', (1, 128, 28, 28)), ('res4a_branch1', (1, 256, 14, 14)), ('res4a_branch2a', (1, 256, 14, 14)), ('res4a_branch2b', (1, 256, 14, 14)), ('res4a', (1, 256, 14, 14)), ('res4a_res4a_relu_0_split_0', (1, 256, 14, 14)), ('res4a_res4a_relu_0_split_1', (1, 256, 14, 14)), ('res4b_branch2a', (1, 256, 14, 14)), ('res4b_branch2b', (1, 256, 14, 14)), ('res4b', (1, 256, 14, 14)), ('res4b_res4b_relu_0_split_0', (1, 256, 14, 14)), ('res4b_res4b_relu_0_split_1', (1, 256, 14, 14)), ('res5a_branch1', (1, 512, 7, 7)), ('res5a_branch2a', (1, 512, 7, 7)), ('res5a_branch2b', (1, 512, 7, 7)), ('res5a', (1, 512, 7, 7)), ('res5a_res5a_relu_0_split_0', (1, 512, 7, 7)), ('res5a_res5a_relu_0_split_1', (1, 512, 7, 7)), ('res5b_branch2a', (1, 512, 7, 7)), ('res5b_branch2b', (1, 512, 7, 7)), ('res5b', (1, 512, 7, 7)), ('fc2019-10-22_15-02-46', (1, 10, 1, 1)), ('prob', (1, 10, 1, 1))] set image transformer : About to compute detect the points : len(args) : 1 Inside predict_points step exec : nb paths : 1 treate image : temp/1742725550_43872_987515173_91fa471b1a04f95b356afdbaf021f623.jpg size of numpy array img : 2408584 scale method : caffe/skimage size of numpy array img_scale : 2408584 (448, 448, 3) nb_h 8 nb_w 8 size of sub images : (224, 224, 3) size of caffe_input : 38535320 (64, 3, 224, 224) time to do the preprocess : 0.04057717323303223 time to do a prediction : 0.33161139488220215 dict_keys(['prob']) shape of output (64, 10, 1, 1) shape of the out_put heatmap (10, 8, 8) number of sub_photos vertical and horizon 8 8 size of heatmap : (8,8) size of heatmap : (8,8) size of heatmap : (8,8) size of heatmap : (8,8) size of heatmap : (8,8) size of heatmap : (8,8) size of heatmap : (8,8) size of heatmap : (8,8) size of heatmap : (8,8) size of heatmap : (8,8) time spend for datou_step_exec : 1.6074767112731934 time spend to save output : 3.361701965332031e-05 total time spend for step 1 : 1.6075103282928467 caffe_path_current : About to save ! 0 After save, about to update current ! datou_cur_ids : [] len(datou.list_steps) : 1 output : {987515173: [(987515173, 1982, 'Autre_Environement', 112, -1, 112, -1, 6.298429226087032e-12), (987515173, 1982, 'Autre_Environement', 144, -1, 112, -1, 2.45402656529059e-11), (987515173, 1982, 'Autre_Environement', 176, -1, 112, -1, 1.064514609794287e-08), (987515173, 1982, 'Autre_Environement', 208, -1, 112, -1, 4.4310581870377064e-07), (987515173, 1982, 'Autre_Environement', 240, -1, 112, -1, 1.9209041965950746e-06), (987515173, 1982, 'Autre_Environement', 272, -1, 112, -1, 3.7788944609928876e-05), (987515173, 1982, 'Autre_Environement', 304, -1, 112, -1, 0.00012281889212317765), (987515173, 1982, 'Autre_Environement', 336, -1, 112, -1, 2.942921310022939e-05), (987515173, 1982, 'Autre_Environement', 112, -1, 144, -1, 2.3636319568254294e-08), (987515173, 1982, 'Autre_Environement', 144, -1, 144, -1, 2.2121106724171113e-08), (987515173, 1982, 'Autre_Environement', 176, -1, 144, -1, 1.374756379846076e-07), (987515173, 1982, 'Autre_Environement', 208, -1, 144, -1, 1.4786736528549227e-06), (987515173, 1982, 'Autre_Environement', 240, -1, 144, -1, 1.1247646398260258e-05), (987515173, 1982, 'Autre_Environement', 272, -1, 144, -1, 0.00015747640281915665), (987515173, 1982, 'Autre_Environement', 304, -1, 144, -1, 0.0004448047839105129), (987515173, 1982, 'Autre_Environement', 336, -1, 144, -1, 6.549868703586981e-05), (987515173, 1982, 'Autre_Environement', 112, -1, 176, -1, 1.3393596418609377e-06), (987515173, 1982, 'Autre_Environement', 144, -1, 176, -1, 1.6200876871153014e-06), (987515173, 1982, 'Autre_Environement', 176, -1, 176, -1, 2.5217484562745085e-06), (987515173, 1982, 'Autre_Environement', 208, -1, 176, -1, 1.614485654499731e-06), (987515173, 1982, 'Autre_Environement', 240, -1, 176, -1, 6.258012035686988e-06), (987515173, 1982, 'Autre_Environement', 272, -1, 176, -1, 8.66023256094195e-05), (987515173, 1982, 'Autre_Environement', 304, -1, 176, -1, 0.0003268145374022424), (987515173, 1982, 'Autre_Environement', 336, -1, 176, -1, 0.00030439477995969355), (987515173, 1982, 'Autre_Environement', 112, -1, 208, -1, 1.858560244727414e-05), (987515173, 1982, 'Autre_Environement', 144, -1, 208, -1, 7.941636795294471e-06), (987515173, 1982, 'Autre_Environement', 176, -1, 208, -1, 2.7104333639726974e-05), (987515173, 1982, 'Autre_Environement', 208, -1, 208, -1, 1.799932033463847e-05), (987515173, 1982, 'Autre_Environement', 240, -1, 208, -1, 2.3427564883604646e-05), (987515173, 1982, 'Autre_Environement', 272, -1, 208, -1, 1.697994775895495e-05), (987515173, 1982, 'Autre_Environement', 304, -1, 208, -1, 4.5392093852569815e-06), (987515173, 1982, 'Autre_Environement', 336, -1, 208, -1, 8.826614248391706e-06), (987515173, 1982, 'Autre_Environement', 112, -1, 240, -1, 6.206920716067543e-06), (987515173, 1982, 'Autre_Environement', 144, -1, 240, -1, 1.6482541695950204e-06), (987515173, 1982, 'Autre_Environement', 176, -1, 240, -1, 1.965183173524565e-06), (987515173, 1982, 'Autre_Environement', 208, -1, 240, -1, 1.4532406567013822e-06), (987515173, 1982, 'Autre_Environement', 240, -1, 240, -1, 7.857755008444656e-06), (987515173, 1982, 'Autre_Environement', 272, -1, 240, -1, 1.2823249562643468e-05), (987515173, 1982, 'Autre_Environement', 304, -1, 240, -1, 9.355127076560166e-06), (987515173, 1982, 'Autre_Environement', 336, -1, 240, -1, 2.1692630980396643e-05), (987515173, 1982, 'Autre_Environement', 112, -1, 272, -1, 3.822400231001666e-06), (987515173, 1982, 'Autre_Environement', 144, -1, 272, -1, 2.5474637368461117e-06), (987515173, 1982, 'Autre_Environement', 176, -1, 272, -1, 2.959025550808292e-06), (987515173, 1982, 'Autre_Environement', 208, -1, 272, -1, 2.756835101536126e-06), (987515173, 1982, 'Autre_Environement', 240, -1, 272, -1, 4.318437731853919e-06), (987515173, 1982, 'Autre_Environement', 272, -1, 272, -1, 8.18479838926578e-06), (987515173, 1982, 'Autre_Environement', 304, -1, 272, -1, 1.1520990483404603e-05), (987515173, 1982, 'Autre_Environement', 336, -1, 272, -1, 4.015783633803949e-05), (987515173, 1982, 'Autre_Environement', 112, -1, 304, -1, 1.206682554766303e-05), (987515173, 1982, 'Autre_Environement', 144, -1, 304, -1, 1.5687932318542153e-05), (987515173, 1982, 'Autre_Environement', 176, -1, 304, -1, 3.3525688195368275e-05), (987515173, 1982, 'Autre_Environement', 208, -1, 304, -1, 0.00015562264889013022), (987515173, 1982, 'Autre_Environement', 240, -1, 304, -1, 0.0002589668147265911), (987515173, 1982, 'Autre_Environement', 272, -1, 304, -1, 0.0001877034519566223), (987515173, 1982, 'Autre_Environement', 304, -1, 304, -1, 0.00021322499378584325), (987515173, 1982, 'Autre_Environement', 336, -1, 304, -1, 0.00016430731920991093), (987515173, 1982, 'Autre_Environement', 112, -1, 336, -1, 4.5438314373313915e-06), (987515173, 1982, 'Autre_Environement', 144, -1, 336, -1, 1.7363974620820954e-05), (987515173, 1982, 'Autre_Environement', 176, -1, 336, -1, 4.9320438847644255e-05), (987515173, 1982, 'Autre_Environement', 208, -1, 336, -1, 0.00012153632997069508), (987515173, 1982, 'Autre_Environement', 240, -1, 336, -1, 0.00019602509564720094), (987515173, 1982, 'Autre_Environement', 272, -1, 336, -1, 0.00018794926290865988), (987515173, 1982, 'Autre_Environement', 304, -1, 336, -1, 0.00012361438712105155), (987515173, 1982, 'Autre_Environement', 336, -1, 336, -1, 0.00027098573627881706), (987515173, 1982, 'Carton', 112, -1, 112, -1, 1.5767797378885007e-07), (987515173, 1982, 'Carton', 144, -1, 112, -1, 4.068970611115219e-06), (987515173, 1982, 'Carton', 176, -1, 112, -1, 7.032145276752999e-06), (987515173, 1982, 'Carton', 208, -1, 112, -1, 0.0008716002921573818), (987515173, 1982, 'Carton', 240, -1, 112, -1, 0.002642825013026595), (987515173, 1982, 'Carton', 272, -1, 112, -1, 0.0033812117762863636), (987515173, 1982, 'Carton', 304, -1, 112, -1, 0.031318895518779755), (987515173, 1982, 'Carton', 336, -1, 112, -1, 0.0557485967874527), (987515173, 1982, 'Carton', 112, -1, 144, -1, 0.00012461180449463427), (987515173, 1982, 'Carton', 144, -1, 144, -1, 0.00020859089272562414), (987515173, 1982, 'Carton', 176, -1, 144, -1, 0.0003661782538983971), (987515173, 1982, 'Carton', 208, -1, 144, -1, 0.0068477303721010685), (987515173, 1982, 'Carton', 240, -1, 144, -1, 0.01579945720732212), (987515173, 1982, 'Carton', 272, -1, 144, -1, 0.009396955370903015), (987515173, 1982, 'Carton', 304, -1, 144, -1, 0.009771112352609634), (987515173, 1982, 'Carton', 336, -1, 144, -1, 0.02206537500023842), (987515173, 1982, 'Carton', 112, -1, 176, -1, 0.021948328241705894), (987515173, 1982, 'Carton', 144, -1, 176, -1, 0.19252631068229675), (987515173, 1982, 'Carton', 176, -1, 176, -1, 0.09660713374614716), (987515173, 1982, 'Carton', 208, -1, 176, -1, 0.12361752241849899), (987515173, 1982, 'Carton', 240, -1, 176, -1, 0.5330812931060791), (987515173, 1982, 'Carton', 272, -1, 176, -1, 0.4598572850227356), (987515173, 1982, 'Carton', 304, -1, 176, -1, 0.7720054388046265), (987515173, 1982, 'Carton', 336, -1, 176, -1, 0.8662400245666504), (987515173, 1982, 'Carton', 112, -1, 208, -1, 0.850604772567749), (987515173, 1982, 'Carton', 144, -1, 208, -1, 0.9843019247055054), (987515173, 1982, 'Carton', 176, -1, 208, -1, 0.9846624135971069), (987515173, 1982, 'Carton', 208, -1, 208, -1, 0.9919398427009583), (987515173, 1982, 'Carton', 240, -1, 208, -1, 0.9993793964385986), (987515173, 1982, 'Carton', 272, -1, 208, -1, 0.9994118213653564), (987515173, 1982, 'Carton', 304, -1, 208, -1, 0.9995877146720886), (987515173, 1982, 'Carton', 336, -1, 208, -1, 0.9992251396179199), (987515173, 1982, 'Carton', 112, -1, 240, -1, 0.9295632839202881), (987515173, 1982, 'Carton', 144, -1, 240, -1, 0.980987548828125), (987515173, 1982, 'Carton', 176, -1, 240, -1, 0.9660825729370117), (987515173, 1982, 'Carton', 208, -1, 240, -1, 0.9686527252197266), (987515173, 1982, 'Carton', 240, -1, 240, -1, 0.9963879585266113), (987515173, 1982, 'Carton', 272, -1, 240, -1, 0.9994214773178101), (987515173, 1982, 'Carton', 304, -1, 240, -1, 0.999784529209137), (987515173, 1982, 'Carton', 336, -1, 240, -1, 0.9996689558029175), (987515173, 1982, 'Carton', 112, -1, 272, -1, 0.989509105682373), (987515173, 1982, 'Carton', 144, -1, 272, -1, 0.9954695701599121), (987515173, 1982, 'Carton', 176, -1, 272, -1, 0.985535740852356), (987515173, 1982, 'Carton', 208, -1, 272, -1, 0.9732249975204468), (987515173, 1982, 'Carton', 240, -1, 272, -1, 0.9974697828292847), (987515173, 1982, 'Carton', 272, -1, 272, -1, 0.9992002844810486), (987515173, 1982, 'Carton', 304, -1, 272, -1, 0.9995174407958984), (987515173, 1982, 'Carton', 336, -1, 272, -1, 0.9991117119789124), (987515173, 1982, 'Carton', 112, -1, 304, -1, 0.997776448726654), (987515173, 1982, 'Carton', 144, -1, 304, -1, 0.9977588653564453), (987515173, 1982, 'Carton', 176, -1, 304, -1, 0.9955574870109558), (987515173, 1982, 'Carton', 208, -1, 304, -1, 0.9927427768707275), (987515173, 1982, 'Carton', 240, -1, 304, -1, 0.9920509457588196), (987515173, 1982, 'Carton', 272, -1, 304, -1, 0.9835404753684998), (987515173, 1982, 'Carton', 304, -1, 304, -1, 0.9819942116737366), (987515173, 1982, 'Carton', 336, -1, 304, -1, 0.9808433651924133), (987515173, 1982, 'Carton', 112, -1, 336, -1, 0.9924429059028625), (987515173, 1982, 'Carton', 144, -1, 336, -1, 0.976182222366333), (987515173, 1982, 'Carton', 176, -1, 336, -1, 0.9911770820617676), (987515173, 1982, 'Carton', 208, -1, 336, -1, 0.9869307279586792), (987515173, 1982, 'Carton', 240, -1, 336, -1, 0.9084459543228149), (987515173, 1982, 'Carton', 272, -1, 336, -1, 0.9453045725822449), (987515173, 1982, 'Carton', 304, -1, 336, -1, 0.9366440773010254), (987515173, 1982, 'Carton', 336, -1, 336, -1, 0.9808643460273743), (987515173, 1982, 'Kraft', 112, -1, 112, -1, 1.949684635960125e-09), (987515173, 1982, 'Kraft', 144, -1, 112, -1, 1.7105380223370048e-08), (987515173, 1982, 'Kraft', 176, -1, 112, -1, 9.674859029473737e-07), (987515173, 1982, 'Kraft', 208, -1, 112, -1, 3.1260169635061175e-05), (987515173, 1982, 'Kraft', 240, -1, 112, -1, 4.441281271283515e-05), (987515173, 1982, 'Kraft', 272, -1, 112, -1, 0.0002065751323243603), (987515173, 1982, 'Kraft', 304, -1, 112, -1, 0.0010803168406710029), (987515173, 1982, 'Kraft', 336, -1, 112, -1, 0.0008277156739495695), (987515173, 1982, 'Kraft', 112, -1, 144, -1, 2.621038402139675e-05), (987515173, 1982, 'Kraft', 144, -1, 144, -1, 7.013700269453693e-06), (987515173, 1982, 'Kraft', 176, -1, 144, -1, 3.6103940601606155e-06), (987515173, 1982, 'Kraft', 208, -1, 144, -1, 3.5675486287800595e-05), (987515173, 1982, 'Kraft', 240, -1, 144, -1, 6.672133895335719e-05), (987515173, 1982, 'Kraft', 272, -1, 144, -1, 8.680358587298542e-05), (987515173, 1982, 'Kraft', 304, -1, 144, -1, 0.0001224404841195792), (987515173, 1982, 'Kraft', 336, -1, 144, -1, 0.00011251147952862084), (987515173, 1982, 'Kraft', 112, -1, 176, -1, 0.0004975548945367336), (987515173, 1982, 'Kraft', 144, -1, 176, -1, 0.00012235154281370342), (987515173, 1982, 'Kraft', 176, -1, 176, -1, 9.107388177653775e-05), (987515173, 1982, 'Kraft', 208, -1, 176, -1, 5.1688155508600175e-05), (987515173, 1982, 'Kraft', 240, -1, 176, -1, 0.00011508285388117656), (987515173, 1982, 'Kraft', 272, -1, 176, -1, 0.00043284831917844713), (987515173, 1982, 'Kraft', 304, -1, 176, -1, 0.0009202859946526587), (987515173, 1982, 'Kraft', 336, -1, 176, -1, 0.0014253410045057535), (987515173, 1982, 'Kraft', 112, -1, 208, -1, 6.869374919915572e-05), (987515173, 1982, 'Kraft', 144, -1, 208, -1, 1.850462649599649e-05), (987515173, 1982, 'Kraft', 176, -1, 208, -1, 2.588482493592892e-05), (987515173, 1982, 'Kraft', 208, -1, 208, -1, 3.551975896698423e-05), (987515173, 1982, 'Kraft', 240, -1, 208, -1, 3.734938218258321e-05), (987515173, 1982, 'Kraft', 272, -1, 208, -1, 8.672834519529715e-05), (987515173, 1982, 'Kraft', 304, -1, 208, -1, 0.00012373006029520184), (987515173, 1982, 'Kraft', 336, -1, 208, -1, 0.0003918699803762138), (987515173, 1982, 'Kraft', 112, -1, 240, -1, 0.00030746861011721194), (987515173, 1982, 'Kraft', 144, -1, 240, -1, 4.174495552433655e-05), (987515173, 1982, 'Kraft', 176, -1, 240, -1, 1.2206062820041552e-05), (987515173, 1982, 'Kraft', 208, -1, 240, -1, 7.219758117571473e-06), (987515173, 1982, 'Kraft', 240, -1, 240, -1, 2.2967131371842697e-05), (987515173, 1982, 'Kraft', 272, -1, 240, -1, 5.837661956320517e-05), (987515173, 1982, 'Kraft', 304, -1, 240, -1, 6.656590267084539e-05), (987515173, 1982, 'Kraft', 336, -1, 240, -1, 0.00018682934751268476), (987515173, 1982, 'Kraft', 112, -1, 272, -1, 0.0014564612647518516), (987515173, 1982, 'Kraft', 144, -1, 272, -1, 0.0006902076420374215), (987515173, 1982, 'Kraft', 176, -1, 272, -1, 0.00027360409148968756), (987515173, 1982, 'Kraft', 208, -1, 272, -1, 4.362126128398813e-05), (987515173, 1982, 'Kraft', 240, -1, 272, -1, 3.341681440360844e-05), (987515173, 1982, 'Kraft', 272, -1, 272, -1, 8.367296686628833e-05), (987515173, 1982, 'Kraft', 304, -1, 272, -1, 0.00011144861491629854), (987515173, 1982, 'Kraft', 336, -1, 272, -1, 0.00043357914546504617), (987515173, 1982, 'Kraft', 112, -1, 304, -1, 0.00099150778260082), (987515173, 1982, 'Kraft', 144, -1, 304, -1, 0.0009060725569725037), (987515173, 1982, 'Kraft', 176, -1, 304, -1, 0.0006190104177221656), (987515173, 1982, 'Kraft', 208, -1, 304, -1, 0.0010862441267818213), (987515173, 1982, 'Kraft', 240, -1, 304, -1, 0.0017846034606918693), (987515173, 1982, 'Kraft', 272, -1, 304, -1, 0.004675894510000944), (987515173, 1982, 'Kraft', 304, -1, 304, -1, 0.004673653282225132), (987515173, 1982, 'Kraft', 336, -1, 304, -1, 0.012514173984527588), (987515173, 1982, 'Kraft', 112, -1, 336, -1, 0.002181007992476225), (987515173, 1982, 'Kraft', 144, -1, 336, -1, 0.005726435221731663), (987515173, 1982, 'Kraft', 176, -1, 336, -1, 0.0008304667426273227), (987515173, 1982, 'Kraft', 208, -1, 336, -1, 0.0012644988019019365), (987515173, 1982, 'Kraft', 240, -1, 336, -1, 0.007795265875756741), (987515173, 1982, 'Kraft', 272, -1, 336, -1, 0.012524516321718693), (987515173, 1982, 'Kraft', 304, -1, 336, -1, 0.017936762422323227), (987515173, 1982, 'Kraft', 336, -1, 336, -1, 0.007747850380837917), (987515173, 1982, 'Lointain_Papier_Magazine', 112, -1, 112, -1, 1.501432450590201e-10), (987515173, 1982, 'Lointain_Papier_Magazine', 144, -1, 112, -1, 8.231896053700893e-09), (987515173, 1982, 'Lointain_Papier_Magazine', 176, -1, 112, -1, 5.516202463695663e-07), (987515173, 1982, 'Lointain_Papier_Magazine', 208, -1, 112, -1, 5.483711902343202e-06), (987515173, 1982, 'Lointain_Papier_Magazine', 240, -1, 112, -1, 8.236050234700087e-06), (987515173, 1982, 'Lointain_Papier_Magazine', 272, -1, 112, -1, 3.566244413377717e-05), (987515173, 1982, 'Lointain_Papier_Magazine', 304, -1, 112, -1, 8.155965770129114e-05), (987515173, 1982, 'Lointain_Papier_Magazine', 336, -1, 112, -1, 4.2158942960668355e-05), (987515173, 1982, 'Lointain_Papier_Magazine', 112, -1, 144, -1, 3.6332502872937766e-07), (987515173, 1982, 'Lointain_Papier_Magazine', 144, -1, 144, -1, 1.3111535963616916e-06), (987515173, 1982, 'Lointain_Papier_Magazine', 176, -1, 144, -1, 2.465604438839364e-06), (987515173, 1982, 'Lointain_Papier_Magazine', 208, -1, 144, -1, 3.4674997095862636e-06), (987515173, 1982, 'Lointain_Papier_Magazine', 240, -1, 144, -1, 5.68376162846107e-06), (987515173, 1982, 'Lointain_Papier_Magazine', 272, -1, 144, -1, 2.0550090994220227e-05), (987515173, 1982, 'Lointain_Papier_Magazine', 304, -1, 144, -1, 3.9061360439518467e-05), (987515173, 1982, 'Lointain_Papier_Magazine', 336, -1, 144, -1, 1.368015455227578e-05), (987515173, 1982, 'Lointain_Papier_Magazine', 112, -1, 176, -1, 3.923274789485731e-07), (987515173, 1982, 'Lointain_Papier_Magazine', 144, -1, 176, -1, 2.555451146690757e-06), (987515173, 1982, 'Lointain_Papier_Magazine', 176, -1, 176, -1, 1.20145368782687e-05), (987515173, 1982, 'Lointain_Papier_Magazine', 208, -1, 176, -1, 7.812083822500426e-06), (987515173, 1982, 'Lointain_Papier_Magazine', 240, -1, 176, -1, 6.344333087326959e-06), (987515173, 1982, 'Lointain_Papier_Magazine', 272, -1, 176, -1, 2.6384019292891026e-05), (987515173, 1982, 'Lointain_Papier_Magazine', 304, -1, 176, -1, 3.914153785444796e-05), (987515173, 1982, 'Lointain_Papier_Magazine', 336, -1, 176, -1, 1.8428894691169262e-05), (987515173, 1982, 'Lointain_Papier_Magazine', 112, -1, 208, -1, 1.7949603261513403e-06), (987515173, 1982, 'Lointain_Papier_Magazine', 144, -1, 208, -1, 5.707778427677113e-07), (987515173, 1982, 'Lointain_Papier_Magazine', 176, -1, 208, -1, 2.202718633270706e-06), (987515173, 1982, 'Lointain_Papier_Magazine', 208, -1, 208, -1, 1.7376274854541407e-06), (987515173, 1982, 'Lointain_Papier_Magazine', 240, -1, 208, -1, 3.993609141161869e-07), (987515173, 1982, 'Lointain_Papier_Magazine', 272, -1, 208, -1, 2.0310648096710793e-07), (987515173, 1982, 'Lointain_Papier_Magazine', 304, -1, 208, -1, 9.864586303365286e-08), (987515173, 1982, 'Lointain_Papier_Magazine', 336, -1, 208, -1, 8.697298170545764e-08), (987515173, 1982, 'Lointain_Papier_Magazine', 112, -1, 240, -1, 1.815025029827666e-06), (987515173, 1982, 'Lointain_Papier_Magazine', 144, -1, 240, -1, 6.336908313642198e-07), (987515173, 1982, 'Lointain_Papier_Magazine', 176, -1, 240, -1, 7.8295374805748e-07), (987515173, 1982, 'Lointain_Papier_Magazine', 208, -1, 240, -1, 6.340636673485278e-07), (987515173, 1982, 'Lointain_Papier_Magazine', 240, -1, 240, -1, 7.714525622759538e-07), (987515173, 1982, 'Lointain_Papier_Magazine', 272, -1, 240, -1, 5.181414053367916e-07), (987515173, 1982, 'Lointain_Papier_Magazine', 304, -1, 240, -1, 1.784918310931971e-07), (987515173, 1982, 'Lointain_Papier_Magazine', 336, -1, 240, -1, 1.44334649121447e-07), (987515173, 1982, 'Lointain_Papier_Magazine', 112, -1, 272, -1, 4.1790974592004204e-07), (987515173, 1982, 'Lointain_Papier_Magazine', 144, -1, 272, -1, 3.168140381148987e-07), (987515173, 1982, 'Lointain_Papier_Magazine', 176, -1, 272, -1, 5.080476057628402e-07), (987515173, 1982, 'Lointain_Papier_Magazine', 208, -1, 272, -1, 7.363583449659927e-07), (987515173, 1982, 'Lointain_Papier_Magazine', 240, -1, 272, -1, 4.0270791146213014e-07), (987515173, 1982, 'Lointain_Papier_Magazine', 272, -1, 272, -1, 3.229922072023328e-07), (987515173, 1982, 'Lointain_Papier_Magazine', 304, -1, 272, -1, 2.098127112049042e-07), (987515173, 1982, 'Lointain_Papier_Magazine', 336, -1, 272, -1, 3.541234150361561e-07), (987515173, 1982, 'Lointain_Papier_Magazine', 112, -1, 304, -1, 3.294898078820552e-07), (987515173, 1982, 'Lointain_Papier_Magazine', 144, -1, 304, -1, 3.256115519434388e-07), (987515173, 1982, 'Lointain_Papier_Magazine', 176, -1, 304, -1, 8.374123012799828e-07), (987515173, 1982, 'Lointain_Papier_Magazine', 208, -1, 304, -1, 3.315959475003183e-06), (987515173, 1982, 'Lointain_Papier_Magazine', 240, -1, 304, -1, 4.413529040903086e-06), (987515173, 1982, 'Lointain_Papier_Magazine', 272, -1, 304, -1, 5.0293642743781675e-06), (987515173, 1982, 'Lointain_Papier_Magazine', 304, -1, 304, -1, 8.193695975933224e-06), (987515173, 1982, 'Lointain_Papier_Magazine', 336, -1, 304, -1, 5.571038855123334e-06), (987515173, 1982, 'Lointain_Papier_Magazine', 112, -1, 336, -1, 4.187884314887924e-07), (987515173, 1982, 'Lointain_Papier_Magazine', 144, -1, 336, -1, 8.227358421208919e-07), (987515173, 1982, 'Lointain_Papier_Magazine', 176, -1, 336, -1, 7.14386487743468e-07), (987515173, 1982, 'Lointain_Papier_Magazine', 208, -1, 336, -1, 1.9528629309206735e-06), (987515173, 1982, 'Lointain_Papier_Magazine', 240, -1, 336, -1, 3.915190518455347e-06), (987515173, 1982, 'Lointain_Papier_Magazine', 272, -1, 336, -1, 2.4562743874412263e-06), (987515173, 1982, 'Lointain_Papier_Magazine', 304, -1, 336, -1, 3.4361498819635017e-06), (987515173, 1982, 'Lointain_Papier_Magazine', 336, -1, 336, -1, 4.829672889172798e-06), (987515173, 1982, 'Metal', 112, -1, 112, -1, 7.414321240295507e-11), (987515173, 1982, 'Metal', 144, -1, 112, -1, 1.931623749840128e-09), (987515173, 1982, 'Metal', 176, -1, 112, -1, 7.309376997000072e-07), (987515173, 1982, 'Metal', 208, -1, 112, -1, 9.432567821932025e-06), (987515173, 1982, 'Metal', 240, -1, 112, -1, 2.6560979677014984e-05), (987515173, 1982, 'Metal', 272, -1, 112, -1, 0.00016943278023973107), (987515173, 1982, 'Metal', 304, -1, 112, -1, 0.0007554899784736335), (987515173, 1982, 'Metal', 336, -1, 112, -1, 0.0003026246267836541), (987515173, 1982, 'Metal', 112, -1, 144, -1, 5.318711941981746e-07), (987515173, 1982, 'Metal', 144, -1, 144, -1, 4.3848129394064017e-07), (987515173, 1982, 'Metal', 176, -1, 144, -1, 3.1784563816472655e-06), (987515173, 1982, 'Metal', 208, -1, 144, -1, 9.61152727541048e-06), (987515173, 1982, 'Metal', 240, -1, 144, -1, 1.6493913790327497e-05), (987515173, 1982, 'Metal', 272, -1, 144, -1, 7.624355930602178e-05), (987515173, 1982, 'Metal', 304, -1, 144, -1, 0.0001312868407694623), (987515173, 1982, 'Metal', 336, -1, 144, -1, 4.6703764382982627e-05), (987515173, 1982, 'Metal', 112, -1, 176, -1, 5.905976649955846e-06), (987515173, 1982, 'Metal', 144, -1, 176, -1, 4.017932042188477e-06), (987515173, 1982, 'Metal', 176, -1, 176, -1, 1.014124063658528e-05), (987515173, 1982, 'Metal', 208, -1, 176, -1, 4.1563448576198425e-06), (987515173, 1982, 'Metal', 240, -1, 176, -1, 6.644531822530553e-06), (987515173, 1982, 'Metal', 272, -1, 176, -1, 5.4466680012410507e-05), (987515173, 1982, 'Metal', 304, -1, 176, -1, 0.0001287733030039817), (987515173, 1982, 'Metal', 336, -1, 176, -1, 6.542421033373103e-05), (987515173, 1982, 'Metal', 112, -1, 208, -1, 8.117451216094196e-06), (987515173, 1982, 'Metal', 144, -1, 208, -1, 2.2591048036701977e-06), (987515173, 1982, 'Metal', 176, -1, 208, -1, 6.669669346592855e-06), (987515173, 1982, 'Metal', 208, -1, 208, -1, 4.586349859891925e-06), (987515173, 1982, 'Metal', 240, -1, 208, -1, 1.7121438986578141e-06), (987515173, 1982, 'Metal', 272, -1, 208, -1, 1.3729218153457623e-06), (987515173, 1982, 'Metal', 304, -1, 208, -1, 5.789302690573095e-07), (987515173, 1982, 'Metal', 336, -1, 208, -1, 8.344427442352753e-07), (987515173, 1982, 'Metal', 112, -1, 240, -1, 2.932962615886936e-06), (987515173, 1982, 'Metal', 144, -1, 240, -1, 7.400842605420621e-07), (987515173, 1982, 'Metal', 176, -1, 240, -1, 6.082815957597631e-07), (987515173, 1982, 'Metal', 208, -1, 240, -1, 6.183297500683693e-07), (987515173, 1982, 'Metal', 240, -1, 240, -1, 1.1986587651335867e-06), (987515173, 1982, 'Metal', 272, -1, 240, -1, 6.965297529859527e-07), (987515173, 1982, 'Metal', 304, -1, 240, -1, 3.169957665249967e-07), (987515173, 1982, 'Metal', 336, -1, 240, -1, 4.117256082736276e-07), (987515173, 1982, 'Metal', 112, -1, 272, -1, 2.6178311145486077e-06), (987515173, 1982, 'Metal', 144, -1, 272, -1, 8.043870138862985e-07), (987515173, 1982, 'Metal', 176, -1, 272, -1, 8.210619739656977e-07), (987515173, 1982, 'Metal', 208, -1, 272, -1, 4.0183638816415623e-07), (987515173, 1982, 'Metal', 240, -1, 272, -1, 2.7392769652578863e-07), (987515173, 1982, 'Metal', 272, -1, 272, -1, 3.31640819695167e-07), (987515173, 1982, 'Metal', 304, -1, 272, -1, 3.430768913403881e-07), (987515173, 1982, 'Metal', 336, -1, 272, -1, 1.5010489278211026e-06), (987515173, 1982, 'Metal', 112, -1, 304, -1, 2.310299805685645e-06), (987515173, 1982, 'Metal', 144, -1, 304, -1, 1.9508859168126946e-06), (987515173, 1982, 'Metal', 176, -1, 304, -1, 4.536827873380389e-06), (987515173, 1982, 'Metal', 208, -1, 304, -1, 1.3340574696485419e-05), (987515173, 1982, 'Metal', 240, -1, 304, -1, 5.6397707339783665e-06), (987515173, 1982, 'Metal', 272, -1, 304, -1, 5.676900855178246e-06), (987515173, 1982, 'Metal', 304, -1, 304, -1, 6.364010459947167e-06), (987515173, 1982, 'Metal', 336, -1, 304, -1, 7.370333150902297e-06), (987515173, 1982, 'Metal', 112, -1, 336, -1, 7.134467978175962e-06), (987515173, 1982, 'Metal', 144, -1, 336, -1, 3.321875192341395e-05), (987515173, 1982, 'Metal', 176, -1, 336, -1, 4.019432526547462e-05), (987515173, 1982, 'Metal', 208, -1, 336, -1, 7.589962478959933e-05), (987515173, 1982, 'Metal', 240, -1, 336, -1, 0.00012127422814955935), (987515173, 1982, 'Metal', 272, -1, 336, -1, 3.715099592227489e-05), (987515173, 1982, 'Metal', 304, -1, 336, -1, 2.9077929866616614e-05), (987515173, 1982, 'Metal', 336, -1, 336, -1, 2.7971667805104516e-05), (987515173, 1982, 'Papier_Magazine', 112, -1, 112, -1, 0.9999953508377075), (987515173, 1982, 'Papier_Magazine', 144, -1, 112, -1, 0.9999926090240479), (987515173, 1982, 'Papier_Magazine', 176, -1, 112, -1, 0.9999085664749146), (987515173, 1982, 'Papier_Magazine', 208, -1, 112, -1, 0.9949613809585571), (987515173, 1982, 'Papier_Magazine', 240, -1, 112, -1, 0.993772566318512), (987515173, 1982, 'Papier_Magazine', 272, -1, 112, -1, 0.9866711497306824), (987515173, 1982, 'Papier_Magazine', 304, -1, 112, -1, 0.8921157121658325), (987515173, 1982, 'Papier_Magazine', 336, -1, 112, -1, 0.8722192645072937), (987515173, 1982, 'Papier_Magazine', 112, -1, 144, -1, 0.9998137354850769), (987515173, 1982, 'Papier_Magazine', 144, -1, 144, -1, 0.9997426867485046), (987515173, 1982, 'Papier_Magazine', 176, -1, 144, -1, 0.9994155168533325), (987515173, 1982, 'Papier_Magazine', 208, -1, 144, -1, 0.9911862015724182), (987515173, 1982, 'Papier_Magazine', 240, -1, 144, -1, 0.9782341122627258), (987515173, 1982, 'Papier_Magazine', 272, -1, 144, -1, 0.900679886341095), (987515173, 1982, 'Papier_Magazine', 304, -1, 144, -1, 0.5356779098510742), (987515173, 1982, 'Papier_Magazine', 336, -1, 144, -1, 0.8108181953430176), (987515173, 1982, 'Papier_Magazine', 112, -1, 176, -1, 0.9775118827819824), (987515173, 1982, 'Papier_Magazine', 144, -1, 176, -1, 0.8071126341819763), (987515173, 1982, 'Papier_Magazine', 176, -1, 176, -1, 0.9026739001274109), (987515173, 1982, 'Papier_Magazine', 208, -1, 176, -1, 0.8750936388969421), (987515173, 1982, 'Papier_Magazine', 240, -1, 176, -1, 0.4654695689678192), (987515173, 1982, 'Papier_Magazine', 272, -1, 176, -1, 0.5261279940605164), (987515173, 1982, 'Papier_Magazine', 304, -1, 176, -1, 0.16581715643405914), (987515173, 1982, 'Papier_Magazine', 336, -1, 176, -1, 0.11062764376401901), (987515173, 1982, 'Papier_Magazine', 112, -1, 208, -1, 0.14911460876464844), (987515173, 1982, 'Papier_Magazine', 144, -1, 208, -1, 0.01543952152132988), (987515173, 1982, 'Papier_Magazine', 176, -1, 208, -1, 0.014867511577904224), (987515173, 1982, 'Papier_Magazine', 208, -1, 208, -1, 0.007599346339702606), (987515173, 1982, 'Papier_Magazine', 240, -1, 208, -1, 0.00034619326470419765), (987515173, 1982, 'Papier_Magazine', 272, -1, 208, -1, 0.00017064172425307333), (987515173, 1982, 'Papier_Magazine', 304, -1, 208, -1, 5.3725460020359606e-05), (987515173, 1982, 'Papier_Magazine', 336, -1, 208, -1, 6.251565355341882e-05), (987515173, 1982, 'Papier_Magazine', 112, -1, 240, -1, 0.0696914866566658), (987515173, 1982, 'Papier_Magazine', 144, -1, 240, -1, 0.0188180822879076), (987515173, 1982, 'Papier_Magazine', 176, -1, 240, -1, 0.03381170332431793), (987515173, 1982, 'Papier_Magazine', 208, -1, 240, -1, 0.03130260854959488), (987515173, 1982, 'Papier_Magazine', 240, -1, 240, -1, 0.0034952196292579174), (987515173, 1982, 'Papier_Magazine', 272, -1, 240, -1, 0.0003413982631172985), (987515173, 1982, 'Papier_Magazine', 304, -1, 240, -1, 2.9799339245073497e-05), (987515173, 1982, 'Papier_Magazine', 336, -1, 240, -1, 1.638093999645207e-05), (987515173, 1982, 'Papier_Magazine', 112, -1, 272, -1, 0.008521762676537037), (987515173, 1982, 'Papier_Magazine', 144, -1, 272, -1, 0.003645838238298893), (987515173, 1982, 'Papier_Magazine', 176, -1, 272, -1, 0.014004400931298733), (987515173, 1982, 'Papier_Magazine', 208, -1, 272, -1, 0.026656053960323334), (987515173, 1982, 'Papier_Magazine', 240, -1, 272, -1, 0.0024547206703573465), (987515173, 1982, 'Papier_Magazine', 272, -1, 272, -1, 0.0006480537122115493), (987515173, 1982, 'Papier_Magazine', 304, -1, 272, -1, 0.00027477386174723506), (987515173, 1982, 'Papier_Magazine', 336, -1, 272, -1, 0.00015938145224936306), (987515173, 1982, 'Papier_Magazine', 112, -1, 304, -1, 0.0010026550153270364), (987515173, 1982, 'Papier_Magazine', 144, -1, 304, -1, 0.0009858990088105202), (987515173, 1982, 'Papier_Magazine', 176, -1, 304, -1, 0.0031919144093990326), (987515173, 1982, 'Papier_Magazine', 208, -1, 304, -1, 0.0050182887353003025), (987515173, 1982, 'Papier_Magazine', 240, -1, 304, -1, 0.003486677771434188), (987515173, 1982, 'Papier_Magazine', 272, -1, 304, -1, 0.004076066892594099), (987515173, 1982, 'Papier_Magazine', 304, -1, 304, -1, 0.0072371261194348335), (987515173, 1982, 'Papier_Magazine', 336, -1, 304, -1, 0.0019574593752622604), (987515173, 1982, 'Papier_Magazine', 112, -1, 336, -1, 0.004859709180891514), (987515173, 1982, 'Papier_Magazine', 144, -1, 336, -1, 0.015505039133131504), (987515173, 1982, 'Papier_Magazine', 176, -1, 336, -1, 0.006784310098737478), (987515173, 1982, 'Papier_Magazine', 208, -1, 336, -1, 0.007989268749952316), (987515173, 1982, 'Papier_Magazine', 240, -1, 336, -1, 0.019048118963837624), (987515173, 1982, 'Papier_Magazine', 272, -1, 336, -1, 0.0036598769947886467), (987515173, 1982, 'Papier_Magazine', 304, -1, 336, -1, 0.006297122221440077), (987515173, 1982, 'Papier_Magazine', 336, -1, 336, -1, 0.0044364226050674915), (987515173, 1982, 'Plastique', 112, -1, 112, -1, 5.6257746905430395e-08), (987515173, 1982, 'Plastique', 144, -1, 112, -1, 8.160384936672926e-07), (987515173, 1982, 'Plastique', 176, -1, 112, -1, 6.24050953774713e-05), (987515173, 1982, 'Plastique', 208, -1, 112, -1, 0.0035446947440505028), (987515173, 1982, 'Plastique', 240, -1, 112, -1, 0.003161385888233781), (987515173, 1982, 'Plastique', 272, -1, 112, -1, 0.007481384556740522), (987515173, 1982, 'Plastique', 304, -1, 112, -1, 0.05492864176630974), (987515173, 1982, 'Plastique', 336, -1, 112, -1, 0.05965627729892731), (987515173, 1982, 'Plastique', 112, -1, 144, -1, 2.788129677355755e-06), (987515173, 1982, 'Plastique', 144, -1, 144, -1, 1.905261706269812e-05), (987515173, 1982, 'Plastique', 176, -1, 144, -1, 0.00017654203111305833), (987515173, 1982, 'Plastique', 208, -1, 144, -1, 0.001500371959991753), (987515173, 1982, 'Plastique', 240, -1, 144, -1, 0.005039947107434273), (987515173, 1982, 'Plastique', 272, -1, 144, -1, 0.08397973328828812), (987515173, 1982, 'Plastique', 304, -1, 144, -1, 0.409701943397522), (987515173, 1982, 'Plastique', 336, -1, 144, -1, 0.07071594893932343), (987515173, 1982, 'Plastique', 112, -1, 176, -1, 3.916215064236894e-06), (987515173, 1982, 'Plastique', 144, -1, 176, -1, 9.542005864204839e-05), (987515173, 1982, 'Plastique', 176, -1, 176, -1, 0.00033943852758966386), (987515173, 1982, 'Plastique', 208, -1, 176, -1, 0.00038877283805049956), (987515173, 1982, 'Plastique', 240, -1, 176, -1, 0.0006240404327400029), (987515173, 1982, 'Plastique', 272, -1, 176, -1, 0.008989527821540833), (987515173, 1982, 'Plastique', 304, -1, 176, -1, 0.03722904622554779), (987515173, 1982, 'Plastique', 336, -1, 176, -1, 0.002065305830910802), (987515173, 1982, 'Plastique', 112, -1, 208, -1, 7.616071525262669e-05), (987515173, 1982, 'Plastique', 144, -1, 208, -1, 4.1320388845633715e-05), (987515173, 1982, 'Plastique', 176, -1, 208, -1, 8.256636647274718e-05), (987515173, 1982, 'Plastique', 208, -1, 208, -1, 3.836446921923198e-05), (987515173, 1982, 'Plastique', 240, -1, 208, -1, 8.346093636646401e-06), (987515173, 1982, 'Plastique', 272, -1, 208, -1, 1.2023991985188331e-05), (987515173, 1982, 'Plastique', 304, -1, 208, -1, 1.2096596037736163e-05), (987515173, 1982, 'Plastique', 336, -1, 208, -1, 4.097521468793275e-06), (987515173, 1982, 'Plastique', 112, -1, 240, -1, 0.0001445766247343272), (987515173, 1982, 'Plastique', 144, -1, 240, -1, 3.537642623996362e-05), (987515173, 1982, 'Plastique', 176, -1, 240, -1, 2.1204899894655682e-05), (987515173, 1982, 'Plastique', 208, -1, 240, -1, 7.286911113624228e-06), (987515173, 1982, 'Plastique', 240, -1, 240, -1, 4.867975803790614e-06), (987515173, 1982, 'Plastique', 272, -1, 240, -1, 2.764595137705328e-06), (987515173, 1982, 'Plastique', 304, -1, 240, -1, 8.018682251531573e-07), (987515173, 1982, 'Plastique', 336, -1, 240, -1, 3.535179473601602e-07), (987515173, 1982, 'Plastique', 112, -1, 272, -1, 3.3681699278531596e-05), (987515173, 1982, 'Plastique', 144, -1, 272, -1, 1.1658216862997506e-05), (987515173, 1982, 'Plastique', 176, -1, 272, -1, 1.3375618436839432e-05), (987515173, 1982, 'Plastique', 208, -1, 272, -1, 5.4367087614082266e-06), (987515173, 1982, 'Plastique', 240, -1, 272, -1, 9.5452458026557e-07), (987515173, 1982, 'Plastique', 272, -1, 272, -1, 6.900048674651771e-07), (987515173, 1982, 'Plastique', 304, -1, 272, -1, 5.682956611963164e-07), (987515173, 1982, 'Plastique', 336, -1, 272, -1, 7.541092372775893e-07), (987515173, 1982, 'Plastique', 112, -1, 304, -1, 3.355524313519709e-06), (987515173, 1982, 'Plastique', 144, -1, 304, -1, 3.3570595405763015e-06), (987515173, 1982, 'Plastique', 176, -1, 304, -1, 6.495143225038191e-06), (987515173, 1982, 'Plastique', 208, -1, 304, -1, 8.735789378988557e-06), (987515173, 1982, 'Plastique', 240, -1, 304, -1, 3.3818478186731227e-06), (987515173, 1982, 'Plastique', 272, -1, 304, -1, 4.755453119287267e-06), (987515173, 1982, 'Plastique', 304, -1, 304, -1, 4.506832283368567e-06), (987515173, 1982, 'Plastique', 336, -1, 304, -1, 2.4166404273273656e-06), (987515173, 1982, 'Plastique', 112, -1, 336, -1, 1.5489042198169045e-05), (987515173, 1982, 'Plastique', 144, -1, 336, -1, 5.355539542506449e-05), (987515173, 1982, 'Plastique', 176, -1, 336, -1, 3.4277654776815325e-05), (987515173, 1982, 'Plastique', 208, -1, 336, -1, 2.3776203306624666e-05), (987515173, 1982, 'Plastique', 240, -1, 336, -1, 3.867457417072728e-05), (987515173, 1982, 'Plastique', 272, -1, 336, -1, 2.57879637501901e-05), (987515173, 1982, 'Plastique', 304, -1, 336, -1, 3.3244159567402676e-05), (987515173, 1982, 'Plastique', 336, -1, 336, -1, 4.171711043454707e-05), (987515173, 1982, 'Sol_Environement', 112, -1, 112, -1, 2.9203670731670073e-12), (987515173, 1982, 'Sol_Environement', 144, -1, 112, -1, 5.535397695766164e-10), (987515173, 1982, 'Sol_Environement', 176, -1, 112, -1, 4.943588010064559e-07), (987515173, 1982, 'Sol_Environement', 208, -1, 112, -1, 1.0106116860697512e-05), (987515173, 1982, 'Sol_Environement', 240, -1, 112, -1, 9.163983122562058e-06), (987515173, 1982, 'Sol_Environement', 272, -1, 112, -1, 5.6243272410938516e-05), (987515173, 1982, 'Sol_Environement', 304, -1, 112, -1, 0.0003790247719734907), (987515173, 1982, 'Sol_Environement', 336, -1, 112, -1, 0.0001649711193749681), (987515173, 1982, 'Sol_Environement', 112, -1, 144, -1, 1.028835896477176e-07), (987515173, 1982, 'Sol_Environement', 144, -1, 144, -1, 5.795569677502499e-07), (987515173, 1982, 'Sol_Environement', 176, -1, 144, -1, 1.4296985000328277e-06), (987515173, 1982, 'Sol_Environement', 208, -1, 144, -1, 5.895559297641739e-06), (987515173, 1982, 'Sol_Environement', 240, -1, 144, -1, 1.810172398108989e-05), (987515173, 1982, 'Sol_Environement', 272, -1, 144, -1, 0.0001259386190213263), (987515173, 1982, 'Sol_Environement', 304, -1, 144, -1, 0.0003248013963457197), (987515173, 1982, 'Sol_Environement', 336, -1, 144, -1, 9.642200893722475e-05), (987515173, 1982, 'Sol_Environement', 112, -1, 176, -1, 4.200181535907177e-07), (987515173, 1982, 'Sol_Environement', 144, -1, 176, -1, 1.0183960057474906e-06), (987515173, 1982, 'Sol_Environement', 176, -1, 176, -1, 6.569912784470944e-06), (987515173, 1982, 'Sol_Environement', 208, -1, 176, -1, 1.7182603642140748e-06), (987515173, 1982, 'Sol_Environement', 240, -1, 176, -1, 3.72608587895229e-06), (987515173, 1982, 'Sol_Environement', 272, -1, 176, -1, 2.806449083436746e-05), (987515173, 1982, 'Sol_Environement', 304, -1, 176, -1, 0.00015335540228988975), (987515173, 1982, 'Sol_Environement', 336, -1, 176, -1, 0.00024175782164093107), (987515173, 1982, 'Sol_Environement', 112, -1, 208, -1, 4.0047793845587876e-06), (987515173, 1982, 'Sol_Environement', 144, -1, 208, -1, 7.508058388339123e-07), (987515173, 1982, 'Sol_Environement', 176, -1, 208, -1, 1.3344770195544697e-06), (987515173, 1982, 'Sol_Environement', 208, -1, 208, -1, 9.061935770660057e-07), (987515173, 1982, 'Sol_Environement', 240, -1, 208, -1, 6.945874133634788e-07), (987515173, 1982, 'Sol_Environement', 272, -1, 208, -1, 1.0850662874872796e-06), (987515173, 1982, 'Sol_Environement', 304, -1, 208, -1, 1.4424236951526836e-06), (987515173, 1982, 'Sol_Environement', 336, -1, 208, -1, 2.3234824766404927e-06), (987515173, 1982, 'Sol_Environement', 112, -1, 240, -1, 4.667056600737851e-06), (987515173, 1982, 'Sol_Environement', 144, -1, 240, -1, 3.7710762512688234e-07), (987515173, 1982, 'Sol_Environement', 176, -1, 240, -1, 2.487361712155689e-07), (987515173, 1982, 'Sol_Environement', 208, -1, 240, -1, 2.1717592346703896e-07), (987515173, 1982, 'Sol_Environement', 240, -1, 240, -1, 5.579168487201969e-07), (987515173, 1982, 'Sol_Environement', 272, -1, 240, -1, 8.632170533928729e-07), (987515173, 1982, 'Sol_Environement', 304, -1, 240, -1, 6.710985758218158e-07), (987515173, 1982, 'Sol_Environement', 336, -1, 240, -1, 7.826654950804368e-07), (987515173, 1982, 'Sol_Environement', 112, -1, 272, -1, 2.988628239108948e-06), (987515173, 1982, 'Sol_Environement', 144, -1, 272, -1, 6.873872848700557e-07), (987515173, 1982, 'Sol_Environement', 176, -1, 272, -1, 5.011139592170366e-07), (987515173, 1982, 'Sol_Environement', 208, -1, 272, -1, 2.0144666734722705e-07), (987515173, 1982, 'Sol_Environement', 240, -1, 272, -1, 1.315043931526816e-07), (987515173, 1982, 'Sol_Environement', 272, -1, 272, -1, 2.704709345380252e-07), (987515173, 1982, 'Sol_Environement', 304, -1, 272, -1, 1.6060396035300073e-07), (987515173, 1982, 'Sol_Environement', 336, -1, 272, -1, 4.96676307193411e-07), (987515173, 1982, 'Sol_Environement', 112, -1, 304, -1, 6.981788374105236e-07), (987515173, 1982, 'Sol_Environement', 144, -1, 304, -1, 4.054036537581851e-07), (987515173, 1982, 'Sol_Environement', 176, -1, 304, -1, 8.933901085583784e-07), (987515173, 1982, 'Sol_Environement', 208, -1, 304, -1, 2.347059080420877e-06), (987515173, 1982, 'Sol_Environement', 240, -1, 304, -1, 3.058956053791917e-06), (987515173, 1982, 'Sol_Environement', 272, -1, 304, -1, 2.6664074539439753e-06), (987515173, 1982, 'Sol_Environement', 304, -1, 304, -1, 1.4982005041019875e-06), (987515173, 1982, 'Sol_Environement', 336, -1, 304, -1, 1.610646449989872e-06), (987515173, 1982, 'Sol_Environement', 112, -1, 336, -1, 4.631292540580034e-07), (987515173, 1982, 'Sol_Environement', 144, -1, 336, -1, 1.1301005997665925e-06), (987515173, 1982, 'Sol_Environement', 176, -1, 336, -1, 6.79607524034509e-07), (987515173, 1982, 'Sol_Environement', 208, -1, 336, -1, 1.4350787296280032e-06), (987515173, 1982, 'Sol_Environement', 240, -1, 336, -1, 3.345676532262587e-06), (987515173, 1982, 'Sol_Environement', 272, -1, 336, -1, 2.1201080926402938e-06), (987515173, 1982, 'Sol_Environement', 304, -1, 336, -1, 2.298940671607852e-06), (987515173, 1982, 'Sol_Environement', 336, -1, 336, -1, 3.3706035083014285e-06), (987515173, 1982, 'Teint_Dans_La_Masse', 112, -1, 112, -1, 4.579776486934861e-06), (987515173, 1982, 'Teint_Dans_La_Masse', 144, -1, 112, -1, 2.4634050532768015e-06), (987515173, 1982, 'Teint_Dans_La_Masse', 176, -1, 112, -1, 1.7728989405441098e-05), (987515173, 1982, 'Teint_Dans_La_Masse', 208, -1, 112, -1, 0.0004736298869829625), (987515173, 1982, 'Teint_Dans_La_Masse', 240, -1, 112, -1, 0.00011541679123183712), (987515173, 1982, 'Teint_Dans_La_Masse', 272, -1, 112, -1, 0.00020975818915758282), (987515173, 1982, 'Teint_Dans_La_Masse', 304, -1, 112, -1, 0.0014400206273421645), (987515173, 1982, 'Teint_Dans_La_Masse', 336, -1, 112, -1, 0.0020213620737195015), (987515173, 1982, 'Teint_Dans_La_Masse', 112, -1, 144, -1, 3.0747225537197664e-05), (987515173, 1982, 'Teint_Dans_La_Masse', 144, -1, 144, -1, 1.7224840121343732e-05), (987515173, 1982, 'Teint_Dans_La_Masse', 176, -1, 144, -1, 2.074822987196967e-05), (987515173, 1982, 'Teint_Dans_La_Masse', 208, -1, 144, -1, 0.000274423771770671), (987515173, 1982, 'Teint_Dans_La_Masse', 240, -1, 144, -1, 0.0004637020465452224), (987515173, 1982, 'Teint_Dans_La_Masse', 272, -1, 144, -1, 0.0005299154436215758), (987515173, 1982, 'Teint_Dans_La_Masse', 304, -1, 144, -1, 0.00019041661289520562), (987515173, 1982, 'Teint_Dans_La_Masse', 336, -1, 144, -1, 0.00020555850642267615), (987515173, 1982, 'Teint_Dans_La_Masse', 112, -1, 176, -1, 1.5063415048643947e-05), (987515173, 1982, 'Teint_Dans_La_Masse', 144, -1, 176, -1, 6.761009444744559e-06), (987515173, 1982, 'Teint_Dans_La_Masse', 176, -1, 176, -1, 2.1028894479968585e-05), (987515173, 1982, 'Teint_Dans_La_Masse', 208, -1, 176, -1, 2.411943205515854e-05), (987515173, 1982, 'Teint_Dans_La_Masse', 240, -1, 176, -1, 3.527651642798446e-05), (987515173, 1982, 'Teint_Dans_La_Masse', 272, -1, 176, -1, 7.906714745331556e-05), (987515173, 1982, 'Teint_Dans_La_Masse', 304, -1, 176, -1, 0.0001004285950330086), (987515173, 1982, 'Teint_Dans_La_Masse', 336, -1, 176, -1, 0.00037772604264318943), (987515173, 1982, 'Teint_Dans_La_Masse', 112, -1, 208, -1, 1.502672785136383e-05), (987515173, 1982, 'Teint_Dans_La_Masse', 144, -1, 208, -1, 1.4642645282947342e-06), (987515173, 1982, 'Teint_Dans_La_Masse', 176, -1, 208, -1, 4.756956514029298e-06), (987515173, 1982, 'Teint_Dans_La_Masse', 208, -1, 208, -1, 3.827542059298139e-06), (987515173, 1982, 'Teint_Dans_La_Masse', 240, -1, 208, -1, 3.6436563277675305e-06), (987515173, 1982, 'Teint_Dans_La_Masse', 272, -1, 208, -1, 1.1692170119204093e-05), (987515173, 1982, 'Teint_Dans_La_Masse', 304, -1, 208, -1, 1.3341682461032178e-05), (987515173, 1982, 'Teint_Dans_La_Masse', 336, -1, 208, -1, 5.991157013340853e-05), (987515173, 1982, 'Teint_Dans_La_Masse', 112, -1, 240, -1, 4.14225687563885e-05), (987515173, 1982, 'Teint_Dans_La_Masse', 144, -1, 240, -1, 5.346239049686119e-06), (987515173, 1982, 'Teint_Dans_La_Masse', 176, -1, 240, -1, 3.903059223375749e-06), (987515173, 1982, 'Teint_Dans_La_Masse', 208, -1, 240, -1, 2.3420711841026787e-06), (987515173, 1982, 'Teint_Dans_La_Masse', 240, -1, 240, -1, 5.7686220316099934e-06), (987515173, 1982, 'Teint_Dans_La_Masse', 272, -1, 240, -1, 2.107585532939993e-05), (987515173, 1982, 'Teint_Dans_La_Masse', 304, -1, 240, -1, 1.7908692825585604e-05), (987515173, 1982, 'Teint_Dans_La_Masse', 336, -1, 240, -1, 2.2710839402861893e-05), (987515173, 1982, 'Teint_Dans_La_Masse', 112, -1, 272, -1, 0.00020107091404497623), (987515173, 1982, 'Teint_Dans_La_Masse', 144, -1, 272, -1, 6.675379700027406e-05), (987515173, 1982, 'Teint_Dans_La_Masse', 176, -1, 272, -1, 4.347903814050369e-05), (987515173, 1982, 'Teint_Dans_La_Masse', 208, -1, 272, -1, 1.4608031051466241e-05), (987515173, 1982, 'Teint_Dans_La_Masse', 240, -1, 272, -1, 7.066009402478812e-06), (987515173, 1982, 'Teint_Dans_La_Masse', 272, -1, 272, -1, 1.5525829439866357e-05), (987515173, 1982, 'Teint_Dans_La_Masse', 304, -1, 272, -1, 1.5341285688919015e-05), (987515173, 1982, 'Teint_Dans_La_Masse', 336, -1, 272, -1, 0.00010801735334098339), (987515173, 1982, 'Teint_Dans_La_Masse', 112, -1, 304, -1, 9.498991130385548e-05), (987515173, 1982, 'Teint_Dans_La_Masse', 144, -1, 304, -1, 0.0001101041489164345), (987515173, 1982, 'Teint_Dans_La_Masse', 176, -1, 304, -1, 0.00015802356938365847), (987515173, 1982, 'Teint_Dans_La_Masse', 208, -1, 304, -1, 0.000542381894774735), (987515173, 1982, 'Teint_Dans_La_Masse', 240, -1, 304, -1, 0.002336635021492839), (987515173, 1982, 'Teint_Dans_La_Masse', 272, -1, 304, -1, 0.007469985168427229), (987515173, 1982, 'Teint_Dans_La_Masse', 304, -1, 304, -1, 0.005849579349160194), (987515173, 1982, 'Teint_Dans_La_Masse', 336, -1, 304, -1, 0.004484832752496004), (987515173, 1982, 'Teint_Dans_La_Masse', 112, -1, 336, -1, 0.00024094831314869225), (987515173, 1982, 'Teint_Dans_La_Masse', 144, -1, 336, -1, 0.002009648596867919), (987515173, 1982, 'Teint_Dans_La_Masse', 176, -1, 336, -1, 0.0007477541221305728), (987515173, 1982, 'Teint_Dans_La_Masse', 208, -1, 336, -1, 0.003354105167090893), (987515173, 1982, 'Teint_Dans_La_Masse', 240, -1, 336, -1, 0.06424067169427872), (987515173, 1982, 'Teint_Dans_La_Masse', 272, -1, 336, -1, 0.03816000744700432), (987515173, 1982, 'Teint_Dans_La_Masse', 304, -1, 336, -1, 0.03879896178841591), (987515173, 1982, 'Teint_Dans_La_Masse', 336, -1, 336, -1, 0.005873352754861116), (987515173, 1982, 'autre_refus', 112, -1, 112, -1, 5.818215909059177e-10), (987515173, 1982, 'autre_refus', 144, -1, 112, -1, 2.0745057227600228e-08), (987515173, 1982, 'autre_refus', 176, -1, 112, -1, 1.4494294191536028e-06), (987515173, 1982, 'autre_refus', 208, -1, 112, -1, 9.19582525966689e-05), (987515173, 1982, 'autre_refus', 240, -1, 112, -1, 0.0002176298585254699), (987515173, 1982, 'autre_refus', 272, -1, 112, -1, 0.0017508638557046652), (987515173, 1982, 'autre_refus', 304, -1, 112, -1, 0.017777379602193832), (987515173, 1982, 'autre_refus', 336, -1, 112, -1, 0.008987532928586006), (987515173, 1982, 'autre_refus', 112, -1, 144, -1, 9.191663252750004e-07), (987515173, 1982, 'autre_refus', 144, -1, 144, -1, 2.919911139542819e-06), (987515173, 1982, 'autre_refus', 176, -1, 144, -1, 1.0283320079906844e-05), (987515173, 1982, 'autre_refus', 208, -1, 144, -1, 0.000135092152049765), (987515173, 1982, 'autre_refus', 240, -1, 144, -1, 0.00034457523724995553), (987515173, 1982, 'autre_refus', 272, -1, 144, -1, 0.004946669563651085), (987515173, 1982, 'autre_refus', 304, -1, 144, -1, 0.0435962937772274), (987515173, 1982, 'autre_refus', 336, -1, 144, -1, 0.09585997462272644), (987515173, 1982, 'autre_refus', 112, -1, 176, -1, 1.5166783668973949e-05), (987515173, 1982, 'autre_refus', 144, -1, 176, -1, 0.00012731006427202374), (987515173, 1982, 'autre_refus', 176, -1, 176, -1, 0.00023635881370864809), (987515173, 1982, 'autre_refus', 208, -1, 176, -1, 0.0008089757757261395), (987515173, 1982, 'autre_refus', 240, -1, 176, -1, 0.0006517767906188965), (987515173, 1982, 'autre_refus', 272, -1, 176, -1, 0.004317794926464558), (987515173, 1982, 'autre_refus', 304, -1, 176, -1, 0.023279590532183647), (987515173, 1982, 'autre_refus', 336, -1, 176, -1, 0.018634002655744553), (987515173, 1982, 'autre_refus', 112, -1, 208, -1, 8.846331184031442e-05), (987515173, 1982, 'autre_refus', 144, -1, 208, -1, 0.00018574440036900342), (987515173, 1982, 'autre_refus', 176, -1, 208, -1, 0.0003194711171090603), (987515173, 1982, 'autre_refus', 208, -1, 208, -1, 0.00035793602000921965), (987515173, 1982, 'autre_refus', 240, -1, 208, -1, 0.00019871523545589298), (987515173, 1982, 'autre_refus', 272, -1, 208, -1, 0.0002873389166779816), (987515173, 1982, 'autre_refus', 304, -1, 208, -1, 0.00020268431399017572), (987515173, 1982, 'autre_refus', 336, -1, 208, -1, 0.00024428716278634965), (987515173, 1982, 'autre_refus', 112, -1, 240, -1, 0.0002361160732107237), (987515173, 1982, 'autre_refus', 144, -1, 240, -1, 0.00010856946028070524), (987515173, 1982, 'autre_refus', 176, -1, 240, -1, 6.487585778813809e-05), (987515173, 1982, 'autre_refus', 208, -1, 240, -1, 2.4959968868643045e-05), (987515173, 1982, 'autre_refus', 240, -1, 240, -1, 7.291968358913437e-05), (987515173, 1982, 'autre_refus', 272, -1, 240, -1, 0.00013996199413668364), (987515173, 1982, 'autre_refus', 304, -1, 240, -1, 8.983325096778572e-05), (987515173, 1982, 'autre_refus', 336, -1, 240, -1, 8.177014387911186e-05), (987515173, 1982, 'autre_refus', 112, -1, 272, -1, 0.0002679538447409868), (987515173, 1982, 'autre_refus', 144, -1, 272, -1, 0.0001115795093937777), (987515173, 1982, 'autre_refus', 176, -1, 272, -1, 0.00012461795995477587), (987515173, 1982, 'autre_refus', 208, -1, 272, -1, 5.118347326060757e-05), (987515173, 1982, 'autre_refus', 240, -1, 272, -1, 2.91562555503333e-05), (987515173, 1982, 'autre_refus', 272, -1, 272, -1, 4.267711847205646e-05), (987515173, 1982, 'autre_refus', 304, -1, 272, -1, 6.812905485276133e-05), (987515173, 1982, 'autre_refus', 336, -1, 272, -1, 0.00014411527081392705), (987515173, 1982, 'autre_refus', 112, -1, 304, -1, 0.00011556825484149158), (987515173, 1982, 'autre_refus', 144, -1, 304, -1, 0.00021733758330810815), (987515173, 1982, 'autre_refus', 176, -1, 304, -1, 0.00042724062222987413), (987515173, 1982, 'autre_refus', 208, -1, 304, -1, 0.0004268806951586157), (987515173, 1982, 'autre_refus', 240, -1, 304, -1, 6.567801028722897e-05), (987515173, 1982, 'autre_refus', 272, -1, 304, -1, 3.1614061299478635e-05), (987515173, 1982, 'autre_refus', 304, -1, 304, -1, 1.1657359209493734e-05), (987515173, 1982, 'autre_refus', 336, -1, 304, -1, 1.8768594600260258e-05), (987515173, 1982, 'autre_refus', 112, -1, 336, -1, 0.00024722181842662394), (987515173, 1982, 'autre_refus', 144, -1, 336, -1, 0.0004707051266450435), (987515173, 1982, 'autre_refus', 176, -1, 336, -1, 0.000335386284859851), (987515173, 1982, 'autre_refus', 208, -1, 336, -1, 0.00023679545847699046), (987515173, 1982, 'autre_refus', 240, -1, 336, -1, 0.00010665112495189533), (987515173, 1982, 'autre_refus', 272, -1, 336, -1, 9.548989328322932e-05), (987515173, 1982, 'autre_refus', 304, -1, 336, -1, 0.0001313834363827482), (987515173, 1982, 'autre_refus', 336, -1, 336, -1, 0.0007291757501661777)]} ############################### TEST certificat_qualite_papier ################################ TEST certificat qualite papier Inside batchDatouExec : verbose : False # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! Step 4442 tile have less inputs used (1) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 4441 detect_points is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 4443 count_percent_refus is not consistent : 4 used against 3 in the step definition ! Step 4444 send_mail_dechet have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : output 1 of step 4440 have datatype=1 whereas input 0 of step 4443 have datatype=2 WARNING : type of output 1 of step 4441 doesn't seem to be define in the database( WARNING : type of input 4 of step 4443 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : init_dechet, tile, detect_points, count_percent_refus, brightness, blur_detection, send_mail_dechet list_input_json : [] origin Catched exception ! Connect or reconnect ! We have 1 , BFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 1 ; length of list_pids : 1 ; length of list_args : 1 time to download the photos : 0.2541694641113281 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : False number of steps : 7 step1:init_dechet Sun Mar 23 11:25:52 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec debut step init detect dechets input : temp/1742725552_43872_987321136_6a08497399a24a3041045c21475a90ea.jpg ON MODIFIE NB AVEC LE INPUT map photo id path extension : temp/1742725552_43872_987321136_6a08497399a24a3041045c21475a90ea.jpg scale : 0.9481481481481482 FIN step init dechet Inside saveOutput : final : False verbose : False saveOutput not yet implemented for datou_step.type : init_dechet we use saveGeneral [987321136] Looping around the photos to save general results len do output : 1 /987321136Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('1848', None, None, None, None, None, None, None, None) ('1848', '1902940', '987321136', None, None, None, None, None, None) begin to insert list_values into mtr_datou_result : length of list_values in save_final : 4 time used for this insertion : 0.013065099716186523 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.00017309188842773438 time spend to save output : 0.013353109359741211 total time spend for step 1 : 0.013526201248168945 step2:tile Sun Mar 23 11:25:52 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure verbose : False param_json : {'token': '78d09a0790ec6ecbf119343125a81fdc', 'portfolio_name': 'tile_correct_upm', 'ETA': 86400, 'new_width': 1500, 'new_height': 20000, 'host': 'www.fotonower.com', 'protocol': 'https', 'photo_tile_type': 1522, 'option_bande': 'True'} type(crop_hashtag_type) : type(crop_hashtag_type_tiled) : We consider crop_hashtag_type is an integer ! map_chi_type_to_chi_type_cropped : {406: 410} map_filenames : {987321136: 'temp/1742725552_43872_987321136_6a08497399a24a3041045c21475a90ea.jpg'} list_pids : 1 list_pids : 2 list_subpids to replace list_pids : 1 batch 1 Loaded 0 chid ids of type : 0 https://marlene.fotonower.com/api/v1/secured/portfolio/new?name=tile_correct_upm&access_token=78d09a0790ec6ecbf119343125a81fdc created feed_id_new_photos : 21619201 with name tile_correct_upm feed_id_new_photos : 21619201 filename : temp/1742725552_43872_987321136_6a08497399a24a3041045c21475a90ea.jpg photo_id : 987321136 height_image_input : 439 width_image_input : 562 new_width : 1500 new_height : 20000 stride : 0 stride_relative : 0.1 chi to copy from the main photo to the tiled photo input_chi_for_this_image_as_chi : 0 list_bib_to_crops : 1 [(0, 562, 0, 439, 0)] new_crops_tiles : 1 crop_transformed : 0 batch 1 Loaded 1 chid ids of type : 1522 treat the image : temp/1742725552_43872_987321136_6a08497399a24a3041045c21475a90ea.jpg , 0 before upload mediasElapsed time : 0.010556221008300781 About to upload 1 photos upload in portfolio : 21619201 Result OK ! uploaded one batch 0 Elapsed time : 5.189397096633911 upload mediasElapsed time : 5.200024127960205 , 0Saving 0 CHIs. end of tileElapsed time : 5.211231708526611 Inside saveOutput : final : False verbose : False saveOutput not yet implemented for datou_step.type : tile we use saveGeneral [987321136, 987321136, '1346581291'] Looping around the photos to save general results len do output : 1 /1346581291Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('1848', None, None, None, None, None, None, None, None) ('1848', '1902940', '987321136', None, None, None, None, None, None) ('1848', None, None, None, None, None, None, None, None) ('1848', '1902940', '987321136', None, None, None, None, None, None) ('1848', None, None, None, None, None, None, None, None) ('1848', None, '1346581291', None, None, None, None, None, None) begin to insert list_values into mtr_datou_result : length of list_values in save_final : 4 time used for this insertion : 0.011959552764892578 save_final save missing photos in datou_result : time spend for datou_step_exec : 12.963930368423462 time spend to save output : 0.012165069580078125 total time spend for step 2 : 12.97609543800354 step3:detect_points Sun Mar 23 11:26:05 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step predict points ! Inside try reload ! gpu_mode in detect_points : False To load net FromThcl() model_param file didn't exist model_name : learn_refus_upm_blanches_1924 model_type : caffe list file need : ['caffemodel', 'deploy_conv_normal.prototxt', 'deploy_fc.prototxt', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file exist in s3 : ['caffemodel', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file manque in s3 : ['deploy_conv_normal.prototxt', 'deploy_fc.prototxt'] local folder : /data/models_weight/learn_refus_upm_blanches_1924 /data/models_weight/learn_refus_upm_blanches_1924/caffemodel size_local : 45774543 size in s3 : 45774543 create time local : 2021-08-09 05:29:53 create time in s3 : 2021-08-06 19:36:04 caffemodel already exist and didn't need to update /data/models_weight/learn_refus_upm_blanches_1924/deploy.prototxt size_local : 17312 size in s3 : 17312 create time local : 2021-08-09 05:29:53 create time in s3 : 2021-08-06 19:36:03 deploy.prototxt already exist and didn't need to update /data/models_weight/learn_refus_upm_blanches_1924/mean.npy size_local : 1572992 size in s3 : 1572992 create time local : 2021-08-09 05:29:53 create time in s3 : 2021-08-06 19:36:05 mean.npy already exist and didn't need to update /data/models_weight/learn_refus_upm_blanches_1924/synset_words.txt size_local : 218 size in s3 : 218 create time local : 2021-08-09 05:29:53 create time in s3 : 2021-08-06 19:36:04 synset_words.txt already exist and didn't need to update reshape net's input to : (224, 224) origin shape : (10, 3, 224, 224) after reshape : (1, 3, 224, 224) [('data', (1, 3, 224, 224)), ('conv1', (1, 64, 112, 112)), ('pool1', (1, 64, 56, 56)), ('pool1_pool1_0_split_0', (1, 64, 56, 56)), ('pool1_pool1_0_split_1', (1, 64, 56, 56)), ('res2a_branch1', (1, 64, 56, 56)), ('res2a_branch2a', (1, 64, 56, 56)), ('res2a_branch2b', (1, 64, 56, 56)), ('res2a', (1, 64, 56, 56)), ('res2a_res2a_relu_0_split_0', (1, 64, 56, 56)), ('res2a_res2a_relu_0_split_1', (1, 64, 56, 56)), ('res2b_branch2a', (1, 64, 56, 56)), ('res2b_branch2b', (1, 64, 56, 56)), ('res2b', (1, 64, 56, 56)), ('res2b_res2b_relu_0_split_0', (1, 64, 56, 56)), ('res2b_res2b_relu_0_split_1', (1, 64, 56, 56)), ('res3a_branch1', (1, 128, 28, 28)), ('res3a_branch2a', (1, 128, 28, 28)), ('res3a_branch2b', (1, 128, 28, 28)), ('res3a', (1, 128, 28, 28)), ('res3a_res3a_relu_0_split_0', (1, 128, 28, 28)), ('res3a_res3a_relu_0_split_1', (1, 128, 28, 28)), ('res3b_branch2a', (1, 128, 28, 28)), ('res3b_branch2b', (1, 128, 28, 28)), ('res3b', (1, 128, 28, 28)), ('res3b_res3b_relu_0_split_0', (1, 128, 28, 28)), ('res3b_res3b_relu_0_split_1', (1, 128, 28, 28)), ('res4a_branch1', (1, 256, 14, 14)), ('res4a_branch2a', (1, 256, 14, 14)), ('res4a_branch2b', (1, 256, 14, 14)), ('res4a', (1, 256, 14, 14)), ('res4a_res4a_relu_0_split_0', (1, 256, 14, 14)), ('res4a_res4a_relu_0_split_1', (1, 256, 14, 14)), ('res4b_branch2a', (1, 256, 14, 14)), ('res4b_branch2b', (1, 256, 14, 14)), ('res4b', (1, 256, 14, 14)), ('res4b_res4b_relu_0_split_0', (1, 256, 14, 14)), ('res4b_res4b_relu_0_split_1', (1, 256, 14, 14)), ('res5a_branch1', (1, 512, 7, 7)), ('res5a_branch2a', (1, 512, 7, 7)), ('res5a_branch2b', (1, 512, 7, 7)), ('res5a', (1, 512, 7, 7)), ('res5a_res5a_relu_0_split_0', (1, 512, 7, 7)), ('res5a_res5a_relu_0_split_1', (1, 512, 7, 7)), ('res5b_branch2a', (1, 512, 7, 7)), ('res5b_branch2b', (1, 512, 7, 7)), ('res5b', (1, 512, 7, 7)), ('fc2019-10-22_15-02-46', (1, 10, 1, 1)), ('prob', (1, 10, 1, 1))] set image transformer : About to compute detect the points : len(args) : 2 Inside predict_points step exec : nb paths : 1 treate image : temp/1742725552_43872_987321136_6a08497399a24a3041045c21475a90ea_0.jpg size of numpy array img : 2960752 scale method : caffe/skimage size of numpy array img_scale : 2655880 (416, 532, 3) nb_h 7 nb_w 11 size of sub images : (224, 224, 3) size of caffe_input : 46362776 (77, 3, 224, 224) time to do the preprocess : 0.03864026069641113 time to do a prediction : 14.538705110549927 dict_keys(['prob']) shape of output (77, 10, 1, 1) shape of the out_put heatmap (10, 7, 11) number of sub_photos vertical and horizon 7 11 size of heatmap : (7,11) size of heatmap : (7,11) size of heatmap : (7,11) size of heatmap : (7,11) size of heatmap : (7,11) size of heatmap : (7,11) size of heatmap : (7,11) size of heatmap : (7,11) size of heatmap : (7,11) size of heatmap : (7,11) Inside saveOutput : final : False verbose : False Inside savePoints : final : False verbose : False threshold to save the result : 0.05 maximun points to save in the table mtr_datou_result for each class : 100 final : False save missing photos in datou_result : time spend for datou_step_exec : 15.717189073562622 time spend to save output : 0.06413793563842773 total time spend for step 3 : 15.78132700920105 step4:count_percent_refus Sun Mar 23 11:26:21 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure debut step count percent refus (987321136, 0.9481481481481482) ('temp/1742725552_43872_987321136_6a08497399a24a3041045c21475a90ea_0.jpg',) list_photo : [987321136] list_photo_correc : [1346581291] debut step count percent refus Treating photo_id : 987321136 Calcul du count_res count res : ((492774966, 3), (2107752386, 7)) Hashtag_id : 492774966 Hashtag_id : 2107752386 We have 2 classes in this image Inside saveOutput : final : False verbose : False begin to insert list_values into mtr_datou_result : length of list_values in save_final : 6 time used for this insertion : 0.05803275108337402 save missing photos in datou_result : time spend for datou_step_exec : 0.02517080307006836 time spend to save output : 0.05824923515319824 total time spend for step 4 : 0.0834200382232666 step5:brightness Sun Mar 23 11:26:21 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1742725552_43872_987321136_6a08497399a24a3041045c21475a90ea.jpg Inside saveOutput : final : False verbose : False begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 1 time used for this insertion : 0.025699615478515625 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 1 time used for this insertion : 0.01260232925415039 save missing photos in datou_result : time spend for datou_step_exec : 0.11257529258728027 time spend to save output : 0.042993783950805664 total time spend for step 5 : 0.15556907653808594 step6:blur_detection Sun Mar 23 11:26:21 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1742725552_43872_987321136_6a08497399a24a3041045c21475a90ea.jpg resize: (439, 562) 987321136 -5.392404060312662 Inside saveOutput : final : False verbose : False begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 1 time used for this insertion : 0.008898735046386719 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 1 time used for this insertion : 0.01488804817199707 save missing photos in datou_result : time spend for datou_step_exec : 0.14879250526428223 time spend to save output : 0.02845311164855957 total time spend for step 6 : 0.1772456169128418 step7:send_mail_dechet Sun Mar 23 11:26:22 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 complete output_args for input 2 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail dechet senders@fotonower.com retour de l'envoi du mail : None Inside saveOutput : final : True verbose : False saveOutput not yet implemented for datou_step.type : send_mail_dechet we use saveGeneral [987321136, 987321136, '1346581291'] Looping around the photos to save general results len do output : 1 /987321136. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('1848', None, None, None, None, None, None, None, None) ('1848', '1902940', '987321136', None, None, None, None, None, None) ('1848', None, None, None, None, None, None, None, None) ('1848', '1902940', '987321136', None, None, None, None, None, None) ('1848', None, None, None, None, None, None, None, None) ('1848', None, '1346581291', None, None, None, None, None, None) begin to insert list_values into mtr_datou_result : length of list_values in save_final : 4 time used for this insertion : 0.013433694839477539 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.4527859687805176 time spend to save output : 0.013753890991210938 total time spend for step 7 : 0.4665398597717285 caffe_path_current : About to save ! 2 After save, about to update current ! datou_cur_ids : [] len(datou.list_steps) : 7 output : {987321136: (-110, -0.39870825574700136, -5.392404060312662, 30.0, 61.64383561643836, {'carton': 3, 'Papier_Magazine': 7}, {'refus_total': 30.0, 'carton': 30.0, 'Papier_Magazine': 70.0}, {'refus_total': 61.64383561643836, 'carton': 61.64383561643836, 'Papier_Magazine': 38.35616438356164}, 0.6164383561643836)} ############################### TEST image_temperature_detection ################################ t Inside batchDatouExec : verbose : False # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : image_temperature_detection list_input_json : [] origin BFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 1 ; length of list_pids : 1 ; length of list_args : 1 time to download the photos : 0.18107223510742188 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : False number of steps : 1 step1:image_temperature_detection Sun Mar 23 11:26:22 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec inside step blanche_jaune_detection treat image : temp/1742725582_43872_984484223_2e25dc219a9a57a9f85bcae482a80c35.jpg 984484223 1.004309911525615 time spend for datou_step_exec : 0.1860337257385254 time spend to save output : 0.00011992454528808594 total time spend for step 1 : 0.18615365028381348 caffe_path_current : About to save ! 0 After save, about to update current ! datou_cur_ids : [] len(datou.list_steps) : 1 output : {984484223: [(984484223, 1.004309911525615, 492630606)]} {984484223: [(984484223, 1.004309911525615, 492630606)]} ############################### TEST broca ################################ t Inside batchDatouExec : verbose : False # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : split_time_score list_input_json : [] origin We have 1 , we have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB time to download the photos : 0.023175477981567383 About to test input to load Calling datou_exec Inside datou_exec : verbose : False number of steps : 1 step1:split_time_score Sun Mar 23 11:26:22 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec split portfolio by speed calcul order for each photo with time calcul time for a portfolio 2021-12-01 10:11:30 2021-12-01 10:11:32 2021-12-01 10:11:30 2021-12-01 10:11:34 2021-12-01 10:11:32 2021-12-01 10:11:40 2021-12-01 10:11:34 2021-12-01 10:12:17 2021-12-01 10:11:40 2021-12-01 10:12:24 2021-12-01 10:12:17 2021-12-01 10:12:27 2021-12-01 10:12:24 2021-12-01 10:12:29 2021-12-01 10:12:27 2021-12-01 10:12:56 2021-12-01 10:12:29 2021-12-01 10:13:04 2021-12-01 10:12:56 2021-12-01 10:13:13 2021-12-01 10:13:04 2021-12-01 10:13:04 distance 1.4513659170185111 2021-12-01 10:13:13 2021-12-01 10:13:22 2021-12-01 10:13:13 2021-12-01 10:13:30 2021-12-01 10:13:22 2021-12-01 10:16:14 2021-12-01 10:13:30 2021-12-01 10:13:30 distance 8.382409567451603 2021-12-01 10:16:14 2021-12-01 10:16:18 2021-12-01 10:16:14 2021-12-01 10:16:47 2021-12-01 10:16:18 2021-12-01 10:16:53 2021-12-01 10:16:47 2021-12-01 10:16:47 distance 8.03396608896571 2021-12-01 10:16:53 2021-12-01 10:16:57 2021-12-01 10:16:53 dict_time_useful: {0: [1098136690, 1098136784, 48.864288393888884, 2.19199505125, [datetime.datetime(2021, 12, 1, 10, 11, 30), datetime.datetime(2021, 12, 1, 10, 13, 4), 94]], 1: [1098136974, 1098137007, 48.86291258986111, 2.19361357125, [datetime.datetime(2021, 12, 1, 10, 16, 14), datetime.datetime(2021, 12, 1, 10, 16, 47), 33]]} get gps info of PAV SELECT id,Y_WGS84,X_WGS84 FROM MTRLabel.info_PAV; get gps info of PAV SELECT id,Y_WGS84,X_WGS84 FROM MTRLabel.info_PAV WHERE type_pav = "CS"; get gps info of PAV SELECT id,Y_WGS84,X_WGS84 FROM MTRLabel.info_PAV WHERE type_pav = "OM"; distance: RUEIL14CS [48.864288393888884, 2.19199505125] 16.57008455321128 time spend for datou_step_exec : 0.1839907169342041 time spend to save output : 0.00010991096496582031 total time spend for step 1 : 0.18410062789916992 caffe_path_current : About to save ! 0 After save, about to update current ! {15: [(21619202, 48.864288393888884, 2.19199505125, 10, 1064919752, [datetime.datetime(2021, 12, 1, 10, 11, 30), datetime.datetime(2021, 12, 1, 10, 13, 4), 94.0], 5205529)]} résultat du premier test BROCA : True True ############################### TEST crop_conditional ################################ t Inside batchDatouExec : verbose : False # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : step 1335 frcnn is not linked in the step_by_step architecture ! WARNING : step 1336 crop_condition is not linked in the step_by_step architecture ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! DataTypes for each output/input checked ! List Step Type Loaded in datou : frcnn, crop_condition list_input_json : [] origin We have 1 , BBBFBFBFFBFFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 6 ; length of list_pids : 6 ; length of list_args : 6 time to download the photos : 0.31330037117004395 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : False number of steps : 2 step1:frcnn Sun Mar 23 11:26:23 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step Faster rcnn ! Inside try reload ! To loadFromThcl() model_param file didn't exist model_name : learn_piece_voiture_0808_v2 model_type : caffe_faster_rcnn list file need : ['caffemodel', 'test.prototxt'] file exist in s3 : ['caffemodel', 'test.prototxt'] file manque in s3 : [] local folder : /data/models_weight/learn_piece_voiture_0808_v2 /data/models_weight/learn_piece_voiture_0808_v2/caffemodel size_local : 350215080 size in s3 : 350215080 create time local : 2021-08-09 05:30:22 create time in s3 : 2021-08-06 19:24:16 caffemodel already exist and didn't need to update /data/models_weight/learn_piece_voiture_0808_v2/test.prototxt size_local : 7166 size in s3 : 7166 create time local : 2021-08-09 05:30:22 create time in s3 : 2021-08-06 19:24:16 test.prototxt already exist and didn't need to update prototxt : /data/models_weight/learn_piece_voiture_0808_v2/test.prototxt caffemodel : /data/models_weight/learn_piece_voiture_0808_v2/caffemodel Loaded network /data/models_weight/learn_piece_voiture_0808_v2/caffemodel About to compute detect_faster_rcnn : len(args) : 6 Inside frcnn step exec : nb paths : 6 image_path : temp/1742725583_43872_950003695_22b4110c9a86b12e1542ec2bb977f6a8.jpg image_size (2160, 3840, 3) [[[111 118 91] [113 120 93] [115 120 93] ... [ 23 40 37] [ 23 40 37] [ 24 41 38]] [[111 118 91] [112 119 92] [115 120 93] ... [ 23 40 37] [ 23 40 37] [ 23 40 37]] [[113 118 91] [114 119 92] [115 120 93] ... [ 22 39 36] [ 23 40 37] [ 23 40 37]] ... [[120 125 94] [119 124 93] [118 123 92] ... [ 22 36 34] [ 22 36 34] [ 23 37 35]] [[119 124 93] [119 124 93] [118 123 92] ... [ 22 36 34] [ 22 36 34] [ 22 36 34]] [[118 123 91] [117 122 90] [117 122 91] ... [ 22 36 34] [ 22 36 34] [ 22 36 34]]] Detection took 0.550s for 300 object proposals image_path : temp/1742725583_43872_926687666_a8bc8c1fad77748c62ca641ceb29ad9c.jpg image_size (480, 640, 3) [[[36 41 44] [36 41 44] [35 40 43] ... [ 8 10 10] [ 8 10 10] [ 8 10 10]] [[37 42 45] [36 41 44] [35 40 43] ... [ 5 7 7] [ 5 7 7] [ 5 7 7]] [[37 42 45] [36 41 44] [35 40 43] ... [ 3 5 5] [ 4 6 6] [ 4 6 6]] ... [[42 47 50] [41 46 49] [40 45 48] ... [ 8 10 10] [ 8 10 10] [ 8 10 10]] [[41 46 49] [41 46 49] [40 45 48] ... [ 0 2 2] [10 12 12] [22 24 24]] [[40 45 48] [40 45 48] [40 45 48] ... [10 12 12] [17 19 19] [26 28 28]]] Detection took 0.037s for 300 object proposals image_path : temp/1742725583_43872_950003812_3dbffe9f441f7d28d087f3e571769e74.jpg image_size (480, 614, 3) [[[ 44 44 44] [ 49 51 51] [ 42 44 44] ... [ 8 10 10] [ 8 10 10] [ 8 10 10]] [[ 43 43 43] [ 36 38 38] [ 39 41 41] ... [ 5 7 7] [ 5 7 7] [ 5 7 7]] [[ 70 70 70] [ 40 42 42] [ 41 43 43] ... [ 4 6 6] [ 4 6 6] [ 4 6 6]] ... [[103 101 101] [110 108 108] [ 61 59 59] ... [ 8 10 10] [ 8 10 10] [ 8 10 10]] [[ 98 96 96] [115 113 113] [ 73 71 71] ... [ 0 2 2] [ 11 13 13] [ 21 23 23]] [[ 92 90 90] [114 112 112] [ 87 82 83] ... [ 10 12 12] [ 18 20 20] [ 25 27 27]]] Detection took 0.034s for 300 object proposals image_path : temp/1742725583_43872_950003696_11e3a77b72af4b332d366d98984039c7.jpg image_size (2160, 3264, 3) [[[168 165 161] [168 165 161] [168 165 161] ... [ 47 59 63] [ 48 60 64] [ 48 60 64]] [[168 165 161] [168 165 161] [168 165 161] ... [ 47 59 63] [ 47 59 63] [ 48 60 64]] [[168 165 161] [168 165 161] [168 165 161] ... [ 47 59 63] [ 47 59 63] [ 47 59 63]] ... [[167 164 160] [167 164 160] [167 164 160] ... [ 44 59 61] [ 44 59 61] [ 44 59 61]] [[165 162 158] [165 162 158] [165 162 158] ... [ 45 60 62] [ 45 60 62] [ 45 60 62]] [[164 161 157] [164 161 157] [164 161 157] ... [ 45 60 62] [ 45 60 62] [ 45 60 62]]] Detection took 0.889s for 300 object proposals image_path : temp/1742725583_43872_950003838_e480bc28e6ceabc2f5995246a6af6b46.jpg image_size (294, 285, 3) [[[ 29 29 29] [ 29 29 29] [ 30 30 30] ... [182 172 165] [141 131 124] [103 94 90]] [[ 29 29 29] [ 29 29 29] [ 31 31 31] ... [231 220 212] [202 193 184] [164 154 147]] [[ 30 30 30] [ 27 27 27] [ 26 26 26] ... [223 211 199] [229 219 209] [228 217 209]] ... [[ 22 27 25] [ 16 21 19] [ 11 16 14] ... [166 145 123] [168 147 125] [170 149 127]] [[ 20 25 23] [ 17 22 20] [ 15 20 18] ... [163 142 120] [165 144 122] [166 145 123]] [[ 13 18 16] [ 17 22 20] [ 20 25 23] ... [162 141 119] [163 142 120] [163 142 121]]] Detection took 0.029s for 300 object proposals image_path : temp/1742725583_43872_950003813_e28be02dfcce79cce594a390a9911a0a.jpg image_size (254, 229, 3) [[[202 190 186] [205 193 189] [205 194 190] ... [ 81 70 56] [ 80 69 55] [ 78 67 53]] [[198 187 183] [200 189 185] [198 189 185] ... [ 50 41 28] [ 44 36 23] [ 45 36 23]] [[192 187 184] [191 186 183] [191 186 183] ... [ 36 30 23] [ 32 29 21] [ 33 27 20]] ... [[187 186 190] [186 185 189] [188 184 189] ... [ 43 38 35] [ 37 33 28] [ 33 28 25]] [[184 185 189] [183 184 188] [184 183 187] ... [ 28 23 22] [ 29 24 21] [ 33 28 27]] [[181 185 186] [180 184 185] [182 184 185] ... [ 23 15 16] [ 22 14 14] [ 24 16 17]]] Detection took 0.027s for 300 object proposals len de result frcnn : 6 time spend for datou_step_exec : 4.515522480010986 time spend to save output : 0.00034809112548828125 total time spend for step 1 : 4.515870571136475 step2:crop_condition Sun Mar 23 11:26:27 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Loading chi in step crop with photo_hashtag_type : 757 Loading chi in step crop for subpids : 6 ! batch 1 Loaded 32 chid ids of type : 757 begin to crop the class : phare param for this class : {'margin_type': 'margin', 'margin_value': 300, 'feed_id_new_photos': 1097966} filtre for class : phare hashtag_id of this class : 492624020 WARNING : margin is only used for type bib ! map_result returned by crop_photo_return_map_crop : length : 3 About to insert : list_path_to_insert length 0 new photo from crops ! About to upload 0 photos WARNING : list_path_to_insert is empty, cannot upload ! we have finished the crop for the class : phare begin to crop the class : aile-avant param for this class : {} filtre for class : aile-avant hashtag_id of this class : 2106233860 WARNING : margin is only used for type bib ! now we use margin_relative for the photo_id : 926687666 now we use margin_relative for the photo_id : 950003812 map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 0 new photo from crops ! About to upload 0 photos WARNING : list_path_to_insert is empty, cannot upload ! we have finished the crop for the class : aile-avant time spend for datou_step_exec : 0.6193544864654541 time spend to save output : 3.981590270996094e-05 total time spend for step 2 : 0.6193943023681641 caffe_path_current : About to save ! 0 After save, about to update current ! datou_cur_ids : [] len(datou.list_steps) : 2 output : {1071808962: [926687666, 'temp/1742725583_43872_926687666_a8bc8c1fad77748c62ca641ceb29ad9c_bib_crop_1655713621_0.jpg', (326, 477, 251, 312)], 1071808957: [950003812, 'temp/1742725583_43872_950003812_3dbffe9f441f7d28d087f3e571769e74_bib_crop_1655713647_0.jpg', (318, 489, 264, 310)], 1071808960: [950003812, 'temp/1742725583_43872_950003812_3dbffe9f441f7d28d087f3e571769e74_bib_crop_1655713648_0.jpg', (261, 408, 234, 331)], 1071808969: [926687666, 'temp/1742725583_43872_926687666_a8bc8c1fad77748c62ca641ceb29ad9c_bib_crop_1655713607_0.jpg', (161, 330, 149, 343)], 1071808966: [950003812, 'temp/1742725583_43872_950003812_3dbffe9f441f7d28d087f3e571769e74_bib_crop_1655713634_0.jpg', (133, 305, 146, 344)]} ############################### TEST image_blanchir ################################ Inside batchDatouExec : verbose : False # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : image_blanchir list_input_json : [] origin BFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 1 ; length of list_pids : 1 ; length of list_args : 1 time to download the photos : 0.13279151916503906 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! WARNING : we have an input that is not a photo, we should get rid of it Calling datou_exec Inside datou_exec : verbose : False number of steps : 1 step1:image_blanchir Sun Mar 23 11:26:28 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec inside step blanchir_image https://marlene.fotonower.com/api/v1/secured/portfolio/new?access_token=78d09a0790ec6ecbf119343125a81fdc feed_id_new_photos:21619203 treat image : temp/1742725588_43872_990111206_7ca22c7e68dd0a10509c7987af0cf549.png blanchir func Result OK ! time spend for datou_step_exec : 6.862620830535889 time spend to save output : 1.0013580322265625e-05 total time spend for step 1 : 6.862630844116211 caffe_path_current : About to save ! 1 Inside saveOutput : final : True verbose : False sauvegarde pour la step blanchir_image begin to insert list_values into mtr_datou_result : length of list_values in save_final : 1 insert ignore into MTRPhoto.mtr_datou_result (mtd_id, mtr_portfolio_id,mtr_photo_id,result,result_long,result_double,hashtag_id,proba, mtr_current_id) values (%s,%s,%s,%s,%s,%s,%s,%s,%s) on duplicate key update mtr_portfolio_id = mtr_portfolio_id list_values : [[1818, 0, 990111206, 1, 1, 1, None, 1, None]] time used for this insertion : 0.012606620788574219 save missing photos in datou_result : After save, about to update current ! datou_cur_ids : [] len(datou.list_steps) : 1 output : [(990111206, '1346581306', 0, 300, 0, 381, 1, 1, 'blanc')] [(990111206, '1346581306', 0, 300, 0, 381, 1, 1, 'blanc')] ############################### TEST darker_image ################################ Inside batchDatouExec : verbose : False # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : darker_image list_input_json : [] origin We have 1 , BFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 1 ; length of list_pids : 1 ; length of list_args : 1 time to download the photos : 0.14658784866333008 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : False number of steps : 1 step1:darker_image Sun Mar 23 11:26:35 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec dans la step darker batch 1 Loaded 7 chid ids of type : 2228 +WARNING : Unexpected points, we should remove this data for chi_id : 1753484977, for now we just ignore these empty polygon points +WARNING : Unexpected points, we should remove this data for chi_id : 1753484978, for now we just ignore these empty polygon points +WARNING : Unexpected points, we should remove this data for chi_id : 1753484979, for now we just ignore these empty polygon points +WARNING : Unexpected points, we should remove this data for chi_id : 1753484980, for now we just ignore these empty polygon points +WARNING : Unexpected points, we should remove this data for chi_id : 1753484981, for now we just ignore these empty polygon points +WARNING : Unexpected points, we should remove this data for chi_id : 1753484982, for now we just ignore these empty polygon points +WARNING : Unexpected points, we should remove this data for chi_id : 1753484983, for now we just ignore these empty polygon points treat image : temp/1742725595_43872_989962950_4d2e56be59e275c3d57b085a836be0ba.jpg Result OK ! batch 1 Loaded 7 chid ids of type : 2228 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! crops sauvegardes time spend for datou_step_exec : 7.609764814376831 time spend to save output : 3.24249267578125e-05 total time spend for step 1 : 7.609797239303589 caffe_path_current : About to save ! 1 Inside saveOutput : final : True verbose : False sauvegarde pour la step blanchir_image begin to insert list_values into mtr_datou_result : length of list_values in save_final : 1 insert ignore into MTRPhoto.mtr_datou_result (mtd_id, mtr_portfolio_id,mtr_photo_id,result,result_long,result_double,hashtag_id,proba, mtr_current_id) values (%s,%s,%s,%s,%s,%s,%s,%s,%s) on duplicate key update mtr_portfolio_id = mtr_portfolio_id list_values : [[2085, 0, 989962950, 1, 1, 1, None, 1, None]] time used for this insertion : 0.13991355895996094 save missing photos in datou_result : After save, about to update current ! datou_cur_ids : [] len(datou.list_steps) : 1 output : [(989962950, '1346581308', 0, 897, 0, 1431, 1, 1, 'darker')] [(989962950, '1346581308', 0, 897, 0, 1431, 1, 1, 'darker')] batch 1 Loaded 7 chid ids of type : 2228 ############################### TEST img_aug ################################ Inside batchDatouExec : verbose : False # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : data_aug list_input_json : [] origin We have 1 , BFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 1 ; length of list_pids : 1 ; length of list_args : 1 time to download the photos : 0.09611654281616211 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : False number of steps : 1 step1:data_aug Sun Mar 23 11:26:44 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec numpy.version est ancienne, on utilise l'ancien bit generator numpy.version est ancienne, on utilise l'ancien bit generator batch 1 Loaded 7 chid ids of type : 2228 +WARNING : Unexpected points, we should remove this data for chi_id : 1753484977, for now we just ignore these empty polygon points +WARNING : Unexpected points, we should remove this data for chi_id : 1753484978, for now we just ignore these empty polygon points +WARNING : Unexpected points, we should remove this data for chi_id : 1753484979, for now we just ignore these empty polygon points +WARNING : Unexpected points, we should remove this data for chi_id : 1753484980, for now we just ignore these empty polygon points +WARNING : Unexpected points, we should remove this data for chi_id : 1753484981, for now we just ignore these empty polygon points +WARNING : Unexpected points, we should remove this data for chi_id : 1753484982, for now we just ignore these empty polygon points +WARNING : Unexpected points, we should remove this data for chi_id : 1753484983, for now we just ignore these empty polygon points on traite des points Result OK ! batch 1 Loaded 7 chid ids of type : 2260 ERROR missing MTRPhoto.crop_hashtag_ids : 492774966 on photo_id : 1346581312 ERROR missing MTRPhoto.crop_hashtag_ids : 492774966 on photo_id : 1346581312 ERROR missing MTRPhoto.crop_hashtag_ids : 492725882 on photo_id : 1346581312 ERROR missing MTRPhoto.crop_hashtag_ids : 492725882 on photo_id : 1346581312 ERROR missing MTRPhoto.crop_hashtag_ids : 492668766 on photo_id : 1346581312 ERROR missing MTRPhoto.crop_hashtag_ids : 492668766 on photo_id : 1346581312 ERROR missing MTRPhoto.crop_hashtag_ids : 492668766 on photo_id : 1346581312 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! photo_uploade augmentation faite pour la photo : 989962950 time spend for datou_step_exec : 8.842884540557861 time spend to save output : 4.1484832763671875e-05 total time spend for step 1 : 8.842926025390625 caffe_path_current : About to save ! 1 Inside saveOutput : final : True verbose : False sauvegarde pour la step blanchir_image begin to insert list_values into mtr_datou_result : length of list_values in save_final : 1 insert ignore into MTRPhoto.mtr_datou_result (mtd_id, mtr_portfolio_id,mtr_photo_id,result,result_long,result_double,hashtag_id,proba, mtr_current_id) values (%s,%s,%s,%s,%s,%s,%s,%s,%s) on duplicate key update mtr_portfolio_id = mtr_portfolio_id list_values : [[2041, 0, 989962950, 1, 1, 1, None, 1, None]] time used for this insertion : 0.012177467346191406 save missing photos in datou_result : After save, about to update current ! datou_cur_ids : [] len(datou.list_steps) : 1 output : [(989962950, 1346581312, 0, 1431, 0, 897, 1, 1, 'img_aug')] [(989962950, 1346581312, 0, 1431, 0, 897, 1, 1, 'img_aug')] batch 1 Loaded 7 chid ids of type : 2260 ############################### TEST rubbia ################################ warning , we can't find thcl infos in json_data warning , we can't find pdt infos in json_data Inside batchDatouExec : verbose : False # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : split_time_score list_input_json : [] origin We have 1 , we have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB time to download the photos : 1.1650383472442627 About to test input to load Calling datou_exec Inside datou_exec : verbose : False we use local cache db, so we are in local job, but when commit will be implemented for local cache db, we could again use save number of steps : 1 step1:split_time_score Sun Mar 23 11:26:55 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec begin split time score 2022-04-13 10:29:59 0 TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('05', 2), ('07', 25), ('06', 1), ('08', 96), ('09', 44), ('10', 64)) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {1: 188, 2: 36, 3: 8} 07092021 4599398 Nombre de photos uploadées : 232 / 23040 (1%) 07092021 4599398 Nombre de photos taguées (types de déchets): 232 / 232 (100%) 07092021 4599398 Nombre de photos taguées (volume) : 232 / 232 (100%) elapsed_time : load_data_split_time_score 2.86102294921875e-06 elapsed_time : order_list_meta_photo_and_scores 0.0002465248107910156 elapsed_time : fill_and_build_computed_from_old_data 0.02347278594970703 elapsed_time : insert_dashboard_record_day_entry 0.025443553924560547 Creating list_photo_total elapsed_time : select_descriptors 22.074384450912476 07092021 4599398 Nombre de photos avec descriptors (type 3963) : 232 / 232 (100%) ERROR : Hum hum, what can we do for different size of descriptors (ignore the difference ) : 0 vs 2048 photo_id : 1049293230 photo_id_prec : 0 0:00:00|ON:0:27:28.999934|OFF:1:46:59.999878|ON:0:00:20.000007|OFF:0:01:51.000162|ON:0:12:18.999909|OFF:0:01:01.000055|ON:0:08:50.000116|OFF:0:00:09.999867|ON:0:00:19.999899|OFF:0:00:09.000058|ON:0:00:29.999860|OFF:0:01:40.000249|ON:0:00:30.999931|OFF:0:07:40.000107|ON:0:00:28.999981|OFF:0:00:09.999968|ON:0:00:10.999986|OFF:0:08:09.999919|ON:0:00:40.000176|OFF:0:01:08.999784|ON:0:00:11.000245|OFF:0:00:39.999921|ON:0:00:19.000004|OFF:0:06:31.000039|ON:0:02:09.999929|OFF:0:01:40.000021|ON:0:00:39.000031|OFF:0:07:10.999966|ON:0:12:30.000101|OFF:0:00:18.999765|ON:0:00:39.999946|OFF:0:00:11.000212|ON:0:00:29.999851|OFF:0:00:20.000150|ON:0:00:30.000042|OFF:0:00:18.999771|ON:0:07:31.000243|OFF:0:00:09.999942|ON:0:00:08.999822|OFF:0:00:11.000172|ON:0:00:39.999914|OFF:0:00:20|ON:0:31:10.000147|OFF:0:12:18.999857|ON:0:01:39.999950|OFF:0:00:19.999947|ON:0:00:21.000213|OFF:0:00:28.999911|ON:0:00:21.000117|OFF:0:00:40.000020|ON:0:10:58.999762|OFF:0:00:41.000023|ON:0:00:09.000008|OFF:0:00:21.000234|ON:0:00:29.999765|OFF:0:00:28.999920|ON:0:00:21.000174|OFF:0:00:30.000078|ON:0:00:29.999938|OFF:0:00:29.999871|ON:0:00:08.999965|OFF:0:09:31.000234|ON:0:00:09.999916|OFF:0:00:20.000049|ON:0:04:09.999926|OFF:0:01:09.000014|ON:0:02:00.999957|OFF:0:00:08.999951|ON:0:00:21.000053|OFF:0:00:18.999927|ON:0:00:39.999997|OFF:0:00:30.000158|ON: 07092021 Removing 115 photos because of the 'same image' condition Total on : 7859.999814999999 list_time_on Total off : 10509.0002 list_time_off dist_desc begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 232 time used for this insertion : 3.2873592376708984 photos_removed : len 115 elapsed_time : remove_photo_duplicate 3.369811773300171 Creating list_photo_total XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX elapsed_time : count_sum_diff_and_build_graph 0.056414127349853516 Total photos : 232 ..can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info ....can't find max_score_info .....can't find max_score_info .can't find max_score_info ...Change port : 10 hashtag : 2107750911 photo_id =1049308384 : rungis_plastique_fonce ..can't find max_score_info ...can't find max_score_info ....can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info ....can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info ....can't find max_score_info ..can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .....can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info ..can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info ...can't find max_score_info .can't find max_score_info .can't find max_score_info .....Change port : 25 hashtag : 2107750908 photo_id =1049311795 : rungis_papier ..can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info ...Change port : 4 hashtag : 2107750911 photo_id =1049311961 : rungis_plastique_fonce .can't find max_score_info .can't find max_score_info .can't find max_score_info .Change port : 1 hashtag : 2107750908 photo_id =1049312208 : rungis_papier .....Change port : 5 hashtag : 2107750911 photo_id =1049312420 : rungis_plastique_fonce .Change port : 1 hashtag : 2107750908 photo_id =1049312422 : rungis_papier ..can't find max_score_info .can't find max_score_info .Change port : 2 hashtag : 2107750911 photo_id =1049312438 : rungis_plastique_fonce ....can't find max_score_info ...can't find max_score_info .can't find max_score_info ....can't find max_score_info .can't find max_score_info ....Change port : 12 hashtag : 2107750908 photo_id =1049312556 : rungis_papier .can't find max_score_info ..can't find max_score_info .....can't find max_score_info .can't find max_score_info ...Change port : 8 hashtag : 2107750911 photo_id =1049312984 : rungis_plastique_fonce ...can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .........can't find max_score_info .can't find max_score_info ...can't find max_score_info .can't find max_score_info ...can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info ...can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .Change port : 17 hashtag : 2107751280 photo_id =1049317359 : rungis_aluminium .can't find max_score_info .can't find max_score_info ....can't find max_score_info .can't find max_score_info .can't find max_score_info ...can't find max_score_info .can't find max_score_info .can't find max_score_info ...Change port : 8 hashtag : 2107750913 photo_id =1049317524 : rungis_tetrapak .can't find max_score_info .can't find max_score_info .can't find max_score_info ..can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .Change port : 2 hashtag : 2107750911 photo_id =1049318212 : rungis_plastique_fonce .can't find max_score_info .can't find max_score_info ...can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info ..........Change port : 12 hashtag : 2107750908 photo_id =1049318287 : rungis_papier ...can't find max_score_info ..Change port : 4 hashtag : 2107750911 photo_id =1049318294 : rungis_plastique_fonce .can't find max_score_info .can't find max_score_info .....can't find max_score_info .can't find max_score_info .can't find max_score_info . Total photos : 232 Number of lists : 15 counter photos in port : 117 hashtag : rungis_aluminium(2107751280) : 8 photos in 1 portfolios ! hashtag : rungis_carton(2107750907) : 0 photos in 0 portfolios ! hashtag : rungis_papier(2107750908) : 33 photos in 6 portfolios ! hashtag : rungis_plastique_clair(2107750909) : 0 photos in 0 portfolios ! hashtag : rungis_plastique_dur(2107750910) : 0 photos in 0 portfolios ! hashtag : rungis_plastique_fonce(2107750911) : 74 photos in 7 portfolios ! hashtag : rungis_tapis_vide(2107750912) : 0 photos in 0 portfolios ! hashtag : rungis_tetrapak(2107750913) : 2 photos in 1 portfolios ! elapsed_time : group_photo_by_moyenne_exp 0.013436555862426758 elapsed_time : compute_and_correct_tag_with_moyenne_mobile 2.6226043701171875e-06 today str has not a value , we define it as the date of the first image todaystr_first : 07092021 attention , prev_timestamp is 0 , we do nothing *******o** BIG TIME 550.0000100135803 (11.000229120254517, 2, 0, 0, 0.979349, 0, 0, 0, 0, 0, 0.8199999980926513, 0.0012, 0.0008999778032302856, 2.9, 0.11100016188621521, -0.0) on 3 1049307693 2021-09-07 07:45:54.010041 id_data : 12 * BIG TIME 168.99982810020447 (11.000229120254517, 2, 0, 0, 0.979349, 0, 0, 0, 0, 0, 0.8199999980926513, 0.0012, 0.0008999778032302856, 2.9, 0.11100016188621521, -0.0) on 3 1049308235 2021-09-07 07:48:43.009869 id_data : 13 ** BIG TIME 499.9998118877411 (191.00026988983154, 2, 0, 0, 0.93498826, 0, 0, 0, 0, 0, 0.9018999995946884, 0.002, 0.002999984407424927, 2.9, 0.019000051021575926, -0.01666705330212911) on 7 1049309345 2021-09-07 07:58:43.009858 id_data : 20 * BIG TIME 371.0001440048218 (271.00081276893616, 5, 0.24365342, 0, 0, 0, 0, 0.38418204, 0, 0.34177557, 0.9720000085830689, 0.0041, 0.014999971222877502, 2.9, 0.061000473976135255, -0.2516670016447703) on 15 1049310132 2021-09-07 08:09:54.010082 id_data : 51 * BIG TIME 461.0001001358032 (301.0006546974182, 0, 0.5752453, 0, 0, 0, 0, 0, 0, 0, 1.0228999980926514, 0.0056, 0.02589997522830963, 2.9, 0.009999968051910401, -0.0) on 18 1049310905 2021-09-07 08:18:54.009936 id_data : 60 * BIG TIME 370.0001759529114 (359.0003435611725, 5, 0, 0, 0, 0, 0, 0.85983855, 0, 0, 1.0898999773979188, 0.0078, 0.04109999623298645, 2.9, 0.008999762058258056, -0.0) on 24 1049311767 2021-09-07 08:28:24.010105 id_data : 81 *** BIG TIME 411.0001149177551 (557.9999935626984, 2, 0, 0, 0.66983944, 0, 0, 0, 0, 0, 1.1558999848842622, 0.0094, 0.050199996829032895, 2.9, 0.00900000500679016, -0.0) on 32 1049312208 2021-09-07 08:40:04.010052 id_data : 97 * BIG TIME 549.9999330043793 (557.9999935626984, 2, 0, 0, 0.66983944, 0, 0, 0, 0, 0, 1.1558999848842622, 0.0094, 0.050199996829032895, 2.9, 0.00900000500679016, -0.0) on 32 1049312363 2021-09-07 08:49:14.009985 id_data : 98 ** BIG TIME 168.99987387657166 (867.0004575252533, 2, 0, 0, 0.5498895, 0, 0, 0, 0, 0.29987606, 1.293000004196167, 0.0123, 0.06009994525909424, 0.9, 0.011000201940536499, -0.0) on 49 1049312508 2021-09-07 08:58:23.009966 id_data : 123 * BIG TIME 259.99999809265137 (867.0004575252533, 2, 0, 0, 0.5498895, 0, 0, 0, 0, 0.29987606, 1.293000004196167, 0.0123, 0.06009994525909424, 0.9, 0.011000201940536499, -0.0) on 49 1049312556 2021-09-07 09:02:43.009964 id_data : 124 * BIG TIME 190.00016593933105 (929.000762462616, 5, 0, 0, 0.44379362, 0, 0, 0.54574114, 0, 0, 1.3459999933004378, 0.0135, 0.06409994735717774, 2.9, 0.009999895095825195, -0.0) on 55 1049312803 2021-09-07 09:07:34.010149 id_data : 135 * BIG TIME 180.0000081062317 (929.000762462616, 5, 0, 0, 0.44379362, 0, 0, 0.54574114, 0, 0, 1.3459999933004378, 0.0135, 0.06409994735717774, 2.9, 0.009999895095825195, -0.0) on 55 1049312984 2021-09-07 09:10:34.010157 id_data : 136 * BIG TIME 1480.0000269412994 (939.0006575584412, 5, 0, 0, 0.2945285, 0, 0, 0.48689777, 0, 0.20073189, 1.3838999820947646, 0.0138, 0.06409994735717774, 2.9, 0.018999608993530273, -0.6316664799054463) on 56 1049316209 2021-09-07 09:35:23.009898 id_data : 138 * BIG TIME 668.9998891353607 (939.0006575584412, 5, 0, 0, 0.2945285, 0, 0, 0.48689777, 0, 0.20073189, 1.3838999820947646, 0.0138, 0.06409994735717774, 2.9, 0.018999608993530273, -0.6316664799054463) on 56 1049316332 2021-09-07 09:47:53.009987 id_data : 147 * BIG TIME 649.9999890327454 (1086.000019311905, 5, 0, 0, 0, 0, 0, 0.69907516, 0, 0.23055789, 1.6300000094890594, 0.0168, 0.08039999685287476, 2.9, 0.01100021505355835, -0.0) on 68 1049317197 2021-09-07 10:02:34.010134 id_data : 168 * BIG TIME 540.0001981258392 (1189.0002081394196, 0, 0.8074409, 0, 0, 0, 0, 0, 0, 0, 1.7199999867916107, 0.0194, 0.09519999706745148, 2.9, 0.009999808073043823, -0.0) on 78 1049318212 2021-09-07 10:16:24.010117 id_data : 198 * BIG TIME 190.00007104873657 (1199.0000162124634, 5, 0, 0.22708784, 0, 0, 0, 0.7244179, 0, 0, 1.781000003194809, 0.0202, 0.10109996955394746, 2.9, 0.011000241041183472, -0.0) on 79 1049318219 2021-09-07 10:20:04.010153 id_data : 202 **Count Time bigger than 30s : 31 #Number Photos for regression : {'07092021': {2107751280: {2107751013: 0, 2107751014: 0, 2107751015: 0, 2107751016: 80.99965000152588, 2107751017: 0}, 2107750907: {2107751013: 0, 2107751014: 0, 2107751015: 0, 2107751016: 49.000049114227295, 2107751017: 0}, 2107750908: {2107751013: 0, 2107751014: 11.000201940536499, 2107751015: 0, 2107751016: 534.9997780323029, 2107751017: 0}, 2107750909: {2107751013: 0, 2107751014: 0, 2107751015: 0, 2107751016: 0, 2107751017: 0}, 2107750910: {2107751013: 0, 2107751014: 0, 2107751015: 0, 2107751016: 31.000057697296143, 2107751017: 0}, 2107750911: {2107751013: 0, 2107751014: 0, 2107751015: 0, 2107751016: 564.0013737678528, 2107751017: 19.999656200408936}, 2107750912: {2107751013: 0, 2107751014: 0, 2107751015: 0, 2107751016: 0, 2107751017: 0}, 2107750913: {2107751013: 0, 2107751014: 8.999944925308228, 2107751015: 0, 2107751016: 89.99986672401428, 2107751017: 9.999994993209839}}} 07092021|rungis_aluminium, 05102018_papier_non_papier_dense:0 07092021|rungis_aluminium, 05102018_papier_non_papier_peu_dense:0 07092021|rungis_aluminium, 05102018_papier_non_papier_presque_vide:0 07092021|rungis_aluminium, 05102018_papier_non_papier_tres_dense:80.99965000152588 07092021|rungis_aluminium, 05102018_papier_non_papier_tres_peu_dense:0 07092021|rungis_carton, 05102018_papier_non_papier_dense:0 07092021|rungis_carton, 05102018_papier_non_papier_peu_dense:0 07092021|rungis_carton, 05102018_papier_non_papier_presque_vide:0 07092021|rungis_carton, 05102018_papier_non_papier_tres_dense:49.000049114227295 07092021|rungis_carton, 05102018_papier_non_papier_tres_peu_dense:0 07092021|rungis_papier, 05102018_papier_non_papier_dense:0 07092021|rungis_papier, 05102018_papier_non_papier_peu_dense:11.000201940536499 07092021|rungis_papier, 05102018_papier_non_papier_presque_vide:0 07092021|rungis_papier, 05102018_papier_non_papier_tres_dense:534.9997780323029 07092021|rungis_papier, 05102018_papier_non_papier_tres_peu_dense:0 07092021|rungis_plastique_clair, 05102018_papier_non_papier_dense:0 07092021|rungis_plastique_clair, 05102018_papier_non_papier_peu_dense:0 07092021|rungis_plastique_clair, 05102018_papier_non_papier_presque_vide:0 07092021|rungis_plastique_clair, 05102018_papier_non_papier_tres_dense:0 07092021|rungis_plastique_clair, 05102018_papier_non_papier_tres_peu_dense:0 07092021|rungis_plastique_dur, 05102018_papier_non_papier_dense:0 07092021|rungis_plastique_dur, 05102018_papier_non_papier_peu_dense:0 07092021|rungis_plastique_dur, 05102018_papier_non_papier_presque_vide:0 07092021|rungis_plastique_dur, 05102018_papier_non_papier_tres_dense:31.000057697296143 07092021|rungis_plastique_dur, 05102018_papier_non_papier_tres_peu_dense:0 07092021|rungis_plastique_fonce, 05102018_papier_non_papier_dense:0 07092021|rungis_plastique_fonce, 05102018_papier_non_papier_peu_dense:0 07092021|rungis_plastique_fonce, 05102018_papier_non_papier_presque_vide:0 07092021|rungis_plastique_fonce, 05102018_papier_non_papier_tres_dense:564.0013737678528 07092021|rungis_plastique_fonce, 05102018_papier_non_papier_tres_peu_dense:19.999656200408936 07092021|rungis_tapis_vide, 05102018_papier_non_papier_dense:0 07092021|rungis_tapis_vide, 05102018_papier_non_papier_peu_dense:0 07092021|rungis_tapis_vide, 05102018_papier_non_papier_presque_vide:0 07092021|rungis_tapis_vide, 05102018_papier_non_papier_tres_dense:0 07092021|rungis_tapis_vide, 05102018_papier_non_papier_tres_peu_dense:0 07092021|rungis_tetrapak, 05102018_papier_non_papier_dense:0 07092021|rungis_tetrapak, 05102018_papier_non_papier_peu_dense:8.999944925308228 07092021|rungis_tetrapak, 05102018_papier_non_papier_presque_vide:0 07092021|rungis_tetrapak, 05102018_papier_non_papier_tres_dense:89.99986672401428 07092021|rungis_tetrapak, 05102018_papier_non_papier_tres_peu_dense:9.999994993209839 #Number Photos for regression amount gros magasin papier (time_diff then nb_photo) : We have not displayed the number of photos removed for one material since Rungis_Papier wasn't in the thcl used ! 07092021_time_diff_distrib Number amount portfolio for this type of dechet : aluminium 8 https://marlene.fotonower.com/api/v1/secured/portfolio/new?name=07092021_aluminium_05102018_papier_non_papier_tres_dense&access_token=0fc1cdda0f63f39f777d9cb33b1aa204 Created to study and clean : 21619204 with name like 07092021_aluminium_05102018_papier_non_papier_tres_dense Number amount portfolio for this type of dechet : carton 6 https://marlene.fotonower.com/api/v1/secured/portfolio/new?name=07092021_carton_05102018_papier_non_papier_tres_dense&access_token=0fc1cdda0f63f39f777d9cb33b1aa204 Created to study and clean : 21619205 with name like 07092021_carton_05102018_papier_non_papier_tres_dense Number amount portfolio for this type of dechet : papier 29 https://marlene.fotonower.com/api/v1/secured/portfolio/new?name=07092021_papier_05102018_papier_non_papier_peu_dense&access_token=0fc1cdda0f63f39f777d9cb33b1aa204 Created to study and clean : 21619206 with name like 07092021_papier_05102018_papier_non_papier_peu_dense https://marlene.fotonower.com/api/v1/secured/portfolio/new?name=07092021_papier_05102018_papier_non_papier_tres_dense&access_token=0fc1cdda0f63f39f777d9cb33b1aa204 Created to study and clean : 21619207 with name like 07092021_papier_05102018_papier_non_papier_tres_dense Number amount portfolio for this type of dechet : plastique_clair 0 Number amount portfolio for this type of dechet : plastique_dur 2 https://marlene.fotonower.com/api/v1/secured/portfolio/new?name=07092021_plastique_dur_05102018_papier_non_papier_tres_dense&access_token=0fc1cdda0f63f39f777d9cb33b1aa204 Created to study and clean : 21619208 with name like 07092021_plastique_dur_05102018_papier_non_papier_tres_dense Number amount portfolio for this type of dechet : plastique_fonce 42 https://marlene.fotonower.com/api/v1/secured/portfolio/new?name=07092021_plastique_fonce_05102018_papier_non_papier_tres_dense&access_token=0fc1cdda0f63f39f777d9cb33b1aa204 Created to study and clean : 21619209 with name like 07092021_plastique_fonce_05102018_papier_non_papier_tres_dense https://marlene.fotonower.com/api/v1/secured/portfolio/new?name=07092021_plastique_fonce_05102018_papier_non_papier_tres_peu_dense&access_token=0fc1cdda0f63f39f777d9cb33b1aa204 Created to study and clean : 21619210 with name like 07092021_plastique_fonce_05102018_papier_non_papier_tres_peu_dense Number amount portfolio for this type of dechet : tapis_vide 0 Number amount portfolio for this type of dechet : tetrapak 11 https://marlene.fotonower.com/api/v1/secured/portfolio/new?name=07092021_tetrapak_05102018_papier_non_papier_peu_dense&access_token=0fc1cdda0f63f39f777d9cb33b1aa204 Created to study and clean : 21619211 with name like 07092021_tetrapak_05102018_papier_non_papier_peu_dense https://marlene.fotonower.com/api/v1/secured/portfolio/new?name=07092021_tetrapak_05102018_papier_non_papier_tres_dense&access_token=0fc1cdda0f63f39f777d9cb33b1aa204 Created to study and clean : 21619212 with name like 07092021_tetrapak_05102018_papier_non_papier_tres_dense https://marlene.fotonower.com/api/v1/secured/portfolio/new?name=07092021_tetrapak_05102018_papier_non_papier_tres_peu_dense&access_token=0fc1cdda0f63f39f777d9cb33b1aa204 Created to study and clean : 21619213 with name like 07092021_tetrapak_05102018_papier_non_papier_tres_peu_dense NUMBER BATCH : 15 list_ponderation used : [0.001, 0.001, 0.001, 0.001, 0.001] , list_hashtag_class_create_as_list : ['pcnc', 'pcm', 'jrm', 'flux_dev', 'pehd_pp', 'papier', 'carton', 'plastique_dur', 'plastique_clair', 'pet_clair', 'plastique_fonce', 'tetrapak', 'aluminium', 'carton_emr', 'grands_cartons', 'gros_de_magasin', 'tapis_vide'] We filter photos on hashtag condition ! We filter photos on hashtag condition ! result_one_balle_Type_papier:{'day': '07092021', 'map_nb_amount': {0: 0, 1: 0, 2: 10, 3: 0, 4: 0}, 'map_time_amount': {0: 0, 1: 0, 2: 191.00026988983154, 3: 0, 4: 0}, 'duration': 9008.999763965607, 'nb_balles_papier': 0.19500026988983155, 'begin_time_port': 'image_07092021_05_20_04_010050m0.jpg 0.001 for time 1, id_amount 3 this amount prod time diff : 0.001'} Production hashtag (incorrect ponderation at 20-10-18) : 0.19500026988983155 We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! result_one_balle_Type_plastique_fonce:{'day': '07092021', 'map_nb_amount': {0: 0, 1: 0, 2: 25, 3: 0, 4: 0}, 'map_time_amount': {0: 0, 1: 0, 2: 225.99965572357178, 3: 0, 4: 0}, 'duration': 2329.999878883362, 'nb_balles_papier': 0.2299996557235718, 'begin_time_port': 'image_07092021_07_50_23_010046m0.jpg 0.010000231981277466 for time 10.000231981277466, id_amount 3 this amount prod time diff : 0.010000231981277466'} Production hashtag (incorrect ponderation at 20-10-18) : 0.2299996557235718 We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! result_one_balle_Type_papier:{'day': '07092021', 'map_nb_amount': {0: 0, 1: 0, 2: 4, 3: 0, 4: 0}, 'map_time_amount': {0: 0, 1: 0, 2: 141.00006794929504, 3: 0, 4: 0}, 'duration': 189.9997718334198, 'nb_balles_papier': 0.14100006794929504, 'begin_time_port': 'image_07092021_08_29_24_010122m0.jpg 0.011000197172164917 for time 11.000197172164917, id_amount 3 this amount prod time diff : 0.011000197172164917'} Production hashtag (incorrect ponderation at 20-10-18) : 0.14100006794929504 We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! result_one_balle_Type_plastique_fonce:{'day': '07092021', 'map_nb_amount': {0: 0, 1: 0, 2: 1, 3: 0, 4: 0}, 'map_time_amount': {0: 0, 1: 0, 2: 9.000005006790161, 3: 0, 4: 0}, 'duration': 0, 'nb_balles_papier': 0.00900000500679016, 'begin_time_port': 'image'} Production hashtag (incorrect ponderation at 20-10-18) : 0.00900000500679016 We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! result_one_balle_Type_papier:{'day': '07092021', 'map_nb_amount': {0: 0, 1: 0, 2: 5, 3: 0, 4: 0}, 'map_time_amount': {0: 0, 1: 0, 2: 148.99991703033447, 3: 0, 4: 0}, 'duration': 698.9998500347137, 'nb_balles_papier': 0.15099991703033447, 'begin_time_port': 'image_07092021_08_40_04_010052m0.jpg 0.001 for time 1, id_amount 3 this amount prod time diff : 0.001'} Production hashtag (incorrect ponderation at 20-10-18) : 0.15099991703033447 We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! result_one_balle_Type_plastique_fonce:{'day': '07092021', 'map_nb_amount': {0: 0, 1: 0, 2: 1, 3: 0, 4: 0}, 'map_time_amount': {0: 0, 1: 0, 2: 11.000216960906982, 3: 0, 4: 0}, 'duration': 0, 'nb_balles_papier': 0.011000216960906983, 'begin_time_port': 'image'} Production hashtag (incorrect ponderation at 20-10-18) : 0.011000216960906983 We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! result_one_balle_Type_papier:{'day': '07092021', 'map_nb_amount': {0: 0, 1: 0, 2: 2, 3: 0, 4: 0}, 'map_time_amount': {0: 0, 1: 0, 2: 28.9998140335083, 3: 0, 4: 0}, 'duration': 0, 'nb_balles_papier': 0.0289998140335083, 'begin_time_port': 'image'} Production hashtag (incorrect ponderation at 20-10-18) : 0.0289998140335083 We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! result_one_balle_Type_plastique_fonce:{'day': '07092021', 'map_nb_amount': {0: 1, 1: 0, 2: 11, 3: 0, 4: 0}, 'map_time_amount': {0: 11.000201940536499, 1: 0, 2: 111.00051093101501, 3: 0, 4: 0}, 'duration': 330.0000479221344, 'nb_balles_papier': 0.12300071287155151, 'begin_time_port': 'image_07092021_08_52_53_009918m0.jpg 0.01 for time 10.0, id_amount 3 this amount prod time diff : 0.01'} Production hashtag (incorrect ponderation at 20-10-18) : 0.12300071287155151 We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! result_one_balle_Type_papier:{'day': '07092021', 'map_nb_amount': {0: 0, 1: 0, 2: 8, 3: 0, 4: 0}, 'map_time_amount': {0: 0, 1: 0, 2: 60.99999809265137, 3: 0, 4: 0}, 'duration': 291.0001850128174, 'nb_balles_papier': 0.06299999809265137, 'begin_time_port': 'image_07092021_09_02_43_009964m0.jpg 0.001 for time 1, id_amount 3 this amount prod time diff : 0.001'} Production hashtag (incorrect ponderation at 20-10-18) : 0.06299999809265137 We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! result_one_balle_Type_plastique_fonce:{'day': '07092021', 'map_nb_amount': {0: 1, 1: 0, 2: 16, 3: 0, 4: 0}, 'map_time_amount': {0: 8.999944925308228, 1: 0, 2: 148.99963188171387, 3: 0, 4: 0}, 'duration': 3119.999976873398, 'nb_balles_papier': 0.16199957680702212, 'begin_time_port': 'image_07092021_09_10_34_010157m0.jpg 0.001 for time 1, id_amount 3 this amount prod time diff : 0.001'} Production hashtag (incorrect ponderation at 20-10-18) : 0.16199957680702212 We filter photos on hashtag condition ! result_one_balle_Type_aluminium:{'day': '07092021', 'map_nb_amount': {0: 0, 1: 0, 2: 7, 3: 1, 4: 0}, 'map_time_amount': {0: 0, 1: 0, 2: 72.00012874603271, 3: 9.999994993209839, 4: 0}, 'duration': 150.00017404556274, 'nb_balles_papier': 0.08200012373924254, 'begin_time_port': 'image_07092021_10_03_24_009930m0.jpg 0.009999775886535644 for time 9.999775886535645, id_amount 3 this amount prod time diff : 0.009999775886535644'} Production hashtag (incorrect ponderation at 20-10-18) : 0.08200012373924254 We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! result_one_balle_Type_tetrapak:{'day': '07092021', 'map_nb_amount': {0: 0, 1: 0, 2: 2, 3: 0, 4: 0}, 'map_time_amount': {0: 0, 1: 0, 2: 19.99965810775757, 3: 0, 4: 0}, 'duration': 0, 'nb_balles_papier': 0.01999965810775757, 'begin_time_port': 'image'} Production hashtag (incorrect ponderation at 20-10-18) : 0.01999965810775757 We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! result_one_balle_Type_plastique_fonce:{'day': '07092021', 'map_nb_amount': {0: 0, 1: 0, 2: 10, 3: 2, 4: 0}, 'map_time_amount': {0: 0, 1: 0, 2: 81.00049686431885, 3: 19.999656200408936, 4: 0}, 'duration': 428.99973487854004, 'nb_balles_papier': 0.10300015306472779, 'begin_time_port': 'image_07092021_10_16_24_010117m0.jpg 0.001 for time 1, id_amount 3 this amount prod time diff : 0.001'} Production hashtag (incorrect ponderation at 20-10-18) : 0.10300015306472779 We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! result_one_balle_Type_papier:{'day': '07092021', 'map_nb_amount': {0: 0, 1: 0, 2: 4, 3: 0, 4: 0}, 'map_time_amount': {0: 0, 1: 0, 2: 40.00009298324585, 3: 0, 4: 0}, 'duration': 38.99979090690613, 'nb_balles_papier': 0.04000009298324585, 'begin_time_port': 'image_07092021_10_23_44_010139m0.jpg 0.011000287055969239 for time 11.000287055969238, id_amount 3 this amount prod time diff : 0.011000287055969239'} Production hashtag (incorrect ponderation at 20-10-18) : 0.04000009298324585 We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! result_one_balle_Type_plastique_fonce:{'day': '07092021', 'map_nb_amount': {0: 0, 1: 0, 2: 6, 3: 0, 4: 0}, 'map_time_amount': {0: 0, 1: 0, 2: 60.00031113624573, 3: 0, 4: 0}, 'duration': 98.99990916252136, 'nb_balles_papier': 0.060000311136245724, 'begin_time_port': 'image_07092021_10_24_34_010156m0.jpg 0.011000226020812989 for time 11.000226020812988, id_amount 3 this amount prod time diff : 0.011000226020812989'} Production hashtag (incorrect ponderation at 20-10-18) : 0.060000311136245724 We filter photos on hashtag condition ! We have rejected 0 photos because of the batch_size condition ! NUMBER BATCH list_of_portfolios_to_create : 15 list_same_port_ids : [13545772] find same portfolio which already exist 13545772 , we will use it list_same_port_ids : [13545774] find same portfolio which already exist 13545774 , we will use it list_same_port_ids : [13545777] find same portfolio which already exist 13545777 , we will use it list_same_port_ids : [5570414] find same portfolio which already exist 5570414 , we will use it list_same_port_ids : [13545779] find same portfolio which already exist 13545779 , we will use it list_same_port_ids : [13545780] find same portfolio which already exist 13545780 , we will use it list_same_port_ids : [13545783] find same portfolio which already exist 13545783 , we will use it list_same_port_ids : [13545785] find same portfolio which already exist 13545785 , we will use it list_same_port_ids : [13545787] find same portfolio which already exist 13545787 , we will use it list_same_port_ids : [13545788] find same portfolio which already exist 13545788 , we will use it list_same_port_ids : [13543473] find same portfolio which already exist 13543473 , we will use it list_same_port_ids : [13543474] find same portfolio which already exist 13543474 , we will use it list_same_port_ids : [13543475] find same portfolio which already exist 13543475 , we will use it list_same_port_ids : [13543476] find same portfolio which already exist 13543476 , we will use it list_same_port_ids : [13543477] find same portfolio which already exist 13543477 , we will use it # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! DataTypes for each output/input checked ! TODO SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=13545772 To do Qualite : 0.005814130015432098 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 10257 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 10261 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 10261 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 10263 argmax have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 10264 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 10258 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 10258 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 10260 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 10259 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 10259 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 10306 send_mail_cod have less inputs used (4) than in the step definition (5) : maybe we manage optionnal inputs ! Step 11081 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 10260 doesn't seem to be define in the database( WARNING : type of input 3 of step 10259 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 10260 doesn't seem to be define in the database( WARNING : output 1 of step 10258 have datatype=7 whereas input 1 of step 10260 have datatype=None WARNING : type of output 2 of step 10257 doesn't seem to be define in the database( WARNING : type of input 2 of step 10261 doesn't seem to be define in the database( WARNING : output 0 of step 10257 have datatype=16 whereas input 0 of step 10264 have datatype=1 WARNING : output 1 of step 10257 have datatype=2 whereas input 1 of step 10264 have datatype=7 WARNING : output 0 of step 10263 have datatype=6 whereas input 2 of step 10264 have datatype=5 WARNING : type of output 2 of step 10264 doesn't seem to be define in the database( WARNING : type of input 1 of step 10258 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 10260 have datatype=10 whereas input 3 of step 10306 have datatype=6 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=13545774 AND mptpi.`type`=4199 To do Qualite : 0.1888521086140681 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! DataTypes for each output/input checked ! TODO SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=13545777 To do Qualite : 0.007415846836419753 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 10257 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 10261 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 10261 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 10263 argmax have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 10264 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 10258 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 10258 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 10260 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 10259 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 10259 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 10306 send_mail_cod have less inputs used (4) than in the step definition (5) : maybe we manage optionnal inputs ! Step 11081 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 10260 doesn't seem to be define in the database( WARNING : type of input 3 of step 10259 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 10260 doesn't seem to be define in the database( WARNING : output 1 of step 10258 have datatype=7 whereas input 1 of step 10260 have datatype=None WARNING : type of output 2 of step 10257 doesn't seem to be define in the database( WARNING : type of input 2 of step 10261 doesn't seem to be define in the database( WARNING : output 0 of step 10257 have datatype=16 whereas input 0 of step 10264 have datatype=1 WARNING : output 1 of step 10257 have datatype=2 whereas input 1 of step 10264 have datatype=7 WARNING : output 0 of step 10263 have datatype=6 whereas input 2 of step 10264 have datatype=5 WARNING : type of output 2 of step 10264 doesn't seem to be define in the database( WARNING : type of input 1 of step 10258 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 10260 have datatype=10 whereas input 3 of step 10306 have datatype=6 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=5570414 AND mptpi.`type`=4199 To do # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! DataTypes for each output/input checked ! TODO SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=13545779 To do Qualite : 0.004572120949074074 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 10257 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 10261 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 10261 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 10263 argmax have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 10264 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 10258 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 10258 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 10260 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 10259 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 10259 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 10306 send_mail_cod have less inputs used (4) than in the step definition (5) : maybe we manage optionnal inputs ! Step 11081 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 10260 doesn't seem to be define in the database( WARNING : type of input 3 of step 10259 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 10260 doesn't seem to be define in the database( WARNING : output 1 of step 10258 have datatype=7 whereas input 1 of step 10260 have datatype=None WARNING : type of output 2 of step 10257 doesn't seem to be define in the database( WARNING : type of input 2 of step 10261 doesn't seem to be define in the database( WARNING : output 0 of step 10257 have datatype=16 whereas input 0 of step 10264 have datatype=1 WARNING : output 1 of step 10257 have datatype=2 whereas input 1 of step 10264 have datatype=7 WARNING : output 0 of step 10263 have datatype=6 whereas input 2 of step 10264 have datatype=5 WARNING : type of output 2 of step 10264 doesn't seem to be define in the database( WARNING : type of input 1 of step 10258 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 10260 have datatype=10 whereas input 3 of step 10306 have datatype=6 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=13545780 AND mptpi.`type`=4199 To do # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! DataTypes for each output/input checked ! TODO SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=13545783 To do Qualite : 0.00907640496399177 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 10257 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 10261 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 10261 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 10263 argmax have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 10264 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 10258 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 10258 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 10260 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 10259 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 10259 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 10306 send_mail_cod have less inputs used (4) than in the step definition (5) : maybe we manage optionnal inputs ! Step 11081 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 10260 doesn't seem to be define in the database( WARNING : type of input 3 of step 10259 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 10260 doesn't seem to be define in the database( WARNING : output 1 of step 10258 have datatype=7 whereas input 1 of step 10260 have datatype=None WARNING : type of output 2 of step 10257 doesn't seem to be define in the database( WARNING : type of input 2 of step 10261 doesn't seem to be define in the database( WARNING : output 0 of step 10257 have datatype=16 whereas input 0 of step 10264 have datatype=1 WARNING : output 1 of step 10257 have datatype=2 whereas input 1 of step 10264 have datatype=7 WARNING : output 0 of step 10263 have datatype=6 whereas input 2 of step 10264 have datatype=5 WARNING : type of output 2 of step 10264 doesn't seem to be define in the database( WARNING : type of input 1 of step 10258 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 10260 have datatype=10 whereas input 3 of step 10306 have datatype=6 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=13545785 AND mptpi.`type`=4199 To do # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! DataTypes for each output/input checked ! TODO SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=13545787 To do Qualite : 0.01485129824918373 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 10257 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 10261 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 10261 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 10263 argmax have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 10264 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 10258 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 10258 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 10260 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 10259 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 10259 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 10306 send_mail_cod have less inputs used (4) than in the step definition (5) : maybe we manage optionnal inputs ! Step 11081 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 10260 doesn't seem to be define in the database( WARNING : type of input 3 of step 10259 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 10260 doesn't seem to be define in the database( WARNING : output 1 of step 10258 have datatype=7 whereas input 1 of step 10260 have datatype=None WARNING : type of output 2 of step 10257 doesn't seem to be define in the database( WARNING : type of input 2 of step 10261 doesn't seem to be define in the database( WARNING : output 0 of step 10257 have datatype=16 whereas input 0 of step 10264 have datatype=1 WARNING : output 1 of step 10257 have datatype=2 whereas input 1 of step 10264 have datatype=7 WARNING : output 0 of step 10263 have datatype=6 whereas input 2 of step 10264 have datatype=5 WARNING : type of output 2 of step 10264 doesn't seem to be define in the database( WARNING : type of input 1 of step 10258 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 10260 have datatype=10 whereas input 3 of step 10306 have datatype=6 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=13545788 AND mptpi.`type`=4199 To do # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : step 0 init_dummy_multi_datou is not linked in the step_by_step architecture ! WARNING : step 1294 init_dummy_multi_datou is not linked in the step_by_step architecture ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! DataTypes for each output/input checked ! TODO SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=13543473 To do # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : step 0 init_dummy_multi_datou is not linked in the step_by_step architecture ! WARNING : step 1294 init_dummy_multi_datou is not linked in the step_by_step architecture ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! DataTypes for each output/input checked ! TODO SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=13543474 To do Qualite : 0.003848153410463827 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 10257 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 10261 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 10261 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 10263 argmax have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 10264 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 10258 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 10258 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 10260 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 10259 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 10259 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 10306 send_mail_cod have less inputs used (4) than in the step definition (5) : maybe we manage optionnal inputs ! Step 11081 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 10260 doesn't seem to be define in the database( WARNING : type of input 3 of step 10259 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 10260 doesn't seem to be define in the database( WARNING : output 1 of step 10258 have datatype=7 whereas input 1 of step 10260 have datatype=None WARNING : type of output 2 of step 10257 doesn't seem to be define in the database( WARNING : type of input 2 of step 10261 doesn't seem to be define in the database( WARNING : output 0 of step 10257 have datatype=16 whereas input 0 of step 10264 have datatype=1 WARNING : output 1 of step 10257 have datatype=2 whereas input 1 of step 10264 have datatype=7 WARNING : output 0 of step 10263 have datatype=6 whereas input 2 of step 10264 have datatype=5 WARNING : type of output 2 of step 10264 doesn't seem to be define in the database( WARNING : type of input 1 of step 10258 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 10260 have datatype=10 whereas input 3 of step 10306 have datatype=6 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=13543475 AND mptpi.`type`=4199 To do Qualite : 0.11478003563407302 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! DataTypes for each output/input checked ! TODO SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=13543476 To do Qualite : 0.019897576026366652 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 10257 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 10261 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 10261 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 10263 argmax have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 10264 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 10258 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 10258 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 10260 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 10259 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 10259 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 10306 send_mail_cod have less inputs used (4) than in the step definition (5) : maybe we manage optionnal inputs ! Step 11081 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 10260 doesn't seem to be define in the database( WARNING : type of input 3 of step 10259 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 10260 doesn't seem to be define in the database( WARNING : output 1 of step 10258 have datatype=7 whereas input 1 of step 10260 have datatype=None WARNING : type of output 2 of step 10257 doesn't seem to be define in the database( WARNING : type of input 2 of step 10261 doesn't seem to be define in the database( WARNING : output 0 of step 10257 have datatype=16 whereas input 0 of step 10264 have datatype=1 WARNING : output 1 of step 10257 have datatype=2 whereas input 1 of step 10264 have datatype=7 WARNING : output 0 of step 10263 have datatype=6 whereas input 2 of step 10264 have datatype=5 WARNING : type of output 2 of step 10264 doesn't seem to be define in the database( WARNING : type of input 1 of step 10258 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 10260 have datatype=10 whereas input 3 of step 10306 have datatype=6 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=13543477 AND mptpi.`type`=4199 To do elapsed_time : count_nb_balles_and_create_portfolio 29.196927785873413 # DISPLAY ALL COLLECTED DATA : {'07092021': {'nb_upload': 232, 'nb_taggue_class': 232, 'nb_taggue_densite': 232, 'nb_descriptors': 232, 'number_port': 15, 'count_photo_in_port': 117, 'nb_port_per_class': {'rungis_aluminium': {'nb_photos': 8, 'nb_portfolios': 1}, 'rungis_carton': {'nb_photos': 0, 'nb_portfolios': 0}, 'rungis_papier': {'nb_photos': 33, 'nb_portfolios': 6}, 'rungis_plastique_clair': {'nb_photos': 0, 'nb_portfolios': 0}, 'rungis_plastique_dur': {'nb_photos': 0, 'nb_portfolios': 0}, 'rungis_plastique_fonce': {'nb_photos': 74, 'nb_portfolios': 7}, 'rungis_tapis_vide': {'nb_photos': 0, 'nb_portfolios': 0}, 'rungis_tetrapak': {'nb_photos': 2, 'nb_portfolios': 1}}}} time spend for datou_step_exec : 54.92820882797241 time spend to save output : 4.0531158447265625e-05 total time spend for step 1 : 54.92824935913086 caffe_path_current : About to save ! 1 Inside saveOutput : final : True verbose : False saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1049318362, 1049318360, 1049318358, 1049318356, 1049318342, 1049318339, 1049318337, 1049318311, 1049318310, 1049318309, 1049318294, 1049318293, 1049318291, 1049318289, 1049318288, 1049318287, 1049318279, 1049318276, 1049318273, 1049318271, 1049318268, 1049318265, 1049318260, 1049318257, 1049318253, 1049318250, 1049318247, 1049318246, 1049318222, 1049318219, 1049318216, 1049318214, 1049318213, 1049318212, 1049317554, 1049317551, 1049317549, 1049317546, 1049317542, 1049317536, 1049317526, 1049317525, 1049317524, 1049317522, 1049317520, 1049317517, 1049317497, 1049317493, 1049317491, 1049317489, 1049317487, 1049317485, 1049317468, 1049317461, 1049317457, 1049317453, 1049317444, 1049317440, 1049317359, 1049317333, 1049317282, 1049317225, 1049317210, 1049317197, 1049316790, 1049316785, 1049316782, 1049316778, 1049316752, 1049316749, 1049316610, 1049316600, 1049316597, 1049316594, 1049316588, 1049316582, 1049316545, 1049316543, 1049316540, 1049316537, 1049316534, 1049316520, 1049316338, 1049316336, 1049316332, 1049316331, 1049316257, 1049316255, 1049316222, 1049316216, 1049316214, 1049316212, 1049316210, 1049316209, 1049313025, 1049312984, 1049312803, 1049312588, 1049312585, 1049312583, 1049312579, 1049312574, 1049312573, 1049312571, 1049312568, 1049312566, 1049312562, 1049312556, 1049312508, 1049312489, 1049312488, 1049312487, 1049312485, 1049312484, 1049312464, 1049312463, 1049312462, 1049312461, 1049312460, 1049312449, 1049312445, 1049312444, 1049312442, 1049312440, 1049312438, 1049312429, 1049312426, 1049312424, 1049312422, 1049312420, 1049312409, 1049312406, 1049312404, 1049312363, 1049312208, 1049311964, 1049311963, 1049311962, 1049311961, 1049311960, 1049311943, 1049311938, 1049311937, 1049311935, 1049311934, 1049311932, 1049311795, 1049311793, 1049311791, 1049311771, 1049311767, 1049311267, 1049311266, 1049311263, 1049311252, 1049311199, 1049311136, 1049311073, 1049311009, 1049311006, 1049310994, 1049310992, 1049310991, 1049310984, 1049310982, 1049310981, 1049310919, 1049310914, 1049310911, 1049310909, 1049310907, 1049310905, 1049310165, 1049310162, 1049310159, 1049310145, 1049310141, 1049310139, 1049310138, 1049310134, 1049310132, 1049309737, 1049309734, 1049309732, 1049309706, 1049309703, 1049309701, 1049309686, 1049309681, 1049309677, 1049309675, 1049309672, 1049309670, 1049309658, 1049309657, 1049309656, 1049309655, 1049309653, 1049309651, 1049309605, 1049309603, 1049309599, 1049309597, 1049309595, 1049309592, 1049309385, 1049309383, 1049309382, 1049309381, 1049309380, 1049309379, 1049309345, 1049308384, 1049308381, 1049308376, 1049308280, 1049308276, 1049308275, 1049308235, 1049307693, 1049306823, 1049306804, 1049306792, 1049306791, 1049306635, 1049306205, 1049304810, 1049303925, 1049296996, 1049296121, 1049294990, 1049293230] Looping around the photos to save general results len do output : 1 /4599398Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049318362', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049318360', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049318358', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049318356', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049318342', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049318339', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049318337', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049318311', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049318310', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049318309', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049318294', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049318293', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049318291', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049318289', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049318288', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049318287', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049318279', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049318276', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049318273', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049318271', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049318268', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049318265', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049318260', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049318257', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049318253', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049318250', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049318247', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049318246', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049318222', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049318219', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049318216', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049318214', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049318213', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049318212', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049317554', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049317551', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049317549', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049317546', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049317542', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049317536', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049317526', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049317525', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049317524', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049317522', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049317520', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049317517', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049317497', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049317493', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049317491', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049317489', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049317487', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049317485', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049317468', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049317461', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049317457', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049317453', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049317444', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049317440', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049317359', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049317333', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049317282', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049317225', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049317210', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049317197', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049316790', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049316785', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049316782', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049316778', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049316752', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049316749', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049316610', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049316600', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049316597', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049316594', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049316588', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049316582', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049316545', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049316543', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049316540', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049316537', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049316534', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049316520', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049316338', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049316336', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049316332', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049316331', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049316257', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049316255', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049316222', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049316216', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049316214', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049316212', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049316210', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049316209', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049313025', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049312984', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049312803', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049312588', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049312585', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049312583', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049312579', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049312574', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049312573', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049312571', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049312568', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049312566', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049312562', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049312556', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049312508', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049312489', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049312488', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049312487', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049312485', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049312484', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049312464', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049312463', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049312462', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049312461', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049312460', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049312449', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049312445', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049312444', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049312442', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049312440', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049312438', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049312429', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049312426', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049312424', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049312422', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049312420', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049312409', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049312406', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049312404', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049312363', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049312208', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049311964', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049311963', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049311962', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049311961', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049311960', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049311943', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049311938', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049311937', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049311935', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049311934', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049311932', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049311795', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049311793', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049311791', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049311771', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049311767', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049311267', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049311266', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049311263', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049311252', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049311199', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049311136', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049311073', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049311009', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049311006', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049310994', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049310992', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049310991', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049310984', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049310982', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049310981', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049310919', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049310914', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049310911', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049310909', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049310907', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049310905', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049310165', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049310162', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049310159', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049310145', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049310141', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049310139', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049310138', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049310134', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049310132', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049309737', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049309734', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049309732', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049309706', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049309703', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049309701', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049309686', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049309681', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049309677', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049309675', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049309672', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049309670', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049309658', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049309657', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049309656', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049309655', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049309653', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049309651', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049309605', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049309603', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049309599', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049309597', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049309595', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049309592', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049309385', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049309383', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049309382', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049309381', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049309380', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049309379', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049309345', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049308384', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049308381', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049308376', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049308280', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049308276', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049308275', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049308235', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049307693', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049306823', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049306804', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049306792', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049306791', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049306635', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049306205', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049304810', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049303925', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049296996', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049296121', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049294990', None, None, None, None, None, None) ('3789', None, None, None, None, None, None, None, None) ('3789', '4599398', '1049293230', None, None, None, None, None, None) begin to insert list_values into mtr_datou_result : length of list_values in save_final : 233 time used for this insertion : 0.08536124229431152 save_final save missing photos in datou_result : After save, about to update current ! Result test rubbia : {'4599398': ([[0, 7, 8, 9, 11, 12, 13, 14, 17, 18], [19, 20, 22, 23, 25, 26, 27, 38, 39, 40, 51, 52, 53, 55, 60, 61, 62, 63, 71, 76, 77, 81, 82, 83, 84], [85, 86, 91, 92], [93], [97, 98, 99, 100, 101], [102], [103, 104], [107, 108, 109, 110, 112, 113, 116, 117, 118, 121, 122, 123], [124, 126, 128, 129, 130, 131, 134, 135], [136, 137, 138, 147, 148, 149, 150, 151, 152, 153, 154, 157, 158, 161, 162, 167, 168], [173, 176, 177, 178, 182, 183, 187, 188], [189, 193], [198, 201, 202, 207, 208, 209, 210, 211, 212, 213, 214, 215], [216, 217, 218, 220], [221, 224, 225, 226, 227, 231]], {'rungis_aluminium': [(10, 11)], 'rungis_carton': [], 'rungis_papier': [(0, 1), (2, 3), (4, 5), (6, 7), (8, 9), (13, 14)], 'rungis_plastique_clair': [], 'rungis_plastique_dur': [], 'rungis_plastique_fonce': [(1, 2), (3, 4), (5, 6), (7, 8), (9, 10), (12, 13), (14, 15)], 'rungis_tapis_vide': [], 'rungis_tetrapak': [(11, 12)]}, {13545772: {'list_of_photos': [1049293230, 1049306791, 1049294990, 1049306792, 1049306823, 1049307693, 1049308235, 1049308275, 1049308376, 1049308381], 'hashtag': 'papier'}, 13545774: {'list_of_photos': [1049308384, 1049309345, 1049309380, 1049309381, 1049309383, 1049309385, 1049309592, 1049309658, 1049309670, 1049309672, 1049310132, 1049310134, 1049310138, 1049310141, 1049310905, 1049310907, 1049310909, 1049310911, 1049310994, 1049311199, 1049311252, 1049311767, 1049311771, 1049311791, 1049311793], 'hashtag': 'plastique_fonce'}, 13545777: {'list_of_photos': [1049311795, 1049311932, 1049311943, 1049311960], 'hashtag': 'papier'}, 5570414: {'list_of_photos': [1049311961], 'hashtag': 'plastique_fonce'}, 13545779: {'list_of_photos': [1049312208, 1049312363, 1049312404, 1049312406, 1049312409], 'hashtag': 'papier'}, 13545780: {'list_of_photos': [1049312420], 'hashtag': 'plastique_fonce'}, 13545783: {'list_of_photos': [1049312422, 1049312424], 'hashtag': 'papier'}, 13545785: {'list_of_photos': [1049312438, 1049312440, 1049312442, 1049312444, 1049312449, 1049312460, 1049312463, 1049312464, 1049312484, 1049312488, 1049312489, 1049312508], 'hashtag': 'plastique_fonce'}, 13545787: {'list_of_photos': [1049312556, 1049312566, 1049312571, 1049312573, 1049312574, 1049312579, 1049312588, 1049312803], 'hashtag': 'papier'}, 13545788: {'list_of_photos': [1049312984, 1049313025, 1049316209, 1049316332, 1049316336, 1049316338, 1049316520, 1049316534, 1049316537, 1049316540, 1049316543, 1049316588, 1049316594, 1049316610, 1049316749, 1049316790, 1049317197], 'hashtag': 'plastique_fonce'}, 13543473: {'list_of_photos': [1049317359, 1049317453, 1049317457, 1049317461, 1049317489, 1049317491, 1049317520, 1049317522], 'hashtag': 'aluminium'}, 13543474: {'list_of_photos': [1049317524, 1049317542], 'hashtag': 'tetrapak'}, 13543475: {'list_of_photos': [1049318212, 1049318216, 1049318219, 1049318253, 1049318257, 1049318260, 1049318265, 1049318268, 1049318271, 1049318273, 1049318276, 1049318279], 'hashtag': 'plastique_fonce'}, 13543476: {'list_of_photos': [1049318287, 1049318288, 1049318289, 1049318293], 'hashtag': 'papier'}, 13543477: {'list_of_photos': [1049318294, 1049318311, 1049318337, 1049318339, 1049318342, 1049318362], 'hashtag': 'plastique_fonce'}}, {2107751280: 8, 2107750907: 0, 2107750908: 33, 2107750909: 0, 2107750910: 0, 2107750911: 74, 2107750912: 0, 2107750913: 2}, {'amount_uploaded_and_tagged': {'07092021': {'nb_upload': 232, 'nb_taggue_class': 232, 'nb_taggue_densite': 232, 'nb_descriptors': 232, 'number_port': 15, 'count_photo_in_port': 117, 'nb_port_per_class': {'rungis_aluminium': {'nb_photos': 8, 'nb_portfolios': 1}, 'rungis_carton': {'nb_photos': 0, 'nb_portfolios': 0}, 'rungis_papier': {'nb_photos': 33, 'nb_portfolios': 6}, 'rungis_plastique_clair': {'nb_photos': 0, 'nb_portfolios': 0}, 'rungis_plastique_dur': {'nb_photos': 0, 'nb_portfolios': 0}, 'rungis_plastique_fonce': {'nb_photos': 74, 'nb_portfolios': 7}, 'rungis_tapis_vide': {'nb_photos': 0, 'nb_portfolios': 0}, 'rungis_tetrapak': {'nb_photos': 2, 'nb_portfolios': 1}}}}, 'map_all_result_after_group_moy_exp': {'number_port': 15, 'count_photo_in_port': 117, 'nb_port_per_class': {'rungis_aluminium': {'nb_photos': 8, 'nb_portfolios': 1}, 'rungis_carton': {'nb_photos': 0, 'nb_portfolios': 0}, 'rungis_papier': {'nb_photos': 33, 'nb_portfolios': 6}, 'rungis_plastique_clair': {'nb_photos': 0, 'nb_portfolios': 0}, 'rungis_plastique_dur': {'nb_photos': 0, 'nb_portfolios': 0}, 'rungis_plastique_fonce': {'nb_photos': 74, 'nb_portfolios': 7}, 'rungis_tapis_vide': {'nb_photos': 0, 'nb_portfolios': 0}, 'rungis_tetrapak': {'nb_photos': 2, 'nb_portfolios': 1}}}, 'map_info_after_moyenne_mobile': {'07092021': {'distrib_time_diff': {'nb': 207, 'mean': 12.512076641626404, 'stddev': 12.296218880583977, 'min': 0.0, 'max': 119.00011491775513, 'quantil_10': {'min': [8.999778032302856], 'max': [11.000291109085083]}, 'quantil_100': {'min': [8.999709129333496], 'max': [61.00024700164795]}, 'quantil_1000': {'min': [0.0], 'max': [119.00011491775513]}, 'quantil_5000': {'min': [0.0], 'max': [119.00011491775513]}, 'quantil_10000': {'min': [0.0], 'max': [119.00011491775513]}}, 'time_diff': {'rungis_aluminium': {'05102018_papier_non_papier_dense': 0, '05102018_papier_non_papier_peu_dense': 0, '05102018_papier_non_papier_presque_vide': 0, '05102018_papier_non_papier_tres_dense': 80.99965000152588, '05102018_papier_non_papier_tres_peu_dense': 0}, 'rungis_carton': {'05102018_papier_non_papier_dense': 0, '05102018_papier_non_papier_peu_dense': 0, '05102018_papier_non_papier_presque_vide': 0, '05102018_papier_non_papier_tres_dense': 49.000049114227295, '05102018_papier_non_papier_tres_peu_dense': 0}, 'rungis_papier': {'05102018_papier_non_papier_dense': 0, '05102018_papier_non_papier_peu_dense': 11.000201940536499, '05102018_papier_non_papier_presque_vide': 0, '05102018_papier_non_papier_tres_dense': 534.9997780323029, '05102018_papier_non_papier_tres_peu_dense': 0}, 'rungis_plastique_clair': {'05102018_papier_non_papier_dense': 0, '05102018_papier_non_papier_peu_dense': 0, '05102018_papier_non_papier_presque_vide': 0, '05102018_papier_non_papier_tres_dense': 0, '05102018_papier_non_papier_tres_peu_dense': 0}, 'rungis_plastique_dur': {'05102018_papier_non_papier_dense': 0, '05102018_papier_non_papier_peu_dense': 0, '05102018_papier_non_papier_presque_vide': 0, '05102018_papier_non_papier_tres_dense': 31.000057697296143, '05102018_papier_non_papier_tres_peu_dense': 0}, 'rungis_plastique_fonce': {'05102018_papier_non_papier_dense': 0, '05102018_papier_non_papier_peu_dense': 0, '05102018_papier_non_papier_presque_vide': 0, '05102018_papier_non_papier_tres_dense': 564.0013737678528, '05102018_papier_non_papier_tres_peu_dense': 19.999656200408936}, 'rungis_tapis_vide': {'05102018_papier_non_papier_dense': 0, '05102018_papier_non_papier_peu_dense': 0, '05102018_papier_non_papier_presque_vide': 0, '05102018_papier_non_papier_tres_dense': 0, '05102018_papier_non_papier_tres_peu_dense': 0}, 'rungis_tetrapak': {'05102018_papier_non_papier_dense': 0, '05102018_papier_non_papier_peu_dense': 8.999944925308228, '05102018_papier_non_papier_presque_vide': 0, '05102018_papier_non_papier_tres_dense': 89.99986672401428, '05102018_papier_non_papier_tres_peu_dense': 9.999994993209839}}, 'time_diff_removed': {'rungis_aluminium': {'05102018_papier_non_papier_dense': 0, '05102018_papier_non_papier_peu_dense': 11.000208854675293, '05102018_papier_non_papier_presque_vide': 0, '05102018_papier_non_papier_tres_dense': 158.99993062019348, '05102018_papier_non_papier_tres_peu_dense': 0}, 'rungis_carton': {'05102018_papier_non_papier_dense': 0, '05102018_papier_non_papier_peu_dense': 0, '05102018_papier_non_papier_presque_vide': 0, '05102018_papier_non_papier_tres_dense': 101.00013995170593, '05102018_papier_non_papier_tres_peu_dense': 0}, 'rungis_papier': {'05102018_papier_non_papier_dense': 0, '05102018_papier_non_papier_peu_dense': 18.999826192855835, '05102018_papier_non_papier_presque_vide': 0, '05102018_papier_non_papier_tres_dense': 168.99926328659058, '05102018_papier_non_papier_tres_peu_dense': 0}, 'rungis_plastique_clair': {'05102018_papier_non_papier_dense': 0, '05102018_papier_non_papier_peu_dense': 0, '05102018_papier_non_papier_presque_vide': 0, '05102018_papier_non_papier_tres_dense': 0, '05102018_papier_non_papier_tres_peu_dense': 0}, 'rungis_plastique_dur': {'05102018_papier_non_papier_dense': 0, '05102018_papier_non_papier_peu_dense': 0, '05102018_papier_non_papier_presque_vide': 0, '05102018_papier_non_papier_tres_dense': 0, '05102018_papier_non_papier_tres_peu_dense': 0}, 'rungis_plastique_fonce': {'05102018_papier_non_papier_dense': 0, '05102018_papier_non_papier_peu_dense': 21.00012707710266, '05102018_papier_non_papier_presque_vide': 0, '05102018_papier_non_papier_tres_dense': 489.9993727207184, '05102018_papier_non_papier_tres_peu_dense': 11.000169038772583}, 'rungis_tapis_vide': {'05102018_papier_non_papier_dense': 0, '05102018_papier_non_papier_peu_dense': 0, '05102018_papier_non_papier_presque_vide': 0, '05102018_papier_non_papier_tres_dense': 0, '05102018_papier_non_papier_tres_peu_dense': 0}, 'rungis_tetrapak': {'05102018_papier_non_papier_dense': 0, '05102018_papier_non_papier_peu_dense': 38.99988508224487, '05102018_papier_non_papier_presque_vide': 0, '05102018_papier_non_papier_tres_dense': 170.0003685951233, '05102018_papier_non_papier_tres_peu_dense': 0}}, 'nb_photos': {'rungis_aluminium': {'05102018_papier_non_papier_dense': 0, '05102018_papier_non_papier_peu_dense': 0, '05102018_papier_non_papier_presque_vide': 0, '05102018_papier_non_papier_tres_dense': 8, '05102018_papier_non_papier_tres_peu_dense': 0}, 'rungis_carton': {'05102018_papier_non_papier_dense': 0, '05102018_papier_non_papier_peu_dense': 0, '05102018_papier_non_papier_presque_vide': 0, '05102018_papier_non_papier_tres_dense': 6, '05102018_papier_non_papier_tres_peu_dense': 0}, 'rungis_papier': {'05102018_papier_non_papier_dense': 0, '05102018_papier_non_papier_peu_dense': 1, '05102018_papier_non_papier_presque_vide': 0, '05102018_papier_non_papier_tres_dense': 28, '05102018_papier_non_papier_tres_peu_dense': 0}, 'rungis_plastique_clair': {'05102018_papier_non_papier_dense': 0, '05102018_papier_non_papier_peu_dense': 0, '05102018_papier_non_papier_presque_vide': 0, '05102018_papier_non_papier_tres_dense': 0, '05102018_papier_non_papier_tres_peu_dense': 0}, 'rungis_plastique_dur': {'05102018_papier_non_papier_dense': 0, '05102018_papier_non_papier_peu_dense': 0, '05102018_papier_non_papier_presque_vide': 0, '05102018_papier_non_papier_tres_dense': 2, '05102018_papier_non_papier_tres_peu_dense': 0}, 'rungis_plastique_fonce': {'05102018_papier_non_papier_dense': 0, '05102018_papier_non_papier_peu_dense': 0, '05102018_papier_non_papier_presque_vide': 0, '05102018_papier_non_papier_tres_dense': 40, '05102018_papier_non_papier_tres_peu_dense': 2}, 'rungis_tapis_vide': {'05102018_papier_non_papier_dense': 0, '05102018_papier_non_papier_peu_dense': 0, '05102018_papier_non_papier_presque_vide': 0, '05102018_papier_non_papier_tres_dense': 0, '05102018_papier_non_papier_tres_peu_dense': 0}, 'rungis_tetrapak': {'05102018_papier_non_papier_dense': 0, '05102018_papier_non_papier_peu_dense': 1, '05102018_papier_non_papier_presque_vide': 0, '05102018_papier_non_papier_tres_dense': 9, '05102018_papier_non_papier_tres_peu_dense': 1}}, 'nb_photos_removed': {'rungis_aluminium': {'05102018_papier_non_papier_dense': 0, '05102018_papier_non_papier_peu_dense': 1, '05102018_papier_non_papier_presque_vide': 0, '05102018_papier_non_papier_tres_dense': 16, '05102018_papier_non_papier_tres_peu_dense': 0}, 'rungis_carton': {'05102018_papier_non_papier_dense': 0, '05102018_papier_non_papier_peu_dense': 0, '05102018_papier_non_papier_presque_vide': 0, '05102018_papier_non_papier_tres_dense': 5, '05102018_papier_non_papier_tres_peu_dense': 0}, 'rungis_papier': {'05102018_papier_non_papier_dense': 0, '05102018_papier_non_papier_peu_dense': 2, '05102018_papier_non_papier_presque_vide': 0, '05102018_papier_non_papier_tres_dense': 16, '05102018_papier_non_papier_tres_peu_dense': 0}, 'rungis_plastique_clair': {'05102018_papier_non_papier_dense': 0, '05102018_papier_non_papier_peu_dense': 0, '05102018_papier_non_papier_presque_vide': 0, '05102018_papier_non_papier_tres_dense': 0, '05102018_papier_non_papier_tres_peu_dense': 0}, 'rungis_plastique_dur': {'05102018_papier_non_papier_dense': 0, '05102018_papier_non_papier_peu_dense': 0, '05102018_papier_non_papier_presque_vide': 0, '05102018_papier_non_papier_tres_dense': 0, '05102018_papier_non_papier_tres_peu_dense': 0}, 'rungis_plastique_fonce': {'05102018_papier_non_papier_dense': 0, '05102018_papier_non_papier_peu_dense': 1, '05102018_papier_non_papier_presque_vide': 0, '05102018_papier_non_papier_tres_dense': 46, '05102018_papier_non_papier_tres_peu_dense': 1}, 'rungis_tapis_vide': {'05102018_papier_non_papier_dense': 0, '05102018_papier_non_papier_peu_dense': 0, '05102018_papier_non_papier_presque_vide': 0, '05102018_papier_non_papier_tres_dense': 0, '05102018_papier_non_papier_tres_peu_dense': 0}, 'rungis_tetrapak': {'05102018_papier_non_papier_dense': 0, '05102018_papier_non_papier_peu_dense': 4, '05102018_papier_non_papier_presque_vide': 0, '05102018_papier_non_papier_tres_dense': 17, '05102018_papier_non_papier_tres_peu_dense': 0}}}}, 'map_amount_per_hashtag': {'rungis_aluminium': [(10, 11)], 'rungis_carton': [], 'rungis_papier': [(0, 1), (2, 3), (4, 5), (6, 7), (8, 9), (13, 14)], 'rungis_plastique_clair': [], 'rungis_plastique_dur': [], 'rungis_plastique_fonce': [(1, 2), (3, 4), (5, 6), (7, 8), (9, 10), (12, 13), (14, 15)], 'rungis_tapis_vide': [], 'rungis_tetrapak': [(11, 12)]}, 'count': {'rungis_aluminium': [(10, 11)], 'rungis_carton': [], 'rungis_papier': [(0, 1), (2, 3), (4, 5), (6, 7), (8, 9), (13, 14)], 'rungis_plastique_clair': [], 'rungis_plastique_dur': [], 'rungis_plastique_fonce': [(1, 2), (3, 4), (5, 6), (7, 8), (9, 10), (12, 13), (14, 15)], 'rungis_tapis_vide': [], 'rungis_tetrapak': [(11, 12)]}})}| Result context_with_local_rubbia.cache_model_config.map_io test rubbia : {'input': {}, 'output': {}}| ############################### TEST rubbia_split_dark ################################ warning , we can't find thcl infos in json_data warning , we can't find pdt infos in json_data Inside batchDatouExec : verbose : False # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : split_time_score_with_photo list_input_json : [] origin We have 1 , BBBBBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFFFFFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 64 ; length of list_pids : 64 ; length of list_args : 64 time to download the photos : 3.901383876800537 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : False we use local cache db, so we are in local job, but when commit will be implemented for local cache db, we could again use save number of steps : 1 step1:split_time_score_with_photo Sun Mar 23 11:27:54 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec ----- Debut du copier-coller des param necessaire pour fonction main de STS ----- TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('18', 4), ('19', 5), ('20', 5), ('24', 8), ('26', 6), ('17', 1), ('27', 9), ('51', 7), ('28', 2), ('21', 4), ('52', 2), ('25', 6), ('50', 3), ('22', 2)) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 06102021 4608689 Nombre de photos uploadées : 64 / 23040 (0%) 06102021 4608689 Nombre de photos taguées (types de déchets): 0 / 64 (0%) 06102021 4608689 Nombre de photos taguées (volume) : 0 / 64 (0%) elapsed_time : load_data_split_time_score 1.7404556274414062e-05 elapsed_time : order_list_meta_photo_and_scores 1.8596649169921875e-05 ???????????????????????????????????????????????????????????????? elapsed_time : fill_and_build_computed_from_old_data 0.0069997310638427734 elapsed_time : insert_dashboard_record_day_entry 0.025266170501708984 ***** BEGIN SPLIT BY DARK ***** To DO 08/10/21 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 1 time used for this insertion : 0.014288663864135742 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 2 time used for this insertion : 0.010965108871459961 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 3 time used for this insertion : 0.010832071304321289 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 4 time used for this insertion : 0.00908970832824707 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 5 time used for this insertion : 0.011051416397094727 elapsed_time : SPLIT_BY_DARK 0.07053852081298828 ***** END SPLIT BY DARK ***** ((1055001085,), (1055008638,), (1055010730,), (1055011086,), (1055012686,)) ***** BEGIN SPLIT TIME ***** False [12, 20, 29, 38, 51] 1633478400.0 `1633508253.0 1633507200.0 `1633508284.0 1633507200.0 `1633508316.0 1633507200.0 `1633508323.0 1633507200.0 `1633508333.0 1633507200.0 `1633508340.0 1633507200.0 `1633508358.0 1633507200.0 `1633508369.0 1633507200.0 `1633508385.0 1633507200.0 `1633508398.0 1633507200.0 `1633508416.0 1633507200.0 `1633508425.0 1633507200.0 `1633508434.0 1633507200.0 `1633508449.0 1633507200.0 `1633508458.0 1633507200.0 `1633508470.0 1633507200.0 `1633508491.0 1633507200.0 `1633508499.0 1633507200.0 `1633508508.0 1633507200.0 `1633508521.0 1633507200.0 `1633508524.0 1633507200.0 `1633508644.0 1633507200.0 `1633508652.0 1633507200.0 `1633508657.0 1633507200.0 `1633508669.0 1633507200.0 `1633508678.0 1633507200.0 `1633508684.0 1633507200.0 `1633508690.0 1633507200.0 `1633508696.0 1633507200.0 `1633508701.0 1633507200.0 `1633508725.0 1633507200.0 `1633508733.0 1633507200.0 `1633508739.0 1633507200.0 `1633508748.0 1633507200.0 `1633508759.0 1633507200.0 `1633508766.0 1633507200.0 `1633508772.0 1633507200.0 `1633508778.0 1633507200.0 `1633508781.0 1633507200.0 `1633508805.0 1633507200.0 `1633508813.0 1633507200.0 `1633508820.0 1633507200.0 `1633508824.0 1633507200.0 `1633508829.0 1633507200.0 `1633508833.0 1633507200.0 `1633508849.0 1633507200.0 `1633508858.0 1633507200.0 `1633508865.0 1633507200.0 `1633508871.0 1633507200.0 `1633508877.0 1633507200.0 `1633508886.0 1633507200.0 `1633508891.0 1633507200.0 `1633524639.0 1633521600.0 `1633524648.0 1633521600.0 `1633524657.0 1633521600.0 `1633524662.0 1633521600.0 `1633524675.0 1633521600.0 `1633524680.0 1633521600.0 `1633524683.0 1633521600.0 `1633524694.0 1633521600.0 `1633524700.0 1633521600.0 `1633524718.0 1633521600.0 `1633524722.0 1633521600.0 `1633524741.0 1633521600.0 list printed: [[0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11], [13, 14, 15, 16, 17, 18, 19], [21, 22, 23, 24, 25, 26, 27, 28], [30, 31, 32, 33, 34, 35, 36, 37], [39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50], [], [52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63]] forced_hashtag: jrm force hashtag to jrm elapsed_time : SPLIT_TIME 0.008481264114379883 ***** END SPLIT TIME ***** NUMBER BATCH : 7 list_ponderation used : [0.001, 0.001, 0.001, 0.001, 0.001] , list_hashtag_class_create_as_list : ['refus', 'jrm'] ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info result_one_balle_Type_jrm:{'day': '06102021', 'map_nb_amount': {0: 0, 1: 0, 2: 0, 3: 0, 4: 0}, 'map_time_amount': {0: 0, 1: 0, 2: 0, 3: 0, 4: 0}, 'duration': 172.0, 'nb_balles_papier': 0, 'begin_time_port': 'IMG_20211006_101733.jpg'} Production hashtag (incorrect ponderation at 20-10-18) : 0 ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info result_one_balle_Type_jrm:{'day': '06102021', 'map_nb_amount': {0: 0, 1: 0, 2: 0, 3: 0, 4: 0}, 'map_time_amount': {0: 0, 1: 0, 2: 0, 3: 0, 4: 0}, 'duration': 72.0, 'nb_balles_papier': 0, 'begin_time_port': 'IMG_20211006_102049.jpg'} Production hashtag (incorrect ponderation at 20-10-18) : 0 ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info result_one_balle_Type_jrm:{'day': '06102021', 'map_nb_amount': {0: 0, 1: 0, 2: 0, 3: 0, 4: 0}, 'map_time_amount': {0: 0, 1: 0, 2: 0, 3: 0, 4: 0}, 'duration': 52.0, 'nb_balles_papier': 0, 'begin_time_port': 'IMG_20211006_102404.jpg'} Production hashtag (incorrect ponderation at 20-10-18) : 0 ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info result_one_balle_Type_jrm:{'day': '06102021', 'map_nb_amount': {0: 0, 1: 0, 2: 0, 3: 0, 4: 0}, 'map_time_amount': {0: 0, 1: 0, 2: 0, 3: 0, 4: 0}, 'duration': 53.0, 'nb_balles_papier': 0, 'begin_time_port': 'IMG_20211006_102525.jpg'} Production hashtag (incorrect ponderation at 20-10-18) : 0 ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info result_one_balle_Type_jrm:{'day': '06102021', 'map_nb_amount': {0: 0, 1: 0, 2: 0, 3: 0, 4: 0}, 'map_time_amount': {0: 0, 1: 0, 2: 0, 3: 0, 4: 0}, 'duration': 81.0, 'nb_balles_papier': 0, 'begin_time_port': 'IMG_20211006_102645.jpg'} Production hashtag (incorrect ponderation at 20-10-18) : 0 Empty batch, bug or could have been filtered ! ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info result_one_balle_Type_jrm:{'day': '06102021', 'map_nb_amount': {0: 0, 1: 0, 2: 0, 3: 0, 4: 0}, 'map_time_amount': {0: 0, 1: 0, 2: 0, 3: 0, 4: 0}, 'duration': 102.0, 'nb_balles_papier': 0, 'begin_time_port': 'IMG_20211006_145039.jpg'} Production hashtag (incorrect ponderation at 20-10-18) : 0 We have rejected 0 photos because of the batch_size condition ! NUMBER BATCH list_of_portfolios_to_create : 6 list_same_port_ids : [4938484] find same portfolio which already exist 4938484 , we will use it list_same_port_ids : [4938485] find same portfolio which already exist 4938485 , we will use it list_same_port_ids : [4938486] find same portfolio which already exist 4938486 , we will use it list_same_port_ids : [4938487] find same portfolio which already exist 4938487 , we will use it list_same_port_ids : [4938488] find same portfolio which already exist 4938488 , we will use it list_same_port_ids : [4756245] find same portfolio which already exist 4756245 , we will use it Qualite : 0.049377889059021136 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 8564 mask_detect is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 8572 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 8573 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 8567 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 8567 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 8566 argmax have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 8568 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 8569 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 8569 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 9453 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 9453 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 8571 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 8571 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 8570 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 8570 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 8574 send_mail_cod have less inputs used (4) than in the step definition (5) : maybe we manage optionnal inputs ! Step 9126 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 8564 doesn't seem to be define in the database( WARNING : type of input 2 of step 8567 doesn't seem to be define in the database( WARNING : output 0 of step 8566 have datatype=6 whereas input 2 of step 8568 have datatype=5 WARNING : output 1 of step 8564 have datatype=2 whereas input 1 of step 8568 have datatype=7 WARNING : output 0 of step 8564 have datatype=16 whereas input 0 of step 8568 have datatype=1 WARNING : type of output 2 of step 8568 doesn't seem to be define in the database( WARNING : type of input 1 of step 8569 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 8568 doesn't seem to be define in the database( WARNING : type of input 1 of step 8571 doesn't seem to be define in the database( WARNING : type of output 1 of step 8571 doesn't seem to be define in the database( WARNING : type of input 3 of step 8570 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 8571 have datatype=10 whereas input 2 of step 8574 have datatype=6 WARNING : type of input 2 of step 9453 doesn't seem to be define in the database( WARNING : output 1 of step 8569 have datatype=7 whereas input 2 of step 9453 have datatype=None WARNING : type of output 3 of step 9453 doesn't seem to be define in the database( WARNING : type of input 2 of step 8571 doesn't seem to be define in the database( WARNING : type of output 3 of step 8564 doesn't seem to be define in the database( WARNING : type of input 1 of step 8572 doesn't seem to be define in the database( WARNING : type of output 3 of step 8564 doesn't seem to be define in the database( WARNING : type of input 1 of step 8573 doesn't seem to be define in the database( WARNING : type of output 1 of step 8572 doesn't seem to be define in the database( WARNING : type of input 3 of step 8567 doesn't seem to be define in the database( WARNING : type of output 1 of step 8573 doesn't seem to be define in the database( WARNING : type of input 4 of step 8567 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=4938484 AND mptpi.`type`=4038 To do Qualite : 0.051267724965616025 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 8564 mask_detect is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 8572 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 8573 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 8567 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 8567 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 8566 argmax have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 8568 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 8569 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 8569 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 9453 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 9453 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 8571 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 8571 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 8570 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 8570 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 8574 send_mail_cod have less inputs used (4) than in the step definition (5) : maybe we manage optionnal inputs ! Step 9126 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 8564 doesn't seem to be define in the database( WARNING : type of input 2 of step 8567 doesn't seem to be define in the database( WARNING : output 0 of step 8566 have datatype=6 whereas input 2 of step 8568 have datatype=5 WARNING : output 1 of step 8564 have datatype=2 whereas input 1 of step 8568 have datatype=7 WARNING : output 0 of step 8564 have datatype=16 whereas input 0 of step 8568 have datatype=1 WARNING : type of output 2 of step 8568 doesn't seem to be define in the database( WARNING : type of input 1 of step 8569 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 8568 doesn't seem to be define in the database( WARNING : type of input 1 of step 8571 doesn't seem to be define in the database( WARNING : type of output 1 of step 8571 doesn't seem to be define in the database( WARNING : type of input 3 of step 8570 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 8571 have datatype=10 whereas input 2 of step 8574 have datatype=6 WARNING : type of input 2 of step 9453 doesn't seem to be define in the database( WARNING : output 1 of step 8569 have datatype=7 whereas input 2 of step 9453 have datatype=None WARNING : type of output 3 of step 9453 doesn't seem to be define in the database( WARNING : type of input 2 of step 8571 doesn't seem to be define in the database( WARNING : type of output 3 of step 8564 doesn't seem to be define in the database( WARNING : type of input 1 of step 8572 doesn't seem to be define in the database( WARNING : type of output 3 of step 8564 doesn't seem to be define in the database( WARNING : type of input 1 of step 8573 doesn't seem to be define in the database( WARNING : type of output 1 of step 8572 doesn't seem to be define in the database( WARNING : type of input 3 of step 8567 doesn't seem to be define in the database( WARNING : type of output 1 of step 8573 doesn't seem to be define in the database( WARNING : type of input 4 of step 8567 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=4938485 AND mptpi.`type`=4038 To do Qualite : 0.06573670331612967 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 8564 mask_detect is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 8572 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 8573 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 8567 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 8567 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 8566 argmax have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 8568 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 8569 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 8569 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 9453 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 9453 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 8571 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 8571 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 8570 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 8570 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 8574 send_mail_cod have less inputs used (4) than in the step definition (5) : maybe we manage optionnal inputs ! Step 9126 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 8564 doesn't seem to be define in the database( WARNING : type of input 2 of step 8567 doesn't seem to be define in the database( WARNING : output 0 of step 8566 have datatype=6 whereas input 2 of step 8568 have datatype=5 WARNING : output 1 of step 8564 have datatype=2 whereas input 1 of step 8568 have datatype=7 WARNING : output 0 of step 8564 have datatype=16 whereas input 0 of step 8568 have datatype=1 WARNING : type of output 2 of step 8568 doesn't seem to be define in the database( WARNING : type of input 1 of step 8569 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 8568 doesn't seem to be define in the database( WARNING : type of input 1 of step 8571 doesn't seem to be define in the database( WARNING : type of output 1 of step 8571 doesn't seem to be define in the database( WARNING : type of input 3 of step 8570 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 8571 have datatype=10 whereas input 2 of step 8574 have datatype=6 WARNING : type of input 2 of step 9453 doesn't seem to be define in the database( WARNING : output 1 of step 8569 have datatype=7 whereas input 2 of step 9453 have datatype=None WARNING : type of output 3 of step 9453 doesn't seem to be define in the database( WARNING : type of input 2 of step 8571 doesn't seem to be define in the database( WARNING : type of output 3 of step 8564 doesn't seem to be define in the database( WARNING : type of input 1 of step 8572 doesn't seem to be define in the database( WARNING : type of output 3 of step 8564 doesn't seem to be define in the database( WARNING : type of input 1 of step 8573 doesn't seem to be define in the database( WARNING : type of output 1 of step 8572 doesn't seem to be define in the database( WARNING : type of input 3 of step 8567 doesn't seem to be define in the database( WARNING : type of output 1 of step 8573 doesn't seem to be define in the database( WARNING : type of input 4 of step 8567 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=4938486 AND mptpi.`type`=4038 To do Qualite : 0.12804353375222421 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 8564 mask_detect is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 8572 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 8573 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 8567 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 8567 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 8566 argmax have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 8568 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 8569 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 8569 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 9453 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 9453 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 8571 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 8571 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 8570 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 8570 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 8574 send_mail_cod have less inputs used (4) than in the step definition (5) : maybe we manage optionnal inputs ! Step 9126 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 8564 doesn't seem to be define in the database( WARNING : type of input 2 of step 8567 doesn't seem to be define in the database( WARNING : output 0 of step 8566 have datatype=6 whereas input 2 of step 8568 have datatype=5 WARNING : output 1 of step 8564 have datatype=2 whereas input 1 of step 8568 have datatype=7 WARNING : output 0 of step 8564 have datatype=16 whereas input 0 of step 8568 have datatype=1 WARNING : type of output 2 of step 8568 doesn't seem to be define in the database( WARNING : type of input 1 of step 8569 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 8568 doesn't seem to be define in the database( WARNING : type of input 1 of step 8571 doesn't seem to be define in the database( WARNING : type of output 1 of step 8571 doesn't seem to be define in the database( WARNING : type of input 3 of step 8570 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 8571 have datatype=10 whereas input 2 of step 8574 have datatype=6 WARNING : type of input 2 of step 9453 doesn't seem to be define in the database( WARNING : output 1 of step 8569 have datatype=7 whereas input 2 of step 9453 have datatype=None WARNING : type of output 3 of step 9453 doesn't seem to be define in the database( WARNING : type of input 2 of step 8571 doesn't seem to be define in the database( WARNING : type of output 3 of step 8564 doesn't seem to be define in the database( WARNING : type of input 1 of step 8572 doesn't seem to be define in the database( WARNING : type of output 3 of step 8564 doesn't seem to be define in the database( WARNING : type of input 1 of step 8573 doesn't seem to be define in the database( WARNING : type of output 1 of step 8572 doesn't seem to be define in the database( WARNING : type of input 3 of step 8567 doesn't seem to be define in the database( WARNING : type of output 1 of step 8573 doesn't seem to be define in the database( WARNING : type of input 4 of step 8567 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=4938487 AND mptpi.`type`=4038 To do Qualite : 0.07355022343618775 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 8564 mask_detect is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 8572 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 8573 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 8567 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 8567 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 8566 argmax have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 8568 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 8569 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 8569 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 9453 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 9453 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 8571 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 8571 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 8570 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 8570 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 8574 send_mail_cod have less inputs used (4) than in the step definition (5) : maybe we manage optionnal inputs ! Step 9126 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 8564 doesn't seem to be define in the database( WARNING : type of input 2 of step 8567 doesn't seem to be define in the database( WARNING : output 0 of step 8566 have datatype=6 whereas input 2 of step 8568 have datatype=5 WARNING : output 1 of step 8564 have datatype=2 whereas input 1 of step 8568 have datatype=7 WARNING : output 0 of step 8564 have datatype=16 whereas input 0 of step 8568 have datatype=1 WARNING : type of output 2 of step 8568 doesn't seem to be define in the database( WARNING : type of input 1 of step 8569 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 8568 doesn't seem to be define in the database( WARNING : type of input 1 of step 8571 doesn't seem to be define in the database( WARNING : type of output 1 of step 8571 doesn't seem to be define in the database( WARNING : type of input 3 of step 8570 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 8571 have datatype=10 whereas input 2 of step 8574 have datatype=6 WARNING : type of input 2 of step 9453 doesn't seem to be define in the database( WARNING : output 1 of step 8569 have datatype=7 whereas input 2 of step 9453 have datatype=None WARNING : type of output 3 of step 9453 doesn't seem to be define in the database( WARNING : type of input 2 of step 8571 doesn't seem to be define in the database( WARNING : type of output 3 of step 8564 doesn't seem to be define in the database( WARNING : type of input 1 of step 8572 doesn't seem to be define in the database( WARNING : type of output 3 of step 8564 doesn't seem to be define in the database( WARNING : type of input 1 of step 8573 doesn't seem to be define in the database( WARNING : type of output 1 of step 8572 doesn't seem to be define in the database( WARNING : type of input 3 of step 8567 doesn't seem to be define in the database( WARNING : type of output 1 of step 8573 doesn't seem to be define in the database( WARNING : type of input 4 of step 8567 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=4938488 AND mptpi.`type`=4038 To do Qualite : 0.10644996740301908 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 8564 mask_detect is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 8572 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 8573 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 8567 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 8567 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 8566 argmax have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 8568 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 8569 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 8569 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 9453 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 9453 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 8571 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 8571 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 8570 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 8570 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 8574 send_mail_cod have less inputs used (4) than in the step definition (5) : maybe we manage optionnal inputs ! Step 9126 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 8564 doesn't seem to be define in the database( WARNING : type of input 2 of step 8567 doesn't seem to be define in the database( WARNING : output 0 of step 8566 have datatype=6 whereas input 2 of step 8568 have datatype=5 WARNING : output 1 of step 8564 have datatype=2 whereas input 1 of step 8568 have datatype=7 WARNING : output 0 of step 8564 have datatype=16 whereas input 0 of step 8568 have datatype=1 WARNING : type of output 2 of step 8568 doesn't seem to be define in the database( WARNING : type of input 1 of step 8569 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 8568 doesn't seem to be define in the database( WARNING : type of input 1 of step 8571 doesn't seem to be define in the database( WARNING : type of output 1 of step 8571 doesn't seem to be define in the database( WARNING : type of input 3 of step 8570 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 8571 have datatype=10 whereas input 2 of step 8574 have datatype=6 WARNING : type of input 2 of step 9453 doesn't seem to be define in the database( WARNING : output 1 of step 8569 have datatype=7 whereas input 2 of step 9453 have datatype=None WARNING : type of output 3 of step 9453 doesn't seem to be define in the database( WARNING : type of input 2 of step 8571 doesn't seem to be define in the database( WARNING : type of output 3 of step 8564 doesn't seem to be define in the database( WARNING : type of input 1 of step 8572 doesn't seem to be define in the database( WARNING : type of output 3 of step 8564 doesn't seem to be define in the database( WARNING : type of input 1 of step 8573 doesn't seem to be define in the database( WARNING : type of output 1 of step 8572 doesn't seem to be define in the database( WARNING : type of input 3 of step 8567 doesn't seem to be define in the database( WARNING : type of output 1 of step 8573 doesn't seem to be define in the database( WARNING : type of input 4 of step 8567 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=4756245 AND mptpi.`type`=4038 To do elapsed_time : count_nb_balles_and_create_portfolio 1.0435760021209717 # DISPLAY ALL COLLECTED DATA : {'06102021': {'nb_upload': 64, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} ------ Fin du Copier-Coller ------ ---------- ONE RESULT --------- ([[0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11], [13, 14, 15, 16, 17, 18, 19], [21, 22, 23, 24, 25, 26, 27, 28], [30, 31, 32, 33, 34, 35, 36, 37], [39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50], [], [52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63]], {'Rungis_jrm': [(0, 1), (1, 2), (2, 3), (3, 4), (4, 5), (5, 6)]}, {4938484: {'list_of_photos': [1055000228, 1055000055, 1055003357, 1055007950, 1055003348, 1055007953, 1055000059, 1055007992, 1055008181, 1055003197, 1055003198, 1055008184], 'hashtag': 'jrm'}, 4938485: {'list_of_photos': [1055000063, 1055004600, 1055008597, 1055003134, 1055008599, 1055003679, 1055004627], 'hashtag': 'jrm'}, 4938486: {'list_of_photos': [1055004217, 1055010143, 1055004278, 1055010723, 1055003131, 1055003202, 1055010725, 1055000068], 'hashtag': 'jrm'}, 4938487: {'list_of_photos': [1055010737, 1055010739, 1055003278, 1055010743, 1055011072, 1055011074, 1055011076, 1055000070], 'hashtag': 'jrm'}, 4938488: {'list_of_photos': [1055011441, 1055011454, 1055003185, 1055011459, 1055001092, 1055001542, 1055003292, 1055011726, 1055011733, 1055011740, 1055012684, 1055002045], 'hashtag': 'jrm'}, 4756245: {'list_of_photos': [1055012722, 1055004798, 1055004608, 1055012727, 1055013693, 1055013724, 1055003249, 1055001545, 1055003259, 1055013727, 1055003266, 1055003261], 'hashtag': 'jrm'}}, {2107757407: 59}, {'amount_uploaded_and_tagged': {'06102021': {'nb_upload': 64, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}}, 'map_amount_per_hashtag': {'Rungis_jrm': [(0, 1), (1, 2), (2, 3), (3, 4), (4, 5), (5, 6)]}, 'count': {'Rungis_jrm': [(0, 1), (1, 2), (2, 3), (3, 4), (4, 5), (5, 6)]}}) ---------- END de ONE RESULT ---------- Suppression des photos Telecharges time spend for datou_step_exec : 6.588240623474121 time spend to save output : 0.0001304149627685547 total time spend for step 1 : 6.58837103843689 caffe_path_current : About to save ! 1 Inside saveOutput : final : True verbose : False saveOutput not yet implemented for datou_step.type : split_time_score_with_photo we use saveGeneral [1055013727, 1055013724, 1055013693, 1055012727, 1055012722, 1055012686, 1055012684, 1055011740, 1055011733, 1055011726, 1055011459, 1055011454, 1055011441, 1055003357, 1055003348, 1055003292, 1055003278, 1055003266, 1055003261, 1055003259, 1055003249, 1055003202, 1055003198, 1055003197, 1055003185, 1055003134, 1055003131, 1055002045, 1055001545, 1055001542, 1055001092, 1055001085, 1055000228, 1055000070, 1055000068, 1055000063, 1055000059, 1055000055, 1055011086, 1055011076, 1055011074, 1055011072, 1055010743, 1055010739, 1055010737, 1055010730, 1055010725, 1055010723, 1055010143, 1055008638, 1055008599, 1055008597, 1055008184, 1055008181, 1055007992, 1055007953, 1055007950, 1055004798, 1055004627, 1055004608, 1055004600, 1055004278, 1055004217, 1055003679] Looping around the photos to save general results len do output : 5 /[[0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11], [13, 14, 15, 16, 17, 18, 19], [21, 22, 23, 24, 25, 26, 27, 28], [30, 31, 32, 33, 34, 35, 36, 37], [39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50], [], [52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63]] /{'Rungis_jrm': [(0, 1), (1, 2), (2, 3), (3, 4), (4, 5), (5, 6)]} /{4938484: {'list_of_photos': [1055000228, 1055000055, 1055003357, 1055007950, 1055003348, 1055007953, 1055000059, 1055007992, 1055008181, 1055003197, 1055003198, 1055008184], 'hashtag': 'jrm'}, 4938485: {'list_of_photos': [1055000063, 1055004600, 1055008597, 1055003134, 1055008599, 1055003679, 1055004627], 'hashtag': 'jrm'}, 4938486: {'list_of_photos': [1055004217, 1055010143, 1055004278, 1055010723, 1055003131, 1055003202, 1055010725, 1055000068], 'hashtag': 'jrm'}, 4938487: {'list_of_photos': [1055010737, 1055010739, 1055003278, 1055010743, 1055011072, 1055011074, 1055011076, 1055000070], 'hashtag': 'jrm'}, 4938488: {'list_of_photos': [1055011441, 1055011454, 1055003185, 1055011459, 1055001092, 1055001542, 1055003292, 1055011726, 1055011733, 1055011740, 1055012684, 1055002045], 'hashtag': 'jrm'}, 4756245: {'list_of_photos': [1055012722, 1055004798, 1055004608, 1055012727, 1055013693, 1055013724, 1055003249, 1055001545, 1055003259, 1055013727, 1055003266, 1055003261], 'hashtag': 'jrm'}} /{2107757407: 59} /{'amount_uploaded_and_tagged': {'06102021': {'nb_upload': 64, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}}, 'map_amount_per_hashtag': {'Rungis_jrm': [(0, 1), (1, 2), (2, 3), (3, 4), (4, 5), (5, 6)]}, 'count': {'Rungis_jrm': [(0, 1), (1, 2), (2, 3), (3, 4), (4, 5), (5, 6)]}} before output type Managing all output in save final without adding information in the mtr_datou_result ('3787', None, None, None, None, None, None, None, None) ('3787', '4608689', '1055013727', None, None, None, None, None, None) ('3787', None, None, None, None, None, None, None, None) ('3787', '4608689', '1055013724', None, None, None, None, None, None) ('3787', None, None, None, None, None, None, None, None) ('3787', '4608689', '1055013693', None, None, None, None, None, None) ('3787', None, None, None, None, None, None, None, None) ('3787', '4608689', '1055012727', None, None, None, None, None, None) ('3787', None, None, None, None, None, None, None, None) ('3787', '4608689', '1055012722', None, None, None, None, None, None) ('3787', None, None, None, None, None, None, None, None) ('3787', '4608689', '1055012686', None, None, None, None, None, None) ('3787', None, None, None, None, None, None, None, None) ('3787', '4608689', '1055012684', None, None, None, None, None, None) ('3787', None, None, None, None, None, None, None, None) ('3787', '4608689', '1055011740', None, None, None, None, None, None) ('3787', None, None, None, None, None, None, None, None) ('3787', '4608689', '1055011733', None, None, None, None, None, None) ('3787', None, None, None, None, None, None, None, None) ('3787', '4608689', '1055011726', None, None, None, None, None, None) ('3787', None, None, None, None, None, None, None, None) ('3787', '4608689', '1055011459', None, None, None, None, None, None) ('3787', None, None, None, None, None, None, None, None) ('3787', '4608689', '1055011454', None, None, None, None, None, None) ('3787', None, None, None, None, None, None, None, None) ('3787', '4608689', '1055011441', None, None, None, None, None, None) ('3787', None, None, None, None, None, None, None, None) ('3787', '4608689', '1055003357', None, None, None, None, None, None) ('3787', None, None, None, None, None, None, None, None) ('3787', '4608689', '1055003348', None, None, None, None, None, None) ('3787', None, None, None, None, None, None, None, None) ('3787', '4608689', '1055003292', None, None, None, None, None, None) ('3787', None, None, None, None, None, None, None, None) ('3787', '4608689', '1055003278', None, None, None, None, None, None) ('3787', None, None, None, None, None, None, None, None) ('3787', '4608689', '1055003266', None, None, None, None, None, None) ('3787', None, None, None, None, None, None, None, None) ('3787', '4608689', '1055003261', None, None, None, None, None, None) ('3787', None, None, None, None, None, None, None, None) ('3787', '4608689', '1055003259', None, None, None, None, None, None) ('3787', None, None, None, None, None, None, None, None) ('3787', '4608689', '1055003249', None, None, None, None, None, None) ('3787', None, None, None, None, None, None, None, None) ('3787', '4608689', '1055003202', None, None, None, None, None, None) ('3787', None, None, None, None, None, None, None, None) ('3787', '4608689', '1055003198', None, None, None, None, None, None) ('3787', None, None, None, None, None, None, None, None) ('3787', '4608689', '1055003197', None, None, None, None, None, None) ('3787', None, None, None, None, None, None, None, None) ('3787', '4608689', '1055003185', None, None, None, None, None, None) ('3787', None, None, None, None, None, None, None, None) ('3787', '4608689', '1055003134', None, None, None, None, None, None) ('3787', None, None, None, None, None, None, None, None) ('3787', '4608689', '1055003131', None, None, None, None, None, None) ('3787', None, None, None, None, None, None, None, None) ('3787', '4608689', '1055002045', None, None, None, None, None, None) ('3787', None, None, None, None, None, None, None, None) ('3787', '4608689', '1055001545', None, None, None, None, None, None) ('3787', None, None, None, None, None, None, None, None) ('3787', '4608689', '1055001542', None, None, None, None, None, None) ('3787', None, None, None, None, None, None, None, None) ('3787', '4608689', '1055001092', None, None, None, None, None, None) ('3787', None, None, None, None, None, None, None, None) ('3787', '4608689', '1055001085', None, None, None, None, None, None) ('3787', None, None, None, None, None, None, None, None) ('3787', '4608689', '1055000228', None, None, None, None, None, None) ('3787', None, None, None, None, None, None, None, None) ('3787', '4608689', '1055000070', None, None, None, None, None, None) ('3787', None, None, None, None, None, None, None, None) ('3787', '4608689', '1055000068', None, None, None, None, None, None) ('3787', None, None, None, None, None, None, None, None) ('3787', '4608689', '1055000063', None, None, None, None, None, None) ('3787', None, None, None, None, None, None, None, None) ('3787', '4608689', '1055000059', None, None, None, None, None, None) ('3787', None, None, None, None, None, None, None, None) ('3787', '4608689', '1055000055', None, None, None, None, None, None) ('3787', None, None, None, None, None, None, None, None) ('3787', '4608689', '1055011086', None, None, None, None, None, None) ('3787', None, None, None, None, None, None, None, None) ('3787', '4608689', '1055011076', None, None, None, None, None, None) ('3787', None, None, None, None, None, None, None, None) ('3787', '4608689', '1055011074', None, None, None, None, None, None) ('3787', None, None, None, None, None, None, None, None) ('3787', '4608689', '1055011072', None, None, None, None, None, None) ('3787', None, None, None, None, None, None, None, None) ('3787', '4608689', '1055010743', None, None, None, None, None, None) ('3787', None, None, None, None, None, None, None, None) ('3787', '4608689', '1055010739', None, None, None, None, None, None) ('3787', None, None, None, None, None, None, None, None) ('3787', '4608689', '1055010737', None, None, None, None, None, None) ('3787', None, None, None, None, None, None, None, None) ('3787', '4608689', '1055010730', None, None, None, None, None, None) ('3787', None, None, None, None, None, None, None, None) ('3787', '4608689', '1055010725', None, None, None, None, None, None) ('3787', None, None, None, None, None, None, None, None) ('3787', '4608689', '1055010723', None, None, None, None, None, None) ('3787', None, None, None, None, None, None, None, None) ('3787', '4608689', '1055010143', None, None, None, None, None, None) ('3787', None, None, None, None, None, None, None, None) ('3787', '4608689', '1055008638', None, None, None, None, None, None) ('3787', None, None, None, None, None, None, None, None) ('3787', '4608689', '1055008599', None, None, None, None, None, None) ('3787', None, None, None, None, None, None, None, None) ('3787', '4608689', '1055008597', None, None, None, None, None, None) ('3787', None, None, None, None, None, None, None, None) ('3787', '4608689', '1055008184', None, None, None, None, None, None) ('3787', None, None, None, None, None, None, None, None) ('3787', '4608689', '1055008181', None, None, None, None, None, None) ('3787', None, None, None, None, None, None, None, None) ('3787', '4608689', '1055007992', None, None, None, None, None, None) ('3787', None, None, None, None, None, None, None, None) ('3787', '4608689', '1055007953', None, None, None, None, None, None) ('3787', None, None, None, None, None, None, None, None) ('3787', '4608689', '1055007950', None, None, None, None, None, None) ('3787', None, None, None, None, None, None, None, None) ('3787', '4608689', '1055004798', None, None, None, None, None, None) ('3787', None, None, None, None, None, None, None, None) ('3787', '4608689', '1055004627', None, None, None, None, None, None) ('3787', None, None, None, None, None, None, None, None) ('3787', '4608689', '1055004608', None, None, None, None, None, None) ('3787', None, None, None, None, None, None, None, None) ('3787', '4608689', '1055004600', None, None, None, None, None, None) ('3787', None, None, None, None, None, None, None, None) ('3787', '4608689', '1055004278', None, None, None, None, None, None) ('3787', None, None, None, None, None, None, None, None) ('3787', '4608689', '1055004217', None, None, None, None, None, None) ('3787', None, None, None, None, None, None, None, None) ('3787', '4608689', '1055003679', None, None, None, None, None, None) begin to insert list_values into mtr_datou_result : length of list_values in save_final : 64 time used for this insertion : 0.035550594329833984 save_final save missing photos in datou_result : After save, about to update current ! datou_cur_ids : [] len(datou.list_steps) : 1 output : ([[0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11], [13, 14, 15, 16, 17, 18, 19], [21, 22, 23, 24, 25, 26, 27, 28], [30, 31, 32, 33, 34, 35, 36, 37], [39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50], [], [52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63]], {'Rungis_jrm': [(0, 1), (1, 2), (2, 3), (3, 4), (4, 5), (5, 6)]}, {4938484: {'list_of_photos': [1055000228, 1055000055, 1055003357, 1055007950, 1055003348, 1055007953, 1055000059, 1055007992, 1055008181, 1055003197, 1055003198, 1055008184], 'hashtag': 'jrm'}, 4938485: {'list_of_photos': [1055000063, 1055004600, 1055008597, 1055003134, 1055008599, 1055003679, 1055004627], 'hashtag': 'jrm'}, 4938486: {'list_of_photos': [1055004217, 1055010143, 1055004278, 1055010723, 1055003131, 1055003202, 1055010725, 1055000068], 'hashtag': 'jrm'}, 4938487: {'list_of_photos': [1055010737, 1055010739, 1055003278, 1055010743, 1055011072, 1055011074, 1055011076, 1055000070], 'hashtag': 'jrm'}, 4938488: {'list_of_photos': [1055011441, 1055011454, 1055003185, 1055011459, 1055001092, 1055001542, 1055003292, 1055011726, 1055011733, 1055011740, 1055012684, 1055002045], 'hashtag': 'jrm'}, 4756245: {'list_of_photos': [1055012722, 1055004798, 1055004608, 1055012727, 1055013693, 1055013724, 1055003249, 1055001545, 1055003259, 1055013727, 1055003266, 1055003261], 'hashtag': 'jrm'}}, {2107757407: 59}, {'amount_uploaded_and_tagged': {'06102021': {'nb_upload': 64, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}}, 'map_amount_per_hashtag': {'Rungis_jrm': [(0, 1), (1, 2), (2, 3), (3, 4), (4, 5), (5, 6)]}, 'count': {'Rungis_jrm': [(0, 1), (1, 2), (2, 3), (3, 4), (4, 5), (5, 6)]}}) Result test split dark : ([[0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11], [13, 14, 15, 16, 17, 18, 19], [21, 22, 23, 24, 25, 26, 27, 28], [30, 31, 32, 33, 34, 35, 36, 37], [39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50], [], [52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63]], {'Rungis_jrm': [(0, 1), (1, 2), (2, 3), (3, 4), (4, 5), (5, 6)]}, {4938484: {'list_of_photos': [1055000228, 1055000055, 1055003357, 1055007950, 1055003348, 1055007953, 1055000059, 1055007992, 1055008181, 1055003197, 1055003198, 1055008184], 'hashtag': 'jrm'}, 4938485: {'list_of_photos': [1055000063, 1055004600, 1055008597, 1055003134, 1055008599, 1055003679, 1055004627], 'hashtag': 'jrm'}, 4938486: {'list_of_photos': [1055004217, 1055010143, 1055004278, 1055010723, 1055003131, 1055003202, 1055010725, 1055000068], 'hashtag': 'jrm'}, 4938487: {'list_of_photos': [1055010737, 1055010739, 1055003278, 1055010743, 1055011072, 1055011074, 1055011076, 1055000070], 'hashtag': 'jrm'}, 4938488: {'list_of_photos': [1055011441, 1055011454, 1055003185, 1055011459, 1055001092, 1055001542, 1055003292, 1055011726, 1055011733, 1055011740, 1055012684, 1055002045], 'hashtag': 'jrm'}, 4756245: {'list_of_photos': [1055012722, 1055004798, 1055004608, 1055012727, 1055013693, 1055013724, 1055003249, 1055001545, 1055003259, 1055013727, 1055003266, 1055003261], 'hashtag': 'jrm'}}, {2107757407: 59}, {'amount_uploaded_and_tagged': {'06102021': {'nb_upload': 64, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}}, 'map_amount_per_hashtag': {'Rungis_jrm': [(0, 1), (1, 2), (2, 3), (3, 4), (4, 5), (5, 6)]}, 'count': {'Rungis_jrm': [(0, 1), (1, 2), (2, 3), (3, 4), (4, 5), (5, 6)]}})| ############################### TEST rubbia_append ################################ warning , we can't find thcl infos in json_data warning , we can't find pdt infos in json_data Inside batchDatouExec : verbose : False # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : split_time_score list_input_json : [] origin We have 1 , We have 1 , we have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB time to download the photos : 0.027413606643676758 About to test input to load Calling datou_exec Inside datou_exec : verbose : False we use local cache db, so we are in local job, but when commit will be implemented for local cache db, we could again use save number of steps : 1 step1:split_time_score Sun Mar 23 11:28:01 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('30', 1), ('36', 1), ('43', 1)) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 21092021 4599006 Nombre de photos uploadées : 3 / 23040 (0%) 21092021 4599006 Nombre de photos taguées (types de déchets): 0 / 3 (0%) 21092021 4599006 Nombre de photos taguées (volume) : 0 / 3 (0%) elapsed_time : load_data_split_time_score 3.5762786865234375e-06 elapsed_time : order_list_meta_photo_and_scores 9.5367431640625e-06 ??? elapsed_time : fill_and_build_computed_from_old_data 0.00045371055603027344 elapsed_time : insert_dashboard_record_day_entry 0.0233914852142334 ---------- APPEND TASK BEGIN ---------- ---------- APPEND TASK END ---------- We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 4599006 order by id desc limit 1 NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'21092021': {'nb_upload': 3, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('12', 1), ('-0', 3)) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 21092021 4505992 Nombre de photos uploadées : 1 / 23040 (0%) 21092021 4505992 Nombre de photos taguées (types de déchets): 0 / 1 (0%) 21092021 4505992 Nombre de photos taguées (volume) : 0 / 1 (0%) elapsed_time : load_data_split_time_score 3.5762786865234375e-06 elapsed_time : order_list_meta_photo_and_scores 8.106231689453125e-06 ? elapsed_time : fill_and_build_computed_from_old_data 0.0001850128173828125 elapsed_time : insert_dashboard_record_day_entry 0.021813154220581055 ---------- APPEND TASK BEGIN ---------- ---------- APPEND TASK END ---------- We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 4599006 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_COD_P4505992_21-09-2021.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 4505992 order by id desc limit 1 NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'21092021': {'nb_upload': 1, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} time spend for datou_step_exec : 2.660611391067505 time spend to save output : 3.170967102050781e-05 total time spend for step 1 : 2.6606431007385254 caffe_path_current : About to save ! 1 Inside saveOutput : final : True verbose : False saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1054572537, 1054572534, 1054572532, 1051605195] Looping around the photos to save general results len do output : 2 /4599006Didn't retrieve data . /4505992Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3856', None, None, None, None, None, None, None, None) ('3856', '4599006', '1054572537', None, None, None, None, None, None) ('3856', None, None, None, None, None, None, None, None) ('3856', '4599006', '1054572534', None, None, None, None, None, None) ('3856', None, None, None, None, None, None, None, None) ('3856', '4599006', '1054572532', None, None, None, None, None, None) ('3856', None, None, None, None, None, None, None, None) ('3856', '4505992', '1051605195', None, None, None, None, None, None) begin to insert list_values into mtr_datou_result : length of list_values in save_final : 6 time used for this insertion : 0.021976709365844727 save_final save missing photos in datou_result : After save, about to update current ! ############################### TEST rubbia_horaire ################################ warning , we can't find thcl infos in json_data warning , we can't find pdt infos in json_data Inside batchDatouExec : verbose : False # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : split_time_score list_input_json : [] origin We have 1 , we have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB time to download the photos : 0.02132558822631836 About to test input to load Calling datou_exec Inside datou_exec : verbose : False we use local cache db, so we are in local job, but when commit will be implemented for local cache db, we could again use save number of steps : 1 step1:split_time_score Sun Mar 23 11:28:04 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('02', 6), ('05', 8), ('06', 19)) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 08032021 3609515 Nombre de photos uploadées : 33 / 23040 (0%) 08032021 3609515 Nombre de photos taguées (types de déchets): 0 / 33 (0%) 08032021 3609515 Nombre de photos taguées (volume) : 0 / 33 (0%) elapsed_time : load_data_split_time_score 5.4836273193359375e-06 elapsed_time : order_list_meta_photo_and_scores 1.0967254638671875e-05 ????????????????????????????????? elapsed_time : fill_and_build_computed_from_old_data 0.0034732818603515625 elapsed_time : insert_dashboard_record_day_entry 0.02356266975402832 Creating list_photo_total elapsed_time : select_descriptors 0.011947393417358398 08032021 3609515 Nombre de photos avec descriptors (type 3963) : 0 / 33 (0%) Missing descriptors for photos 0 and 1014054233 0:00:00|ON:Missing descriptors for photos 1014054233 and 1014054232 Missing descriptors for photos 1014054232 and 1014054231 Missing descriptors for photos 1014054231 and 1014054230 Missing descriptors for photos 1014054230 and 1014054235 Missing descriptors for photos 1014054235 and 1014054234 Missing descriptors for photos 1014054234 and 1014097492 Missing descriptors for photos 1014097492 and 1014097499 Missing descriptors for photos 1014097499 and 1014097497 Missing descriptors for photos 1014097497 and 1014097580 Missing descriptors for photos 1014097580 and 1014097924 Missing descriptors for photos 1014097924 and 1014098236 Missing descriptors for photos 1014098236 and 1014098602 Missing descriptors for photos 1014098602 and 1014099035 Missing descriptors for photos 1014099035 and 1014105778 Missing descriptors for photos 1014105778 and 1014105777 Missing descriptors for photos 1014105777 and 1014105784 Missing descriptors for photos 1014105784 and 1014105783 Missing descriptors for photos 1014105783 and 1014105782 Missing descriptors for photos 1014105782 and 1014105781 Missing descriptors for photos 1014105781 and 1014105786 Missing descriptors for photos 1014105786 and 1014105785 Missing descriptors for photos 1014105785 and 1014105791 Missing descriptors for photos 1014105791 and 1014105790 Missing descriptors for photos 1014105790 and 1014105798 Missing descriptors for photos 1014105798 and 1014105797 Missing descriptors for photos 1014105797 and 1014105796 Missing descriptors for photos 1014105796 and 1014105795 Missing descriptors for photos 1014105795 and 1014105800 Missing descriptors for photos 1014105800 and 1014105799 Missing descriptors for photos 1014105799 and 1014106095 Missing descriptors for photos 1014106095 and 1014106094 Missing descriptors for photos 1014106094 and 1014106093 08032021 Removing 0 photos because of the 'same image' condition Total on : 0 Total off : 0.0 list_time_off Warning in study_and_display_distrib_list : min=max : 0.0 0.0 dist_desc Warning in study_and_display_distrib_list : min=max : -1 -1 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 33 time used for this insertion : 0.02348184585571289 photos_removed : len 0 elapsed_time : remove_photo_duplicate 0.047016143798828125 To do, maybe not at the correct place ! .................................force hashtag to JRM elapsed_time : CREATE_PORT_BATCH_BY_HOUR 0.006011009216308594 NUMBER BATCH : 3 list_ponderation used : [1e-05, 1e-05, 1e-05, 1e-05, 1e-05] , list_hashtag_class_create_as_list : ['jrm'] We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We have rejected 0 photos because of the batch_size condition ! NUMBER BATCH list_of_portfolios_to_create : 0 elapsed_time : count_nb_balles_and_create_portfolio 0.022769451141357422 # DISPLAY ALL COLLECTED DATA : {'08032021': {'nb_upload': 33, 'nb_taggue_class': 0, 'nb_taggue_densite': 0, 'nb_descriptors': 0}} time spend for datou_step_exec : 0.18235993385314941 time spend to save output : 2.8133392333984375e-05 total time spend for step 1 : 0.1823880672454834 caffe_path_current : About to save ! 1 Inside saveOutput : final : True verbose : False saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1014106095, 1014106094, 1014106093, 1014105800, 1014105799, 1014105798, 1014105797, 1014105796, 1014105795, 1014105791, 1014105790, 1014105786, 1014105785, 1014105784, 1014105783, 1014105782, 1014105781, 1014105778, 1014105777, 1014099035, 1014098602, 1014098236, 1014097924, 1014097580, 1014097499, 1014097497, 1014097492, 1014054235, 1014054234, 1014054233, 1014054232, 1014054231, 1014054230] Looping around the photos to save general results len do output : 1 /3609515Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3181', None, None, None, None, None, None, None, None) ('3181', '3609515', '1014106095', None, None, None, None, None, None) ('3181', None, None, None, None, None, None, None, None) ('3181', '3609515', '1014106094', None, None, None, None, None, None) ('3181', None, None, None, None, None, None, None, None) ('3181', '3609515', '1014106093', None, None, None, None, None, None) ('3181', None, None, None, None, None, None, None, None) ('3181', '3609515', '1014105800', None, None, None, None, None, None) ('3181', None, None, None, None, None, None, None, None) ('3181', '3609515', '1014105799', None, None, None, None, None, None) ('3181', None, None, None, None, None, None, None, None) ('3181', '3609515', '1014105798', None, None, None, None, None, None) ('3181', None, None, None, None, None, None, None, None) ('3181', '3609515', '1014105797', None, None, None, None, None, None) ('3181', None, None, None, None, None, None, None, None) ('3181', '3609515', '1014105796', None, None, None, None, None, None) ('3181', None, None, None, None, None, None, None, None) ('3181', '3609515', '1014105795', None, None, None, None, None, None) ('3181', None, None, None, None, None, None, None, None) ('3181', '3609515', '1014105791', None, None, None, None, None, None) ('3181', None, None, None, None, None, None, None, None) ('3181', '3609515', '1014105790', None, None, None, None, None, None) ('3181', None, None, None, None, None, None, None, None) ('3181', '3609515', '1014105786', None, None, None, None, None, None) ('3181', None, None, None, None, None, None, None, None) ('3181', '3609515', '1014105785', None, None, None, None, None, None) ('3181', None, None, None, None, None, None, None, None) ('3181', '3609515', '1014105784', None, None, None, None, None, None) ('3181', None, None, None, None, None, None, None, None) ('3181', '3609515', '1014105783', None, None, None, None, None, None) ('3181', None, None, None, None, None, None, None, None) ('3181', '3609515', '1014105782', None, None, None, None, None, None) ('3181', None, None, None, None, None, None, None, None) ('3181', '3609515', '1014105781', None, None, None, None, None, None) ('3181', None, None, None, None, None, None, None, None) ('3181', '3609515', '1014105778', None, None, None, None, None, None) ('3181', None, None, None, None, None, None, None, None) ('3181', '3609515', '1014105777', None, None, None, None, None, None) ('3181', None, None, None, None, None, None, None, None) ('3181', '3609515', '1014099035', None, None, None, None, None, None) ('3181', None, None, None, None, None, None, None, None) ('3181', '3609515', '1014098602', None, None, None, None, None, None) ('3181', None, None, None, None, None, None, None, None) ('3181', '3609515', '1014098236', None, None, None, None, None, None) ('3181', None, None, None, None, None, None, None, None) ('3181', '3609515', '1014097924', None, None, None, None, None, None) ('3181', None, None, None, None, None, None, None, None) ('3181', '3609515', '1014097580', None, None, None, None, None, None) ('3181', None, None, None, None, None, None, None, None) ('3181', '3609515', '1014097499', None, None, None, None, None, None) ('3181', None, None, None, None, None, None, None, None) ('3181', '3609515', '1014097497', None, None, None, None, None, None) ('3181', None, None, None, None, None, None, None, None) ('3181', '3609515', '1014097492', None, None, None, None, None, None) ('3181', None, None, None, None, None, None, None, None) ('3181', '3609515', '1014054235', None, None, None, None, None, None) ('3181', None, None, None, None, None, None, None, None) ('3181', '3609515', '1014054234', None, None, None, None, None, None) ('3181', None, None, None, None, None, None, None, None) ('3181', '3609515', '1014054233', None, None, None, None, None, None) ('3181', None, None, None, None, None, None, None, None) ('3181', '3609515', '1014054232', None, None, None, None, None, None) ('3181', None, None, None, None, None, None, None, None) ('3181', '3609515', '1014054231', None, None, None, None, None, None) ('3181', None, None, None, None, None, None, None, None) ('3181', '3609515', '1014054230', None, None, None, None, None, None) begin to insert list_values into mtr_datou_result : length of list_values in save_final : 34 time used for this insertion : 0.023593902587890625 save_final save missing photos in datou_result : After save, about to update current ! got : {'Rungis_JRM': []} expected : {'Rungis_JRM': [(0, 1), (1, 2), (2, 3)]} ERROR rubbia_horaire FAILED ############################### TEST rle_unique_nms_with_priority ################################ t Inside batchDatouExec : verbose : False # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : rle_unique_nms_with_priority list_input_json : [] origin BFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 1 ; length of list_pids : 1 ; length of list_args : 1 time to download the photos : 0.1346452236175537 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : False number of steps : 1 step1:rle_unique_nms_with_priority Sun Mar 23 11:28:04 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Begin step rle-unique-nms batch 1 Loaded 10 chid ids of type : 2804 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 10 nb_hashtags : 2 time to prepare the origin masks : 0.3157012462615967 time for calcul the mask position with numpy : 0.0060765743255615234 nb_pixel_total : 217207 time to create 1 rle with new method : 0.048027992248535156 time for calcul the mask position with numpy : 0.0029768943786621094 nb_pixel_total : 1008 time to create 1 rle with old method : 0.0023016929626464844 time for calcul the mask position with numpy : 0.003008127212524414 nb_pixel_total : 751 time to create 1 rle with old method : 0.0017042160034179688 time for calcul the mask position with numpy : 0.002887725830078125 nb_pixel_total : 722 time to create 1 rle with old method : 0.001641988754272461 time for calcul the mask position with numpy : 0.0030791759490966797 nb_pixel_total : 2949 time to create 1 rle with old method : 0.0068531036376953125 time for calcul the mask position with numpy : 0.002866029739379883 nb_pixel_total : 497 time to create 1 rle with old method : 0.0012121200561523438 time for calcul the mask position with numpy : 0.0029654502868652344 nb_pixel_total : 1086 time to create 1 rle with old method : 0.013987064361572266 time for calcul the mask position with numpy : 0.005549430847167969 nb_pixel_total : 1924 time to create 1 rle with old method : 0.004693508148193359 time for calcul the mask position with numpy : 0.003458738327026367 nb_pixel_total : 413 time to create 1 rle with old method : 0.0010607242584228516 time for calcul the mask position with numpy : 0.003147602081298828 nb_pixel_total : 526 time to create 1 rle with old method : 0.0012547969818115234 create new chi : 0.11918163299560547 time to delete rle : 0.02401113510131836 batch 1 Loaded 10 chid ids of type : 2805 Number RLEs to save : 1674 TO DO : save crop sub photo not yet done ! save time : 0.8940057754516602 map_output_result : {998957128: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms time spend for datou_step_exec : 3.0132389068603516 time spend to save output : 0.00011444091796875 total time spend for step 1 : 3.0133533477783203 caffe_path_current : About to save ! 0 After save, about to update current ! datou_cur_ids : [] len(datou.list_steps) : 1 output : {998957128: (0.0, 'Should be the crop_list due to order', 0)} Inside batchDatouExec : verbose : False # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : rle_unique_nms_with_priority list_input_json : [] origin BFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 1 ; length of list_pids : 1 ; length of list_args : 1 time to download the photos : 0.7195687294006348 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : False number of steps : 1 step1:rle_unique_nms_with_priority Sun Mar 23 11:28:08 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Begin step rle-unique-nms batch 1 Loaded 10 chid ids of type : 4169 seulement à utiliser dans la step consolidation batch 1 Loaded 10 chid ids of type : 2805 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.3138127326965332 map_output_result : {1066511071: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms time spend for datou_step_exec : 3.215259075164795 time spend to save output : 8.58306884765625e-05 total time spend for step 1 : 3.2153449058532715 caffe_path_current : About to save ! 0 After save, about to update current ! datou_cur_ids : [] len(datou.list_steps) : 1 output : {1066511071: (0.0, 'Should be the crop_list due to order', 0)} Inside batchDatouExec : verbose : False # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : rle_unique_nms_with_priority list_input_json : [] origin BFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 1 ; length of list_pids : 1 ; length of list_args : 1 time to download the photos : 0.21549415588378906 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : False number of steps : 1 step1:rle_unique_nms_with_priority Sun Mar 23 11:28:11 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Begin step rle-unique-nms batch 1 Loaded 91 chid ids of type : 2596 +++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 43 nb_hashtags : 2 time to prepare the origin masks : 26.08884334564209 time for calcul the mask position with numpy : 0.3929586410522461 nb_pixel_total : 5233657 time to create 1 rle with new method : 0.40520691871643066 time for calcul the mask position with numpy : 0.031912803649902344 nb_pixel_total : 11972 time to create 1 rle with old method : 0.0255434513092041 time for calcul the mask position with numpy : 0.03172564506530762 nb_pixel_total : 15054 time to create 1 rle with old method : 0.033377885818481445 time for calcul the mask position with numpy : 0.03117060661315918 nb_pixel_total : 13954 time to create 1 rle with old method : 0.029136180877685547 time for calcul the mask position with numpy : 0.030093669891357422 nb_pixel_total : 4888 time to create 1 rle with old method : 0.010327816009521484 time for calcul the mask position with numpy : 0.04410982131958008 nb_pixel_total : 1188492 time to create 1 rle with new method : 0.4165642261505127 time for calcul the mask position with numpy : 0.033991336822509766 nb_pixel_total : 184585 time to create 1 rle with new method : 0.35788893699645996 time for calcul the mask position with numpy : 0.03166365623474121 nb_pixel_total : 18620 time to create 1 rle with old method : 0.038298606872558594 time for calcul the mask position with numpy : 0.031139850616455078 nb_pixel_total : 62945 time to create 1 rle with old method : 0.1283102035522461 time for calcul the mask position with numpy : 0.03159332275390625 nb_pixel_total : 9427 time to create 1 rle with old method : 0.019672155380249023 time for calcul the mask position with numpy : 0.030701637268066406 nb_pixel_total : 9081 time to create 1 rle with old method : 0.01852703094482422 time for calcul the mask position with numpy : 0.030623674392700195 nb_pixel_total : 15987 time to create 1 rle with old method : 0.03367733955383301 time for calcul the mask position with numpy : 0.03207206726074219 nb_pixel_total : 33276 time to create 1 rle with old method : 0.07169222831726074 time for calcul the mask position with numpy : 0.03274178504943848 nb_pixel_total : 17533 time to create 1 rle with old method : 0.03906822204589844 time for calcul the mask position with numpy : 0.03254270553588867 nb_pixel_total : 4876 time to create 1 rle with old method : 0.01098322868347168 time for calcul the mask position with numpy : 0.032204627990722656 nb_pixel_total : 25226 time to create 1 rle with old method : 0.05071139335632324 time for calcul the mask position with numpy : 0.03091120719909668 nb_pixel_total : 30773 time to create 1 rle with old method : 0.06318116188049316 time for calcul the mask position with numpy : 0.03208613395690918 nb_pixel_total : 65671 time to create 1 rle with old method : 0.13727951049804688 time for calcul the mask position with numpy : 0.03216266632080078 nb_pixel_total : 12230 time to create 1 rle with old method : 0.02583789825439453 time for calcul the mask position with numpy : 0.03274106979370117 nb_pixel_total : 29560 time to create 1 rle with old method : 0.06368470191955566 time for calcul the mask position with numpy : 0.0328516960144043 nb_pixel_total : 14310 time to create 1 rle with old method : 0.0307159423828125 time for calcul the mask position with numpy : 0.03214693069458008 nb_pixel_total : 15117 time to create 1 rle with old method : 0.03246784210205078 time for calcul the mask position with numpy : 0.0345003604888916 nb_pixel_total : 301487 time to create 1 rle with new method : 0.37993860244750977 time for calcul the mask position with numpy : 0.03136014938354492 nb_pixel_total : 29821 time to create 1 rle with old method : 0.06342434883117676 time for calcul the mask position with numpy : 0.03321075439453125 nb_pixel_total : 40299 time to create 1 rle with old method : 0.08600974082946777 time for calcul the mask position with numpy : 0.03293943405151367 nb_pixel_total : 12680 time to create 1 rle with old method : 0.027920007705688477 time for calcul the mask position with numpy : 0.033831119537353516 nb_pixel_total : 9449 time to create 1 rle with old method : 0.02180314064025879 time for calcul the mask position with numpy : 0.03220534324645996 nb_pixel_total : 15168 time to create 1 rle with old method : 0.03314924240112305 time for calcul the mask position with numpy : 0.03260540962219238 nb_pixel_total : 11140 time to create 1 rle with old method : 0.0238645076751709 time for calcul the mask position with numpy : 0.03185439109802246 nb_pixel_total : 29065 time to create 1 rle with old method : 0.061072349548339844 time for calcul the mask position with numpy : 0.03138875961303711 nb_pixel_total : 22774 time to create 1 rle with old method : 0.048705101013183594 time for calcul the mask position with numpy : 0.03192925453186035 nb_pixel_total : 13880 time to create 1 rle with old method : 0.03011035919189453 time for calcul the mask position with numpy : 0.033588409423828125 nb_pixel_total : 155366 time to create 1 rle with new method : 0.3624763488769531 time for calcul the mask position with numpy : 0.03376126289367676 nb_pixel_total : 63941 time to create 1 rle with old method : 0.13848876953125 time for calcul the mask position with numpy : 0.03481411933898926 nb_pixel_total : 7836 time to create 1 rle with old method : 0.01779794692993164 time for calcul the mask position with numpy : 0.032868146896362305 nb_pixel_total : 7460 time to create 1 rle with old method : 0.016853809356689453 time for calcul the mask position with numpy : 0.03314065933227539 nb_pixel_total : 44600 time to create 1 rle with old method : 0.09701728820800781 time for calcul the mask position with numpy : 0.03252673149108887 nb_pixel_total : 11879 time to create 1 rle with old method : 0.025748252868652344 time for calcul the mask position with numpy : 0.03306317329406738 nb_pixel_total : 44195 time to create 1 rle with old method : 0.09558796882629395 time for calcul the mask position with numpy : 0.03327512741088867 nb_pixel_total : 23652 time to create 1 rle with old method : 0.05477786064147949 time for calcul the mask position with numpy : 0.03222393989562988 nb_pixel_total : 30006 time to create 1 rle with old method : 0.06521201133728027 time for calcul the mask position with numpy : 0.03241705894470215 nb_pixel_total : 15880 time to create 1 rle with old method : 0.035030364990234375 time for calcul the mask position with numpy : 0.03311276435852051 nb_pixel_total : 29845 time to create 1 rle with old method : 0.06553864479064941 time for calcul the mask position with numpy : 0.033191680908203125 nb_pixel_total : 144263 time to create 1 rle with old method : 0.2980930805206299 create new chi : 6.013632297515869 time to delete rle : 0.3381819725036621 batch 1 Loaded 44 chid ids of type : 2805 Number RLEs to save : 27884 TO DO : save crop sub photo not yet done ! save time : 3.28662109375 map_output_result : {996751167: (1.0, 'Should be the crop_list due to order', 1.0)} End step rle-unique-nms time spend for datou_step_exec : 36.45673584938049 time spend to save output : 0.0001971721649169922 total time spend for step 1 : 36.45693302154541 caffe_path_current : About to save ! 0 After save, about to update current ! datou_cur_ids : [] len(datou.list_steps) : 1 output : {996751167: (1.0, 'Should be the crop_list due to order', 1.0)} batch 1 Loaded 54 chid ids of type : 2805 ############################### TEST random_deformation ################################ Inside batchDatouExec : verbose : False # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : random_deformation list_input_json : [] origin We have 1 , BFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 1 ; length of list_pids : 1 ; length of list_args : 1 time to download the photos : 0.15514636039733887 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : False number of steps : 1 step1:random_deformation Sun Mar 23 11:29:07 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec beginning of datou step random deformation get user info for portfolio 3288640 About to upload 4 photos upload in portfolio : 3287159 init cache_photo without model_param we have 4 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1742725749_43872 we have uploaded 4 photos in the portfolio 3287159 time of upload the photos Elapsed time : 1.4655475616455078 time spend for datou_step_exec : 3.2091622352600098 time spend to save output : 6.151199340820312e-05 total time spend for step 1 : 3.209223747253418 caffe_path_current : About to save ! 1 Inside saveOutput : final : True verbose : False saveOutput not yet implemented for datou_step.type : random_deformation we use saveGeneral [1006293201] Looping around the photos to save general results len do output : 4 /1346581364Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1346581365Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1346581366Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1346581367Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('2896', None, None, None, None, None, None, None, None) ('2896', '3288640', '1006293201', None, None, None, None, None, None) begin to insert list_values into mtr_datou_result : length of list_values in save_final : 13 time used for this insertion : 0.012963056564331055 save_final save missing photos in datou_result : After save, about to update current ! datou_cur_ids : [] len(datou.list_steps) : 1 output : {1346581364: ['1006293201', 'temp/1006293201_random_deformation_0.png', []], 1346581365: ['1006293201', 'temp/1006293201_random_deformation_1.png', []], 1346581366: ['1006293201', 'temp/1006293201_random_deformation_2.png', []], 1346581367: ['1006293201', 'temp/1006293201_random_deformation_3.png', []]} name 'urllib' is not defined can't unload the photo : 1006293201 t ############################### TEST tile ################################ test tile avec chi rectangles, rles, polygones Inside batchDatouExec : verbose : False # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : tile list_input_json : [] origin We have 1 , BFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 1 ; length of list_pids : 1 ; length of list_args : 1 time to download the photos : 0.6476805210113525 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : False number of steps : 1 step1:tile Sun Mar 23 11:29:11 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec verbose : False param_json : {'ETA': 3600, 'new_width': 640, 'new_height': 640, 'token': '5d93a4b2b749464f208c339a1324b78f', 'stride': 0, 'stride_relative': 0, 'portfolio_name': 'results_test_tile', 'crop_hashtag_type_tiled': 3243, 'crop_hashtag_type': 3242, 'arg_aux_upload': {'type_upload': 'python'}, 'host': 'www.fotonower.com'} type(crop_hashtag_type) : type(crop_hashtag_type_tiled) : We consider crop_hashtag_type is an integer ! map_chi_type_to_chi_type_cropped : {3242: 3243} TO DEPRECATE VR 14-6-18 map_filenames : {1008283903: 'temp/1742725750_43872_1008283903_6d008d31a1477b2e98cbafa96bd48e53.jpg'} list_pids : 1 list_pids : 2 list_subpids to replace list_pids : 0 batch 1 Loaded 2 chid ids of type : 3242 ++https://marlene.fotonower.com/api/v1/secured/portfolio/new?name=results_test_tile&access_token=5d93a4b2b749464f208c339a1324b78f created feed_id_new_photos : 21619214 with name results_test_tile feed_id_new_photos : 21619214 filename : temp/1742725750_43872_1008283903_6d008d31a1477b2e98cbafa96bd48e53.jpg photo_id : 1008283903 height_image_input : 2464 width_image_input : 3280 new_width : 640 new_height : 640 stride : 0 stride_relative : 0 chi to copy from the main photo to the tiled photo input_chi_for_this_image_as_chi : 2 list_bib_to_crops : 24 [(0, 640, 0, 640, 0), (0, 640, 640, 1280, 1), (0, 640, 1280, 1920, 2), (0, 640, 1824, 2464, 3), (640, 1280, 0, 640, 4), (640, 1280, 640, 1280, 5), (640, 1280, 1280, 1920, 6), (640, 1280, 1824, 2464, 7), (1280, 1920, 0, 640, 8), (1280, 1920, 640, 1280, 9), (1280, 1920, 1280, 1920, 10), (1280, 1920, 1824, 2464, 11), (1920, 2560, 0, 640, 12), (1920, 2560, 640, 1280, 13), (1920, 2560, 1280, 1920, 14), (1920, 2560, 1824, 2464, 15), (2560, 3200, 0, 640, 16), (2560, 3200, 640, 1280, 17), (2560, 3200, 1280, 1920, 18), (2560, 3200, 1824, 2464, 19), (2640, 3280, 0, 640, 20), (2640, 3280, 640, 1280, 21), (2640, 3280, 1280, 1920, 22), (2640, 3280, 1824, 2464, 23)] new_crops_tiles : 24 crop_transformed : 7 batch 1 Loaded 24 chid ids of type : 17 treat the image : temp/1742725750_43872_1008283903_6d008d31a1477b2e98cbafa96bd48e53.jpg , 0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23 before upload mediasElapsed time : 0.33316636085510254 on upload les photos avec python init cache_photo without model_param we have 24 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1742725758_43872 we have uploaded 24 photos in the portfolio 21619214 Importing ! upload mediasElapsed time : 9.30245566368103 , 0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23Saving 7 CHIs. batch 1 Loaded 7 chid ids of type : 3243 Number RLEs to save : 2937 TO DO : save crop sub photo not yet done ! end of tileElapsed time : 11.062175273895264 time spend for datou_step_exec : 17.931812524795532 time spend to save output : 3.743171691894531e-05 total time spend for step 1 : 17.93184995651245 caffe_path_current : About to save ! 0 After save, about to update current ! datou_cur_ids : [] len(datou.list_steps) : 1 output : {'1346581375': ['temp/1742725750_43872_1008283903_6d008d31a1477b2e98cbafa96bd48e53_0.jpg'], '1346581376': ['temp/1742725750_43872_1008283903_6d008d31a1477b2e98cbafa96bd48e53_1.jpg'], '1346581377': ['temp/1742725750_43872_1008283903_6d008d31a1477b2e98cbafa96bd48e53_2.jpg'], '1346581379': ['temp/1742725750_43872_1008283903_6d008d31a1477b2e98cbafa96bd48e53_3.jpg'], '1346581380': ['temp/1742725750_43872_1008283903_6d008d31a1477b2e98cbafa96bd48e53_4.jpg'], '1346581381': ['temp/1742725750_43872_1008283903_6d008d31a1477b2e98cbafa96bd48e53_5.jpg'], '1346581382': ['temp/1742725750_43872_1008283903_6d008d31a1477b2e98cbafa96bd48e53_6.jpg'], '1346581383': ['temp/1742725750_43872_1008283903_6d008d31a1477b2e98cbafa96bd48e53_7.jpg'], '1346581384': ['temp/1742725750_43872_1008283903_6d008d31a1477b2e98cbafa96bd48e53_8.jpg'], '1346581385': ['temp/1742725750_43872_1008283903_6d008d31a1477b2e98cbafa96bd48e53_9.jpg'], '1346581386': ['temp/1742725750_43872_1008283903_6d008d31a1477b2e98cbafa96bd48e53_10.jpg'], '1346581387': ['temp/1742725750_43872_1008283903_6d008d31a1477b2e98cbafa96bd48e53_11.jpg'], '1346581388': ['temp/1742725750_43872_1008283903_6d008d31a1477b2e98cbafa96bd48e53_12.jpg'], '1346581389': ['temp/1742725750_43872_1008283903_6d008d31a1477b2e98cbafa96bd48e53_13.jpg'], '1346581390': ['temp/1742725750_43872_1008283903_6d008d31a1477b2e98cbafa96bd48e53_14.jpg'], '1346581391': ['temp/1742725750_43872_1008283903_6d008d31a1477b2e98cbafa96bd48e53_15.jpg'], '1346581392': ['temp/1742725750_43872_1008283903_6d008d31a1477b2e98cbafa96bd48e53_16.jpg'], '1346581393': ['temp/1742725750_43872_1008283903_6d008d31a1477b2e98cbafa96bd48e53_17.jpg'], '1346581394': ['temp/1742725750_43872_1008283903_6d008d31a1477b2e98cbafa96bd48e53_18.jpg'], '1346581395': ['temp/1742725750_43872_1008283903_6d008d31a1477b2e98cbafa96bd48e53_19.jpg'], '1346581396': ['temp/1742725750_43872_1008283903_6d008d31a1477b2e98cbafa96bd48e53_20.jpg'], '1346581397': ['temp/1742725750_43872_1008283903_6d008d31a1477b2e98cbafa96bd48e53_21.jpg'], '1346581399': ['temp/1742725750_43872_1008283903_6d008d31a1477b2e98cbafa96bd48e53_22.jpg'], '1346581400': ['temp/1742725750_43872_1008283903_6d008d31a1477b2e98cbafa96bd48e53_23.jpg']} batch 1 Loaded 7 chid ids of type : 3243 ++++++++++++++fin du test de tile ############################### TEST rotate_chi ################################ test rotate avec chi rectangles, rles, polygones Inside batchDatouExec : verbose : False # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : rotate list_input_json : [] origin We have 1 , BFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 1 ; length of list_pids : 1 ; length of list_args : 1 time to download the photos : 0.38657069206237793 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : False number of steps : 1 step1:rotate Sun Mar 23 11:29:29 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou_step_rotate ! Warning, new_feed_id is empty ! We are in a linear step without datou_depend ! rotate photos of 0,90,180,270 degres batch 1 Loaded 16 chid ids of type : 3086 ++++++++++++++++ map_chi of length : 1 https://marlene.fotonower.com/api/v1/secured/portfolio/new?access_token=78d09a0790ec6ecbf119343125a81fdc feed_id_new_photos : 21619215 time for calcul the mask position with numpy : 0.010077714920043945 nb_pixel_total : 110633 time to create 1 rle with old method : 0.23577404022216797 .time for calcul the mask position with numpy : 0.009025335311889648 nb_pixel_total : 15826 time to create 1 rle with old method : 0.034470319747924805 .time for calcul the mask position with numpy : 0.008682489395141602 nb_pixel_total : 5286 time to create 1 rle with old method : 0.011161327362060547 .time for calcul the mask position with numpy : 0.008734941482543945 nb_pixel_total : 1633 time to create 1 rle with old method : 0.0036344528198242188 .time for calcul the mask position with numpy : 0.009650468826293945 nb_pixel_total : 105533 time to create 1 rle with old method : 0.21864104270935059 .time for calcul the mask position with numpy : 0.008594989776611328 nb_pixel_total : 4393 time to create 1 rle with old method : 0.00955963134765625 .time for calcul the mask position with numpy : 0.008922100067138672 nb_pixel_total : 632 time to create 1 rle with old method : 0.0015468597412109375 .time for calcul the mask position with numpy : 0.009272336959838867 nb_pixel_total : 62627 time to create 1 rle with old method : 0.13308954238891602 .time for calcul the mask position with numpy : 0.009279012680053711 nb_pixel_total : 33681 time to create 1 rle with old method : 0.06957292556762695 .time for calcul the mask position with numpy : 0.008720874786376953 nb_pixel_total : 37724 time to create 1 rle with old method : 0.07717299461364746 .time for calcul the mask position with numpy : 0.009102582931518555 nb_pixel_total : 48775 time to create 1 rle with old method : 0.10334467887878418 .time for calcul the mask position with numpy : 0.050839900970458984 nb_pixel_total : 1171703 time to create 1 rle with new method : 0.1197197437286377 .time for calcul the mask position with numpy : 0.008408784866333008 nb_pixel_total : 2310 time to create 1 rle with old method : 0.0049512386322021484 .time for calcul the mask position with numpy : 0.008614063262939453 nb_pixel_total : 2256 time to create 1 rle with old method : 0.004870891571044922 .time for calcul the mask position with numpy : 0.00936269760131836 nb_pixel_total : 3112 time to create 1 rle with old method : 0.006709098815917969 .time for calcul the mask position with numpy : 0.008933305740356445 nb_pixel_total : 1662 time to create 1 rle with old method : 0.0034923553466796875 .Needs to change image size ! time for calcul the mask position with numpy : 0.009346961975097656 nb_pixel_total : 110633 time to create 1 rle with old method : 0.22426867485046387 .time for calcul the mask position with numpy : 0.008722782135009766 nb_pixel_total : 15826 time to create 1 rle with old method : 0.03235483169555664 .time for calcul the mask position with numpy : 0.008818626403808594 nb_pixel_total : 5286 time to create 1 rle with old method : 0.013408422470092773 .time for calcul the mask position with numpy : 0.008570432662963867 nb_pixel_total : 1633 time to create 1 rle with old method : 0.0035986900329589844 .time for calcul the mask position with numpy : 0.00922846794128418 nb_pixel_total : 105533 time to create 1 rle with old method : 0.22147583961486816 .time for calcul the mask position with numpy : 0.008875131607055664 nb_pixel_total : 4393 time to create 1 rle with old method : 0.010897636413574219 .time for calcul the mask position with numpy : 0.008428812026977539 nb_pixel_total : 632 time to create 1 rle with old method : 0.0014047622680664062 .time for calcul the mask position with numpy : 0.00917816162109375 nb_pixel_total : 62627 time to create 1 rle with old method : 0.13008737564086914 .time for calcul the mask position with numpy : 0.008629560470581055 nb_pixel_total : 33681 time to create 1 rle with old method : 0.06919312477111816 .time for calcul the mask position with numpy : 0.008825063705444336 nb_pixel_total : 37724 time to create 1 rle with old method : 0.08063435554504395 .time for calcul the mask position with numpy : 0.008839845657348633 nb_pixel_total : 48775 time to create 1 rle with old method : 0.10287332534790039 .time for calcul the mask position with numpy : 0.03983163833618164 nb_pixel_total : 1171703 time to create 1 rle with new method : 0.1173095703125 .time for calcul the mask position with numpy : 0.008312463760375977 nb_pixel_total : 2310 time to create 1 rle with old method : 0.0049343109130859375 .time for calcul the mask position with numpy : 0.008637666702270508 nb_pixel_total : 2256 time to create 1 rle with old method : 0.004876852035522461 .time for calcul the mask position with numpy : 0.010014772415161133 nb_pixel_total : 3112 time to create 1 rle with old method : 0.007772684097290039 .time for calcul the mask position with numpy : 0.009775876998901367 nb_pixel_total : 1662 time to create 1 rle with old method : 0.003844738006591797 .time for calcul the mask position with numpy : 0.009636163711547852 nb_pixel_total : 110633 time to create 1 rle with old method : 0.2338724136352539 .time for calcul the mask position with numpy : 0.010298967361450195 nb_pixel_total : 15826 time to create 1 rle with old method : 0.046663522720336914 .time for calcul the mask position with numpy : 0.009179353713989258 nb_pixel_total : 5286 time to create 1 rle with old method : 0.012180805206298828 .time for calcul the mask position with numpy : 0.009453296661376953 nb_pixel_total : 1633 time to create 1 rle with old method : 0.003705263137817383 .time for calcul the mask position with numpy : 0.01193094253540039 nb_pixel_total : 105533 time to create 1 rle with old method : 0.2283339500427246 .time for calcul the mask position with numpy : 0.008360147476196289 nb_pixel_total : 4393 time to create 1 rle with old method : 0.009645223617553711 .time for calcul the mask position with numpy : 0.008519649505615234 nb_pixel_total : 632 time to create 1 rle with old method : 0.0013587474822998047 .time for calcul the mask position with numpy : 0.008990764617919922 nb_pixel_total : 62627 time to create 1 rle with old method : 0.12830567359924316 .time for calcul the mask position with numpy : 0.00893545150756836 nb_pixel_total : 33681 time to create 1 rle with old method : 0.07094502449035645 .time for calcul the mask position with numpy : 0.009154796600341797 nb_pixel_total : 37724 time to create 1 rle with old method : 0.08038854598999023 .time for calcul the mask position with numpy : 0.008769512176513672 nb_pixel_total : 48775 time to create 1 rle with old method : 0.10163092613220215 .time for calcul the mask position with numpy : 0.04038834571838379 nb_pixel_total : 1171703 time to create 1 rle with new method : 0.1270918846130371 .time for calcul the mask position with numpy : 0.008931636810302734 nb_pixel_total : 2310 time to create 1 rle with old method : 0.005230426788330078 .time for calcul the mask position with numpy : 0.008597612380981445 nb_pixel_total : 2256 time to create 1 rle with old method : 0.005333900451660156 .time for calcul the mask position with numpy : 0.008943319320678711 nb_pixel_total : 3112 time to create 1 rle with old method : 0.007750749588012695 .time for calcul the mask position with numpy : 0.008927106857299805 nb_pixel_total : 1662 time to create 1 rle with old method : 0.003950834274291992 .Needs to change image size ! time for calcul the mask position with numpy : 0.01002359390258789 nb_pixel_total : 110633 time to create 1 rle with old method : 0.2761881351470947 .time for calcul the mask position with numpy : 0.00914311408996582 nb_pixel_total : 15826 time to create 1 rle with old method : 0.03446054458618164 .time for calcul the mask position with numpy : 0.009278535842895508 nb_pixel_total : 5286 time to create 1 rle with old method : 0.014738321304321289 .time for calcul the mask position with numpy : 0.008827924728393555 nb_pixel_total : 1633 time to create 1 rle with old method : 0.0037305355072021484 .time for calcul the mask position with numpy : 0.010015010833740234 nb_pixel_total : 105533 time to create 1 rle with old method : 0.23084497451782227 .time for calcul the mask position with numpy : 0.009066104888916016 nb_pixel_total : 4393 time to create 1 rle with old method : 0.009224653244018555 .time for calcul the mask position with numpy : 0.00891733169555664 nb_pixel_total : 632 time to create 1 rle with old method : 0.0015654563903808594 .time for calcul the mask position with numpy : 0.010149002075195312 nb_pixel_total : 62627 time to create 1 rle with old method : 0.13540291786193848 .time for calcul the mask position with numpy : 0.010379791259765625 nb_pixel_total : 33681 time to create 1 rle with old method : 0.07135725021362305 .time for calcul the mask position with numpy : 0.009145021438598633 nb_pixel_total : 37724 time to create 1 rle with old method : 0.08062553405761719 .time for calcul the mask position with numpy : 0.009478330612182617 nb_pixel_total : 48775 time to create 1 rle with old method : 0.10771846771240234 .time for calcul the mask position with numpy : 0.05067086219787598 nb_pixel_total : 1171703 time to create 1 rle with new method : 0.18428921699523926 .time for calcul the mask position with numpy : 0.008965253829956055 nb_pixel_total : 2310 time to create 1 rle with old method : 0.005220174789428711 .time for calcul the mask position with numpy : 0.008949041366577148 nb_pixel_total : 2256 time to create 1 rle with old method : 0.0050470829010009766 .time for calcul the mask position with numpy : 0.008688211441040039 nb_pixel_total : 3112 time to create 1 rle with old method : 0.006758213043212891 .time for calcul the mask position with numpy : 0.00862741470336914 nb_pixel_total : 1662 time to create 1 rle with old method : 0.0037088394165039062 . About to upload 4 photos upload in portfolio : 21619215 init cache_photo without model_param we have 4 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1742725784_43872 we have uploaded 4 photos in the portfolio 21619215 time of upload the photos Elapsed time : 1.304460048675537 Len new_chis : 4 Len list_new_chi_with_photo_id : 64 of type : 3230 batch 1 Loaded 64 chid ids of type : 3230 Number RLEs to save : 24654 TO DO : save crop sub photo not yet done ! batch 1 Loaded 64 chid ids of type : 3230 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! batch 1 Loaded 64 chid ids of type : 3230 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! batch 1 Loaded 64 chid ids of type : 3230 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! time spend for datou_step_exec : 17.613993167877197 time spend to save output : 0.0001533031463623047 total time spend for step 1 : 17.61414647102356 caffe_path_current : About to save ! 0 After save, about to update current ! datou_cur_ids : [] len(datou.list_steps) : 1 output : {1346581404: ['1003369118', 'temp/1742725769_43872_1003369118_58171420504d0b5f05a1233b6c515509_658263370.jpg', [, , , , , , , , , , , , , , , ]], 1346581405: ['1003369118', 'temp/1742725769_43872_1003369118_58171420504d0b5f05a1233b6c515509_6582633790.jpg', [, , , , , , , , , , , , , , , ]], 1346581406: ['1003369118', 'temp/1742725769_43872_1003369118_58171420504d0b5f05a1233b6c515509_65826337180.jpg', [, , , , , , , , , , , , , , , ]], 1346581408: ['1003369118', 'temp/1742725769_43872_1003369118_58171420504d0b5f05a1233b6c515509_65826337270.jpg', [, , , , , , , , , , , , , , , ]]} batch 1 Loaded 64 chid ids of type : 3230 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++fin du test de rotate_chi Ayatollah of tests excluded it ! (Bon le prochain developpeur qui passe ici peut enlever ayatollah VR 11-2-21) name : rubbia_carac_pet_clair_0121 not run because too long ############################### TEST rubbia_carac_pet_clair_0121_no_cnn ################################ Inside batchDatouExec : verbose : False # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 6479 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 6480 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7445 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 6509 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 6479 doesn't seem to be define in the database( WARNING : type of input 1 of step 6480 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 6479 doesn't seem to be define in the database( WARNING : type of input 1 of step 7445 doesn't seem to be define in the database( WARNING : type of output 1 of step 7445 doesn't seem to be define in the database( WARNING : type of input 3 of step 6509 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! DataTypes for each output/input checked ! List Step Type Loaded in datou : merge_mask_thcl_custom, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final list_input_json : [] origin We have 1 , BBFFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 2 ; length of list_pids : 2 ; length of list_args : 2 time to download the photos : 0.22597765922546387 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : False number of steps : 4 step1:merge_mask_thcl_custom Sun Mar 23 11:29:47 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Begin step merge_mask_thcl_custom batch 1 Loaded 82 chid ids of type : 2800 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++As expected we have just one thcl present begin to find the sub_photo_id : begin to find the sub_photo_id : batch 1 Loaded 76 chid ids of type : 2913 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! batch 1 Loaded 76 chid ids of type : 2913 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++End of step merge_mask_thcl_custom time spend for datou_step_exec : 1.5867128372192383 time spend to save output : 0.00011181831359863281 total time spend for step 1 : 1.586824655532837 step2:rle_unique_nms_with_priority Sun Mar 23 11:29:49 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 43 chid ids of type : 2913 +++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 0 nb_hashtags : 2 time to prepare the origin masks : 2.254612922668457 create new chi : 4.029273986816406e-05 time to delete rle : 0.030624866485595703 save time : 3.886222839355469e-05 nb_obj : 0 nb_hashtags : 1 time to prepare the origin masks : 2.3967208862304688 create new chi : 4.172325134277344e-05 time to delete rle : 0.013936042785644531 save time : 1.33514404296875e-05 map_output_result : {1009068683: (0.002588053987919006, 'Should be the crop_list due to order', 0.005176107975838012), 1009068724: (0.002588053987919006, 'Should be the crop_list due to order', 0.0)} End step rle-unique-nms time spend for datou_step_exec : 4.8848717212677 time spend to save output : 0.0001773834228515625 total time spend for step 2 : 4.885049104690552 step3:ventilate_hashtags_in_portfolio Sun Mar 23 11:29:54 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 3373196 get user id for portfolio 3373196 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=3373196 AND mptpi.`type`=2913 AND mptpi.`min_score`=0.7 To do To do ! Use context local managing function ! time spend for datou_step_exec : 6.19796085357666 time spend to save output : 5.0067901611328125e-05 total time spend for step 3 : 6.1980109214782715 step4:final Sun Mar 23 11:30:00 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! time spend for datou_step_exec : 0.10316324234008789 time spend to save output : 6.103515625e-05 total time spend for step 4 : 0.10322427749633789 caffe_path_current : About to save ! 1 Inside saveOutput : final : True verbose : False original output for save of step final : {1009068683: ('0.0025316977085267163',), 1009068724: ('0.0025316977085267163',)} new output for save of step final : {1009068683: ('0.0025316977085267163',), 1009068724: ('0.0025316977085267163',)} [1009068683, 1009068724] Looping around the photos to save general results len do output : 2 /1009068683.Didn't retrieve data . /1009068724.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('2719', None, None, None, None, None, None, None, None) ('2719', '3373196', '1009068683', None, None, None, None, None, None) ('2719', None, None, None, None, None, None, None, None) ('2719', '3373196', '1009068724', None, None, None, None, None, None) begin to insert list_values into mtr_datou_result : length of list_values in save_final : 6 time used for this insertion : 0.01332855224609375 save_final save missing photos in datou_result : After save, about to update current ! datou_cur_ids : [] len(datou.list_steps) : 4 output : {1009068683: ('0.0025316977085267163',), 1009068724: ('0.0025316977085267163',)} {1009068683: ('0.0025316977085267163',), 1009068724: ('0.0025316977085267163',)} ############################### TEST rubbia_carac_jrm_no_mask_detect ################################ Inside batchDatouExec : verbose : False # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! Step 7557 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 7556 argmax have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 7561 merge_mask_and_thcl is not consistent : 3 used against 1 in the step definition ! WARNING : number of inputs for step 7558 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7560 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7559 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7560 doesn't seem to be define in the database( WARNING : type of input 3 of step 7559 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7556 have datatype=6 whereas input 0 of step 7561 have datatype=20 WARNING : type of output 1 of step 7561 doesn't seem to be define in the database( WARNING : type of input 1 of step 7558 doesn't seem to be define in the database( WARNING : type of output 2 of step 7561 doesn't seem to be define in the database( WARNING : type of input 1 of step 7560 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : crop_condition, thcl, argmax, merge_mask_and_thcl, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final list_input_json : [] origin We have 1 , BBBBBFBFBFBFBFBFBFBFFBFBFFFFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 14 ; length of list_pids : 14 ; length of list_args : 14 time to download the photos : 1.0555493831634521 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : False number of steps : 7 step1:crop_condition Sun Mar 23 11:30:01 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Loading chi in step crop with photo_hashtag_type : 3336 Loading chi in step crop for list_pids : 14 ! batch 1 Loaded 121 chid ids of type : 3336 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : teint_dans_la_masse param for this class : {'min_score': 0.7} filtre for class : teint_dans_la_masse hashtag_id of this class : 2107752385 map_result returned by crop_photo_return_map_crop : length : 0 About to insert : list_path_to_insert length 0 new photo from crops ! About to upload 0 photos WARNING : list_path_to_insert is empty, cannot upload ! we have finished the crop for the class : teint_dans_la_masse begin to crop the class : autre_refus param for this class : {'min_score': 0.7} filtre for class : autre_refus hashtag_id of this class : 2107752406 map_result returned by crop_photo_return_map_crop : length : 0 About to insert : list_path_to_insert length 0 new photo from crops ! About to upload 0 photos WARNING : list_path_to_insert is empty, cannot upload ! we have finished the crop for the class : autre_refus begin to crop the class : carton_gris param for this class : {'min_score': 0.7} filtre for class : carton_gris hashtag_id of this class : 2107753020 map_result returned by crop_photo_return_map_crop : length : 0 About to insert : list_path_to_insert length 0 new photo from crops ! About to upload 0 photos WARNING : list_path_to_insert is empty, cannot upload ! we have finished the crop for the class : carton_gris begin to crop the class : cartonnette param for this class : {'min_score': 0.7} filtre for class : cartonnette hashtag_id of this class : 702398920 map_result returned by crop_photo_return_map_crop : length : 0 About to insert : list_path_to_insert length 0 new photo from crops ! About to upload 0 photos WARNING : list_path_to_insert is empty, cannot upload ! we have finished the crop for the class : cartonnette begin to crop the class : carton_brun param for this class : {'min_score': 0.7} filtre for class : carton_brun hashtag_id of this class : 2107753024 map_result returned by crop_photo_return_map_crop : length : 0 About to insert : list_path_to_insert length 0 new photo from crops ! About to upload 0 photos WARNING : list_path_to_insert is empty, cannot upload ! we have finished the crop for the class : carton_brun begin to crop the class : plastique param for this class : {'min_score': 0.7} filtre for class : plastique hashtag_id of this class : 492725882 begin to crop the class : kraft param for this class : {'min_score': 0.7} filtre for class : kraft hashtag_id of this class : 493202403 begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 time spend for datou_step_exec : 9.969499826431274 time spend to save output : 0.0009682178497314453 total time spend for step 1 : 9.970468044281006 step2:thcl Sun Mar 23 11:30:11 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure No keys ! Beginning of datou step Thcl ! no input time spend for datou_step_exec : 0.0006601810455322266 time spend to save output : 3.0994415283203125e-05 total time spend for step 2 : 0.0006911754608154297 step3:argmax Sun Mar 23 11:30:11 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure No keys ! Beginning of datou_step Argmax ! no input time spend for datou_step_exec : 5.8650970458984375e-05 time spend to save output : 1.1444091796875e-05 total time spend for step 3 : 7.009506225585938e-05 step4:merge_mask_and_thcl Sun Mar 23 11:30:11 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure No keys ! debut de la step merge mask and classif time spend for datou_step_exec : 0.00016045570373535156 time spend to save output : 2.47955322265625e-05 total time spend for step 4 : 0.00018525123596191406 step5:rle_unique_nms_with_priority Sun Mar 23 11:30:11 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 26 chid ids of type : 3418 ++++++++++++++++++++++++++++nb_obj : 0 nb_hashtags : 2 time to prepare the origin masks : 1.620633602142334 create new chi : 0.006207466125488281 time to delete rle : 0.35596466064453125 save time : 1.7881393432617188e-05 nb_obj : 0 nb_hashtags : 2 time to prepare the origin masks : 2.354440450668335 create new chi : 0.00684809684753418 time to delete rle : 0.4362950325012207 save time : 3.9577484130859375e-05 nb_obj : 0 nb_hashtags : 1 time to prepare the origin masks : 1.034273624420166 create new chi : 3.147125244140625e-05 time to delete rle : 0.4609980583190918 save time : 1.3828277587890625e-05 nb_obj : 0 nb_hashtags : 1 time to prepare the origin masks : 0.8042693138122559 create new chi : 0.0081787109375 time to delete rle : 0.43836355209350586 save time : 8.106231689453125e-06 nb_obj : 0 nb_hashtags : 1 time to prepare the origin masks : 1.5486693382263184 create new chi : 5.1975250244140625e-05 time to delete rle : 0.42966532707214355 save time : 5.173683166503906e-05 nb_obj : 0 nb_hashtags : 1 time to prepare the origin masks : 0.9211626052856445 create new chi : 0.006244659423828125 time to delete rle : 0.3602631092071533 save time : 8.106231689453125e-06 nb_obj : 0 nb_hashtags : 1 time to prepare the origin masks : 1.3191289901733398 create new chi : 2.4557113647460938e-05 time to delete rle : 0.5384783744812012 save time : 1.2874603271484375e-05 nb_obj : 0 nb_hashtags : 1 time to prepare the origin masks : 2.1094930171966553 create new chi : 6.628036499023438e-05 time to delete rle : 0.3115096092224121 save time : 4.172325134277344e-05 nb_obj : 0 nb_hashtags : 1 time to prepare the origin masks : 2.047719955444336 create new chi : 3.552436828613281e-05 time to delete rle : 0.6873183250427246 save time : 1.239776611328125e-05 nb_obj : 0 nb_hashtags : 2 time to prepare the origin masks : 1.6144981384277344 create new chi : 0.006600379943847656 time to delete rle : 0.4110889434814453 save time : 1.9311904907226562e-05 nb_obj : 0 nb_hashtags : 2 time to prepare the origin masks : 1.8457677364349365 create new chi : 0.006723165512084961 time to delete rle : 0.4321773052215576 save time : 3.933906555175781e-05 nb_obj : 0 nb_hashtags : 1 time to prepare the origin masks : 0.7007186412811279 create new chi : 0.007118701934814453 time to delete rle : 0.4483160972595215 save time : 8.106231689453125e-06 nb_obj : 0 nb_hashtags : 1 time to prepare the origin masks : 0.879218578338623 create new chi : 2.3603439331054688e-05 time to delete rle : 0.3708791732788086 save time : 8.106231689453125e-06 nb_obj : 0 nb_hashtags : 1 time to prepare the origin masks : 1.2353696823120117 create new chi : 2.6226043701171875e-05 time to delete rle : 0.3811333179473877 save time : 1.0967254638671875e-05 map_output_result : {1008921601: (0.005230650193135238, 'Should be the crop_list due to order', 0.01189037070001202), 1008921600: (0.005230650193135238, 'Should be the crop_list due to order', 0.012566967797237925), 1008922003: (0.005230650193135238, 'Should be the crop_list due to order', 0.010260185698447893), 1008922002: (0.005230650193135238, 'Should be the crop_list due to order', 0.0), 1008921786: (0.005230650193135238, 'Should be the crop_list due to order', 0.0024127929996832437), 1008922095: (0.005230650193135238, 'Should be the crop_list due to order', 0.0), 1008922073: (0.005230650193135238, 'Should be the crop_list due to order', 0.0034527686490338928), 1008922072: (0.005230650193135238, 'Should be the crop_list due to order', 0.006595957396262274), 1008922130: (0.005230650193135238, 'Should be the crop_list due to order', 0.009172696586949636), 1008922101: (0.005230650193135238, 'Should be the crop_list due to order', 0.001800476457962238), 1008922097: (0.005230650193135238, 'Should be the crop_list due to order', 0.0021337986371828908), 1008921657: (0.005230650193135238, 'Should be the crop_list due to order', 0.0), 1008921656: (0.005230650193135238, 'Should be the crop_list due to order', 0.0018834633354450428), 1008921602: (0.005230650193135238, 'Should be the crop_list due to order', 0.011059624445676274)} End step rle-unique-nms time spend for datou_step_exec : 28.139272451400757 time spend to save output : 0.00010991096496582031 total time spend for step 5 : 28.139382362365723 step6:ventilate_hashtags_in_portfolio Sun Mar 23 11:30:39 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! To do loadFromThcl(), then load ParamDescType : thcl2456 thcls : [{'id': 2456, 'mtr_user_id': 31, 'name': 'learn_qualipapia_papier_refus_from_vlg_data_aug', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'papier,refus', 'svm_portfolios_learning': '3028087,3028251', 'photo_hashtag_type': 3049, 'photo_desc_type': 4999, 'type_classification': 'caffe', 'hashtag_id_list': '492668766,538914404'}] thcl {'id': 2456, 'mtr_user_id': 31, 'name': 'learn_qualipapia_papier_refus_from_vlg_data_aug', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'papier,refus', 'svm_portfolios_learning': '3028087,3028251', 'photo_hashtag_type': 3049, 'photo_desc_type': 4999, 'type_classification': 'caffe', 'hashtag_id_list': '492668766,538914404'} Update svm_hashtag_type_desc : 4999 Iterating over portfolio : 3364276 get user id for portfolio 3364276 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=3535038 AND mptpi.`type`=3418 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','refus')) AND mptpi.`min_score`=0.7 To do To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=3364276 AND mptpi.`type`=3418 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','refus')) AND mptpi.`min_score`=0.7 To do To do ! Use context local managing function ! time spend for datou_step_exec : 0.17239856719970703 time spend to save output : 8.296966552734375e-05 total time spend for step 6 : 0.17248153686523438 step7:final Sun Mar 23 11:30:39 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! time spend for datou_step_exec : 0.019952058792114258 time spend to save output : 3.933906555175781e-05 total time spend for step 7 : 0.019991397857666016 caffe_path_current : About to save ! 1 Inside saveOutput : final : True verbose : False original output for save of step final : {1008921601: ('0.005252307643909098',), 1008921600: ('0.005252307643909098',), 1008922003: ('0.005252307643909098',), 1008922002: ('0.005252307643909098',), 1008921786: ('0.005252307643909098',), 1008922095: ('0.005252307643909098',), 1008922073: ('0.005252307643909098',), 1008922072: ('0.005252307643909098',), 1008922130: ('0.005252307643909098',), 1008922101: ('0.005252307643909098',), 1008922097: ('0.005252307643909098',), 1008921657: ('0.005252307643909098',), 1008921656: ('0.005252307643909098',), 1008921602: ('0.005252307643909098',)} new output for save of step final : {1008921601: ('0.005252307643909098',), 1008921600: ('0.005252307643909098',), 1008922003: ('0.005252307643909098',), 1008922002: ('0.005252307643909098',), 1008921786: ('0.005252307643909098',), 1008922095: ('0.005252307643909098',), 1008922073: ('0.005252307643909098',), 1008922072: ('0.005252307643909098',), 1008922130: ('0.005252307643909098',), 1008922101: ('0.005252307643909098',), 1008922097: ('0.005252307643909098',), 1008921657: ('0.005252307643909098',), 1008921656: ('0.005252307643909098',), 1008921602: ('0.005252307643909098',)} [1008921601, 1008921600, 1008922003, 1008922002, 1008921786, 1008922095, 1008922073, 1008922072, 1008922130, 1008922101, 1008922097, 1008921657, 1008921656, 1008921602] Looping around the photos to save general results len do output : 14 /1008921601.Didn't retrieve data . /1008921600.Didn't retrieve data . /1008922003.Didn't retrieve data . /1008922002.Didn't retrieve data . /1008921786.Didn't retrieve data . /1008922095.Didn't retrieve data . /1008922073.Didn't retrieve data . /1008922072.Didn't retrieve data . /1008922130.Didn't retrieve data . /1008922101.Didn't retrieve data . /1008922097.Didn't retrieve data . /1008921657.Didn't retrieve data . /1008921656.Didn't retrieve data . /1008921602.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3164', None, None, None, None, None, None, None, None) ('3164', '3364276', '1008921601', None, None, None, None, None, None) ('3164', None, None, None, None, None, None, None, None) ('3164', '3364276', '1008921600', None, None, None, None, None, None) ('3164', None, None, None, None, None, None, None, None) ('3164', '3364276', '1008922003', None, None, None, None, None, None) ('3164', None, None, None, None, None, None, None, None) ('3164', '3364276', '1008922002', None, None, None, None, None, None) ('3164', None, None, None, None, None, None, None, None) ('3164', '3364276', '1008921786', None, None, None, None, None, None) ('3164', None, None, None, None, None, None, None, None) ('3164', '3364276', '1008922095', None, None, None, None, None, None) ('3164', None, None, None, None, None, None, None, None) ('3164', '3364276', '1008922073', None, None, None, None, None, None) ('3164', None, None, None, None, None, None, None, None) ('3164', '3364276', '1008922072', None, None, None, None, None, None) ('3164', None, None, None, None, None, None, None, None) ('3164', '3364276', '1008922130', None, None, None, None, None, None) ('3164', None, None, None, None, None, None, None, None) ('3164', '3364276', '1008922101', None, None, None, None, None, None) ('3164', None, None, None, None, None, None, None, None) ('3164', '3364276', '1008922097', None, None, None, None, None, None) ('3164', None, None, None, None, None, None, None, None) ('3164', '3364276', '1008921657', None, None, None, None, None, None) ('3164', None, None, None, None, None, None, None, None) ('3164', '3364276', '1008921656', None, None, None, None, None, None) ('3164', None, None, None, None, None, None, None, None) ('3164', '3364276', '1008921602', None, None, None, None, None, None) begin to insert list_values into mtr_datou_result : length of list_values in save_final : 42 time used for this insertion : 0.015795469284057617 save_final save missing photos in datou_result : After save, about to update current ! datou_cur_ids : [] len(datou.list_steps) : 7 output : {1008921601: ('0.005252307643909098',), 1008921600: ('0.005252307643909098',), 1008922003: ('0.005252307643909098',), 1008922002: ('0.005252307643909098',), 1008921786: ('0.005252307643909098',), 1008922095: ('0.005252307643909098',), 1008922073: ('0.005252307643909098',), 1008922072: ('0.005252307643909098',), 1008922130: ('0.005252307643909098',), 1008922101: ('0.005252307643909098',), 1008922097: ('0.005252307643909098',), 1008921657: ('0.005252307643909098',), 1008921656: ('0.005252307643909098',), 1008921602: ('0.005252307643909098',)} {1008921601: ('0.005252307643909098',), 1008921600: ('0.005252307643909098',), 1008922003: ('0.005252307643909098',), 1008922002: ('0.005252307643909098',), 1008921786: ('0.005252307643909098',), 1008922095: ('0.005252307643909098',), 1008922073: ('0.005252307643909098',), 1008922072: ('0.005252307643909098',), 1008922130: ('0.005252307643909098',), 1008922101: ('0.005252307643909098',), 1008922097: ('0.005252307643909098',), 1008921657: ('0.005252307643909098',), 1008921656: ('0.005252307643909098',), 1008921602: ('0.005252307643909098',)} ############################### TEST ventilate_hashtags_in_portfolio ################################ DELETE FROM MTRUser.mtr_portfolio_photos where mtr_portfolio_id = 5486631; Inside batchDatouExec : verbose : False # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : ventilate_hashtags_in_portfolio list_input_json : [] origin We have 1 , we have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB time to download the photos : 0.02093505859375 About to test input to load Calling datou_exec Inside datou_exec : verbose : False number of steps : 1 step1:ventilate_hashtags_in_portfolio Sun Mar 23 11:30:39 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 5363525 get user id for portfolio 5363525 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=5363525 AND mptpi.`type`=4268 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_clair','error','environment')) AND mptpi.`min_score`=0.3 To do To do ! Use context local managing function ! time spend for datou_step_exec : 0.1810457706451416 time spend to save output : 0.00011277198791503906 total time spend for step 1 : 0.18115854263305664 caffe_path_current : About to save ! 1 Inside saveOutput : final : True verbose : False saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1075306598, 1075306564, 1075306534, 1075306522, 1075304668] Looping around the photos to save general results len do output : 1 /5363525. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3070', None, None, None, None, None, None, None, None) ('3070', '5363525', '1075306598', None, None, None, None, None, None) ('3070', None, None, None, None, None, None, None, None) ('3070', '5363525', '1075306564', None, None, None, None, None, None) ('3070', None, None, None, None, None, None, None, None) ('3070', '5363525', '1075306534', None, None, None, None, None, None) ('3070', None, None, None, None, None, None, None, None) ('3070', '5363525', '1075306522', None, None, None, None, None, None) ('3070', None, None, None, None, None, None, None, None) ('3070', '5363525', '1075304668', None, None, None, None, None, None) begin to insert list_values into mtr_datou_result : length of list_values in save_final : 6 time used for this insertion : 0.10854339599609375 save_final save missing photos in datou_result : After save, about to update current ! Ayatollah of tests excluded it ! (Bon le prochain developpeur qui passe ici peut enlever ayatollah VR 11-2-21) name : merge_qualipapia_like not run because too long ############################### TEST poly_ro_rle ################################ test creation de rle a partir de polygon Inside batchDatouExec : verbose : False # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : poly_to_rle list_input_json : [] origin We have 1 , BFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 1 ; length of list_pids : 1 ; length of list_args : 1 time to download the photos : 0.23863935470581055 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : False number of steps : 1 step1:poly_to_rle Sun Mar 23 11:30:40 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec can't find the hashtag_type_input ,set the output_type same as the input_type batch 1 Loaded 16 chid ids of type : 3391 ++++++++++++++++time for calcul the mask position with numpy : 0.00908660888671875 nb_pixel_total : 110633 time to create 1 rle with old method : 0.26763248443603516 time for calcul the mask position with numpy : 0.007339000701904297 nb_pixel_total : 15826 time to create 1 rle with old method : 0.03528165817260742 time for calcul the mask position with numpy : 0.007149696350097656 nb_pixel_total : 5286 time to create 1 rle with old method : 0.012938737869262695 time for calcul the mask position with numpy : 0.007400035858154297 nb_pixel_total : 1633 time to create 1 rle with old method : 0.004075765609741211 time for calcul the mask position with numpy : 0.007736682891845703 nb_pixel_total : 105533 time to create 1 rle with old method : 0.23285818099975586 time for calcul the mask position with numpy : 0.007455348968505859 nb_pixel_total : 4393 time to create 1 rle with old method : 0.010562419891357422 time for calcul the mask position with numpy : 0.0076444149017333984 nb_pixel_total : 632 time to create 1 rle with old method : 0.0016298294067382812 time for calcul the mask position with numpy : 0.008030414581298828 nb_pixel_total : 62627 time to create 1 rle with old method : 0.13961410522460938 time for calcul the mask position with numpy : 0.007382869720458984 nb_pixel_total : 33681 time to create 1 rle with old method : 0.07170367240905762 time for calcul the mask position with numpy : 0.007615804672241211 nb_pixel_total : 37724 time to create 1 rle with old method : 0.08337616920471191 time for calcul the mask position with numpy : 0.00785970687866211 nb_pixel_total : 48775 time to create 1 rle with old method : 0.10902881622314453 time for calcul the mask position with numpy : 0.06999850273132324 nb_pixel_total : 1171703 time to create 1 rle with new method : 0.16265201568603516 time for calcul the mask position with numpy : 0.007294416427612305 nb_pixel_total : 2310 time to create 1 rle with old method : 0.0053136348724365234 time for calcul the mask position with numpy : 0.0073583126068115234 nb_pixel_total : 2256 time to create 1 rle with old method : 0.005542755126953125 time for calcul the mask position with numpy : 0.007214546203613281 nb_pixel_total : 3112 time to create 1 rle with old method : 0.0070726871490478516 time for calcul the mask position with numpy : 0.007297515869140625 nb_pixel_total : 1662 time to create 1 rle with old method : 0.003991842269897461 batch 1 Loaded 16 chid ids of type : 3391 ++++++++++++++++Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! time spend for datou_step_exec : 1.6167495250701904 time spend to save output : 0.00010538101196289062 total time spend for step 1 : 1.6168549060821533 caffe_path_current : About to save ! 0 After save, about to update current ! datou_cur_ids : [] len(datou.list_steps) : 1 output : {1003369118: 'temp/1742725840_43872_1003369118_58171420504d0b5f05a1233b6c515509_65826337.jpg'} batch 1 Loaded 16 chid ids of type : 3391 ++++++++++++++++fin du test de poly_to_rle ############################### TEST cod_sts ################################ warning , we can't find thcl infos in json_data warning , we can't find pdt infos in json_data Inside batchDatouExec : verbose : False # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : split_time_score list_input_json : [] origin We have 1 , we have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB time to download the photos : 0.019013404846191406 About to test input to load Calling datou_exec Inside datou_exec : verbose : False we use local cache db, so we are in local job, but when commit will be implemented for local cache db, we could again use save number of steps : 1 step1:split_time_score Sun Mar 23 11:30:42 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('48', 4), ('42', 3)) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 17082021 4453840 Nombre de photos uploadées : 7 / 23040 (0%) 17082021 4453840 Nombre de photos taguées (types de déchets): 0 / 7 (0%) 17082021 4453840 Nombre de photos taguées (volume) : 0 / 7 (0%) elapsed_time : load_data_split_time_score 5.0067901611328125e-06 elapsed_time : order_list_meta_photo_and_scores 1.0013580322265625e-05 ??????? elapsed_time : fill_and_build_computed_from_old_data 0.0009286403656005859 elapsed_time : insert_dashboard_record_day_entry 0.023001432418823242 TODO 20-09-21 https://github.com/fotonower/raspi-fotonower-x/issues/253#issuecomment-923099773 TODO 20-9-21 TODO 20-9-21 ***** BEGIN SPLIT TIME ***** False 1629158400.0 `1629186488.0 1629186300.0 `1629186488.0 1629186300.0 `1629186512.0 1629186300.0 `1629186512.0 1629186300.0 `1629189733.0 1629189600.0 `1629189733.0 1629189600.0 `1629189736.0 1629189600.0 list printed: [[0, 1, 2, 3], [4, 5, 6]] forced_hashtag: jrm force hashtag to jrm elapsed_time : SPLIT_TIME 0.005159616470336914 ***** END SPLIT TIME ***** NUMBER BATCH : 2 list_ponderation used : [0.001, 0.001, 0.001, 0.001, 0.001] , list_hashtag_class_create_as_list : ['jrm'] ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info result_one_balle_Type_jrm:{'day': '17082021', 'map_nb_amount': {0: 0, 1: 0, 2: 0, 3: 0, 4: 0}, 'map_time_amount': {0: 0, 1: 0, 2: 0, 3: 0, 4: 0}, 'duration': 24.0, 'nb_balles_papier': 0, 'begin_time_port': 'IMG_20210817_094808.jpg'} Production hashtag (incorrect ponderation at 20-10-18) : 0 ERROR missing amount info ERROR missing amount info ERROR missing amount info result_one_balle_Type_jrm:{'day': '17082021', 'map_nb_amount': {0: 0, 1: 0, 2: 0, 3: 0, 4: 0}, 'map_time_amount': {0: 0, 1: 0, 2: 0, 3: 0, 4: 0}, 'duration': 3.0, 'nb_balles_papier': 0, 'begin_time_port': 'IMG_20210817_104213.jpg'} Production hashtag (incorrect ponderation at 20-10-18) : 0 We have rejected 0 photos because of the batch_size condition ! NUMBER BATCH list_of_portfolios_to_create : 2 list_same_port_ids : [4453926] find same portfolio which already exist 4453926 , we will use it list_same_port_ids : [4652336] find same portfolio which already exist 4652336 , we will use it Qualite : 0.5219450480102605 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 8564 mask_detect is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 8572 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 8573 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 8567 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 8567 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 8566 argmax have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 8568 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 8569 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 8569 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 9453 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 9453 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 8571 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 8571 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 8570 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 8570 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 8574 send_mail_cod have less inputs used (4) than in the step definition (5) : maybe we manage optionnal inputs ! Step 9126 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 8564 doesn't seem to be define in the database( WARNING : type of input 2 of step 8567 doesn't seem to be define in the database( WARNING : output 0 of step 8566 have datatype=6 whereas input 2 of step 8568 have datatype=5 WARNING : output 1 of step 8564 have datatype=2 whereas input 1 of step 8568 have datatype=7 WARNING : output 0 of step 8564 have datatype=16 whereas input 0 of step 8568 have datatype=1 WARNING : type of output 2 of step 8568 doesn't seem to be define in the database( WARNING : type of input 1 of step 8569 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 8568 doesn't seem to be define in the database( WARNING : type of input 1 of step 8571 doesn't seem to be define in the database( WARNING : type of output 1 of step 8571 doesn't seem to be define in the database( WARNING : type of input 3 of step 8570 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 8571 have datatype=10 whereas input 2 of step 8574 have datatype=6 WARNING : type of input 2 of step 9453 doesn't seem to be define in the database( WARNING : output 1 of step 8569 have datatype=7 whereas input 2 of step 9453 have datatype=None WARNING : type of output 3 of step 9453 doesn't seem to be define in the database( WARNING : type of input 2 of step 8571 doesn't seem to be define in the database( WARNING : type of output 3 of step 8564 doesn't seem to be define in the database( WARNING : type of input 1 of step 8572 doesn't seem to be define in the database( WARNING : type of output 3 of step 8564 doesn't seem to be define in the database( WARNING : type of input 1 of step 8573 doesn't seem to be define in the database( WARNING : type of output 1 of step 8572 doesn't seem to be define in the database( WARNING : type of input 3 of step 8567 doesn't seem to be define in the database( WARNING : type of output 1 of step 8573 doesn't seem to be define in the database( WARNING : type of input 4 of step 8567 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=4453926 AND mptpi.`type`=4038 To do Qualite : 0.1657989516453152 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 8564 mask_detect is not consistent : 4 used against 2 in the step definition ! WARNING : number of outputs for step 8572 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 8573 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 8567 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 8567 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 8566 argmax have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 8568 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 8569 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 8569 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 9453 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 9453 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 8571 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 8571 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 8570 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 8570 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 8574 send_mail_cod have less inputs used (4) than in the step definition (5) : maybe we manage optionnal inputs ! Step 9126 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 8564 doesn't seem to be define in the database( WARNING : type of input 2 of step 8567 doesn't seem to be define in the database( WARNING : output 0 of step 8566 have datatype=6 whereas input 2 of step 8568 have datatype=5 WARNING : output 1 of step 8564 have datatype=2 whereas input 1 of step 8568 have datatype=7 WARNING : output 0 of step 8564 have datatype=16 whereas input 0 of step 8568 have datatype=1 WARNING : type of output 2 of step 8568 doesn't seem to be define in the database( WARNING : type of input 1 of step 8569 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 8568 doesn't seem to be define in the database( WARNING : type of input 1 of step 8571 doesn't seem to be define in the database( WARNING : type of output 1 of step 8571 doesn't seem to be define in the database( WARNING : type of input 3 of step 8570 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 8571 have datatype=10 whereas input 2 of step 8574 have datatype=6 WARNING : type of input 2 of step 9453 doesn't seem to be define in the database( WARNING : output 1 of step 8569 have datatype=7 whereas input 2 of step 9453 have datatype=None WARNING : type of output 3 of step 9453 doesn't seem to be define in the database( WARNING : type of input 2 of step 8571 doesn't seem to be define in the database( WARNING : type of output 3 of step 8564 doesn't seem to be define in the database( WARNING : type of input 1 of step 8572 doesn't seem to be define in the database( WARNING : type of output 3 of step 8564 doesn't seem to be define in the database( WARNING : type of input 1 of step 8573 doesn't seem to be define in the database( WARNING : type of output 1 of step 8572 doesn't seem to be define in the database( WARNING : type of input 3 of step 8567 doesn't seem to be define in the database( WARNING : type of output 1 of step 8573 doesn't seem to be define in the database( WARNING : type of input 4 of step 8567 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=4652336 AND mptpi.`type`=4038 To do elapsed_time : count_nb_balles_and_create_portfolio 1.0205156803131104 # DISPLAY ALL COLLECTED DATA : {'17082021': {'nb_upload': 7, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} time spend for datou_step_exec : 1.0986359119415283 time spend to save output : 8.177757263183594e-05 total time spend for step 1 : 1.0987176895141602 caffe_path_current : About to save ! 1 Inside saveOutput : final : True verbose : False saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1050302186, 1050302153, 1050302152, 1050302146, 1050302113, 1050302110, 1050302106] Looping around the photos to save general results len do output : 1 /4453840Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3781', None, None, None, None, None, None, None, None) ('3781', '4453840', '1050302186', None, None, None, None, None, None) ('3781', None, None, None, None, None, None, None, None) ('3781', '4453840', '1050302153', None, None, None, None, None, None) ('3781', None, None, None, None, None, None, None, None) ('3781', '4453840', '1050302152', None, None, None, None, None, None) ('3781', None, None, None, None, None, None, None, None) ('3781', '4453840', '1050302146', None, None, None, None, None, None) ('3781', None, None, None, None, None, None, None, None) ('3781', '4453840', '1050302113', None, None, None, None, None, None) ('3781', None, None, None, None, None, None, None, None) ('3781', '4453840', '1050302110', None, None, None, None, None, None) ('3781', None, None, None, None, None, None, None, None) ('3781', '4453840', '1050302106', None, None, None, None, None, None) begin to insert list_values into mtr_datou_result : length of list_values in save_final : 8 time used for this insertion : 0.01520395278930664 save_final save missing photos in datou_result : After save, about to update current ! Result test cod : {4453840: ([[0, 1, 2, 3], [4, 5, 6]], {'Rungis_jrm': [(0, 1), (1, 2)]}, {4453926: {'list_of_photos': [1050302106, 1050302146, 1050302110, 1050302152], 'hashtag': 'jrm'}, 4652336: {'list_of_photos': [1050302113, 1050302153, 1050302186], 'hashtag': 'jrm'}}, {2107757407: 7}, {'amount_uploaded_and_tagged': {'17082021': {'nb_upload': 7, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}}, 'map_amount_per_hashtag': {'Rungis_jrm': [(0, 1), (1, 2)]}, 'count': {'Rungis_jrm': [(0, 1), (1, 2)]}})}| ############################### TEST cod_download ################################ warning , we can't find thcl infos in json_data warning , we can't find pdt infos in json_data [] [] ############################### TEST sendgrid ################################ test sendgrid senders@fotonower.com no problem of authentification, for test if the email can be received, try with a real receiver fin du test de sendgrid ############################### TEST rym_consolidate ################################ test_rym_consolidate Inside batchDatouExec : verbose : False # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 9321 copy_chis is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 9357 consolidate_hashtags_from_manual_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 9318 rle_unique_nms_with_priority is not consistent : 3 used against 1 in the step definition ! WARNING : number of outputs for step 9318 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 9410 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 9319 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 9328 blur_detection have less inputs used (0) than in the step definition (1) : maybe we manage optionnal inputs ! Step 9327 brightness have less inputs used (0) than in the step definition (1) : maybe we manage optionnal inputs ! Step 9326 send_mail_cod have less inputs used (4) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 9321 have datatype=11 whereas input 0 of step 9318 have datatype=2 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 9357 doesn't seem to be define in the database( WARNING : type of input 1 of step 9318 doesn't seem to be define in the database( WARNING : type of output 1 of step 9357 doesn't seem to be define in the database( WARNING : type of input 3 of step 9319 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 9410 doesn't seem to be define in the database( WARNING : output 1 of step 9318 have datatype=7 whereas input 1 of step 9410 have datatype=None WARNING : type of output 1 of step 9410 doesn't seem to be define in the database( WARNING : type of input 4 of step 9319 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 9410 have datatype=10 whereas input 3 of step 9326 have datatype=6 WARNING : type of output 1 of step 9321 doesn't seem to be define in the database( WARNING : type of input 1 of step 9357 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : copy_chis, consolidate_hashtags_from_manual_portfolio, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, send_mail_cod list_input_json : [] origin We have 1 , BBFFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 2 ; length of list_pids : 2 ; length of list_args : 2 time to download the photos : 0.17815566062927246 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : False number of steps : 8 step1:copy_chis Sun Mar 23 11:30:45 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Begin step datou_step_copy_crop batch 1 Loaded 0 chid ids of type : 0 time spend for datou_step_exec : 0.07589244842529297 time spend to save output : 7.104873657226562e-05 total time spend for step 1 : 0.07596349716186523 step2:consolidate_hashtags_from_manual_portfolio Sun Mar 23 11:30:46 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step consolidate_hashtags_from_manual_portfolio Iterating over portfolio : 4709558 on est dans le IF portfolio mere 26T SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=4709558 AND mptpi.`type`=4016 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_clair','etiquette','bouchon','pehd','barquette_avec_film','metal','pet_fonce','aluminium','carton','film_plastique','papier','autre')) To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=4709558 AND mptpi.`type`=4016 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_clair','etiquette','bouchon','pehd','barquette_avec_film','metal','pet_fonce','aluminium','carton','film_plastique','papier','autre')) To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=4683188 AND mptpi.`type`=4016 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_clair','etiquette','bouchon','pehd','barquette_avec_film','metal','pet_fonce','aluminium','carton','film_plastique','papier','autre')) To do TODO : # On doit donc construire les chi a partir des informations dans les photos filles query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=4673496 AND mpp.hide_status=0 ORDER BY ph.size desc TODO : # On doit donc construire les chi a partir des informations dans les photos filles query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=4673497 AND mpp.hide_status=0 ORDER BY ph.size desc TODO : # On doit donc construire les chi a partir des informations dans les photos filles query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=4673498 AND mpp.hide_status=0 ORDER BY ph.size desc TODO : # On doit donc construire les chi a partir des informations dans les photos filles query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=4673500 AND mpp.hide_status=0 ORDER BY ph.size desc TODO : # On doit donc construire les chi a partir des informations dans les photos filles query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=4673501 AND mpp.hide_status=0 ORDER BY ph.size desc TODO : # On doit donc construire les chi a partir des informations dans les photos filles query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=4673502 AND mpp.hide_status=0 ORDER BY ph.size desc TODO : # On doit donc construire les chi a partir des informations dans les photos filles query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=4673503 AND mpp.hide_status=0 ORDER BY ph.size desc TODO : # On doit donc construire les chi a partir des informations dans les photos filles query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=4673504 AND mpp.hide_status=0 ORDER BY ph.size desc TODO : # On doit donc construire les chi a partir des informations dans les photos filles query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=4673505 AND mpp.hide_status=0 ORDER BY ph.size desc TODO : # On doit donc construire les chi a partir des informations dans les photos filles query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=4673506 AND mpp.hide_status=0 ORDER BY ph.size desc TODO : # On doit donc construire les chi a partir des informations dans les photos filles query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=4673507 AND mpp.hide_status=0 ORDER BY ph.size desc TODO : # On doit donc construire les chi a partir des informations dans les photos filles query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=4673508 AND mpp.hide_status=0 ORDER BY ph.size desc To test ! Use context local managing function ! time spend for datou_step_exec : 7.936971187591553 time spend to save output : 8.988380432128906e-05 total time spend for step 2 : 7.937061071395874 step3:rle_unique_nms_with_priority Sun Mar 23 11:30:53 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 65 chid ids of type : 4016 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 0 nb_hashtags : 3 time to prepare the origin masks : 19.193930864334106 create new chi : 8.273124694824219e-05 time to delete rle : 0.6381816864013672 save time : 5.078315734863281e-05 nb_obj : 0 nb_hashtags : 3 time to prepare the origin masks : 22.123973608016968 create new chi : 9.584426879882812e-05 time to delete rle : 0.6087229251861572 save time : 9.703636169433594e-05 map_output_result : {1057289467: (0.0, 'Should be the crop_list due to order', 0.0), 1057289546: (0.0, 'Should be the crop_list due to order', 0.0)} End step rle-unique-nms time spend for datou_step_exec : 42.847721099853516 time spend to save output : 0.0005962848663330078 total time spend for step 3 : 42.84831738471985 step4:ventilate_hashtags_in_portfolio Sun Mar 23 11:31:36 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 4709558 get user id for portfolio 4709558 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=4709558 AND mptpi.`type`=4016 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('environnement','mal_croppe','pet_clair','etiquette','bouchon','pehd','barquette_avec_film','metal','pet_fonce','aluminium','carton','film_plastique','papier','autre')) AND mptpi.`min_score`=0.7 To do To do ! Use context local managing function ! time spend for datou_step_exec : 0.2112424373626709 time spend to save output : 0.00010085105895996094 total time spend for step 4 : 0.21134328842163086 step5:final Sun Mar 23 11:31:37 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! time spend for datou_step_exec : 0.02265334129333496 time spend to save output : 5.030632019042969e-05 total time spend for step 5 : 0.02270364761352539 step6:blur_detection Sun Mar 23 11:31:37 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection toutes les photos sont déjà traitées, on saute les calculs time spend for datou_step_exec : 0.006162881851196289 time spend to save output : 3.24249267578125e-05 total time spend for step 6 : 0.0061953067779541016 step7:brightness Sun Mar 23 11:31:37 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness toutes les photos sont déjà traitées, on saute les calculs time spend for datou_step_exec : 0.0060770511627197266 time spend to save output : 2.3126602172851562e-05 total time spend for step 7 : 0.006100177764892578 step8:send_mail_cod Sun Mar 23 11:31:37 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/temp in order to get the selector url, please entre the license of selector results_COD_P4709558_23-03-2025_11_31_37.pdf 4673494 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette46734941742725897 4673496 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette46734961742725898 4673497 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette46734971742725899 4673498 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette46734981742725902 4673500 change filename to text .change filename to text .imagette46735001742725903 4673501 change filename to text .imagette46735011742725903 4673502 imagette46735021742725903 4673503 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette46735031742725903 4673504 imagette46735041742725905 4673505 imagette46735051742725905 4673506 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette46735061742725905 4673507 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette46735071742725906 4673508 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette46735081742725907 velour_link : ce batch n'est pas dans un dashboard, on n'envoi pas de mail. si vous voulez quand même des mail , veuillez configurer no_mail = 2 args[1057289467] : ((1057289467, -4.424440243329978, 492609224), (1057289467, -0.4062218880770088, 496442774), '0.009511382621534484') We are sending mail with results at marine@fotonower.com args[1057289546] : ((1057289546, -4.333383571220791, 492609224), (1057289546, -0.5998675991292823, 501862349), '0.009511382621534484') We are sending mail with results at marine@fotonower.com refus_total : 0.009511382621534484 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=4709558 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 current_id not found list index out of range start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_COD_P4709558_23-03-2025_11_31_37.pdf results_COD_P4709558_23-03-2025_11_31_37.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_COD_P4709558_23-03-2025_11_31_37.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3818','4709558','results_COD_P4709558_23-03-2025_11_31_37.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_COD_P4709558_23-03-2025_11_31_37.pdf','pdf','','0.48','0.009511382621534484') time spend for datou_step_exec : 14.557955741882324 time spend to save output : 5.650520324707031e-05 total time spend for step 8 : 14.558012247085571 caffe_path_current : About to save ! 0 After save, about to update current ! datou_cur_ids : [] len(datou.list_steps) : 8 output : fin du test de rym_consolidate ############################### TEST generate_new_image_add_crop ################################ test_generate_new_image_add_crop Inside batchDatouExec : verbose : False # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : generate_new_image list_input_json : [] origin We have 1 , BBBFFFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 3 ; length of list_pids : 3 ; length of list_args : 3 time to download the photos : 0.12405037879943848 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : False number of steps : 1 step1:generate_new_image Sun Mar 23 11:31:51 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=4789595 ORDER BY ph.size desc We have 1 , we need 3 photos there is already 3 photos exist in our local_cache we have to download 0 photos we have successful downloaded 0 photos there are 0 photos missing finally, we can get 3 photo needed from our local_cache list of photo_id_missing : [] batch 1 Loaded 2 chid ids of type : 4021 ++we need 2 photos there is already 2 photos exist in our local_cache we have to download 0 photos we have successful downloaded 0 photos there are 0 photos missing finally, we can get 2 photo needed from our local_cache list of photo_id_missing : [] begin to treate photo :1057314774 add chi : 2208326712 , rotate : 180 (640, 640) (273, 528, 1, 557) (556, 255, 3) (556, 255) (640, 640, 3) time for calcul the mask position with numpy : 0.0023763179779052734 nb_pixel_total : 98268 time to create 1 rle with old method : 0.28102684020996094 batch 1 Loaded 0 chid ids of type : 0 time for calcul the mask position with numpy : 0.002759218215942383 nb_pixel_total : 98268 time to create 1 rle with old method : 0.23838520050048828 begin to treate photo :1057314768 add chi : 2208326718 , rotate : 17 (799, 799) (13, 349, 615, 717) (102, 336, 3) (102, 336) (799, 799, 3) time for calcul the mask position with numpy : 0.0011248588562011719 nb_pixel_total : 8870 time to create 1 rle with old method : 0.020194292068481445 batch 1 Loaded 2 chid ids of type : 4021 ++time for calcul the mask position with numpy : 0.002443075180053711 nb_pixel_total : 73028 time to create 1 rle with old method : 0.1835775375366211 time for calcul the mask position with numpy : 0.0017919540405273438 nb_pixel_total : 8870 time to create 1 rle with old method : 0.022228717803955078 time for calcul the mask position with numpy : 0.0017151832580566406 nb_pixel_total : 8755 time to create 1 rle with old method : 0.020069122314453125 begin to treate photo :1057314766 add chi : 2208326712 , rotate : 26 (855, 855) (140, 561, 190, 704) (514, 421, 3) (514, 421) (855, 855, 3) time for calcul the mask position with numpy : 0.0018410682678222656 nb_pixel_total : 98281 time to create 1 rle with old method : 0.23176336288452148 batch 1 Loaded 3 chid ids of type : 4021 +++time for calcul the mask position with numpy : 0.002511262893676758 nb_pixel_total : 65320 time to create 1 rle with old method : 0.17375445365905762 time for calcul the mask position with numpy : 0.0027980804443359375 nb_pixel_total : 36270 time to create 1 rle with old method : 0.1033935546875 time for calcul the mask position with numpy : 0.002115488052368164 nb_pixel_total : 98281 time to create 1 rle with old method : 0.258709192276001 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1742725915_43872 we have uploaded 1 photos in the portfolio 4789106 batch 1 Loaded 1 chid ids of type : 4086 Number RLEs to save : 556 TO DO : save crop sub photo not yet done ! we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1742725915_43872 we have uploaded 1 photos in the portfolio 4789106 batch 1 Loaded 3 chid ids of type : 4086 Number RLEs to save : 644 TO DO : save crop sub photo not yet done ! we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1742725916_43872 we have uploaded 1 photos in the portfolio 4789106 batch 1 Loaded 3 chid ids of type : 4086 Number RLEs to save : 1572 TO DO : save crop sub photo not yet done ! time spend for datou_step_exec : 4.705845355987549 time spend to save output : 0.00027108192443847656 total time spend for step 1 : 4.706116437911987 caffe_path_current : About to save ! 0 After save, about to update current ! datou_cur_ids : [] len(datou.list_steps) : 1 output : None nombre de crop attendu : 8, nombre de crop obtenu : 7 fin du test de generate_new_image ERROR generate_new_image_add_crop FAILED ############################### TEST velours_tree ################################ test velours_tree - Retrieving photos to tag... query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=4837217 ORDER BY ph.size desc - Loading descriptors... Size : 512 len(descriptors) : 5 Compute structured hierarchical clustering... ward : AgglomerativeClustering(n_clusters=5) ward.labels_ : [4 3 2 1 0] Elapsed time: 0.01067972183227539 graph_id used : 1145 - Beta version, working pretty good on 11-5-16 ! fin du test de velours_tree ############################### TEST step ACP ################################ Inside batchDatouExec : verbose : False # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : acp list_input_json : [] origin We have 1 , we have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB time to download the photos : 0.018674135208129883 About to test input to load Calling datou_exec Inside datou_exec : verbose : False number of steps : 1 step1:acp Sun Mar 23 11:31:57 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Cette step permet de calculer une ACP. ATTENTION : le size etait trop grand : 20, on a changé sa valeur à : 9 find save_photo_desc_type : 5705 On sauvegarde les nouveaux descripteurs dans le photo desc type : 5705 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5705, 'ACP_from_type_5619_size_9', 9, 9, 'ACP_from_type_5619_size_9', None, 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2022, 6, 16, 11, 6, 15), None) time to traite the descriptors : 0.00040340423583984375 storage_type for insertDescriptorsMulti : 3 Missing photo l117 : 1069306708 Missing photo l117 : 1069306710 Missing photo l117 : 1069306805 Missing photo l117 : 1069306815 Missing photo l117 : 1069306841 Missing photo l117 : 1069306843 Missing photo l117 : 1069306844 Missing photo l117 : 1069306954 Missing photo l117 : 1069306964 Missing photo l117 : 1069306967 To insert : 1069306708 To insert : 1069306710 To insert : 1069306805 To insert : 1069306815 To insert : 1069306841 To insert : 1069306843 To insert : 1069306844 To insert : 1069306954 To insert : 1069306964 To insert : 1069306967 time to insert the descriptors : 2.619999408721924 res : {'1069306708': b'\xc3\xbf\x00\x00\x00\x00\x08\x14\x03\x05', '1069306710': b'\x00\x00\x00\x00\x00\x00\x00"\xc2\xb3', '1069306805': b'\x00\x06\x00\x00\x00\x00\x00\xc2\x8a\x00', '1069306815': b'\x00l\x00\x00\x00\xc3\x84>\x00\x00', '1069306841': b'\x004\x00\xc3\xad@=sz\x00', '1069306843': b'\x00\x00-\x00\xc3\xb9\x00\x00\x00\x00', '1069306844': b'\x00\x00\x00\xc2\x86\x00T\x00\x00\x00', '1069306954': b'\x14\xc2\x83\xc3\xbf\x1f\x00\x00\x00\x00\x00', '1069306964': b'\x06\xc3\xbf\x00X\x1a\x00\x00\x00\x1f', '1069306967': b'\x00\x00\x00\x00\x00\x00\xc2\xab\x00\x00'} time spend for datou_step_exec : 3.834977626800537 time spend to save output : 0.00014734268188476562 total time spend for step 1 : 3.835124969482422 caffe_path_current : About to save ! 1 Inside saveOutput : final : True verbose : False saveOutput not yet implemented for datou_step.type : acp we use saveGeneral [1069306967, 1069306964, 1069306954, 1069306844, 1069306843, 1069306841, 1069306815, 1069306805, 1069306710, 1069306708] Looping around the photos to save general results len do output : 10 /1069306708Didn't retrieve data . /1069306710Didn't retrieve data . /1069306805Didn't retrieve data . /1069306815Didn't retrieve data . /1069306841Didn't retrieve data . /1069306843Didn't retrieve data . /1069306844Didn't retrieve data . /1069306954Didn't retrieve data . /1069306964Didn't retrieve data . /1069306967Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4208', None, None, None, None, None, None, None, None) ('4208', '5709050', '1069306967', None, None, None, None, None, None) ('4208', None, None, None, None, None, None, None, None) ('4208', '5709050', '1069306964', None, None, None, None, None, None) ('4208', None, None, None, None, None, None, None, None) ('4208', '5709050', '1069306954', None, None, None, None, None, None) ('4208', None, None, None, None, None, None, None, None) ('4208', '5709050', '1069306844', None, None, None, None, None, None) ('4208', None, None, None, None, None, None, None, None) ('4208', '5709050', '1069306843', None, None, None, None, None, None) ('4208', None, None, None, None, None, None, None, None) ('4208', '5709050', '1069306841', None, None, None, None, None, None) ('4208', None, None, None, None, None, None, None, None) ('4208', '5709050', '1069306815', None, None, None, None, None, None) ('4208', None, None, None, None, None, None, None, None) ('4208', '5709050', '1069306805', None, None, None, None, None, None) ('4208', None, None, None, None, None, None, None, None) ('4208', '5709050', '1069306710', None, None, None, None, None, None) ('4208', None, None, None, None, None, None, None, None) ('4208', '5709050', '1069306708', None, None, None, None, None, None) begin to insert list_values into mtr_datou_result : length of list_values in save_final : 20 time used for this insertion : 0.01619744300842285 save_final save missing photos in datou_result : After save, about to update current ! Inside batchDatouExec : verbose : False # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : acp list_input_json : [] origin We have 1 , we have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB time to download the photos : 0.014908075332641602 About to test input to load Calling datou_exec Inside datou_exec : verbose : False number of steps : 1 step1:acp Sun Mar 23 11:32:01 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Cette step permet de calculer une ACP. ATTENTION : le size etait trop grand : 20, on a changé sa valeur à : 9 Sauvegarde du modèle et envoi sur OVH Attention : /data/models_weight/ACP_from_port_5709050_type_5619_size_9 existe, son contenu risque d'être écrasé model_param file didn't exist model didn't exist , save the new model in s3 local folder to save in s3 : /data/models_weight/ACP_from_port_5709050_type_5619_size_9 update : 1742725924.2611866 done ! 1742725924.4221008 {'files': [{'name': 'pca_model.pkl', 'size': 103314, 'last_modified': '2025-03-23T10:32:04.276710', 'hash': 'd7e2c6aa9a1ef592ffdfc4abe9c66263'}], 'directories': []} Création d'un nouveau thème de classification Le thème de classification 'ACP_from_port_5709050_type_5619_size_9' existe déjà, merci de relancer avec un nouveau nom dans les params-json. time spend for datou_step_exec : 2.8422653675079346 time spend to save output : 5.888938903808594e-05 total time spend for step 1 : 2.8423242568969727 caffe_path_current : About to save ! 1 Inside saveOutput : final : True verbose : False saveOutput not yet implemented for datou_step.type : acp we use saveGeneral [1069306967, 1069306964, 1069306954, 1069306844, 1069306843, 1069306841, 1069306815, 1069306805, 1069306710, 1069306708] Looping around the photos to save general results object of type 'int' has no len() begin to insert list_values into mtr_datou_result : length of list_values in save_final : 10 time used for this insertion : 0.014925241470336914 save_final save missing photos in datou_result : After save, about to update current ! Inside batchDatouExec : verbose : False # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : acp list_input_json : [] origin We have 1 , we have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB time to download the photos : 0.013813972473144531 About to test input to load Calling datou_exec Inside datou_exec : verbose : False number of steps : 1 step1:acp Sun Mar 23 11:32:04 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Cette step permet de calculer une ACP. To do loadFromThcl(), then load ParamDescType : thcl3412 thcls : [{'id': 3412, 'mtr_user_id': 31, 'name': 'ACP_from_port_5709050_type_5619_size_9', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '', 'svm_portfolios_learning': '0', 'photo_hashtag_type': 4398, 'photo_desc_type': 5706, 'type_classification': 'ACP', 'hashtag_id_list': '0'}] thcl {'id': 3412, 'mtr_user_id': 31, 'name': 'ACP_from_port_5709050_type_5619_size_9', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '', 'svm_portfolios_learning': '0', 'photo_hashtag_type': 4398, 'photo_desc_type': 5706, 'type_classification': 'ACP', 'hashtag_id_list': '0'} Update svm_hashtag_type_desc : 5706 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5706, 'ACP_from_port_5709050_type_5619_size_9', 9, 9, 'ACP_from_port_5709050_type_5619_size_9', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2022, 6, 16, 11, 8, 14), datetime.datetime(2022, 6, 16, 11, 8, 14)) model_param file didn't exist model_name : ACP_from_port_5709050_type_5619_size_9 model_type : acp list file need : ['pca_model.pkl'] file exist in s3 : ['pca_model.pkl'] file manque in s3 : [] local folder : /data/models_weight/ACP_from_port_5709050_type_5619_size_9 /data/models_weight/ACP_from_port_5709050_type_5619_size_9/pca_model.pkl size_local : 103314 size in s3 : 103314 create time local : 2025-03-23 11:32:02 create time in s3 : 2025-03-23 10:32:04 pca_model.pkl already exist and didn't need to update model_name : ACP_from_port_5709050_type_5619_size_9 On sauvegarde les nouveaux descripteurs dans le photo desc type : 5706 time to traite the descriptors : 0.00038909912109375 storage_type for insertDescriptorsMulti : 3 Missing photo l117 : 1069306708 Missing photo l117 : 1069306710 Missing photo l117 : 1069306805 Missing photo l117 : 1069306815 Missing photo l117 : 1069306841 Missing photo l117 : 1069306843 Missing photo l117 : 1069306844 Missing photo l117 : 1069306954 Missing photo l117 : 1069306964 Missing photo l117 : 1069306967 To insert : 1069306708 To insert : 1069306710 To insert : 1069306805 To insert : 1069306815 To insert : 1069306841 To insert : 1069306843 To insert : 1069306844 To insert : 1069306954 To insert : 1069306964 To insert : 1069306967 time to insert the descriptors : 2.29237961769104 res : {'1069306708': b'\xc3\xbf\x00\x00\x00\x00\x08\x14\x03\x05', '1069306710': b'\x00\x00\x00\x00\x00\x00\x00"\xc2\xb3', '1069306805': b'\x00\x06\x00\x00\x00\x00\x00\xc2\x8a\x00', '1069306815': b'\x00l\x00\x00\x00\xc3\x84>\x00\x00', '1069306841': b'\x004\x00\xc3\xad@=sz\x00', '1069306843': b'\x00\x00-\x00\xc3\xb9\x00\x00\x00\x00', '1069306844': b'\x00\x00\x00\xc2\x86\x00T\x00\x00\x00', '1069306954': b'\x14\xc2\x83\xc3\xbf\x1f\x00\x00\x00\x00\x00', '1069306964': b'\x06\xc3\xbf\x00X\x1a\x00\x00\x00\x1f', '1069306967': b'\x00\x00\x00\x00\x00\x00\xc2\xab\x00\x00'} time spend for datou_step_exec : 4.026665925979614 time spend to save output : 6.198883056640625e-05 total time spend for step 1 : 4.026727914810181 caffe_path_current : About to save ! 1 Inside saveOutput : final : True verbose : False saveOutput not yet implemented for datou_step.type : acp we use saveGeneral [1069306967, 1069306964, 1069306954, 1069306844, 1069306843, 1069306841, 1069306815, 1069306805, 1069306710, 1069306708] Looping around the photos to save general results len do output : 10 /1069306708Didn't retrieve data . /1069306710Didn't retrieve data . /1069306805Didn't retrieve data . /1069306815Didn't retrieve data . /1069306841Didn't retrieve data . /1069306843Didn't retrieve data . /1069306844Didn't retrieve data . /1069306954Didn't retrieve data . /1069306964Didn't retrieve data . /1069306967Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4212', None, None, None, None, None, None, None, None) ('4212', '5709050', '1069306967', None, None, None, None, None, None) ('4212', None, None, None, None, None, None, None, None) ('4212', '5709050', '1069306964', None, None, None, None, None, None) ('4212', None, None, None, None, None, None, None, None) ('4212', '5709050', '1069306954', None, None, None, None, None, None) ('4212', None, None, None, None, None, None, None, None) ('4212', '5709050', '1069306844', None, None, None, None, None, None) ('4212', None, None, None, None, None, None, None, None) ('4212', '5709050', '1069306843', None, None, None, None, None, None) ('4212', None, None, None, None, None, None, None, None) ('4212', '5709050', '1069306841', None, None, None, None, None, None) ('4212', None, None, None, None, None, None, None, None) ('4212', '5709050', '1069306815', None, None, None, None, None, None) ('4212', None, None, None, None, None, None, None, None) ('4212', '5709050', '1069306805', None, None, None, None, None, None) ('4212', None, None, None, None, None, None, None, None) ('4212', '5709050', '1069306710', None, None, None, None, None, None) ('4212', None, None, None, None, None, None, None, None) ('4212', '5709050', '1069306708', None, None, None, None, None, None) begin to insert list_values into mtr_datou_result : length of list_values in save_final : 20 time used for this insertion : 0.015495777130126953 save_final save missing photos in datou_result : After save, about to update current ! fin du test de la step acp ############################### TEST blur_crop ################################ Inside batchDatouExec : verbose : False # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : crop_condition list_input_json : [] origin We have 1 , BBFFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 2 ; length of list_pids : 2 ; length of list_args : 2 time to download the photos : 0.14375519752502441 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : False number of steps : 1 step1:crop_condition Sun Mar 23 11:32:08 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Loading chi in step crop with photo_hashtag_type : 4356 Loading chi in step crop for list_pids : 2 ! batch 1 Loaded 3 chid ids of type : 4356 +++++ begin to crop the class : Papier_Magazine param for this class : {} filtre for class : Papier_Magazine hashtag_id of this class : 2107752386 begin to crop the class : carton_brun param for this class : {} filtre for class : carton_brun hashtag_id of this class : 2107753024 begin to crop the class : carton_gris param for this class : {} filtre for class : carton_gris hashtag_id of this class : 2107753020 begin to crop the class : cartonnette param for this class : {} filtre for class : cartonnette hashtag_id of this class : 702398920 begin to crop the class : kraft param for this class : {} filtre for class : kraft hashtag_id of this class : 493202403 begin to crop the class : autre_refus param for this class : {} filtre for class : autre_refus hashtag_id of this class : 2107752406 begin to crop the class : metal param for this class : {} filtre for class : metal hashtag_id of this class : 492628673 begin to crop the class : plastique param for this class : {} filtre for class : plastique hashtag_id of this class : 492725882 begin to crop the class : teint_dans_la_masse param for this class : {} filtre for class : teint_dans_la_masse hashtag_id of this class : 2107752385 begin to crop the class : environnement param for this class : {} filtre for class : environnement hashtag_id of this class : 493012381 begin to crop the class : contaminant param for this class : {} filtre for class : contaminant hashtag_id of this class : 681467679 map_result returned by crop_photo_return_map_crop : length : 3 About to insert : list_path_to_insert length 0 new photo from crops ! About to upload 0 photos WARNING : list_path_to_insert is empty, cannot upload ! we have finished the crop for the class : contaminant time spend for datou_step_exec : 0.18582510948181152 time spend to save output : 0.00021648406982421875 total time spend for step 1 : 0.18604159355163574 caffe_path_current : About to save ! 1 Inside saveOutput : final : True verbose : False saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1105701516, 1105701500] Looping around the photos to save general results len do output : 3 /1105703686Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1105703688Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1105703689Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3990', None, None, None, None, None, None, None, None) ('3990', '6135916', '1105701516', None, None, None, None, None, None) ('3990', None, None, None, None, None, None, None, None) ('3990', '6135916', '1105701500', None, None, None, None, None, None) begin to insert list_values into mtr_datou_result : length of list_values in save_final : 11 time used for this insertion : 0.014121055603027344 save_final save missing photos in datou_result : After save, about to update current ! datou_cur_ids : [] len(datou.list_steps) : 1 output : {1105703686: [1105701516, 'temp/1742725928_43872_1105701516_047b0ce16fe5e308d8512c83125c4058_polygon_blur_2436374092_1.jpg', (25, 175, 137, 235)], 1105703688: [1105701500, 'temp/1742725928_43872_1105701500_b57a1caec2d74ede6814095fdd28cb27_polygon_blur_2436373819_1.jpg', (108, 300, 16, 138)], 1105703689: [1105701500, 'temp/1742725928_43872_1105701500_b57a1caec2d74ede6814095fdd28cb27_polygon_blur_2436374262_1.jpg', (47, 300, 91, 247)]} fin du test de la step crop option blur ############################### TEST pma_consolidate ################################ Inside batchDatouExec : verbose : False # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 12666 copy_chis is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12667 consolidate_hashtags_from_manual_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 12664 rle_unique_nms_with_priority is not consistent : 3 used against 1 in the step definition ! WARNING : number of outputs for step 12664 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12671 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 12666 have datatype=11 whereas input 0 of step 12664 have datatype=2 WARNING : type of output 1 of step 12667 doesn't seem to be define in the database( WARNING : type of input 3 of step 12665 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 12667 doesn't seem to be define in the database( WARNING : type of input 1 of step 12664 doesn't seem to be define in the database( WARNING : type of input 1 of step 12671 doesn't seem to be define in the database( WARNING : output 1 of step 12664 have datatype=7 whereas input 1 of step 12671 have datatype=None WARNING : type of output 1 of step 12671 doesn't seem to be define in the database( WARNING : type of input 4 of step 12665 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 12666 doesn't seem to be define in the database( WARNING : type of input 1 of step 12667 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : copy_chis, consolidate_hashtags_from_manual_portfolio, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final list_input_json : [] origin We have 1 , BBFFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 2 ; length of list_pids : 2 ; length of list_args : 2 time to download the photos : 0.22011160850524902 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : False number of steps : 5 step1:copy_chis Sun Mar 23 11:32:09 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Begin step datou_step_copy_crop batch 1 Loaded 21 chid ids of type : 4482 batch 1 Loaded 88 chid ids of type : 4490 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! time spend for datou_step_exec : 0.0893552303314209 time spend to save output : 0.00010418891906738281 total time spend for step 1 : 0.08945941925048828 step2:consolidate_hashtags_from_manual_portfolio Sun Mar 23 11:32:09 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step consolidate_hashtags_from_manual_portfolio Iterating over portfolio : 6549724 on est dans le IF portfolio mere 26T SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=6549724 AND mptpi.`type`=4483 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','carton','metal','pet_clair','pehd','pet_fonce','pet_opaque','barquette_opaque','film_plastique','ela','sac','textiles','verre','organique','dasri','masque','encombrant','autre_emballage','autre_non_emballage','environnement')) AND mptpi.`min_score`=0.1 To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=6549724 AND mptpi.`type`=4490 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','carton','metal','pet_clair','pehd','pet_fonce','pet_opaque','barquette_opaque','film_plastique','ela','sac','textiles','verre','organique','dasri','masque','encombrant','autre_emballage','autre_non_emballage','environnement')) AND mptpi.`min_score`=0.1 To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=9778120 AND mptpi.`type`=4483 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','carton','metal','pet_clair','pehd','pet_fonce','pet_opaque','barquette_opaque','film_plastique','ela','sac','textiles','verre','organique','dasri','masque','encombrant','autre_emballage','autre_non_emballage','environnement')) AND mptpi.`min_score`=0.1 To do TODO : # On doit donc construire les chi a partir des informations dans les photos filles query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=9755323 AND mpp.hide_status=0 ORDER BY ph.size desc batch 1 Loaded 101 chid ids of type : 4482 begin to find the sub_photo_id : begin to find the sub_photo_id : TODO : # On doit donc construire les chi a partir des informations dans les photos filles query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=9755324 AND mpp.hide_status=0 ORDER BY ph.size desc batch 1 Loaded 101 chid ids of type : 4482 begin to find the sub_photo_id : begin to find the sub_photo_id : TODO : # On doit donc construire les chi a partir des informations dans les photos filles query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=9755325 AND mpp.hide_status=0 ORDER BY ph.size desc batch 1 Loaded 53 chid ids of type : 4482 begin to find the sub_photo_id : TODO : # On doit donc construire les chi a partir des informations dans les photos filles query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=9755326 AND mpp.hide_status=0 ORDER BY ph.size desc batch 1 Loaded 101 chid ids of type : 4482 begin to find the sub_photo_id : begin to find the sub_photo_id : TODO : # On doit donc construire les chi a partir des informations dans les photos filles query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=9755327 AND mpp.hide_status=0 ORDER BY ph.size desc TODO : # On doit donc construire les chi a partir des informations dans les photos filles query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=9755328 AND mpp.hide_status=0 ORDER BY ph.size desc batch 1 Loaded 53 chid ids of type : 4482 begin to find the sub_photo_id : TODO : # On doit donc construire les chi a partir des informations dans les photos filles query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=9755329 AND mpp.hide_status=0 ORDER BY ph.size desc TODO : # On doit donc construire les chi a partir des informations dans les photos filles query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=9755330 AND mpp.hide_status=0 ORDER BY ph.size desc TODO : # On doit donc construire les chi a partir des informations dans les photos filles query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=9755331 AND mpp.hide_status=0 ORDER BY ph.size desc TODO : # On doit donc construire les chi a partir des informations dans les photos filles query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=9755332 AND mpp.hide_status=0 ORDER BY ph.size desc TODO : # On doit donc construire les chi a partir des informations dans les photos filles query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=9755333 AND mpp.hide_status=0 ORDER BY ph.size desc batch 1 Loaded 101 chid ids of type : 4482 begin to find the sub_photo_id : begin to find the sub_photo_id : TODO : # On doit donc construire les chi a partir des informations dans les photos filles query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=9755334 AND mpp.hide_status=0 ORDER BY ph.size desc TODO : # On doit donc construire les chi a partir des informations dans les photos filles query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=9755335 AND mpp.hide_status=0 ORDER BY ph.size desc TODO : # On doit donc construire les chi a partir des informations dans les photos filles query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=9755336 AND mpp.hide_status=0 ORDER BY ph.size desc TODO : # On doit donc construire les chi a partir des informations dans les photos filles query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=9755337 AND mpp.hide_status=0 ORDER BY ph.size desc TODO : # On doit donc construire les chi a partir des informations dans les photos filles query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=9755338 AND mpp.hide_status=0 ORDER BY ph.size desc TODO : # On doit donc construire les chi a partir des informations dans les photos filles query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=9755339 AND mpp.hide_status=0 ORDER BY ph.size desc TODO : # On doit donc construire les chi a partir des informations dans les photos filles query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=9755340 AND mpp.hide_status=0 ORDER BY ph.size desc TODO : # On doit donc construire les chi a partir des informations dans les photos filles query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=9755341 AND mpp.hide_status=0 ORDER BY ph.size desc batch 1 Loaded 48 chid ids of type : 4482 begin to find the sub_photo_id : TODO : # On doit donc construire les chi a partir des informations dans les photos filles query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=9755342 AND mpp.hide_status=0 ORDER BY ph.size desc batch 1 Loaded 101 chid ids of type : 4482 begin to find the sub_photo_id : begin to find the sub_photo_id : To test ! Use context local managing function ! time spend for datou_step_exec : 2.0583903789520264 time spend to save output : 6.532669067382812e-05 total time spend for step 2 : 2.0584557056427 step3:rle_unique_nms_with_priority Sun Mar 23 11:32:11 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 88 chid ids of type : 4490 seulement à utiliser dans la step consolidation batch 1 Loaded 38 chid ids of type : 4490 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.03349447250366211 seulement à utiliser dans la step consolidation batch 1 Loaded 50 chid ids of type : 4490 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.03359580039978027 map_output_result : {1114046597: (0.09264291817443555, 'Should be the crop_list due to order', 0.042237513638672064), 1114046377: (0.09264291817443555, 'Should be the crop_list due to order', 0.14304832271019904)} End step rle-unique-nms time spend for datou_step_exec : 1.254279613494873 time spend to save output : 8.320808410644531e-05 total time spend for step 3 : 1.2543628215789795 step4:ventilate_hashtags_in_portfolio Sun Mar 23 11:32:12 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 6549724 get user id for portfolio 6549724 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=6549724 AND mptpi.`type`=4490 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','carton','metal','pet_clair','pehd','pet_fonce','pet_opaque','barquette_opaque','film_plastique','ela','sac','textiles','verre','organique','dasri','masque','encombrant','autre_emballage','autre_non_emballage','environnement','mal_croppe','flou')) AND mptpi.`min_score`=0.1 To do To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=6549724 AND mptpi.`type`=4483 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','carton','metal','pet_clair','pehd','pet_fonce','pet_opaque','barquette_opaque','film_plastique','ela','sac','textiles','verre','organique','dasri','masque','encombrant','autre_emballage','autre_non_emballage','environnement','mal_croppe','flou')) AND mptpi.`min_score`=0.1 To do lien utilise dans velours : https://www.fotonower.com/velours/9755323,9755324,9755325,9755326,9755327,9755328,9755329,9755330,9755331,9755332,9755333,9755334,9755335,9755336,9755337,9755338,9755339,9755340,9755341,9755342,9755344,9755345?tags=papier,carton,metal,pet_clair,pehd,pet_fonce,pet_opaque,barquette_opaque,film_plastique,ela,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement,mal_croppe,flou&datou_id_consolidate=4387&port_consolidate=6549724 time spend for datou_step_exec : 0.42676639556884766 time spend to save output : 0.00014090538024902344 total time spend for step 4 : 0.4269073009490967 step5:final Sun Mar 23 11:32:13 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! time spend for datou_step_exec : 0.10603857040405273 time spend to save output : 5.245208740234375e-05 total time spend for step 5 : 0.10609102249145508 caffe_path_current : About to save ! 1 Inside saveOutput : final : True verbose : False original output for save of step final : {1114046597: ('0.3133414848207032',), 1114046377: ('0.3133414848207032',)} new output for save of step final : {1114046597: ('0.3133414848207032',), 1114046377: ('0.3133414848207032',)} [1114046597, 1114046377] Looping around the photos to save general results len do output : 2 /1114046597.Didn't retrieve data . /1114046377.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('4492', None, None, None, None, None, None, None, None) ('4492', '6549724', '1114046597', None, None, None, None, None, None) ('4492', None, None, None, None, None, None, None, None) ('4492', '6549724', '1114046377', None, None, None, None, None, None) begin to insert list_values into mtr_datou_result : length of list_values in save_final : 6 time used for this insertion : 0.011975765228271484 save_final save missing photos in datou_result : After save, about to update current ! datou_cur_ids : [] len(datou.list_steps) : 5 output : {1114046597: ('0.3133414848207032',), 1114046377: ('0.3133414848207032',)} fin du test de portfolio mere absolue dans consolidate ############################### TEST pma_ventilate ################################ Inside batchDatouExec : verbose : False # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 12795 copy_chis is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12796 consolidate_hashtags_from_manual_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 12793 rle_unique_nms_with_priority is not consistent : 3 used against 1 in the step definition ! WARNING : number of outputs for step 12793 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : output 0 of step 12795 have datatype=11 whereas input 0 of step 12793 have datatype=2 WARNING : type of output 1 of step 12796 doesn't seem to be define in the database( WARNING : type of input 1 of step 12793 doesn't seem to be define in the database( WARNING : type of input 1 of step 12800 doesn't seem to be define in the database( WARNING : output 1 of step 12793 have datatype=7 whereas input 1 of step 12800 have datatype=None WARNING : type of output 1 of step 12795 doesn't seem to be define in the database( WARNING : type of input 1 of step 12796 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : copy_chis, consolidate_hashtags_from_manual_portfolio, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio list_input_json : [] origin We have 1 , BBFFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 2 ; length of list_pids : 2 ; length of list_args : 2 time to download the photos : 0.328294038772583 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : False number of steps : 4 step1:copy_chis Sun Mar 23 11:32:13 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Begin step datou_step_copy_crop batch 1 Loaded 21 chid ids of type : 4482 batch 1 Loaded 88 chid ids of type : 4490 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! time spend for datou_step_exec : 0.05542278289794922 time spend to save output : 9.107589721679688e-05 total time spend for step 1 : 0.055513858795166016 step2:consolidate_hashtags_from_manual_portfolio Sun Mar 23 11:32:13 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step consolidate_hashtags_from_manual_portfolio Iterating over portfolio : 6549724 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=6549724 AND mptpi.`type`=4483 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','carton','metal','pet_clair','pehd','pet_fonce','pet_opaque','barquette_opaque','film_plastique','ela','sac','textiles','verre','organique','dasri','masque','encombrant','autre_emballage','autre_non_emballage','environnement')) To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=6549724 AND mptpi.`type`=4490 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','carton','metal','pet_clair','pehd','pet_fonce','pet_opaque','barquette_opaque','film_plastique','ela','sac','textiles','verre','organique','dasri','masque','encombrant','autre_emballage','autre_non_emballage','environnement')) To do TODO : # On doit donc construire les chi a partir des informations dans les photos filles query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=9755323 AND mpp.hide_status=0 ORDER BY ph.size desc batch 1 Loaded 101 chid ids of type : 4482 begin to find the sub_photo_id : begin to find the sub_photo_id : TODO : # On doit donc construire les chi a partir des informations dans les photos filles query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=9755324 AND mpp.hide_status=0 ORDER BY ph.size desc batch 1 Loaded 101 chid ids of type : 4482 begin to find the sub_photo_id : begin to find the sub_photo_id : TODO : # On doit donc construire les chi a partir des informations dans les photos filles query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=9755325 AND mpp.hide_status=0 ORDER BY ph.size desc batch 1 Loaded 53 chid ids of type : 4482 begin to find the sub_photo_id : TODO : # On doit donc construire les chi a partir des informations dans les photos filles query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=9755326 AND mpp.hide_status=0 ORDER BY ph.size desc batch 1 Loaded 101 chid ids of type : 4482 begin to find the sub_photo_id : begin to find the sub_photo_id : TODO : # On doit donc construire les chi a partir des informations dans les photos filles query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=9755327 AND mpp.hide_status=0 ORDER BY ph.size desc TODO : # On doit donc construire les chi a partir des informations dans les photos filles query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=9755328 AND mpp.hide_status=0 ORDER BY ph.size desc batch 1 Loaded 53 chid ids of type : 4482 begin to find the sub_photo_id : TODO : # On doit donc construire les chi a partir des informations dans les photos filles query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=9755329 AND mpp.hide_status=0 ORDER BY ph.size desc TODO : # On doit donc construire les chi a partir des informations dans les photos filles query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=9755330 AND mpp.hide_status=0 ORDER BY ph.size desc TODO : # On doit donc construire les chi a partir des informations dans les photos filles query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=9755331 AND mpp.hide_status=0 ORDER BY ph.size desc TODO : # On doit donc construire les chi a partir des informations dans les photos filles query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=9755332 AND mpp.hide_status=0 ORDER BY ph.size desc TODO : # On doit donc construire les chi a partir des informations dans les photos filles query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=9755333 AND mpp.hide_status=0 ORDER BY ph.size desc batch 1 Loaded 101 chid ids of type : 4482 begin to find the sub_photo_id : begin to find the sub_photo_id : TODO : # On doit donc construire les chi a partir des informations dans les photos filles query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=9755334 AND mpp.hide_status=0 ORDER BY ph.size desc TODO : # On doit donc construire les chi a partir des informations dans les photos filles query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=9755335 AND mpp.hide_status=0 ORDER BY ph.size desc TODO : # On doit donc construire les chi a partir des informations dans les photos filles query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=9755336 AND mpp.hide_status=0 ORDER BY ph.size desc TODO : # On doit donc construire les chi a partir des informations dans les photos filles query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=9755337 AND mpp.hide_status=0 ORDER BY ph.size desc TODO : # On doit donc construire les chi a partir des informations dans les photos filles query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=9755338 AND mpp.hide_status=0 ORDER BY ph.size desc TODO : # On doit donc construire les chi a partir des informations dans les photos filles query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=9755339 AND mpp.hide_status=0 ORDER BY ph.size desc TODO : # On doit donc construire les chi a partir des informations dans les photos filles query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=9755340 AND mpp.hide_status=0 ORDER BY ph.size desc TODO : # On doit donc construire les chi a partir des informations dans les photos filles query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=9755341 AND mpp.hide_status=0 ORDER BY ph.size desc batch 1 Loaded 48 chid ids of type : 4482 begin to find the sub_photo_id : TODO : # On doit donc construire les chi a partir des informations dans les photos filles query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=9755342 AND mpp.hide_status=0 ORDER BY ph.size desc batch 1 Loaded 101 chid ids of type : 4482 begin to find the sub_photo_id : begin to find the sub_photo_id : To test ! Use context local managing function ! time spend for datou_step_exec : 1.5572741031646729 time spend to save output : 0.0001163482666015625 total time spend for step 2 : 1.5573904514312744 step3:rle_unique_nms_with_priority Sun Mar 23 11:32:15 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 88 chid ids of type : 4490 seulement à utiliser dans la step consolidation batch 1 Loaded 38 chid ids of type : 4490 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.03475499153137207 seulement à utiliser dans la step consolidation batch 1 Loaded 50 chid ids of type : 4490 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.03425288200378418 map_output_result : {1114046597: (0.09264291817443555, 'Should be the crop_list due to order', 0.042237513638672064), 1114046377: (0.09264291817443555, 'Should be the crop_list due to order', 0.14304832271019904)} End step rle-unique-nms time spend for datou_step_exec : 0.6369216442108154 time spend to save output : 4.291534423828125e-05 total time spend for step 3 : 0.6369645595550537 step4:ventilate_hashtags_in_portfolio Sun Mar 23 11:32:15 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 6549724 get user id for portfolio 6549724 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=9974548 AND mptpi.`type`=4490 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','carton','metal','pet_clair','pehd','pet_fonce','pet_opaque','barquette_opaque','film_plastique','ela','sac','textiles','verre','organique','dasri','masque','encombrant','autre_emballage','autre_non_emballage','environnement','mal_croppe','flou')) AND mptpi.`min_score`=0.1 To do To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=6549724 AND mptpi.`type`=4490 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','carton','metal','pet_clair','pehd','pet_fonce','pet_opaque','barquette_opaque','film_plastique','ela','sac','textiles','verre','organique','dasri','masque','encombrant','autre_emballage','autre_non_emballage','environnement','mal_croppe','flou')) AND mptpi.`min_score`=0.1 To do To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=6549724 AND mptpi.`type`=4483 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','carton','metal','pet_clair','pehd','pet_fonce','pet_opaque','barquette_opaque','film_plastique','ela','sac','textiles','verre','organique','dasri','masque','encombrant','autre_emballage','autre_non_emballage','environnement','mal_croppe','flou')) AND mptpi.`min_score`=0.1 To do lien utilise dans velours : https://www.fotonower.com/velours/9755323,9755324,9755325,9755326,9755327,9755328,9755329,9755330,9755331,9755332,9755333,9755334,9755335,9755336,9755337,9755338,9755339,9755340,9755341,9755342,9755344,9755345?tags=papier,carton,metal,pet_clair,pehd,pet_fonce,pet_opaque,barquette_opaque,film_plastique,ela,sac,textiles,verre,organique,dasri,masque,encombrant,autre_emballage,autre_non_emballage,environnement,mal_croppe,flou&datou_id_consolidate=4387&port_consolidate=6549724 time spend for datou_step_exec : 0.8998532295227051 time spend to save output : 6.318092346191406e-05 total time spend for step 4 : 0.899916410446167 caffe_path_current : About to save ! 1 Inside saveOutput : final : True verbose : False saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1114046597, 1114046377] Looping around the photos to save general results len do output : 1 /6549724. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4553', None, None, None, None, None, None, None, None) ('4553', '6549724', '1114046597', None, None, None, None, None, None) ('4553', None, None, None, None, None, None, None, None) ('4553', '6549724', '1114046377', None, None, None, None, None, None) begin to insert list_values into mtr_datou_result : length of list_values in save_final : 3 time used for this insertion : 0.01798224449157715 save_final save missing photos in datou_result : After save, about to update current ! datou_cur_ids : [] len(datou.list_steps) : 4 output : {6549724: [{'papier': 9755346, 'carton': 9755347, 'metal': 9755348, 'pet_clair': 9755349, 'pehd': 9755350, 'pet_fonce': 9755351, 'pet_opaque': 9755352, 'barquette_opaque': 9755353, 'film_plastique': 9755354, 'ela': 9755355, 'sac': 9755356, 'textiles': 9755357, 'verre': 9755358, 'organique': 9755359, 'dasri': 9755360, 'masque': 9755361, 'encombrant': 9755362, 'autre_emballage': 9755363, 'autre_non_emballage': 9755364, 'environnement': 9755365, 'mal_croppe': 9755366, 'flou': 9755367}]} fin du test de portfolio mere absolue dans consolidate #&_#_#&_# TEST sam SUCCEEDED #&_#_#&_# #&_#_#&_# TEST frcnn SUCCEEDED #&_#_#&_# #&_#_#&_# TEST thcl SUCCEEDED #&_#_#&_# #&_#_#&_# TEST tfhub2 FAILED #&_#_#&_# #&_#_#&_# TEST ordonner SUCCEEDED #&_#_#&_# #&_#_#&_# TEST rotate SUCCEEDED #&_#_#&_# #&_#_#&_# TEST data_augmentation_ellipse_varroa_tile_rotate SUCCEEDED #&_#_#&_# #&_#_#&_# TEST flip SUCCEEDED #&_#_#&_# #&_#_#&_# TEST crop_rles SUCCEEDED #&_#_#&_# #&_#_#&_# TEST angular_coeff SUCCEEDED #&_#_#&_# #&_#_#&_# TEST detection_filter_by_crop SUCCEEDED #&_#_#&_# #&_#_#&_# TEST detection_filter_by_classif SUCCEEDED #&_#_#&_# #&_#_#&_# TEST blur_detection SUCCEEDED #&_#_#&_# #&_#_#&_# TEST detect_point_224x224 SUCCEEDED #&_#_#&_# #&_#_#&_# TEST certificat_qualite_papier SUCCEEDED #&_#_#&_# #&_#_#&_# TEST image_temperature_detection SUCCEEDED #&_#_#&_# #&_#_#&_# TEST broca SUCCEEDED #&_#_#&_# #&_#_#&_# TEST crop_conditional SUCCEEDED #&_#_#&_# #&_#_#&_# TEST image_blanchir SUCCEEDED #&_#_#&_# #&_#_#&_# TEST darker_image SUCCEEDED #&_#_#&_# #&_#_#&_# TEST img_aug SUCCEEDED #&_#_#&_# #&_#_#&_# TEST rubbia SUCCEEDED #&_#_#&_# #&_#_#&_# TEST rubbia_split_dark SUCCEEDED #&_#_#&_# #&_#_#&_# TEST rubbia_append SUCCEEDED #&_#_#&_# #&_#_#&_# TEST rubbia_horaire FAILED #&_#_#&_# #&_#_#&_# TEST rle_unique_nms_with_priority SUCCEEDED #&_#_#&_# #&_#_#&_# TEST random_deformation SUCCEEDED #&_#_#&_# #&_#_#&_# TEST tile SUCCEEDED #&_#_#&_# #&_#_#&_# TEST rotate_chi SUCCEEDED #&_#_#&_# #&_#_#&_# TEST rubbia_carac_pet_clair_0121_no_cnn SUCCEEDED #&_#_#&_# #&_#_#&_# TEST rubbia_carac_jrm_no_mask_detect SUCCEEDED #&_#_#&_# #&_#_#&_# TEST ventilate_hashtags_in_portfolio SUCCEEDED #&_#_#&_# #&_#_#&_# TEST poly_ro_rle SUCCEEDED #&_#_#&_# #&_#_#&_# TEST cod_sts SUCCEEDED #&_#_#&_# #&_#_#&_# TEST cod_download SUCCEEDED #&_#_#&_# #&_#_#&_# TEST sendgrid SUCCEEDED #&_#_#&_# #&_#_#&_# TEST rym_consolidate SUCCEEDED #&_#_#&_# #&_#_#&_# TEST generate_new_image_add_crop FAILED #&_#_#&_# #&_#_#&_# TEST velours_tree SUCCEEDED #&_#_#&_# #&_#_#&_# TEST step ACP SUCCEEDED #&_#_#&_# #&_#_#&_# TEST blur_crop SUCCEEDED #&_#_#&_# #&_#_#&_# TEST pma_consolidate SUCCEEDED #&_#_#&_# #&_#_#&_# TEST pma_ventilate SUCCEEDED #&_#_#&_# #&_# TEST FAILED #&_# : tests/datou_test #&_# #&_# END OF TEST #&_# : tests/datou_test #&_# #&_# BEGIN OF TEST : mtr/database_queries/CacheModelData_queries #&_# /home/admin/workarea/git/Velours/python/mtr/database_queries/CacheModelData_queries.py Test Cache Model Data test a faire VR 27-9-17 #&_# TEST SUCCEEDED #&_# : mtr/database_queries/CacheModelData_queries #&_# #&_# END OF TEST #&_# : mtr/database_queries/CacheModelData_queries #&_# #&_# BEGIN OF TEST : tests/cache_photo_data_test #&_# /home/admin/workarea/git/Velours/python/tests/cache_photo_data_test.py Test local_cache_photo ############################### test_download_photos_by_local_cache ################################ test download portfolio 1162416 : 574 photos We have 1 , we need 574 photos there is already 574 photos exist in our local_cache we have to download 0 photos we have successful downloaded 0 photos there are 0 photos missing finally, we can get 574 photo needed from our local_cache list of photo_id_missing : [] test download a list if photos : 10 photos (6 exist in ovh and 4 missing in ovh) we need 10 photos there is already 6 photos exist in our local_cache we have to download 4 photos download_photo : 1 to 2000 BBBBHTTP Error 404: Not Found can't download the photo : 1109585121 HTTP Error 404: Not Found can't download the photo : 1109585109 FFHTTP Error 404: Not Found can't download the photo : 1109585436 FHTTP Error 404: Not Found can't download the photo : 1109585120 Fwe have successful downloaded 0 photos there are 4 photos missing finally, we can get 6 photo needed from our local_cache list of photo_id_missing : [1109585121, 1109585109, 1109585436, 1109585120] ############################### test_update_time_created ################################ we need 1 photos there is already 1 photos exist in our local_cache we have to download 0 photos we have successful downloaded 0 photos there are 0 photos missing finally, we can get 1 photo needed from our local_cache list of photo_id_missing : [] #&_#_#&_# TEST cache photo data SUCCEEDED #&_#_#&_# #&_# TEST SUCCEEDED #&_# : tests/cache_photo_data_test #&_# #&_# END OF TEST #&_# : tests/cache_photo_data_test #&_# #&_# BEGIN OF TEST : mtr/mask_rcnn/prepare_maskdata #&_# /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/prepare_maskdata.py test prepare mask data 2096875719 599722655 batch 1 Loaded 20 chid ids of type : 840 ++++++++++++++++++++batch 1 Loaded 16 chid ids of type : 840 +++++++++batch 1 Loaded 20 chid ids of type : 840 ++++++++++++++++++++batch 1 Loaded 19 chid ids of type : 840 ++++++++++batch 1 Loaded 20 chid ids of type : 840 ++++++++++++{2096875719: 'Plaque-immatriculation', 599722655: 'capot'} logo-marque 2096875717 907850592 x0 : 38 y1 : 269 width : 32, height : 38, area : 1216, score : 1.0 None pare-choc 624624117 907850592 x0 : 0 y1 : 559 width : 362, height : 235, area : 85070, score : 1.0 None coffre 495920967 907850592 x0 : 0 y1 : 398 width : 302, height : 336, area : 101472, score : 1.0 None coffre 495920967 907850592 x0 : 626 y1 : 206 width : 18, height : 35, area : 630, score : 1.0 None aile-arriere 2106233861 907850592 x0 : 189 y1 : 476 width : 282, height : 235, area : 66270, score : 1.0 None roue 492689227 907850592 x0 : 275 y1 : 620 width : 170, height : 215, area : 36550, score : 1.0 None Plaque-immatriculation 2096875719 907850592 x0 : 10 y1 : 454 width : 108, height : 84, area : 9072, score : 1.0 None feu-arriere 2096875713 907850592 x0 : 192 y1 : 359 width : 147, height : 96, area : 14112, score : 1.0 None poignee 499500794 907850592 x0 : 437 y1 : 315 width : 42, height : 37, area : 1554, score : 1.0 None poignee 499500794 907850592 x0 : 567 y1 : 282 width : 25, height : 31, area : 775, score : 1.0 None Pot-echappement 2096875720 907850592 x0 : 155 y1 : 532 width : 21, height : 20, area : 420, score : 1.0 None toit 492731002 907850592 x0 : 136 y1 : 74 width : 281, height : 21, area : 5901, score : 1.0 None Pare-brise 2096875709 907850592 x0 : 1 y1 : 241 width : 285, height : 165, area : 47025, score : 1.0 None porte 492654799 907850592 x0 : 354 y1 : 442 width : 210, height : 380, area : 79800, score : 1.0 None porte 492654799 907850592 x0 : 501 y1 : 389 width : 135, height : 324, area : 43740, score : 1.0 None Info-modele 2096875721 907850592 x0 : 132 y1 : 295 width : 53, height : 31, area : 1643, score : 1.0 None vitre 492925064 907850592 x0 : 407 y1 : 201 width : 123, height : 122, area : 15006, score : 1.0 None vitre 492925064 907850592 x0 : 377 y1 : 201 width : 64, height : 118, area : 7552, score : 1.0 None vitre 492925064 907850592 x0 : 522 y1 : 203 width : 102, height : 120, area : 12240, score : 1.0 None Essuie-glace 2096875722 907850592 x0 : 7 y1 : 250 width : 72, height : 61, area : 4392, score : 1.0 None /data/data_root/test_preparedata/train/907850592.jpg logo-marque 2096875717 907862724 x0 : 100 y1 : 282 width : 35, height : 41, area : 1435, score : 1.0 None pare-choc 624624117 907862724 x0 : 1 y1 : 483 width : 435, height : 194, area : 84390, score : 1.0 None aile-arriere 2106233861 907862724 x0 : 399 y1 : 411 width : 110, height : 128, area : 14080, score : 1.0 None retroviseur 492844413 907862724 x0 : 600 y1 : 203 width : 41, height : 37, area : 1517, score : 1.0 None coffre 495920967 907862724 x0 : 5 y1 : 351 width : 369, height : 270, area : 99630, score : 1.0 None Cache-reservoir 2096875718 907862724 x0 : 417 y1 : 289 width : 50, height : 61, area : 3050, score : 1.0 None roue 492689227 907862724 x0 : 367 y1 : 541 width : 121, height : 190, area : 22990, score : 1.0 None poignee 499500794 907862724 x0 : 478 y1 : 275 width : 33, height : 25, area : 825, score : 1.0 None toit 492731002 907862724 x0 : 226 y1 : 110 width : 223, height : 36, area : 8028, score : 1.0 None feu-arriere 2096875713 907862724 x0 : 294 y1 : 331 width : 112, height : 146, area : 16352, score : 1.0 None poignee 499500794 907862724 x0 : 566 y1 : 252 width : 20, height : 27, area : 540, score : 1.0 None Plaque-immatriculation 2096875719 907862724 x0 : 55 y1 : 436 width : 142, height : 54, area : 7668, score : 1.0 None Pare-brise 2096875709 907862724 x0 : 6 y1 : 225 width : 366, height : 132, area : 48312, score : 1.0 None porte 492654799 907862724 x0 : 395 y1 : 391 width : 170, height : 311, area : 52870, score : 1.0 None porte 492654799 907862724 x0 : 508 y1 : 354 width : 101, height : 269, area : 27169, score : 1.0 None vitre 492925064 907862724 x0 : 451 y1 : 202 width : 85, height : 99, area : 8415, score : 1.0 None vitre 492925064 907862724 x0 : 524 y1 : 202 width : 70, height : 99, area : 6930, score : 1.0 None vitre 492925064 907862724 x0 : 428 y1 : 208 width : 50, height : 102, area : 5100, score : 1.0 None Essuie-glace 2096875722 907862724 x0 : 114 y1 : 218 width : 186, height : 27, area : 5022, score : 1.0 None Info-modele 2096875721 907862724 x0 : 10 y1 : 306 width : 41, height : 33, area : 1353, score : 1.0 None /data/data_root/test_preparedata/train/907862724.jpg porte 492654799 907863602 x0 : 129 y1 : 380 width : 300, height : 279, area : 83700, score : 1.0 None porte 492654799 907863602 x0 : 193 y1 : 345 width : 228, height : 215, area : 49020, score : 1.0 None porte 492654799 907863602 x0 : 379 y1 : 385 width : 257, height : 286, area : 73502, score : 1.0 None porte 492654799 907863602 x0 : 400 y1 : 365 width : 195, height : 248, area : 48360, score : 1.0 None roue 492689227 907863602 x0 : 0 y1 : 419 width : 124, height : 148, area : 18352, score : 1.0 None roue 492689227 907863602 x0 : 0 y1 : 411 width : 127, height : 129, area : 16383, score : 1.0 None roue 492689227 907863602 x0 : 580 y1 : 449 width : 60, height : 129, area : 7740, score : 1.0 None roue 492689227 907863602 x0 : 584 y1 : 444 width : 50, height : 126, area : 6300, score : 1.0 None retroviseur 492844413 907863602 x0 : 165 y1 : 225 width : 53, height : 51, area : 2703, score : 1.0 None vitre 492925064 907863602 x0 : 211 y1 : 218 width : 197, height : 109, area : 21473, score : 1.0 None vitre 492925064 907863602 x0 : 217 y1 : 214 width : 193, height : 99, area : 19107, score : 1.0 None vitre 492925064 907863602 x0 : 409 y1 : 214 width : 188, height : 98, area : 18424, score : 1.0 None vitre 492925064 907863602 x0 : 414 y1 : 206 width : 187, height : 96, area : 17952, score : 1.0 None poignee 499500794 907863602 x0 : 320 y1 : 271 width : 46, height : 19, area : 874, score : 1.0 None poignee 499500794 907863602 x0 : 321 y1 : 270 width : 44, height : 19, area : 836, score : 1.0 None poignee 499500794 907863602 x0 : 553 y1 : 270 width : 62, height : 25, area : 1550, score : 1.0 None poignee 499500794 907863602 x0 : 565 y1 : 266 width : 42, height : 16, area : 672, score : 1.0 None capot 599722655 907863602 x0 : -1 y1 : 215 width : 135, height : 37, area : 4995, score : 1.0 None capot 599722655 907863602 x0 : 242 y1 : 123 width : 330, height : 52, area : 17160, score : 1.0 None /data/data_root/test_preparedata/train/907863602.jpg porte 492654799 907863940 x0 : 109 y1 : 426 width : 283, height : 265, area : 74995, score : 1.0 None porte 492654799 907863940 x0 : 179 y1 : 399 width : 203, height : 221, area : 44863, score : 1.0 None porte 492654799 907863940 x0 : 354 y1 : 425 width : 277, height : 266, area : 73682, score : 1.0 None porte 492654799 907863940 x0 : 370 y1 : 407 width : 179, height : 233, area : 41707, score : 1.0 None roue 492689227 907863940 x0 : -1 y1 : 463 width : 98, height : 141, area : 13818, score : 1.0 None roue 492689227 907863940 x0 : 0 y1 : 468 width : 88, height : 147, area : 12936, score : 1.0 None roue 492689227 907863940 x0 : 523 y1 : 493 width : 117, height : 146, area : 17082, score : 1.0 None roue 492689227 907863940 x0 : 525 y1 : 493 width : 111, height : 147, area : 16317, score : 1.0 None retroviseur 492844413 907863940 x0 : 138 y1 : 278 width : 46, height : 44, area : 2024, score : 1.0 None vitre 492925064 907863940 x0 : 182 y1 : 266 width : 200, height : 95, area : 19000, score : 1.0 None vitre 492925064 907863940 x0 : 385 y1 : 257 width : 172, height : 90, area : 15480, score : 1.0 None vitre 492925064 907863940 x0 : 394 y1 : 256 width : 144, height : 86, area : 12384, score : 1.0 None vitre 492925064 907863940 x0 : 549 y1 : 253 width : 58, height : 53, area : 3074, score : 1.0 None poignee 499500794 907863940 x0 : 300 y1 : 306 width : 59, height : 17, area : 1003, score : 1.0 None poignee 499500794 907863940 x0 : 307 y1 : 313 width : 51, height : 24, area : 1224, score : 1.0 None poignee 499500794 907863940 x0 : 527 y1 : 308 width : 53, height : 22, area : 1166, score : 1.0 None poignee 499500794 907863940 x0 : 536 y1 : 310 width : 45, height : 24, area : 1080, score : 1.0 None capot 599722655 907863940 x0 : 219 y1 : 181 width : 370, height : 38, area : 14060, score : 1.0 None logo-roue 2106233859 907863940 x0 : 7 y1 : 419 width : 27, height : 43, area : 1161, score : 1.0 None logo-roue 2106233859 907863940 x0 : 594 y1 : 441 width : 26, height : 25, area : 650, score : 1.0 None /data/data_root/test_preparedata/val/907863940.jpg #&_#_#&_# TEST prepare mask data poly SUCCEEDED #&_#_#&_# 2107755846 batch 1 Loaded 15 chid ids of type : 2622 {2107755846: 'pet_clair'} environment 492622729 964453879 x0 : 0 y1 : 479 width : 112, height : 415, area : 46480, score : 1.0 None error 501120777 964453879 x0 : 142 y1 : 479 width : 28, height : 20, area : 560, score : 1.0 None error 501120777 964453879 x0 : 151 y1 : 99 width : 23, height : 42, area : 966, score : 1.0 None error 501120777 964453879 x0 : 175 y1 : 59 width : 117, height : 59, area : 6903, score : 1.0 None error 501120777 964453879 x0 : 282 y1 : 479 width : 35, height : 62, area : 2170, score : 1.0 None error 501120777 964453879 x0 : 315 y1 : 460 width : 19, height : 26, area : 494, score : 1.0 None error 501120777 964453879 x0 : 353 y1 : 361 width : 32, height : 41, area : 1312, score : 1.0 None error 501120777 964453879 x0 : 403 y1 : 215 width : 47, height : 51, area : 2397, score : 1.0 None error 501120777 964453879 x0 : 497 y1 : 253 width : 89, height : 55, area : 4895, score : 1.0 None error 501120777 964453879 x0 : 546 y1 : 195 width : 58, height : 68, area : 3944, score : 1.0 None error 501120777 964453879 x0 : 613 y1 : 323 width : 20, height : 32, area : 640, score : 1.0 None error 501120777 964453879 x0 : 638 y1 : 225 width : 17, height : 27, area : 459, score : 1.0 None pet_clair 2107755846 964453879 x0 : 0 y1 : 479 width : 719, height : 479, area : 344401, score : 1.0 None error 501120777 964453879 x0 : 546 y1 : 195 width : 60, height : 68, area : 4080, score : 1.0 None error 501120777 964453879 x0 : 613 y1 : 323 width : 22, height : 32, area : 704, score : 1.0 None /data/data_root/test_preparedata/val/964453879.jpg #&_#_#&_# TEST prepare mask data rle SUCCEEDED #&_#_#&_# time for calcul the mask position with numpy : 0.00015926361083984375 nb_pixel_total : 6 time to create 1 rle with old method : 0.00011873245239257812 Sanity check PASSED : sum_rle_size : 12 height * width : 12 7 #&_#_#&_# TEST prepare mask data mat SUCCEEDED #&_#_#&_# #&_# TEST SUCCEEDED #&_# : mtr/mask_rcnn/prepare_maskdata #&_# #&_# END OF TEST #&_# : mtr/mask_rcnn/prepare_maskdata #&_# #&_# BEGIN OF TEST : mtr/database_queries/portfolio_queries #&_# /home/admin/workarea/git/Velours/python/mtr/database_queries/portfolio_queries.py test portfolio queries Catched exception ! Connect or reconnect ! #&_# TEST SUCCEEDED #&_# : mtr/database_queries/portfolio_queries #&_# #&_# END OF TEST #&_# : mtr/database_queries/portfolio_queries #&_# #&_# BEGIN OF TEST : prod/memo/memo #&_# /home/admin/workarea/git/Velours/python/prod/memo/memo.py SLA Mensuel python version used : 3 ############################### TEST memo ################################ Removing /home/admin/workarea/git/Velours/python/prod/memo/sla_mensuel VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11488 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11496 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11497 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11492 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11492 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11495 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11495 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11489 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11489 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11575 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11575 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11491 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11490 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11490 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11498 send_mail_cod have less outputs used (0) than in the step definition (1) : some outputs may be not used ! Step 11499 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11491 doesn't seem to be define in the database( WARNING : type of input 3 of step 11490 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11488 doesn't seem to be define in the database( WARNING : type of input 2 of step 11492 doesn't seem to be define in the database( WARNING : output 1 of step 11488 have datatype=2 whereas input 1 of step 11495 have datatype=7 WARNING : type of output 2 of step 11495 doesn't seem to be define in the database( WARNING : type of input 1 of step 11489 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11491 have datatype=10 whereas input 3 of step 11498 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11575 doesn't seem to be define in the database( WARNING : output 1 of step 11489 have datatype=7 whereas input 2 of step 11575 have datatype=None WARNING : type of output 3 of step 11575 doesn't seem to be define in the database( WARNING : type of input 1 of step 11491 doesn't seem to be define in the database( WARNING : output 0 of step 11491 have datatype=10 whereas input 0 of step 11581 have datatype=18 WARNING : type of input 5 of step 11498 doesn't seem to be define in the database( WARNING : output 0 of step 11581 have datatype=11 whereas input 5 of step 11498 have datatype=None WARNING : type of output 1 of step 11496 doesn't seem to be define in the database( WARNING : type of input 3 of step 11492 doesn't seem to be define in the database( WARNING : type of output 1 of step 11497 doesn't seem to be define in the database( WARNING : type of input 3 of step 11492 doesn't seem to be define in the database( WARNING : output 0 of step 11495 have datatype=1 whereas input 0 of step 11489 have datatype=2 DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4209, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,metal,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'papier,background', 'hashtag_weights': {'barquette_opaque': 0.7, 'carton': 0.7, 'ela': 0.7, 'etiquette': 0.5, 'film_plastique': 0.5, 'kraft': 0.7, 'metal': 1.5, 'pehd': 0.7, 'pet_clair': 0.7, 'pet_opaque': 0.7, 'textiles_sanitaires': 0.5, 'pet_fonce': 0.7}, 'ETA': 600} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4207, 'hashtag_proportion': 'barquette_opaque,ela,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'carton,background', 'hashtag_weights': {'barquette_opaque': 1, 'ela': 1, 'etiquette': 1.0, 'film_plastique': 0.5, 'kraft': 1, 'metal': 3.0, 'papier': 1, 'pehd': 2, 'pet_clair': 2, 'pet_opaque': 2, 'textiles_sanitaires': 1.0, 'pet_fonce': 2}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3726, 'hashtag_proportion': 'Carton_brun,Carton_gris,Teint_Dans_La_Masse,autre_refus,cartonnette,kraft,metal,plastique', 'hashtag_parmi': 'papier,background', 'hashtag_weights': {'Carton_brun': 1.5, 'Carton_gris': 1.5, 'Teint_Dans_La_Masse': 1.0, 'autre_refus': 1.5, 'cartonnette': 1.0, 'kraft': 1.5, 'metal': 3, 'plastique': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11512 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11521 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11520 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11516 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11516 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11519 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11519 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11513 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11513 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11577 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11577 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11515 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11514 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11514 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11523 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11515 doesn't seem to be define in the database( WARNING : type of input 3 of step 11514 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11512 doesn't seem to be define in the database( WARNING : type of input 2 of step 11516 doesn't seem to be define in the database( WARNING : output 1 of step 11512 have datatype=2 whereas input 1 of step 11519 have datatype=7 WARNING : type of output 2 of step 11519 doesn't seem to be define in the database( WARNING : type of input 1 of step 11513 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11515 have datatype=10 whereas input 3 of step 11522 have datatype=6 WARNING : type of input 2 of step 11577 doesn't seem to be define in the database( WARNING : output 1 of step 11513 have datatype=7 whereas input 2 of step 11577 have datatype=None WARNING : type of output 3 of step 11577 doesn't seem to be define in the database( WARNING : type of input 1 of step 11515 doesn't seem to be define in the database( WARNING : output 0 of step 11515 have datatype=10 whereas input 0 of step 11583 have datatype=18 WARNING : type of input 5 of step 11522 doesn't seem to be define in the database( WARNING : output 0 of step 11583 have datatype=11 whereas input 5 of step 11522 have datatype=None WARNING : type of output 1 of step 11521 doesn't seem to be define in the database( WARNING : type of input 3 of step 11516 doesn't seem to be define in the database( WARNING : type of output 1 of step 11520 doesn't seem to be define in the database( WARNING : type of input 3 of step 11516 doesn't seem to be define in the database( WARNING : output 0 of step 11519 have datatype=1 whereas input 0 of step 11513 have datatype=2 DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4203, 'hashtag_proportion': 'barquette_opaque,carton,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'ela,background', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 1, 'etiquette': 0.5, 'film_plastique': 0.5, 'kraft': 0.8, 'metal': 2, 'papier': 0.8, 'pehd': 0.8, 'pet_clair': 0.8, 'pet_opaque': 0.8, 'textiles_sanitaires': 0.5, 'pet_fonce': 0.8}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11524 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11533 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11532 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11528 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11528 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11531 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11531 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11525 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11525 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11578 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11578 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11527 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11526 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11526 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11535 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11527 doesn't seem to be define in the database( WARNING : type of input 3 of step 11526 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11524 doesn't seem to be define in the database( WARNING : type of input 2 of step 11528 doesn't seem to be define in the database( WARNING : output 1 of step 11524 have datatype=2 whereas input 1 of step 11531 have datatype=7 WARNING : type of output 2 of step 11531 doesn't seem to be define in the database( WARNING : type of input 1 of step 11525 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11527 have datatype=10 whereas input 3 of step 11534 have datatype=6 WARNING : type of input 2 of step 11578 doesn't seem to be define in the database( WARNING : output 1 of step 11525 have datatype=7 whereas input 2 of step 11578 have datatype=None WARNING : type of output 3 of step 11578 doesn't seem to be define in the database( WARNING : type of input 1 of step 11527 doesn't seem to be define in the database( WARNING : output 0 of step 11527 have datatype=10 whereas input 0 of step 11584 have datatype=18 WARNING : type of input 5 of step 11534 doesn't seem to be define in the database( WARNING : output 0 of step 11584 have datatype=11 whereas input 5 of step 11534 have datatype=None WARNING : type of output 1 of step 11533 doesn't seem to be define in the database( WARNING : type of input 3 of step 11528 doesn't seem to be define in the database( WARNING : type of output 1 of step 11532 doesn't seem to be define in the database( WARNING : type of input 3 of step 11528 doesn't seem to be define in the database( WARNING : output 0 of step 11531 have datatype=1 whereas input 0 of step 11525 have datatype=2 DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4211, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,metal,papier,pet_fonce,pet_clair,pet_opaque,textiles_sanitaires', 'hashtag_parmi': 'pehd,background', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 0.3, 'ela': 0.3, 'etiquette': 0.1, 'film_plastique': 0.1, 'kraft': 0.3, 'metal': 1.5, 'papier': 0.3, 'pet_clair': 0.3, 'pet_opaque': 0.3, 'textiles_sanitaires': 0.3, 'pet_fonce': 0.3, 'background': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11548 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11556 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11557 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11552 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11552 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11555 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11555 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11580 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11580 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11551 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11550 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11550 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11559 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11551 doesn't seem to be define in the database( WARNING : type of input 3 of step 11550 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11548 doesn't seem to be define in the database( WARNING : type of input 2 of step 11552 doesn't seem to be define in the database( WARNING : output 1 of step 11548 have datatype=2 whereas input 1 of step 11555 have datatype=7 WARNING : type of output 2 of step 11555 doesn't seem to be define in the database( WARNING : type of input 1 of step 11549 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11551 have datatype=10 whereas input 3 of step 11558 have datatype=6 WARNING : type of input 2 of step 11580 doesn't seem to be define in the database( WARNING : output 1 of step 11549 have datatype=7 whereas input 2 of step 11580 have datatype=None WARNING : type of output 3 of step 11580 doesn't seem to be define in the database( WARNING : type of input 1 of step 11551 doesn't seem to be define in the database( WARNING : output 0 of step 11551 have datatype=10 whereas input 0 of step 11586 have datatype=18 WARNING : type of input 5 of step 11558 doesn't seem to be define in the database( WARNING : output 0 of step 11586 have datatype=11 whereas input 5 of step 11558 have datatype=None WARNING : type of output 1 of step 11556 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : type of output 1 of step 11557 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : output 0 of step 11555 have datatype=1 whereas input 0 of step 11549 have datatype=2 DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4200, 'hashtag_proportion': 'carton,ela,etiquette,film_plastique,kraft,metal,papier,pehd,pet_opaque,textiles_sanitaires,barquette_opaque,pet_clair', 'hashtag_parmi': 'pet_fonce,background', 'hashtag_weights': {'barquette_opaque': 1.5, 'carton': 2.5, 'ela': 1.5, 'etiquette': 1.5, 'film_plastique': 1, 'kraft': 1.5, 'metal': 3.0, 'papier': 1.2, 'pehd': 1.5, 'pet_clair': 1.5, 'pet_opaque': 1.5, 'textiles_sanitaires': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11536 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11545 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11544 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11540 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11540 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11543 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11543 merge_mask_thcl_custom have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 11537 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11579 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11579 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11539 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11538 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11538 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11547 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11539 doesn't seem to be define in the database( WARNING : type of input 3 of step 11538 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11536 doesn't seem to be define in the database( WARNING : type of input 2 of step 11540 doesn't seem to be define in the database( WARNING : output 1 of step 11536 have datatype=2 whereas input 1 of step 11543 have datatype=7 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11539 have datatype=10 whereas input 3 of step 11546 have datatype=6 WARNING : type of input 2 of step 11579 doesn't seem to be define in the database( WARNING : output 1 of step 11537 have datatype=7 whereas input 2 of step 11579 have datatype=None WARNING : type of output 3 of step 11579 doesn't seem to be define in the database( WARNING : type of input 1 of step 11539 doesn't seem to be define in the database( WARNING : output 0 of step 11539 have datatype=10 whereas input 0 of step 11585 have datatype=18 WARNING : type of input 5 of step 11546 doesn't seem to be define in the database( WARNING : output 0 of step 11585 have datatype=11 whereas input 5 of step 11546 have datatype=None WARNING : type of output 1 of step 11545 doesn't seem to be define in the database( WARNING : type of input 3 of step 11540 doesn't seem to be define in the database( WARNING : type of output 1 of step 11544 doesn't seem to be define in the database( WARNING : type of input 3 of step 11540 doesn't seem to be define in the database( WARNING : output 0 of step 11543 have datatype=1 whereas input 0 of step 11537 have datatype=2 DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4205, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'metal,background', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 1.5, 'ela': 1.5, 'etiquette': 1, 'film_plastique': 1, 'kraft': 1, 'papier': 1, 'pehd': 1.5, 'pet_clair': 1.5, 'pet_opaque': 1.5, 'textiles_sanitaires': 1.5, 'pet_fonce': 1.5}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3594, 'hashtag_proportion': 'papier,carton,metal,pet_clair,autre,pehd,pet_fonce', 'hashtag_parmi': 'refus,background', 'hashtag_weights': {'papier': 1, 'carton': 1, 'metal': 1, 'pet_clair': 1, 'autre': 1, 'pehd': 1, 'pet_fonce': 1, 'refus': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11560 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11567 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11567 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11563 crop_condition is not consistent : 4 used against 2 in the step definition ! Step 11563 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11564 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11564 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11573 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11573 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11566 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11566 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 1 of step 11560 have datatype=2 whereas input 1 of step 11564 have datatype=7 WARNING : type of output 2 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11565 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11567 doesn't seem to be define in the database( WARNING : type of input 3 of step 11563 doesn't seem to be define in the database( WARNING : type of output 3 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11568 doesn't seem to be define in the database( WARNING : type of output 1 of step 11568 doesn't seem to be define in the database( WARNING : type of input 3 of step 11566 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11570 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11569 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11570 doesn't seem to be define in the database( WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11569 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11568 have datatype=10 whereas input 3 of step 11571 have datatype=6 WARNING : type of input 2 of step 11573 doesn't seem to be define in the database( WARNING : output 1 of step 11565 have datatype=7 whereas input 2 of step 11573 have datatype=None WARNING : type of output 3 of step 11573 doesn't seem to be define in the database( WARNING : type of input 3 of step 11568 doesn't seem to be define in the database( WARNING : output 0 of step 11568 have datatype=10 whereas input 0 of step 11587 have datatype=18 WARNING : type of input 5 of step 11571 doesn't seem to be define in the database( WARNING : output 0 of step 11587 have datatype=11 whereas input 5 of step 11571 have datatype=None WARNING : output 0 of step 11564 have datatype=1 whereas input 0 of step 11565 have datatype=2 DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3327, 'hashtag_proportion': 'autre,carton,metal,papier,pehd,pet_fonce', 'hashtag_parmi': 'pet_clair,bouchon,etiquette,barquette_avec_film,background', 'hashtag_weights': {'autre': 8.0, 'barquette_avec_film': 6, 'carton': 8.0, 'metal': 12, 'papier': 5, 'pehd': 8, 'pet_fonce': 8, 'bouchon': 8, 'etiquette': 8}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier TODO : Insert select and so on # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11488 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11496 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11497 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11492 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11492 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11495 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11495 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11489 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11489 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11575 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11575 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11491 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11490 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11490 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11498 send_mail_cod have less outputs used (0) than in the step definition (1) : some outputs may be not used ! Step 11499 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11491 doesn't seem to be define in the database( WARNING : type of input 3 of step 11490 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11488 doesn't seem to be define in the database( WARNING : type of input 2 of step 11492 doesn't seem to be define in the database( WARNING : output 1 of step 11488 have datatype=2 whereas input 1 of step 11495 have datatype=7 WARNING : type of output 2 of step 11495 doesn't seem to be define in the database( WARNING : type of input 1 of step 11489 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11491 have datatype=10 whereas input 3 of step 11498 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11575 doesn't seem to be define in the database( WARNING : output 1 of step 11489 have datatype=7 whereas input 2 of step 11575 have datatype=None WARNING : type of output 3 of step 11575 doesn't seem to be define in the database( WARNING : type of input 1 of step 11491 doesn't seem to be define in the database( WARNING : output 0 of step 11491 have datatype=10 whereas input 0 of step 11581 have datatype=18 WARNING : type of input 5 of step 11498 doesn't seem to be define in the database( WARNING : output 0 of step 11581 have datatype=11 whereas input 5 of step 11498 have datatype=None WARNING : type of output 1 of step 11496 doesn't seem to be define in the database( WARNING : type of input 3 of step 11492 doesn't seem to be define in the database( WARNING : type of output 1 of step 11497 doesn't seem to be define in the database( WARNING : type of input 3 of step 11492 doesn't seem to be define in the database( WARNING : output 0 of step 11495 have datatype=1 whereas input 0 of step 11489 have datatype=2 DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4209, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,metal,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'papier,background', 'hashtag_weights': {'barquette_opaque': 0.7, 'carton': 0.7, 'ela': 0.7, 'etiquette': 0.5, 'film_plastique': 0.5, 'kraft': 0.7, 'metal': 1.5, 'pehd': 0.7, 'pet_clair': 0.7, 'pet_opaque': 0.7, 'textiles_sanitaires': 0.5, 'pet_fonce': 0.7}, 'ETA': 600} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4207, 'hashtag_proportion': 'barquette_opaque,ela,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'carton,background', 'hashtag_weights': {'barquette_opaque': 1, 'ela': 1, 'etiquette': 1.0, 'film_plastique': 0.5, 'kraft': 1, 'metal': 3.0, 'papier': 1, 'pehd': 2, 'pet_clair': 2, 'pet_opaque': 2, 'textiles_sanitaires': 1.0, 'pet_fonce': 2}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3726, 'hashtag_proportion': 'Carton_brun,Carton_gris,Teint_Dans_La_Masse,autre_refus,cartonnette,kraft,metal,plastique', 'hashtag_parmi': 'papier,background', 'hashtag_weights': {'Carton_brun': 1.5, 'Carton_gris': 1.5, 'Teint_Dans_La_Masse': 1.0, 'autre_refus': 1.5, 'cartonnette': 1.0, 'kraft': 1.5, 'metal': 3, 'plastique': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11512 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11521 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11520 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11516 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11516 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11519 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11519 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11513 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11513 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11577 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11577 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11515 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11514 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11514 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11523 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11515 doesn't seem to be define in the database( WARNING : type of input 3 of step 11514 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11512 doesn't seem to be define in the database( WARNING : type of input 2 of step 11516 doesn't seem to be define in the database( WARNING : output 1 of step 11512 have datatype=2 whereas input 1 of step 11519 have datatype=7 WARNING : type of output 2 of step 11519 doesn't seem to be define in the database( WARNING : type of input 1 of step 11513 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11515 have datatype=10 whereas input 3 of step 11522 have datatype=6 WARNING : type of input 2 of step 11577 doesn't seem to be define in the database( WARNING : output 1 of step 11513 have datatype=7 whereas input 2 of step 11577 have datatype=None WARNING : type of output 3 of step 11577 doesn't seem to be define in the database( WARNING : type of input 1 of step 11515 doesn't seem to be define in the database( WARNING : output 0 of step 11515 have datatype=10 whereas input 0 of step 11583 have datatype=18 WARNING : type of input 5 of step 11522 doesn't seem to be define in the database( WARNING : output 0 of step 11583 have datatype=11 whereas input 5 of step 11522 have datatype=None WARNING : type of output 1 of step 11521 doesn't seem to be define in the database( WARNING : type of input 3 of step 11516 doesn't seem to be define in the database( WARNING : type of output 1 of step 11520 doesn't seem to be define in the database( WARNING : type of input 3 of step 11516 doesn't seem to be define in the database( WARNING : output 0 of step 11519 have datatype=1 whereas input 0 of step 11513 have datatype=2 DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4203, 'hashtag_proportion': 'barquette_opaque,carton,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'ela,background', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 1, 'etiquette': 0.5, 'film_plastique': 0.5, 'kraft': 0.8, 'metal': 2, 'papier': 0.8, 'pehd': 0.8, 'pet_clair': 0.8, 'pet_opaque': 0.8, 'textiles_sanitaires': 0.5, 'pet_fonce': 0.8}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11524 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11533 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11532 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11528 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11528 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11531 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11531 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11525 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11525 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11578 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11578 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11527 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11526 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11526 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11535 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11527 doesn't seem to be define in the database( WARNING : type of input 3 of step 11526 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11524 doesn't seem to be define in the database( WARNING : type of input 2 of step 11528 doesn't seem to be define in the database( WARNING : output 1 of step 11524 have datatype=2 whereas input 1 of step 11531 have datatype=7 WARNING : type of output 2 of step 11531 doesn't seem to be define in the database( WARNING : type of input 1 of step 11525 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11527 have datatype=10 whereas input 3 of step 11534 have datatype=6 WARNING : type of input 2 of step 11578 doesn't seem to be define in the database( WARNING : output 1 of step 11525 have datatype=7 whereas input 2 of step 11578 have datatype=None WARNING : type of output 3 of step 11578 doesn't seem to be define in the database( WARNING : type of input 1 of step 11527 doesn't seem to be define in the database( WARNING : output 0 of step 11527 have datatype=10 whereas input 0 of step 11584 have datatype=18 WARNING : type of input 5 of step 11534 doesn't seem to be define in the database( WARNING : output 0 of step 11584 have datatype=11 whereas input 5 of step 11534 have datatype=None WARNING : type of output 1 of step 11533 doesn't seem to be define in the database( WARNING : type of input 3 of step 11528 doesn't seem to be define in the database( WARNING : type of output 1 of step 11532 doesn't seem to be define in the database( WARNING : type of input 3 of step 11528 doesn't seem to be define in the database( WARNING : output 0 of step 11531 have datatype=1 whereas input 0 of step 11525 have datatype=2 DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4211, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,metal,papier,pet_fonce,pet_clair,pet_opaque,textiles_sanitaires', 'hashtag_parmi': 'pehd,background', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 0.3, 'ela': 0.3, 'etiquette': 0.1, 'film_plastique': 0.1, 'kraft': 0.3, 'metal': 1.5, 'papier': 0.3, 'pet_clair': 0.3, 'pet_opaque': 0.3, 'textiles_sanitaires': 0.3, 'pet_fonce': 0.3, 'background': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11548 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11556 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11557 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11552 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11552 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11555 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11555 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11580 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11580 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11551 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11550 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11550 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11559 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11551 doesn't seem to be define in the database( WARNING : type of input 3 of step 11550 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11548 doesn't seem to be define in the database( WARNING : type of input 2 of step 11552 doesn't seem to be define in the database( WARNING : output 1 of step 11548 have datatype=2 whereas input 1 of step 11555 have datatype=7 WARNING : type of output 2 of step 11555 doesn't seem to be define in the database( WARNING : type of input 1 of step 11549 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11551 have datatype=10 whereas input 3 of step 11558 have datatype=6 WARNING : type of input 2 of step 11580 doesn't seem to be define in the database( WARNING : output 1 of step 11549 have datatype=7 whereas input 2 of step 11580 have datatype=None WARNING : type of output 3 of step 11580 doesn't seem to be define in the database( WARNING : type of input 1 of step 11551 doesn't seem to be define in the database( WARNING : output 0 of step 11551 have datatype=10 whereas input 0 of step 11586 have datatype=18 WARNING : type of input 5 of step 11558 doesn't seem to be define in the database( WARNING : output 0 of step 11586 have datatype=11 whereas input 5 of step 11558 have datatype=None WARNING : type of output 1 of step 11556 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : type of output 1 of step 11557 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : output 0 of step 11555 have datatype=1 whereas input 0 of step 11549 have datatype=2 DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4200, 'hashtag_proportion': 'carton,ela,etiquette,film_plastique,kraft,metal,papier,pehd,pet_opaque,textiles_sanitaires,barquette_opaque,pet_clair', 'hashtag_parmi': 'pet_fonce,background', 'hashtag_weights': {'barquette_opaque': 1.5, 'carton': 2.5, 'ela': 1.5, 'etiquette': 1.5, 'film_plastique': 1, 'kraft': 1.5, 'metal': 3.0, 'papier': 1.2, 'pehd': 1.5, 'pet_clair': 1.5, 'pet_opaque': 1.5, 'textiles_sanitaires': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11536 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11545 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11544 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11540 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11540 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11543 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11543 merge_mask_thcl_custom have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 11537 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11579 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11579 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11539 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11538 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11538 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11547 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11539 doesn't seem to be define in the database( WARNING : type of input 3 of step 11538 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11536 doesn't seem to be define in the database( WARNING : type of input 2 of step 11540 doesn't seem to be define in the database( WARNING : output 1 of step 11536 have datatype=2 whereas input 1 of step 11543 have datatype=7 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11539 have datatype=10 whereas input 3 of step 11546 have datatype=6 WARNING : type of input 2 of step 11579 doesn't seem to be define in the database( WARNING : output 1 of step 11537 have datatype=7 whereas input 2 of step 11579 have datatype=None WARNING : type of output 3 of step 11579 doesn't seem to be define in the database( WARNING : type of input 1 of step 11539 doesn't seem to be define in the database( WARNING : output 0 of step 11539 have datatype=10 whereas input 0 of step 11585 have datatype=18 WARNING : type of input 5 of step 11546 doesn't seem to be define in the database( WARNING : output 0 of step 11585 have datatype=11 whereas input 5 of step 11546 have datatype=None WARNING : type of output 1 of step 11545 doesn't seem to be define in the database( WARNING : type of input 3 of step 11540 doesn't seem to be define in the database( WARNING : type of output 1 of step 11544 doesn't seem to be define in the database( WARNING : type of input 3 of step 11540 doesn't seem to be define in the database( WARNING : output 0 of step 11543 have datatype=1 whereas input 0 of step 11537 have datatype=2 DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4205, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'metal,background', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 1.5, 'ela': 1.5, 'etiquette': 1, 'film_plastique': 1, 'kraft': 1, 'papier': 1, 'pehd': 1.5, 'pet_clair': 1.5, 'pet_opaque': 1.5, 'textiles_sanitaires': 1.5, 'pet_fonce': 1.5}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3594, 'hashtag_proportion': 'papier,carton,metal,pet_clair,autre,pehd,pet_fonce', 'hashtag_parmi': 'refus,background', 'hashtag_weights': {'papier': 1, 'carton': 1, 'metal': 1, 'pet_clair': 1, 'autre': 1, 'pehd': 1, 'pet_fonce': 1, 'refus': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11560 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11567 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11567 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11563 crop_condition is not consistent : 4 used against 2 in the step definition ! Step 11563 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11564 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11564 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11573 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11573 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11566 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11566 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 1 of step 11560 have datatype=2 whereas input 1 of step 11564 have datatype=7 WARNING : type of output 2 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11565 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11567 doesn't seem to be define in the database( WARNING : type of input 3 of step 11563 doesn't seem to be define in the database( WARNING : type of output 3 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11568 doesn't seem to be define in the database( WARNING : type of output 1 of step 11568 doesn't seem to be define in the database( WARNING : type of input 3 of step 11566 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11570 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11569 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11570 doesn't seem to be define in the database( WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11569 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11568 have datatype=10 whereas input 3 of step 11571 have datatype=6 WARNING : type of input 2 of step 11573 doesn't seem to be define in the database( WARNING : output 1 of step 11565 have datatype=7 whereas input 2 of step 11573 have datatype=None WARNING : type of output 3 of step 11573 doesn't seem to be define in the database( WARNING : type of input 3 of step 11568 doesn't seem to be define in the database( WARNING : output 0 of step 11568 have datatype=10 whereas input 0 of step 11587 have datatype=18 WARNING : type of input 5 of step 11571 doesn't seem to be define in the database( WARNING : output 0 of step 11587 have datatype=11 whereas input 5 of step 11571 have datatype=None WARNING : output 0 of step 11564 have datatype=1 whereas input 0 of step 11565 have datatype=2 DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3327, 'hashtag_proportion': 'autre,carton,metal,papier,pehd,pet_fonce', 'hashtag_parmi': 'pet_clair,bouchon,etiquette,barquette_avec_film,background', 'hashtag_weights': {'autre': 8.0, 'barquette_avec_film': 6, 'carton': 8.0, 'metal': 12, 'papier': 5, 'pehd': 8, 'pet_fonce': 8, 'bouchon': 8, 'etiquette': 8}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier nb_day : (0, 31) VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11488 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11496 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11497 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11492 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11492 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11495 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11495 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11489 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11489 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11575 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11575 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11491 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11490 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11490 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11498 send_mail_cod have less outputs used (0) than in the step definition (1) : some outputs may be not used ! Step 11499 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11491 doesn't seem to be define in the database( WARNING : type of input 3 of step 11490 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11488 doesn't seem to be define in the database( WARNING : type of input 2 of step 11492 doesn't seem to be define in the database( WARNING : output 1 of step 11488 have datatype=2 whereas input 1 of step 11495 have datatype=7 WARNING : type of output 2 of step 11495 doesn't seem to be define in the database( WARNING : type of input 1 of step 11489 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11491 have datatype=10 whereas input 3 of step 11498 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11575 doesn't seem to be define in the database( WARNING : output 1 of step 11489 have datatype=7 whereas input 2 of step 11575 have datatype=None WARNING : type of output 3 of step 11575 doesn't seem to be define in the database( WARNING : type of input 1 of step 11491 doesn't seem to be define in the database( WARNING : output 0 of step 11491 have datatype=10 whereas input 0 of step 11581 have datatype=18 WARNING : type of input 5 of step 11498 doesn't seem to be define in the database( WARNING : output 0 of step 11581 have datatype=11 whereas input 5 of step 11498 have datatype=None WARNING : type of output 1 of step 11496 doesn't seem to be define in the database( WARNING : type of input 3 of step 11492 doesn't seem to be define in the database( WARNING : type of output 1 of step 11497 doesn't seem to be define in the database( WARNING : type of input 3 of step 11492 doesn't seem to be define in the database( WARNING : output 0 of step 11495 have datatype=1 whereas input 0 of step 11489 have datatype=2 DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4209, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,metal,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'papier,background', 'hashtag_weights': {'barquette_opaque': 0.7, 'carton': 0.7, 'ela': 0.7, 'etiquette': 0.5, 'film_plastique': 0.5, 'kraft': 0.7, 'metal': 1.5, 'pehd': 0.7, 'pet_clair': 0.7, 'pet_opaque': 0.7, 'textiles_sanitaires': 0.5, 'pet_fonce': 0.7}, 'ETA': 600} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4207, 'hashtag_proportion': 'barquette_opaque,ela,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'carton,background', 'hashtag_weights': {'barquette_opaque': 1, 'ela': 1, 'etiquette': 1.0, 'film_plastique': 0.5, 'kraft': 1, 'metal': 3.0, 'papier': 1, 'pehd': 2, 'pet_clair': 2, 'pet_opaque': 2, 'textiles_sanitaires': 1.0, 'pet_fonce': 2}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3726, 'hashtag_proportion': 'Carton_brun,Carton_gris,Teint_Dans_La_Masse,autre_refus,cartonnette,kraft,metal,plastique', 'hashtag_parmi': 'papier,background', 'hashtag_weights': {'Carton_brun': 1.5, 'Carton_gris': 1.5, 'Teint_Dans_La_Masse': 1.0, 'autre_refus': 1.5, 'cartonnette': 1.0, 'kraft': 1.5, 'metal': 3, 'plastique': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11512 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11521 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11520 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11516 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11516 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11519 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11519 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11513 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11513 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11577 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11577 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11515 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11514 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11514 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11523 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11515 doesn't seem to be define in the database( WARNING : type of input 3 of step 11514 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11512 doesn't seem to be define in the database( WARNING : type of input 2 of step 11516 doesn't seem to be define in the database( WARNING : output 1 of step 11512 have datatype=2 whereas input 1 of step 11519 have datatype=7 WARNING : type of output 2 of step 11519 doesn't seem to be define in the database( WARNING : type of input 1 of step 11513 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11515 have datatype=10 whereas input 3 of step 11522 have datatype=6 WARNING : type of input 2 of step 11577 doesn't seem to be define in the database( WARNING : output 1 of step 11513 have datatype=7 whereas input 2 of step 11577 have datatype=None WARNING : type of output 3 of step 11577 doesn't seem to be define in the database( WARNING : type of input 1 of step 11515 doesn't seem to be define in the database( WARNING : output 0 of step 11515 have datatype=10 whereas input 0 of step 11583 have datatype=18 WARNING : type of input 5 of step 11522 doesn't seem to be define in the database( WARNING : output 0 of step 11583 have datatype=11 whereas input 5 of step 11522 have datatype=None WARNING : type of output 1 of step 11521 doesn't seem to be define in the database( WARNING : type of input 3 of step 11516 doesn't seem to be define in the database( WARNING : type of output 1 of step 11520 doesn't seem to be define in the database( WARNING : type of input 3 of step 11516 doesn't seem to be define in the database( WARNING : output 0 of step 11519 have datatype=1 whereas input 0 of step 11513 have datatype=2 DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4203, 'hashtag_proportion': 'barquette_opaque,carton,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'ela,background', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 1, 'etiquette': 0.5, 'film_plastique': 0.5, 'kraft': 0.8, 'metal': 2, 'papier': 0.8, 'pehd': 0.8, 'pet_clair': 0.8, 'pet_opaque': 0.8, 'textiles_sanitaires': 0.5, 'pet_fonce': 0.8}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11524 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11533 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11532 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11528 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11528 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11531 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11531 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11525 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11525 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11578 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11578 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11527 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11526 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11526 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11535 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11527 doesn't seem to be define in the database( WARNING : type of input 3 of step 11526 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11524 doesn't seem to be define in the database( WARNING : type of input 2 of step 11528 doesn't seem to be define in the database( WARNING : output 1 of step 11524 have datatype=2 whereas input 1 of step 11531 have datatype=7 WARNING : type of output 2 of step 11531 doesn't seem to be define in the database( WARNING : type of input 1 of step 11525 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11527 have datatype=10 whereas input 3 of step 11534 have datatype=6 WARNING : type of input 2 of step 11578 doesn't seem to be define in the database( WARNING : output 1 of step 11525 have datatype=7 whereas input 2 of step 11578 have datatype=None WARNING : type of output 3 of step 11578 doesn't seem to be define in the database( WARNING : type of input 1 of step 11527 doesn't seem to be define in the database( WARNING : output 0 of step 11527 have datatype=10 whereas input 0 of step 11584 have datatype=18 WARNING : type of input 5 of step 11534 doesn't seem to be define in the database( WARNING : output 0 of step 11584 have datatype=11 whereas input 5 of step 11534 have datatype=None WARNING : type of output 1 of step 11533 doesn't seem to be define in the database( WARNING : type of input 3 of step 11528 doesn't seem to be define in the database( WARNING : type of output 1 of step 11532 doesn't seem to be define in the database( WARNING : type of input 3 of step 11528 doesn't seem to be define in the database( WARNING : output 0 of step 11531 have datatype=1 whereas input 0 of step 11525 have datatype=2 DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4211, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,metal,papier,pet_fonce,pet_clair,pet_opaque,textiles_sanitaires', 'hashtag_parmi': 'pehd,background', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 0.3, 'ela': 0.3, 'etiquette': 0.1, 'film_plastique': 0.1, 'kraft': 0.3, 'metal': 1.5, 'papier': 0.3, 'pet_clair': 0.3, 'pet_opaque': 0.3, 'textiles_sanitaires': 0.3, 'pet_fonce': 0.3, 'background': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11548 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11556 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11557 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11552 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11552 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11555 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11555 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11580 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11580 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11551 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11550 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11550 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11559 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11551 doesn't seem to be define in the database( WARNING : type of input 3 of step 11550 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11548 doesn't seem to be define in the database( WARNING : type of input 2 of step 11552 doesn't seem to be define in the database( WARNING : output 1 of step 11548 have datatype=2 whereas input 1 of step 11555 have datatype=7 WARNING : type of output 2 of step 11555 doesn't seem to be define in the database( WARNING : type of input 1 of step 11549 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11551 have datatype=10 whereas input 3 of step 11558 have datatype=6 WARNING : type of input 2 of step 11580 doesn't seem to be define in the database( WARNING : output 1 of step 11549 have datatype=7 whereas input 2 of step 11580 have datatype=None WARNING : type of output 3 of step 11580 doesn't seem to be define in the database( WARNING : type of input 1 of step 11551 doesn't seem to be define in the database( WARNING : output 0 of step 11551 have datatype=10 whereas input 0 of step 11586 have datatype=18 WARNING : type of input 5 of step 11558 doesn't seem to be define in the database( WARNING : output 0 of step 11586 have datatype=11 whereas input 5 of step 11558 have datatype=None WARNING : type of output 1 of step 11556 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : type of output 1 of step 11557 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : output 0 of step 11555 have datatype=1 whereas input 0 of step 11549 have datatype=2 DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4200, 'hashtag_proportion': 'carton,ela,etiquette,film_plastique,kraft,metal,papier,pehd,pet_opaque,textiles_sanitaires,barquette_opaque,pet_clair', 'hashtag_parmi': 'pet_fonce,background', 'hashtag_weights': {'barquette_opaque': 1.5, 'carton': 2.5, 'ela': 1.5, 'etiquette': 1.5, 'film_plastique': 1, 'kraft': 1.5, 'metal': 3.0, 'papier': 1.2, 'pehd': 1.5, 'pet_clair': 1.5, 'pet_opaque': 1.5, 'textiles_sanitaires': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11536 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11545 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11544 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11540 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11540 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11543 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11543 merge_mask_thcl_custom have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 11537 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11579 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11579 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11539 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11538 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11538 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11547 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11539 doesn't seem to be define in the database( WARNING : type of input 3 of step 11538 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11536 doesn't seem to be define in the database( WARNING : type of input 2 of step 11540 doesn't seem to be define in the database( WARNING : output 1 of step 11536 have datatype=2 whereas input 1 of step 11543 have datatype=7 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11539 have datatype=10 whereas input 3 of step 11546 have datatype=6 WARNING : type of input 2 of step 11579 doesn't seem to be define in the database( WARNING : output 1 of step 11537 have datatype=7 whereas input 2 of step 11579 have datatype=None WARNING : type of output 3 of step 11579 doesn't seem to be define in the database( WARNING : type of input 1 of step 11539 doesn't seem to be define in the database( WARNING : output 0 of step 11539 have datatype=10 whereas input 0 of step 11585 have datatype=18 WARNING : type of input 5 of step 11546 doesn't seem to be define in the database( WARNING : output 0 of step 11585 have datatype=11 whereas input 5 of step 11546 have datatype=None WARNING : type of output 1 of step 11545 doesn't seem to be define in the database( WARNING : type of input 3 of step 11540 doesn't seem to be define in the database( WARNING : type of output 1 of step 11544 doesn't seem to be define in the database( WARNING : type of input 3 of step 11540 doesn't seem to be define in the database( WARNING : output 0 of step 11543 have datatype=1 whereas input 0 of step 11537 have datatype=2 DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4205, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'metal,background', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 1.5, 'ela': 1.5, 'etiquette': 1, 'film_plastique': 1, 'kraft': 1, 'papier': 1, 'pehd': 1.5, 'pet_clair': 1.5, 'pet_opaque': 1.5, 'textiles_sanitaires': 1.5, 'pet_fonce': 1.5}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3594, 'hashtag_proportion': 'papier,carton,metal,pet_clair,autre,pehd,pet_fonce', 'hashtag_parmi': 'refus,background', 'hashtag_weights': {'papier': 1, 'carton': 1, 'metal': 1, 'pet_clair': 1, 'autre': 1, 'pehd': 1, 'pet_fonce': 1, 'refus': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11560 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11567 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11567 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11563 crop_condition is not consistent : 4 used against 2 in the step definition ! Step 11563 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11564 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11564 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11573 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11573 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11566 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11566 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 1 of step 11560 have datatype=2 whereas input 1 of step 11564 have datatype=7 WARNING : type of output 2 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11565 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11567 doesn't seem to be define in the database( WARNING : type of input 3 of step 11563 doesn't seem to be define in the database( WARNING : type of output 3 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11568 doesn't seem to be define in the database( WARNING : type of output 1 of step 11568 doesn't seem to be define in the database( WARNING : type of input 3 of step 11566 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11570 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11569 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11570 doesn't seem to be define in the database( WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11569 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11568 have datatype=10 whereas input 3 of step 11571 have datatype=6 WARNING : type of input 2 of step 11573 doesn't seem to be define in the database( WARNING : output 1 of step 11565 have datatype=7 whereas input 2 of step 11573 have datatype=None WARNING : type of output 3 of step 11573 doesn't seem to be define in the database( WARNING : type of input 3 of step 11568 doesn't seem to be define in the database( WARNING : output 0 of step 11568 have datatype=10 whereas input 0 of step 11587 have datatype=18 WARNING : type of input 5 of step 11571 doesn't seem to be define in the database( WARNING : output 0 of step 11587 have datatype=11 whereas input 5 of step 11571 have datatype=None WARNING : output 0 of step 11564 have datatype=1 whereas input 0 of step 11565 have datatype=2 DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3327, 'hashtag_proportion': 'autre,carton,metal,papier,pehd,pet_fonce', 'hashtag_parmi': 'pet_clair,bouchon,etiquette,barquette_avec_film,background', 'hashtag_weights': {'autre': 8.0, 'barquette_avec_film': 6, 'carton': 8.0, 'metal': 12, 'papier': 5, 'pehd': 8, 'pet_fonce': 8, 'bouchon': 8, 'etiquette': 8}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier TODO : Insert select and so on # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11488 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11496 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11497 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11492 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11492 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11495 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11495 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11489 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11489 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11575 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11575 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11491 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11490 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11490 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11498 send_mail_cod have less outputs used (0) than in the step definition (1) : some outputs may be not used ! Step 11499 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11491 doesn't seem to be define in the database( WARNING : type of input 3 of step 11490 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11488 doesn't seem to be define in the database( WARNING : type of input 2 of step 11492 doesn't seem to be define in the database( WARNING : output 1 of step 11488 have datatype=2 whereas input 1 of step 11495 have datatype=7 WARNING : type of output 2 of step 11495 doesn't seem to be define in the database( WARNING : type of input 1 of step 11489 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11491 have datatype=10 whereas input 3 of step 11498 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11575 doesn't seem to be define in the database( WARNING : output 1 of step 11489 have datatype=7 whereas input 2 of step 11575 have datatype=None WARNING : type of output 3 of step 11575 doesn't seem to be define in the database( WARNING : type of input 1 of step 11491 doesn't seem to be define in the database( WARNING : output 0 of step 11491 have datatype=10 whereas input 0 of step 11581 have datatype=18 WARNING : type of input 5 of step 11498 doesn't seem to be define in the database( WARNING : output 0 of step 11581 have datatype=11 whereas input 5 of step 11498 have datatype=None WARNING : type of output 1 of step 11496 doesn't seem to be define in the database( WARNING : type of input 3 of step 11492 doesn't seem to be define in the database( WARNING : type of output 1 of step 11497 doesn't seem to be define in the database( WARNING : type of input 3 of step 11492 doesn't seem to be define in the database( WARNING : output 0 of step 11495 have datatype=1 whereas input 0 of step 11489 have datatype=2 DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4209, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,metal,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'papier,background', 'hashtag_weights': {'barquette_opaque': 0.7, 'carton': 0.7, 'ela': 0.7, 'etiquette': 0.5, 'film_plastique': 0.5, 'kraft': 0.7, 'metal': 1.5, 'pehd': 0.7, 'pet_clair': 0.7, 'pet_opaque': 0.7, 'textiles_sanitaires': 0.5, 'pet_fonce': 0.7}, 'ETA': 600} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4207, 'hashtag_proportion': 'barquette_opaque,ela,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'carton,background', 'hashtag_weights': {'barquette_opaque': 1, 'ela': 1, 'etiquette': 1.0, 'film_plastique': 0.5, 'kraft': 1, 'metal': 3.0, 'papier': 1, 'pehd': 2, 'pet_clair': 2, 'pet_opaque': 2, 'textiles_sanitaires': 1.0, 'pet_fonce': 2}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3726, 'hashtag_proportion': 'Carton_brun,Carton_gris,Teint_Dans_La_Masse,autre_refus,cartonnette,kraft,metal,plastique', 'hashtag_parmi': 'papier,background', 'hashtag_weights': {'Carton_brun': 1.5, 'Carton_gris': 1.5, 'Teint_Dans_La_Masse': 1.0, 'autre_refus': 1.5, 'cartonnette': 1.0, 'kraft': 1.5, 'metal': 3, 'plastique': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11512 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11521 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11520 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11516 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11516 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11519 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11519 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11513 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11513 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11577 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11577 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11515 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11514 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11514 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11523 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11515 doesn't seem to be define in the database( WARNING : type of input 3 of step 11514 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11512 doesn't seem to be define in the database( WARNING : type of input 2 of step 11516 doesn't seem to be define in the database( WARNING : output 1 of step 11512 have datatype=2 whereas input 1 of step 11519 have datatype=7 WARNING : type of output 2 of step 11519 doesn't seem to be define in the database( WARNING : type of input 1 of step 11513 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11515 have datatype=10 whereas input 3 of step 11522 have datatype=6 WARNING : type of input 2 of step 11577 doesn't seem to be define in the database( WARNING : output 1 of step 11513 have datatype=7 whereas input 2 of step 11577 have datatype=None WARNING : type of output 3 of step 11577 doesn't seem to be define in the database( WARNING : type of input 1 of step 11515 doesn't seem to be define in the database( WARNING : output 0 of step 11515 have datatype=10 whereas input 0 of step 11583 have datatype=18 WARNING : type of input 5 of step 11522 doesn't seem to be define in the database( WARNING : output 0 of step 11583 have datatype=11 whereas input 5 of step 11522 have datatype=None WARNING : type of output 1 of step 11521 doesn't seem to be define in the database( WARNING : type of input 3 of step 11516 doesn't seem to be define in the database( WARNING : type of output 1 of step 11520 doesn't seem to be define in the database( WARNING : type of input 3 of step 11516 doesn't seem to be define in the database( WARNING : output 0 of step 11519 have datatype=1 whereas input 0 of step 11513 have datatype=2 DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4203, 'hashtag_proportion': 'barquette_opaque,carton,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'ela,background', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 1, 'etiquette': 0.5, 'film_plastique': 0.5, 'kraft': 0.8, 'metal': 2, 'papier': 0.8, 'pehd': 0.8, 'pet_clair': 0.8, 'pet_opaque': 0.8, 'textiles_sanitaires': 0.5, 'pet_fonce': 0.8}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11524 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11533 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11532 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11528 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11528 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11531 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11531 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11525 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11525 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11578 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11578 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11527 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11526 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11526 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11535 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11527 doesn't seem to be define in the database( WARNING : type of input 3 of step 11526 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11524 doesn't seem to be define in the database( WARNING : type of input 2 of step 11528 doesn't seem to be define in the database( WARNING : output 1 of step 11524 have datatype=2 whereas input 1 of step 11531 have datatype=7 WARNING : type of output 2 of step 11531 doesn't seem to be define in the database( WARNING : type of input 1 of step 11525 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11527 have datatype=10 whereas input 3 of step 11534 have datatype=6 WARNING : type of input 2 of step 11578 doesn't seem to be define in the database( WARNING : output 1 of step 11525 have datatype=7 whereas input 2 of step 11578 have datatype=None WARNING : type of output 3 of step 11578 doesn't seem to be define in the database( WARNING : type of input 1 of step 11527 doesn't seem to be define in the database( WARNING : output 0 of step 11527 have datatype=10 whereas input 0 of step 11584 have datatype=18 WARNING : type of input 5 of step 11534 doesn't seem to be define in the database( WARNING : output 0 of step 11584 have datatype=11 whereas input 5 of step 11534 have datatype=None WARNING : type of output 1 of step 11533 doesn't seem to be define in the database( WARNING : type of input 3 of step 11528 doesn't seem to be define in the database( WARNING : type of output 1 of step 11532 doesn't seem to be define in the database( WARNING : type of input 3 of step 11528 doesn't seem to be define in the database( WARNING : output 0 of step 11531 have datatype=1 whereas input 0 of step 11525 have datatype=2 DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4211, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,metal,papier,pet_fonce,pet_clair,pet_opaque,textiles_sanitaires', 'hashtag_parmi': 'pehd,background', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 0.3, 'ela': 0.3, 'etiquette': 0.1, 'film_plastique': 0.1, 'kraft': 0.3, 'metal': 1.5, 'papier': 0.3, 'pet_clair': 0.3, 'pet_opaque': 0.3, 'textiles_sanitaires': 0.3, 'pet_fonce': 0.3, 'background': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11548 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11556 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11557 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11552 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11552 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11555 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11555 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11580 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11580 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11551 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11550 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11550 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11559 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11551 doesn't seem to be define in the database( WARNING : type of input 3 of step 11550 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11548 doesn't seem to be define in the database( WARNING : type of input 2 of step 11552 doesn't seem to be define in the database( WARNING : output 1 of step 11548 have datatype=2 whereas input 1 of step 11555 have datatype=7 WARNING : type of output 2 of step 11555 doesn't seem to be define in the database( WARNING : type of input 1 of step 11549 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11551 have datatype=10 whereas input 3 of step 11558 have datatype=6 WARNING : type of input 2 of step 11580 doesn't seem to be define in the database( WARNING : output 1 of step 11549 have datatype=7 whereas input 2 of step 11580 have datatype=None WARNING : type of output 3 of step 11580 doesn't seem to be define in the database( WARNING : type of input 1 of step 11551 doesn't seem to be define in the database( WARNING : output 0 of step 11551 have datatype=10 whereas input 0 of step 11586 have datatype=18 WARNING : type of input 5 of step 11558 doesn't seem to be define in the database( WARNING : output 0 of step 11586 have datatype=11 whereas input 5 of step 11558 have datatype=None WARNING : type of output 1 of step 11556 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : type of output 1 of step 11557 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : output 0 of step 11555 have datatype=1 whereas input 0 of step 11549 have datatype=2 DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4200, 'hashtag_proportion': 'carton,ela,etiquette,film_plastique,kraft,metal,papier,pehd,pet_opaque,textiles_sanitaires,barquette_opaque,pet_clair', 'hashtag_parmi': 'pet_fonce,background', 'hashtag_weights': {'barquette_opaque': 1.5, 'carton': 2.5, 'ela': 1.5, 'etiquette': 1.5, 'film_plastique': 1, 'kraft': 1.5, 'metal': 3.0, 'papier': 1.2, 'pehd': 1.5, 'pet_clair': 1.5, 'pet_opaque': 1.5, 'textiles_sanitaires': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11536 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11545 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11544 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11540 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11540 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11543 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11543 merge_mask_thcl_custom have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 11537 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11579 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11579 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11539 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11538 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11538 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11547 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11539 doesn't seem to be define in the database( WARNING : type of input 3 of step 11538 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11536 doesn't seem to be define in the database( WARNING : type of input 2 of step 11540 doesn't seem to be define in the database( WARNING : output 1 of step 11536 have datatype=2 whereas input 1 of step 11543 have datatype=7 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11539 have datatype=10 whereas input 3 of step 11546 have datatype=6 WARNING : type of input 2 of step 11579 doesn't seem to be define in the database( WARNING : output 1 of step 11537 have datatype=7 whereas input 2 of step 11579 have datatype=None WARNING : type of output 3 of step 11579 doesn't seem to be define in the database( WARNING : type of input 1 of step 11539 doesn't seem to be define in the database( WARNING : output 0 of step 11539 have datatype=10 whereas input 0 of step 11585 have datatype=18 WARNING : type of input 5 of step 11546 doesn't seem to be define in the database( WARNING : output 0 of step 11585 have datatype=11 whereas input 5 of step 11546 have datatype=None WARNING : type of output 1 of step 11545 doesn't seem to be define in the database( WARNING : type of input 3 of step 11540 doesn't seem to be define in the database( WARNING : type of output 1 of step 11544 doesn't seem to be define in the database( WARNING : type of input 3 of step 11540 doesn't seem to be define in the database( WARNING : output 0 of step 11543 have datatype=1 whereas input 0 of step 11537 have datatype=2 DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4205, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'metal,background', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 1.5, 'ela': 1.5, 'etiquette': 1, 'film_plastique': 1, 'kraft': 1, 'papier': 1, 'pehd': 1.5, 'pet_clair': 1.5, 'pet_opaque': 1.5, 'textiles_sanitaires': 1.5, 'pet_fonce': 1.5}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3594, 'hashtag_proportion': 'papier,carton,metal,pet_clair,autre,pehd,pet_fonce', 'hashtag_parmi': 'refus,background', 'hashtag_weights': {'papier': 1, 'carton': 1, 'metal': 1, 'pet_clair': 1, 'autre': 1, 'pehd': 1, 'pet_fonce': 1, 'refus': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11560 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11567 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11567 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11563 crop_condition is not consistent : 4 used against 2 in the step definition ! Step 11563 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11564 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11564 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11573 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11573 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11566 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11566 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 1 of step 11560 have datatype=2 whereas input 1 of step 11564 have datatype=7 WARNING : type of output 2 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11565 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11567 doesn't seem to be define in the database( WARNING : type of input 3 of step 11563 doesn't seem to be define in the database( WARNING : type of output 3 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11568 doesn't seem to be define in the database( WARNING : type of output 1 of step 11568 doesn't seem to be define in the database( WARNING : type of input 3 of step 11566 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11570 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11569 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11570 doesn't seem to be define in the database( WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11569 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11568 have datatype=10 whereas input 3 of step 11571 have datatype=6 WARNING : type of input 2 of step 11573 doesn't seem to be define in the database( WARNING : output 1 of step 11565 have datatype=7 whereas input 2 of step 11573 have datatype=None WARNING : type of output 3 of step 11573 doesn't seem to be define in the database( WARNING : type of input 3 of step 11568 doesn't seem to be define in the database( WARNING : output 0 of step 11568 have datatype=10 whereas input 0 of step 11587 have datatype=18 WARNING : type of input 5 of step 11571 doesn't seem to be define in the database( WARNING : output 0 of step 11587 have datatype=11 whereas input 5 of step 11571 have datatype=None WARNING : output 0 of step 11564 have datatype=1 whereas input 0 of step 11565 have datatype=2 DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3327, 'hashtag_proportion': 'autre,carton,metal,papier,pehd,pet_fonce', 'hashtag_parmi': 'pet_clair,bouchon,etiquette,barquette_avec_film,background', 'hashtag_weights': {'autre': 8.0, 'barquette_avec_film': 6, 'carton': 8.0, 'metal': 12, 'papier': 5, 'pehd': 8, 'pet_fonce': 8, 'bouchon': 8, 'etiquette': 8}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier select count(distinct mtr_photo_id) from MTRUser.mtr_portfolio_photos where mtr_portfolio_id in (select id from MTRUser.mtr_portfolios where id in (select mtr_portfolio_id from MTRPhoto.dashboard_results where dashboard_run_id in(select last_run_id from MTRPhoto.dashboard_entry_day where dashboard_place_id in (select id from MTRPhoto.dashboard_places where name = 'Romainville_Presse_2' and date like '%2022-08%') and created_at like '%2022-08%'))); nb_day : (0, 31) after unwanted_material_data nb_day : (0, 31) after coverage_data after number_of_batch date_start : 2022-08-01 : dt_date_just_month_year : 2022-08-01 00:00:00 : VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! Error parsing crontab ! [Errno 2] No such file or directory: '' You better check your LOGRASPI env !!! after pl.get_datou_sts_from_crontab : verbose : False no sts found, try to find from database SELECT dri.id FROM MTRPhoto.dashboard_run_ids dri, MTRPhoto.dashboard_entry_day ded, MTRPhoto.dashboard_places dp WHERE dp.name= "Romainville_Presse_2" AND ded.dashboard_place_id=dp.id AND dri.dashboard_entry_day=ded.id AND dri.id=ded.last_run_id AND ded.date >= "2022-08-01" AND ded.date <= "2022-08-31" apple3 {'gm': {'mat': 'gm', 'pht': 4209, 'datou_carac_id': 3994, 'unwanted_material': [], 'hashtag_majoritaire_from_carac': 'papier,background'}, 'emr': {'mat': 'emr', 'pht': 4207, 'datou_carac_id': 3993, 'unwanted_material': [], 'hashtag_majoritaire_from_carac': 'carton,background'}, 'jrm': {'mat': 'jrm', 'pht': 3726, 'datou_carac_id': 3459, 'unwanted_material': [], 'hashtag_majoritaire_from_carac': 'papier,background'}, 'ela': {'mat': 'ela', 'pht': 4203, 'datou_carac_id': 3991, 'unwanted_material': [], 'hashtag_majoritaire_from_carac': 'ela,background'}, 'pehd_pp': {'mat': 'pehd_pp', 'pht': 4211, 'datou_carac_id': 3995, 'unwanted_material': [], 'hashtag_majoritaire_from_carac': 'pehd,background'}, 'pet_fonce': {'mat': 'pet_fonce', 'pht': 4200, 'datou_carac_id': 4153, 'unwanted_material': [], 'hashtag_majoritaire_from_carac': 'pet_fonce,background'}, 'aluminium': {'mat': 'aluminium', 'pht': 4205, 'datou_carac_id': 3992, 'unwanted_material': [], 'hashtag_majoritaire_from_carac': 'metal,background'}, 'refus': {'mat': 'refus', 'pht': 3594, 'datou_carac_id': 3318, 'unwanted_material': [], 'hashtag_majoritaire_from_carac': 'refus,background'}, 'pet_clair': {'mat': 'pet_clair', 'pht': 3327, 'datou_carac_id': 3804, 'unwanted_material': [], 'hashtag_majoritaire_from_carac': 'pet_clair,bouchon,etiquette,barquette_avec_film,background'}} SELECT h.hashtag as unwanted_material, substr(dr.hashtag,8) as main_material, ptp.type as pht_type, sum(pcr.value*dr.nombre_balle)/sum(dr.nombre_balle) as ratio, count(distinct mpp.mtr_photo_id) as nb_photo, group_concat(distinct ptp.mtr_portfolio_id_2) as list_port_cont, group_concat(distinct concat(cast(ptp.mtr_portfolio_id_1 as char), ":", cast(ptp.mtr_portfolio_id_2 as char))) as assoc_port, group_concat(distinct concat(cast(ptp.mtr_portfolio_id_1 as char), ":", h.hashtag, ":", cast(ptp.type as char), ":", cast(ptp.mtr_portfolio_id_2 as char))) as assoc_mat FROM MTRPhoto.dashboard_results dr, MTRPhoto.mtr_port_to_port_ids ptp, MTRUser.mtr_portfolio_photos mpp, MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h WHERE dr.dashboard_run_id IN (448643,449568,454450,454465,454459,454472,456239,458795,461498,454567,457375,457649,459844,460382,461634,463066,472528,465865,469297,468129,475039,472453,474892,474538,475316,476524,479832,481665,479903) AND dr.mtr_portfolio_id=ptp.mtr_portfolio_id_1 AND dr.qualite >= 0 AND mpp.mtr_portfolio_id=ptp.mtr_portfolio_id_2 AND pcr.portfolio_id=ptp.mtr_portfolio_id_1 AND h.hashtag_id = pcr.hashtag_id AND ptp.type = pcr.hashtag_type AND mpp.hide_status = 0 AND ptp.hashtag_id=h.hashtag_id AND ptp.type IN (4209,4207,3726,4203,4211,4200,4205,3594,3327) group by h.hashtag, dr.hashtag, ptp.type; VR TODO TO BETTER PARSE ! ({'unwanted_material': 'barquette_opaque', 'main_material': 'emr', 'pht_type': 4207, 'ratio': 0.0001728785023265608, 'nb_photo': 18, 'list_port_cont': '6861407,6862123,6862547,6867908,6868674,6869389,6869558,6877707,6877972,6881690,6891352,6894202,6907047,6922714,6925593', 'assoc_port': '6790887:6862547,6794193:6862123,6834822:6877972,6840554:6877707,6845438:6869389,6846972:6869558,6851003:6868674,6853215:6861407,6864848:6867908,6881492:6881690,6889190:6891352,6894094:6894202,6906036:6907047,6921897:6922714,6925484:6925593', 'assoc_mat': '6790887:barquette_opaque:4207:6862547,6794193:barquette_opaque:4207:6862123,6834822:barquette_opaque:4207:6877972,6840554:barquette_opaque:4207:6877707,6845438:barquette_opaque:4207:6869389,6846972:barquette_opaque:4207:6869558,6851003:barquette_opaque:4207:6868674,6853215:barquette_opaque:4207:6861407,6864848:barquette_opaque:4207:6867908,6881492:barquette_opaque:4207:6881690,6889190:barquette_opaque:4207:6891352,6894094:barquette_opaque:4207:6894202,6906036:barquette_opaque:4207:6907047,6921897:barquette_opaque:4207:6922714,6925484:barquette_opaque:4207:6925593'}, {'unwanted_material': 'barquette_opaque', 'main_material': 'emr', 'pht_type': 4209, 'ratio': 8.469862336652651e-05, 'nb_photo': 44, 'list_port_cont': '6626450,6627857,6628405,6628829,6644425,6664932,6665236,6666075,6666652,6669243,6669771,6706891,6712605,6719637,6720391,6720629,6722154,6744912,6762879,6775287,6835808,6841133,6842925,6846016,6852775,6853230', 'assoc_port': '6625827:6626450,6627447:6627857,6627801:6628405,6628455:6628829,6630580:6664932,6630581:6665236,6630822:6666075,6631618:6669771,6639123:6644425,6665718:6666652,6668655:6669243,6706262:6706891,6708643:6712605,6719441:6719637,6719951:6720391,6720202:6720629,6721827:6722154,6744086:6744912,6762224:6762879,6774283:6775287,6834821:6835808,6840554:6841133,6842390:6842925,6845438:6846016,6852117:6852775,6852533:6853230', 'assoc_mat': '6625827:barquette_opaque:4209:6626450,6627447:barquette_opaque:4209:6627857,6627801:barquette_opaque:4209:6628405,6628455:barquette_opaque:4209:6628829,6630580:barquette_opaque:4209:6664932,6630581:barquette_opaque:4209:6665236,6630822:barquette_opaque:4209:6666075,6631618:barquette_opaque:4209:6669771,6639123:barquette_opaque:4209:6644425,6665718:barquette_opaque:4209:6666652,6668655:barquette_opaque:4209:6669243,6706262:barquette_opaque:4209:6706891,6708643:barquette_opaque:4209:6712605,6719441:barquette_opaque:4209:6719637,6719951:barquette_opaque:4209:6720391,6720202:barquette_opaque:4209:6720629,6721827:barquette_opaque:4209:6722154,6744086:barquette_opaque:4209:6744912,6762224:barquette_opaque:4209:6762879,6774283:barquette_opaque:4209:6775287,6834821:barquette_opaque:4209:6835808,6840554:barquette_opaque:4209:6841133,6842390:barquette_opaque:4209:6842925,6845438:barquette_opaque:4209:6846016,6852117:barquette_opaque:4209:6852775,6852533:barquette_opaque:4209:6853230'}, {'unwanted_material': 'carton', 'main_material': 'aluminium', 'pht_type': 4205, 'ratio': 0.01022994561299725, 'nb_photo': 16, 'list_port_cont': '6625532,6880743,6880786', 'assoc_port': '6625304:6625532,6880715:6880786,6880716:6880743', 'assoc_mat': '6625304:carton:4205:6625532,6880715:carton:4205:6880786,6880716:carton:4205:6880743'}, {'unwanted_material': 'carton', 'main_material': 'emr', 'pht_type': 4207, 'ratio': 0.9683717828305286, 'nb_photo': 2565, 'list_port_cont': '6860769,6860801,6860841,6860928,6860987,6861035,6861210,6861405,6861437,6861808,6861831,6861929,6862023,6862130,6862206,6862328,6862365,6862540,6862581,6862649,6862984,6863819,6864050,6866304,6866467,6866495,6866955,6867660,6867837,6867907,6868220,6868254,6868280,6868378,6868398,6868623,6868676,6868731,6868887,6868963,6869104,6869323,6869395,6869455,6869560,6876859,6876893,6876912,6876948,6877006,6877054,6877103,6877189,6877551,6877616,6877676,6877710,6877780,6877820,6877867,6877909,6877915,6877971,6877996,6878027,6881699,6884486,6886468,6886876,6887990,6888294,6889466,6891082,6891177,6891354,6894196,6894492,6895946,6896156,6897897,6898092,6898471,6898488,6900295,6900456,6904480,6904513,6905153,6905998,6906484,6907056,6908162,6908516,6908935,6909121,6914618,6915177,6915209,6915268,6916694,6917250,6917397,6920809,6922717,6925589', 'assoc_port': '6790886:6864050,6790887:6862540,6794193:6862130,6832752:6877915,6832753:6877867,6833565:6878027,6834821:6877996,6834822:6877971,6836050:6877780,6838973:6877676,6838974:6877616,6840554:6877710,6842390:6877820,6845438:6869395,6846972:6869560,6846973:6869455,6848417:6869323,6849526:6868887,6851003:6868676,6852117:6868731,6852533:6869104,6852534:6868963,6853215:6861405,6853569:6861437,6853919:6868623,6855642:6860801,6859123:6861831,6860530:6861210,6860531:6861035,6860532:6860987,6860535:6860928,6860537:6860841,6860538:6860769,6861512:6868220,6861514:6868280,6861516:6868254,6861517:6868378,6861519:6862581,6861520:6862649,6861522:6861808,6861523:6862328,6861524:6862206,6861525:6861929,6861635:6862365,6861636:6862023,6862501:6862984,6863220:6863819,6864848:6867907,6864850:6867837,6864851:6867660,6864853:6866955,6864855:6866495,6865738:6866304,6865739:6866467,6868332:6868398,6876683:6877189,6876684:6876912,6876685:6877006,6876686:6877054,6876687:6877103,6876688:6876893,6876689:6876948,6876691:6876859,6877478:6877909,', 'assoc_mat': '6790886:carton:4207:6864050,6790887:carton:4207:6862540,6794193:carton:4207:6862130,6832752:carton:4207:6877915,6832753:carton:4207:6877867,6833565:carton:4207:6878027,6834821:carton:4207:6877996,6834822:carton:4207:6877971,6836050:carton:4207:6877780,6838973:carton:4207:6877676,6838974:carton:4207:6877616,6840554:carton:4207:6877710,6842390:carton:4207:6877820,6845438:carton:4207:6869395,6846972:carton:4207:6869560,6846973:carton:4207:6869455,6848417:carton:4207:6869323,6849526:carton:4207:6868887,6851003:carton:4207:6868676,6852117:carton:4207:6868731,6852533:carton:4207:6869104,6852534:carton:4207:6868963,6853215:carton:4207:6861405,6853569:carton:4207:6861437,6853919:carton:4207:6868623,6855642:carton:4207:6860801,6859123:carton:4207:6861831,6860530:carton:4207:6861210,6860531:carton:4207:6861035,6860532:carton:4207:6860987,6860535:carton:4207:6860928,6860537:carton:4207:6860841,6860538:carton:4207:6860769,6861512:carton:4207:6868220,6861514:carton:4207:6868280,6861516:carton:4207:6868254,6861517:carton:4'}, {'unwanted_material': 'carton', 'main_material': 'emr', 'pht_type': 4209, 'ratio': 0.007834080277437061, 'nb_photo': 1462, 'list_port_cont': '6613099,6614127,6614585,6615525,6616029,6626453,6627860,6628395,6628840,6629152,6629205,6629281,6635304,6635369,6635432,6639702,6640661,6641608,6642551,6644436,6646356,6647438,6648160,6648884,6654375,6655819,6657180,6658370,6659145,6659232,6660891,6661075,6664557,6664640,6664706,6664802,6664929,6665234,6666043,6666077,6666648,6666765,6666944,6668004,6668673,6668922,6669250,6669483,6669559,6669701,6669786,6669812,6670114,6671149,6671463,6671574,6671847,6672297,6674151,6674264,6674794,6676772,6678452,6681186,6683438,6683967,6700222,6702222,6704712,6706887,6708974,6709414,6709569,6710040,6710776,6711299,6712611,6716502,6718348,6718717,6718883,6719281,6719649,6719891,6720389,6720622,6722163,6722585,6722885,6723449,6723510,6744917,6745245,6746407,6748615,6748946,6749029,6758826,6760253,6760547,6761445,6761998,6762877,6774108,6774613,6775298,6776475,6776981,6813192,6834126,6834362,6834696,6835803,6836102,6837017,6839291,6839592,6841138,6842928,6846019,6847495,6847556,6849259,6850419,6851368,6852770,6853216,6853519,', 'assoc_port': '6612572:6613099,6613636:6614127,6614336:6614585,6614890:6615525,6614891:6616029,6625827:6626453,6627447:6627860,6627801:6628395,6627802:6629281,6628455:6628840,6628735:6629152,6628736:6629205,6630577:6664557,6630578:6664706,6630579:6664640,6630580:6664929,6630581:6665234,6630822:6666077,6630823:6666043,6631154:6668004,6631384:6668673,6631385:6668922,6631618:6669786,6631619:6669812,6631901:6670114,6632901:6671149,6632902:6671463,6633542:6635432,6633543:6635304,6633544:6671847,6633545:6635369,6633546:6672297,6635651:6661075,6635653:6660891,6639123:6644436,6639124:6639702,6639695:6642551,6640066:6640661,6640928:6641608,6645791:6646356,6646682:6647438,6647202:6648160,6648217:6648884,6652800:6654375,6655088:6655819,6656505:6657180,6656506:6658370,6657819:6659145,6659025:6659232,6663042:6664802,6665067:6666944,6665718:6666648,6665719:6666765,6668654:6669701,6668655:6669250,6668656:6669483,6668657:6669559,6670886:6671574,6671756:6676772,6673385:6674151,6673850:6674264,6674357:6674794,6678032:6678452,6680947:6681186,', 'assoc_mat': '6612572:carton:4209:6613099,6613636:carton:4209:6614127,6614336:carton:4209:6614585,6614890:carton:4209:6615525,6614891:carton:4209:6616029,6625827:carton:4209:6626453,6627447:carton:4209:6627860,6627801:carton:4209:6628395,6627802:carton:4209:6629281,6628455:carton:4209:6628840,6628735:carton:4209:6629152,6628736:carton:4209:6629205,6630577:carton:4209:6664557,6630578:carton:4209:6664706,6630579:carton:4209:6664640,6630580:carton:4209:6664929,6630581:carton:4209:6665234,6630822:carton:4209:6666077,6630823:carton:4209:6666043,6631154:carton:4209:6668004,6631384:carton:4209:6668673,6631385:carton:4209:6668922,6631618:carton:4209:6669786,6631619:carton:4209:6669812,6631901:carton:4209:6670114,6632901:carton:4209:6671149,6632902:carton:4209:6671463,6633542:carton:4209:6635432,6633543:carton:4209:6635304,6633544:carton:4209:6671847,6633545:carton:4209:6635369,6633546:carton:4209:6672297,6635651:carton:4209:6661075,6635653:carton:4209:6660891,6639123:carton:4209:6644436,6639124:carton:4209:6639702,6639695:carton:4'}, {'unwanted_material': 'carton', 'main_material': 'gm', 'pht_type': 4209, 'ratio': 0.0029313403454804565, 'nb_photo': 10, 'list_port_cont': '6861174,6862613,6886392,6902824,6905431,6920955', 'assoc_port': '6860533:6861174,6861515:6862613,6886257:6886392,6900676:6902824,6905103:6905431,6920015:6920955', 'assoc_mat': '6860533:carton:4209:6861174,6861515:carton:4209:6862613,6886257:carton:4209:6886392,6900676:carton:4209:6902824,6905103:carton:4209:6905431,6920015:carton:4209:6920955'}, {'unwanted_material': 'carton', 'main_material': 'pet_fonce', 'pht_type': 4200, 'ratio': 0.005861756255830517, 'nb_photo': 4, 'list_port_cont': '6647696', 'assoc_port': '6647200:6647696', 'assoc_mat': '6647200:carton:4200:6647696'}, {'unwanted_material': 'ela', 'main_material': 'emr', 'pht_type': 4207, 'ratio': 0.0001359155180754883, 'nb_photo': 1, 'list_port_cont': '6877603', 'assoc_port': '6838974:6877603', 'assoc_mat': '6838974:ela:4207:6877603'}, {'unwanted_material': 'ela', 'main_material': 'emr', 'pht_type': 4209, 'ratio': 5.6302219709875656e-05, 'nb_photo': 3, 'list_port_cont': '6635371,6644435,6657178', 'assoc_port': '6633545:6635371,6639123:6644435,6656505:6657178', 'assoc_mat': '6633545:ela:4209:6635371,6639123:ela:4209:6644435,6656505:ela:4209:6657178'}, {'unwanted_material': 'etiquette', 'main_material': 'emr', 'pht_type': 4207, 'ratio': 0.0004908205603477037, 'nb_photo': 82, 'list_port_cont': '6860802,6860985,6861441,6861842,6861919,6862212,6862342,6862370,6862544,6862643,6868221,6868633,6868729,6869099,6869322,6869388,6869458,6876887,6877052,6877109,6877190,6877547,6877688,6877715,6877814,6877918,6877964,6877998,6878028,6886871,6891088,6891171,6896147,6900293,6900464,6904479,6907053,6908947,6909124,6915211,6915265,6916685,6917252,6920804,6922718', 'assoc_port': '6790887:6862544,6832752:6877918,6833565:6878028,6834821:6877998,6834822:6877964,6838973:6877688,6840554:6877715,6842390:6877814,6845438:6869388,6846973:6869458,6848417:6869322,6852117:6868729,6852533:6869099,6853569:6861441,6853919:6868633,6855642:6860802,6859123:6861842,6860532:6860985,6861512:6868221,6861520:6862643,6861523:6862342,6861524:6862212,6861525:6861919,6861635:6862370,6876683:6877190,6876686:6877052,6876687:6877109,6876688:6876887,6877480:6877547,6886258:6886871,6889185:6891088,6891024:6891171,6895749:6896147,6899246:6900464,6899248:6900293,6900677:6909124,6900678:6908947,6903712:6904479,6906036:6907053,6914258:6915211,6914260:6916685,6914751:6915265,6917033:6917252,6920014:6920804,6921897:6922718', 'assoc_mat': '6790887:etiquette:4207:6862544,6832752:etiquette:4207:6877918,6833565:etiquette:4207:6878028,6834821:etiquette:4207:6877998,6834822:etiquette:4207:6877964,6838973:etiquette:4207:6877688,6840554:etiquette:4207:6877715,6842390:etiquette:4207:6877814,6845438:etiquette:4207:6869388,6846973:etiquette:4207:6869458,6848417:etiquette:4207:6869322,6852117:etiquette:4207:6868729,6852533:etiquette:4207:6869099,6853569:etiquette:4207:6861441,6853919:etiquette:4207:6868633,6855642:etiquette:4207:6860802,6859123:etiquette:4207:6861842,6860532:etiquette:4207:6860985,6861512:etiquette:4207:6868221,6861520:etiquette:4207:6862643,6861523:etiquette:4207:6862342,6861524:etiquette:4207:6862212,6861525:etiquette:4207:6861919,6861635:etiquette:4207:6862370,6876683:etiquette:4207:6877190,6876686:etiquette:4207:6877052,6876687:etiquette:4207:6877109,6876688:etiquette:4207:6876887,6877480:etiquette:4207:6877547,6886258:etiquette:4207:6886871,6889185:etiquette:4207:6891088,6891024:etiquette:4207:6891171,6895749:etiquette:4207:6896147,6'}, {'unwanted_material': 'etiquette', 'main_material': 'emr', 'pht_type': 4209, 'ratio': 0.0008238173967106119, 'nb_photo': 1049, 'list_port_cont': '6613101,6614126,6614587,6616038,6626458,6627864,6628397,6628838,6629141,6629204,6629280,6635302,6635366,6635430,6640667,6641598,6642545,6644428,6646362,6647450,6648167,6648890,6654367,6655834,6657182,6658372,6659142,6659220,6660894,6661081,6664553,6664638,6664707,6664807,6664938,6665231,6666055,6666086,6666643,6666770,6666946,6668001,6668670,6668913,6669257,6669490,6669555,6669702,6669778,6669808,6670117,6671148,6671464,6671561,6671836,6672301,6674153,6674271,6674799,6676771,6678460,6681184,6683436,6683981,6700231,6702226,6704721,6706890,6708962,6709416,6709579,6710035,6710785,6711300,6712603,6716517,6718720,6718877,6719278,6719639,6719881,6720398,6720627,6722161,6722583,6722896,6723446,6723519,6744916,6745258,6746410,6748605,6748955,6749037,6760261,6760532,6761442,6762007,6774112,6774618,6775290,6776483,6776974,6813185,6834132,6834363,6834703,6835800,6836101,6837027,6839290,6839587,6841136,6842924,6846017,6847494,6847557,6849269,6850421,6852780,6853222,6853521,6853980,6854357,6855828,6859399', 'assoc_port': '6612572:6613101,6613636:6614126,6614336:6614587,6614891:6616038,6625827:6626458,6627447:6627864,6627801:6628397,6627802:6629280,6628455:6628838,6628735:6629141,6628736:6629204,6630577:6664553,6630578:6664707,6630579:6664638,6630580:6664938,6630581:6665231,6630822:6666086,6630823:6666055,6631154:6668001,6631384:6668670,6631385:6668913,6631618:6669778,6631619:6669808,6631901:6670117,6632901:6671148,6632902:6671464,6633542:6635430,6633543:6635302,6633544:6671836,6633545:6635366,6633546:6672301,6635651:6661081,6635653:6660894,6639123:6644428,6639695:6642545,6640066:6640667,6640928:6641598,6645791:6646362,6646682:6647450,6647202:6648167,6648217:6648890,6652800:6654367,6655088:6655834,6656505:6657182,6656506:6658372,6657819:6659142,6659025:6659220,6663042:6664807,6665067:6666946,6665718:6666643,6665719:6666770,6668654:6669702,6668655:6669257,6668656:6669490,6668657:6669555,6670886:6671561,6671756:6676771,6673385:6674153,6673850:6674271,6674357:6674799,6678032:6678460,6680947:6681184,6682633:6683436,6683289:6683981,', 'assoc_mat': '6612572:etiquette:4209:6613101,6613636:etiquette:4209:6614126,6614336:etiquette:4209:6614587,6614891:etiquette:4209:6616038,6625827:etiquette:4209:6626458,6627447:etiquette:4209:6627864,6627801:etiquette:4209:6628397,6627802:etiquette:4209:6629280,6628455:etiquette:4209:6628838,6628735:etiquette:4209:6629141,6628736:etiquette:4209:6629204,6630577:etiquette:4209:6664553,6630578:etiquette:4209:6664707,6630579:etiquette:4209:6664638,6630580:etiquette:4209:6664938,6630581:etiquette:4209:6665231,6630822:etiquette:4209:6666086,6630823:etiquette:4209:6666055,6631154:etiquette:4209:6668001,6631384:etiquette:4209:6668670,6631385:etiquette:4209:6668913,6631618:etiquette:4209:6669778,6631619:etiquette:4209:6669808,6631901:etiquette:4209:6670117,6632901:etiquette:4209:6671148,6632902:etiquette:4209:6671464,6633542:etiquette:4209:6635430,6633543:etiquette:4209:6635302,6633544:etiquette:4209:6671836,6633545:etiquette:4209:6635366,6633546:etiquette:4209:6672301,6635651:etiquette:4209:6661081,6635653:etiquette:4209:6660894,6'}, {'unwanted_material': 'etiquette', 'main_material': 'gm', 'pht_type': 4209, 'ratio': 0.0007589310876444754, 'nb_photo': 16, 'list_port_cont': '6860869,6861178,6861533,6862611,6863435,6876769,6889758,6894819,6902814,6920942', 'assoc_port': '6860533:6861178,6860536:6860869,6861163:6861533,6861515:6862611,6863221:6863435,6876690:6876769,6889188:6889758,6894658:6894819,6900676:6902814,6920015:6920942', 'assoc_mat': '6860533:etiquette:4209:6861178,6860536:etiquette:4209:6860869,6861163:etiquette:4209:6861533,6861515:etiquette:4209:6862611,6863221:etiquette:4209:6863435,6876690:etiquette:4209:6876769,6889188:etiquette:4209:6889758,6894658:etiquette:4209:6894819,6900676:etiquette:4209:6902814,6920015:etiquette:4209:6920942'}, {'unwanted_material': 'etiquette', 'main_material': 'pet_fonce', 'pht_type': 4200, 'ratio': 0.0010885671487047438, 'nb_photo': 5, 'list_port_cont': '6647706', 'assoc_port': '6647200:6647706', 'assoc_mat': '6647200:etiquette:4200:6647706'}, {'unwanted_material': 'film_plastique', 'main_material': 'emr', 'pht_type': 4207, 'ratio': 0.00029682028164317286, 'nb_photo': 8, 'list_port_cont': '6862648,6866460,6877060,6877718,6877925,6922720,6925580', 'assoc_port': '6832752:6877925,6840554:6877718,6861520:6862648,6865739:6866460,6876686:6877060,6921897:6922720,6925484:6925580', 'assoc_mat': '6832752:film_plastique:4207:6877925,6840554:film_plastique:4207:6877718,6861520:film_plastique:4207:6862648,6865739:film_plastique:4207:6866460,6876686:film_plastique:4207:6877060,6921897:film_plastique:4207:6922720,6925484:film_plastique:4207:6925580'}, {'unwanted_material': 'film_plastique', 'main_material': 'emr', 'pht_type': 4209, 'ratio': 9.746706181821035e-05, 'nb_photo': 9, 'list_port_cont': '6614124,6644434,6702223,6711304,6712598,6744913,6834700', 'assoc_port': '6613636:6614124,6639123:6644434,6701501:6702223,6708643:6712598,6708644:6711304,6744086:6744913,6832752:6834700', 'assoc_mat': '6613636:film_plastique:4209:6614124,6639123:film_plastique:4209:6644434,6701501:film_plastique:4209:6702223,6708643:film_plastique:4209:6712598,6708644:film_plastique:4209:6711304,6744086:film_plastique:4209:6744913,6832752:film_plastique:4209:6834700'}, {'unwanted_material': 'kraft', 'main_material': 'emr', 'pht_type': 4207, 'ratio': 0.0011039430628874177, 'nb_photo': 1, 'list_port_cont': '6917403', 'assoc_port': '6917034:6917403', 'assoc_mat': '6917034:kraft:4207:6917403'}, {'unwanted_material': 'metal', 'main_material': 'aluminium', 'pht_type': 4205, 'ratio': 0.9896715615394742, 'nb_photo': 54, 'list_port_cont': '6625531,6661187,6880740,6880777,6881860,6918649', 'assoc_port': '6625304:6625531,6632479:6661187,6880715:6880777,6880716:6880740,6881491:6881860,6887696:6918649', 'assoc_mat': '6625304:metal:4205:6625531,6632479:metal:4205:6661187,6880715:metal:4205:6880777,6880716:metal:4205:6880740,6881491:metal:4205:6881860,6887696:metal:4205:6918649'}, {'unwanted_material': 'metal', 'main_material': 'emr', 'pht_type': 4207, 'ratio': 0.002857356890964171, 'nb_photo': 188, 'list_port_cont': '6860922,6860979,6861033,6861211,6861400,6861433,6861833,6862030,6862128,6862210,6862338,6862362,6862534,6862572,6862638,6863807,6864053,6866290,6866466,6866498,6866956,6867841,6867914,6868223,6868261,6868374,6868621,6868667,6868732,6869091,6869331,6869392,6869468,6869545,6876850,6876885,6876957,6877055,6877099,6877198,6877539,6877618,6877678,6877719,6877785,6877818,6877877,6877912,6877928,6877966,6878004,6878040,6884491,6886881,6887977,6888302,6894497,6895947,6896159,6897898,6898087,6898465,6898489,6900299,6900468,6904477,6905148,6905987,6907057,6908937,6909122,6915222,6915272,6916692,6917256,6920805,6925583', 'assoc_port': '6790886:6864053,6790887:6862534,6794193:6862128,6832752:6877928,6832753:6877877,6833565:6878040,6834821:6878004,6834822:6877966,6836050:6877785,6838973:6877678,6838974:6877618,6840554:6877719,6842390:6877818,6845438:6869392,6846972:6869545,6846973:6869468,6848417:6869331,6851003:6868667,6852117:6868732,6852533:6869091,6853215:6861400,6853569:6861433,6853919:6868621,6859123:6861833,6860530:6861211,6860531:6861033,6860532:6860979,6860535:6860922,6861512:6868223,6861516:6868261,6861517:6868374,6861519:6862572,6861520:6862638,6861523:6862338,6861524:6862210,6861635:6862362,6861636:6862030,6863220:6863807,6864848:6867914,6864850:6867841,6864853:6866956,6864855:6866498,6865738:6866290,6865739:6866466,6876683:6877198,6876686:6877055,6876687:6877099,6876688:6876885,6876689:6876957,6876691:6876850,6877478:6877912,6877480:6877539,6884290:6884491,6886258:6886881,6887695:6888302,6887732:6887977,6894095:6894497,6895749:6896159,6895752:6895947,6897575:6898087,6897576:6897898,6898175:6898489,6898176:6898465,6899246:6900468,', 'assoc_mat': '6790886:metal:4207:6864053,6790887:metal:4207:6862534,6794193:metal:4207:6862128,6832752:metal:4207:6877928,6832753:metal:4207:6877877,6833565:metal:4207:6878040,6834821:metal:4207:6878004,6834822:metal:4207:6877966,6836050:metal:4207:6877785,6838973:metal:4207:6877678,6838974:metal:4207:6877618,6840554:metal:4207:6877719,6842390:metal:4207:6877818,6845438:metal:4207:6869392,6846972:metal:4207:6869545,6846973:metal:4207:6869468,6848417:metal:4207:6869331,6851003:metal:4207:6868667,6852117:metal:4207:6868732,6852533:metal:4207:6869091,6853215:metal:4207:6861400,6853569:metal:4207:6861433,6853919:metal:4207:6868621,6859123:metal:4207:6861833,6860530:metal:4207:6861211,6860531:metal:4207:6861033,6860532:metal:4207:6860979,6860535:metal:4207:6860922,6861512:metal:4207:6868223,6861516:metal:4207:6868261,6861517:metal:4207:6868374,6861519:metal:4207:6862572,6861520:metal:4207:6862638,6861523:metal:4207:6862338,6861524:metal:4207:6862210,6861635:metal:4207:6862362,6861636:metal:4207:6862030,6863220:metal:4207:686380'}, {'unwanted_material': 'metal', 'main_material': 'emr', 'pht_type': 4209, 'ratio': 0.026017127541676587, 'nb_photo': 787, 'list_port_cont': '6613097,6614121,6615521,6616026,6626451,6627868,6628403,6628835,6629153,6629208,6629277,6635307,6635359,6635433,6639705,6640666,6641594,6642552,6644427,6647437,6648164,6648886,6654370,6655828,6657169,6658371,6659139,6660892,6661087,6664549,6664633,6664701,6664796,6664935,6665224,6666046,6666081,6666646,6666766,6666945,6667992,6668663,6668912,6669249,6669482,6669546,6669703,6669773,6669806,6670109,6671159,6671466,6671576,6672296,6674155,6674267,6674795,6676776,6678453,6681189,6683437,6683972,6700233,6702218,6704725,6706893,6708961,6709417,6709566,6710044,6710774,6711296,6712599,6716510,6718358,6718713,6718870,6719287,6719648,6720401,6720631,6722162,6722586,6722893,6723437,6723512,6744909,6745246,6746419,6748619,6748941,6749034,6758839,6760267,6760542,6761443,6762005,6774106,6774607,6775285,6776482,6776987,6813179,6834120,6834369,6834695,6835802,6836110,6837026,6839593,6841134,6846021,6847508,6847568,6849264,6850424,6851374,6852778,6853219,6853526,6854348,6855834,6859395', 'assoc_port': '6612572:6613097,6613636:6614121,6614890:6615521,6614891:6616026,6625827:6626451,6627447:6627868,6627801:6628403,6627802:6629277,6628455:6628835,6628735:6629153,6628736:6629208,6630577:6664549,6630578:6664701,6630579:6664633,6630580:6664935,6630581:6665224,6630822:6666081,6630823:6666046,6631154:6667992,6631384:6668663,6631385:6668912,6631618:6669773,6631619:6669806,6631901:6670109,6632901:6671159,6632902:6671466,6633542:6635433,6633543:6635307,6633545:6635359,6633546:6672296,6635651:6661087,6635653:6660892,6639123:6644427,6639124:6639705,6639695:6642552,6640066:6640666,6640928:6641594,6646682:6647437,6647202:6648164,6648217:6648886,6652800:6654370,6655088:6655828,6656505:6657169,6656506:6658371,6657819:6659139,6663042:6664796,6665067:6666945,6665718:6666646,6665719:6666766,6668654:6669703,6668655:6669249,6668656:6669482,6668657:6669546,6670886:6671576,6671756:6676776,6673385:6674155,6673850:6674267,6674357:6674795,6678032:6678453,6680947:6681189,6682633:6683437,6683289:6683972,6699726:6700233,6700555:6704725,', 'assoc_mat': '6612572:metal:4209:6613097,6613636:metal:4209:6614121,6614890:metal:4209:6615521,6614891:metal:4209:6616026,6625827:metal:4209:6626451,6627447:metal:4209:6627868,6627801:metal:4209:6628403,6627802:metal:4209:6629277,6628455:metal:4209:6628835,6628735:metal:4209:6629153,6628736:metal:4209:6629208,6630577:metal:4209:6664549,6630578:metal:4209:6664701,6630579:metal:4209:6664633,6630580:metal:4209:6664935,6630581:metal:4209:6665224,6630822:metal:4209:6666081,6630823:metal:4209:6666046,6631154:metal:4209:6667992,6631384:metal:4209:6668663,6631385:metal:4209:6668912,6631618:metal:4209:6669773,6631619:metal:4209:6669806,6631901:metal:4209:6670109,6632901:metal:4209:6671159,6632902:metal:4209:6671466,6633542:metal:4209:6635433,6633543:metal:4209:6635307,6633545:metal:4209:6635359,6633546:metal:4209:6672296,6635651:metal:4209:6661087,6635653:metal:4209:6660892,6639123:metal:4209:6644427,6639124:metal:4209:6639705,6639695:metal:4209:6642552,6640066:metal:4209:6640666,6640928:metal:4209:6641594,6646682:metal:4209:664743'}, {'unwanted_material': 'metal', 'main_material': 'gm', 'pht_type': 4209, 'ratio': 0.03426755560145856, 'nb_photo': 14, 'list_port_cont': '6861172,6863427,6863597,6865059,6876772,6881616,6889760,6902821,6920943', 'assoc_port': '6860533:6861172,6863219:6863597,6863221:6863427,6864849:6865059,6876690:6876772,6881493:6881616,6889188:6889760,6900676:6902821,6920015:6920943', 'assoc_mat': '6860533:metal:4209:6861172,6863219:metal:4209:6863597,6863221:metal:4209:6863427,6864849:metal:4209:6865059,6876690:metal:4209:6876772,6881493:metal:4209:6881616,6889188:metal:4209:6889760,6900676:metal:4209:6902821,6920015:metal:4209:6920943'}, {'unwanted_material': 'papier', 'main_material': 'aluminium', 'pht_type': 4205, 'ratio': 0.0013353682339268438, 'nb_photo': 9, 'list_port_cont': '6625537,6880784', 'assoc_port': '6625304:6625537,6880715:6880784', 'assoc_mat': '6625304:papier:4205:6625537,6880715:papier:4205:6880784'}, {'unwanted_material': 'papier', 'main_material': 'emr', 'pht_type': 4207, 'ratio': 0.030078019576209876, 'nb_photo': 6564, 'list_port_cont': '6860765,6860809,6860834,6860929,6860974,6861044,6861206,6861412,6861434,6861798,6861840,6861924,6862024,6862135,6862201,6862331,6862374,6862545,6862582,6862651,6862990,6863820,6864046,6866293,6866465,6866499,6866949,6867662,6867830,6867915,6868217,6868247,6868293,6868379,6868403,6868626,6868668,6868733,6868889,6868970,6869094,6869326,6869384,6869464,6869555,6876860,6876889,6876921,6876951,6877008,6877057,6877102,6877186,6877542,6877605,6877685,6877711,6877787,6877810,6877872,6877908,6877920,6877963,6878007,6878032,6881693,6884489,6886474,6886878,6887983,6888296,6889465,6891084,6891165,6891355,6894204,6894504,6895937,6896154,6897893,6898095,6898457,6898491,6900292,6900467,6904483,6904508,6905154,6905995,6906491,6907050,6908161,6908519,6908941,6909123,6914622,6915183,6915210,6915259,6916693,6917258,6917398,6920814,6922713,6925594', 'assoc_port': '6790886:6864046,6790887:6862545,6794193:6862135,6832752:6877920,6832753:6877872,6833565:6878032,6834821:6878007,6834822:6877963,6836050:6877787,6838973:6877685,6838974:6877605,6840554:6877711,6842390:6877810,6845438:6869384,6846972:6869555,6846973:6869464,6848417:6869326,6849526:6868889,6851003:6868668,6852117:6868733,6852533:6869094,6852534:6868970,6853215:6861412,6853569:6861434,6853919:6868626,6855642:6860809,6859123:6861840,6860530:6861206,6860531:6861044,6860532:6860974,6860535:6860929,6860537:6860834,6860538:6860765,6861512:6868217,6861514:6868293,6861516:6868247,6861517:6868379,6861519:6862582,6861520:6862651,6861522:6861798,6861523:6862331,6861524:6862201,6861525:6861924,6861635:6862374,6861636:6862024,6862501:6862990,6863220:6863820,6864848:6867915,6864850:6867830,6864851:6867662,6864853:6866949,6864855:6866499,6865738:6866293,6865739:6866465,6868332:6868403,6876683:6877186,6876684:6876921,6876685:6877008,6876686:6877057,6876687:6877102,6876688:6876889,6876689:6876951,6876691:6876860,6877478:6877908,', 'assoc_mat': '6790886:papier:4207:6864046,6790887:papier:4207:6862545,6794193:papier:4207:6862135,6832752:papier:4207:6877920,6832753:papier:4207:6877872,6833565:papier:4207:6878032,6834821:papier:4207:6878007,6834822:papier:4207:6877963,6836050:papier:4207:6877787,6838973:papier:4207:6877685,6838974:papier:4207:6877605,6840554:papier:4207:6877711,6842390:papier:4207:6877810,6845438:papier:4207:6869384,6846972:papier:4207:6869555,6846973:papier:4207:6869464,6848417:papier:4207:6869326,6849526:papier:4207:6868889,6851003:papier:4207:6868668,6852117:papier:4207:6868733,6852533:papier:4207:6869094,6852534:papier:4207:6868970,6853215:papier:4207:6861412,6853569:papier:4207:6861434,6853919:papier:4207:6868626,6855642:papier:4207:6860809,6859123:papier:4207:6861840,6860530:papier:4207:6861206,6860531:papier:4207:6861044,6860532:papier:4207:6860974,6860535:papier:4207:6860929,6860537:papier:4207:6860834,6860538:papier:4207:6860765,6861512:papier:4207:6868217,6861514:papier:4207:6868293,6861516:papier:4207:6868247,6861517:papier:4'}, {'unwanted_material': 'papier', 'main_material': 'emr', 'pht_type': 4209, 'ratio': 0.9686131104416358, 'nb_photo': 148871, 'list_port_cont': '6613100,6614114,6614594,6615529,6616034,6626462,6627859,6628399,6628843,6629142,6629212,6629275,6635305,6635363,6635424,6639712,6640665,6641601,6642549,6644429,6646359,6647443,6648156,6648888,6654374,6655830,6657171,6658366,6659151,6659226,6660896,6661088,6664555,6664630,6664696,6664799,6664931,6665226,6666045,6666080,6666650,6666767,6666948,6667998,6668669,6668911,6669246,6669487,6669556,6669704,6669775,6669818,6670116,6671162,6671475,6671569,6671851,6672303,6674157,6674272,6674793,6676777,6678463,6681194,6683426,6683976,6700220,6702213,6704717,6706880,6708963,6709412,6709561,6710050,6710787,6711302,6712597,6716513,6718354,6718721,6718876,6719283,6719641,6719885,6720392,6720623,6722156,6722577,6722881,6723438,6723515,6744914,6745255,6746412,6748609,6748948,6749033,6758834,6760258,6760534,6761446,6762006,6762872,6774101,6774621,6775292,6776474,6776980,6813189,6834129,6834360,6834694,6835804,6836115,6837019,6839283,6839590,6841139,6842937,6846030,6847507,6847554,6849265,6850417,6851367,6852769,6853226,6853512,', 'assoc_port': '6612572:6613100,6613636:6614114,6614336:6614594,6614890:6615529,6614891:6616034,6625827:6626462,6627447:6627859,6627801:6628399,6627802:6629275,6628455:6628843,6628735:6629142,6628736:6629212,6630577:6664555,6630578:6664696,6630579:6664630,6630580:6664931,6630581:6665226,6630822:6666080,6630823:6666045,6631154:6667998,6631384:6668669,6631385:6668911,6631618:6669775,6631619:6669818,6631901:6670116,6632901:6671162,6632902:6671475,6633542:6635424,6633543:6635305,6633544:6671851,6633545:6635363,6633546:6672303,6635651:6661088,6635653:6660896,6639123:6644429,6639124:6639712,6639695:6642549,6640066:6640665,6640928:6641601,6645791:6646359,6646682:6647443,6647202:6648156,6648217:6648888,6652800:6654374,6655088:6655830,6656505:6657171,6656506:6658366,6657819:6659151,6659025:6659226,6663042:6664799,6665067:6666948,6665718:6666650,6665719:6666767,6668654:6669704,6668655:6669246,6668656:6669487,6668657:6669556,6670886:6671569,6671756:6676777,6673385:6674157,6673850:6674272,6674357:6674793,6678032:6678463,6680947:6681194,', 'assoc_mat': '6612572:papier:4209:6613100,6613636:papier:4209:6614114,6614336:papier:4209:6614594,6614890:papier:4209:6615529,6614891:papier:4209:6616034,6625827:papier:4209:6626462,6627447:papier:4209:6627859,6627801:papier:4209:6628399,6627802:papier:4209:6629275,6628455:papier:4209:6628843,6628735:papier:4209:6629142,6628736:papier:4209:6629212,6630577:papier:4209:6664555,6630578:papier:4209:6664696,6630579:papier:4209:6664630,6630580:papier:4209:6664931,6630581:papier:4209:6665226,6630822:papier:4209:6666080,6630823:papier:4209:6666045,6631154:papier:4209:6667998,6631384:papier:4209:6668669,6631385:papier:4209:6668911,6631618:papier:4209:6669775,6631619:papier:4209:6669818,6631901:papier:4209:6670116,6632901:papier:4209:6671162,6632902:papier:4209:6671475,6633542:papier:4209:6635424,6633543:papier:4209:6635305,6633544:papier:4209:6671851,6633545:papier:4209:6635363,6633546:papier:4209:6672303,6635651:papier:4209:6661088,6635653:papier:4209:6660896,6639123:papier:4209:6644429,6639124:papier:4209:6639712,6639695:papier:4'}, {'unwanted_material': 'papier', 'main_material': 'gm', 'pht_type': 4209, 'ratio': 0.9902901831097267, 'nb_photo': 2955, 'list_port_cont': '6860598,6860874,6861066,6861173,6861345,6861539,6861959,6862604,6863422,6863593,6864917,6865058,6866086,6866174,6876761,6877571,6877655,6877751,6881620,6886395,6888025,6889756,6894811,6902822,6905423,6907081,6909151,6920947', 'assoc_port': '6860529:6861066,6860533:6861173,6860534:6860598,6860536:6860874,6861163:6861539,6861164:6861345,6861513:6861959,6861515:6862604,6863219:6863593,6863221:6863422,6864847:6866174,6864849:6865058,6864854:6864917,6865737:6866086,6876690:6876761,6877477:6877751,6877481:6877655,6877482:6877571,6881493:6881620,6886257:6886395,6887731:6888025,6889188:6889756,6894658:6894811,6899249:6909151,6900676:6902822,6903711:6907081,6905103:6905423,6920015:6920947', 'assoc_mat': '6860529:papier:4209:6861066,6860533:papier:4209:6861173,6860534:papier:4209:6860598,6860536:papier:4209:6860874,6861163:papier:4209:6861539,6861164:papier:4209:6861345,6861513:papier:4209:6861959,6861515:papier:4209:6862604,6863219:papier:4209:6863593,6863221:papier:4209:6863422,6864847:papier:4209:6866174,6864849:papier:4209:6865058,6864854:papier:4209:6864917,6865737:papier:4209:6866086,6876690:papier:4209:6876761,6877477:papier:4209:6877751,6877481:papier:4209:6877655,6877482:papier:4209:6877571,6881493:papier:4209:6881620,6886257:papier:4209:6886395,6887731:papier:4209:6888025,6889188:papier:4209:6889756,6894658:papier:4209:6894811,6899249:papier:4209:6909151,6900676:papier:4209:6902822,6903711:papier:4209:6907081,6905103:papier:4209:6905423,6920015:papier:4209:6920947'}, {'unwanted_material': 'papier', 'main_material': 'pet_fonce', 'pht_type': 4200, 'ratio': 0.010245453120925422, 'nb_photo': 31, 'list_port_cont': '6647707,6861711', 'assoc_port': '6647200:6647707,6861521:6861711', 'assoc_mat': '6647200:papier:4200:6647707,6861521:papier:4200:6861711'}, {'unwanted_material': 'pehd', 'main_material': 'emr', 'pht_type': 4209, 'ratio': 2.520265649788176e-05, 'nb_photo': 2, 'list_port_cont': '6678458', 'assoc_port': '6678032:6678458', 'assoc_mat': '6678032:pehd:4209:6678458'}, {'unwanted_material': 'pet_clair', 'main_material': 'emr', 'pht_type': 4207, 'ratio': 0.0009691335779369147, 'nb_photo': 50, 'list_port_cont': '6862208,6862361,6862535,6862580,6862650,6867917,6868229,6868248,6868281,6868376,6868672,6869102,6869324,6869466,6869550,6877011,6877046,6877191,6877677,6877777,6877812,6877923,6877993,6878035,6886875,6888290,6891353,6896153,6898498,6904509,6907044,6917257,6922719,6925591', 'assoc_port': '6790887:6862535,6832752:6877923,6833565:6878035,6834821:6877993,6836050:6877777,6838973:6877677,6842390:6877812,6846972:6869550,6846973:6869466,6848417:6869324,6851003:6868672,6852533:6869102,6861512:6868229,6861514:6868281,6861516:6868248,6861517:6868376,6861519:6862580,6861520:6862650,6861524:6862208,6861635:6862361,6864848:6867917,6876683:6877191,6876685:6877011,6876686:6877046,6886258:6886875,6887695:6888290,6889190:6891353,6895749:6896153,6898175:6898498,6904057:6904509,6906036:6907044,6917033:6917257,6921897:6922719,6925484:6925591', 'assoc_mat': '6790887:pet_clair:4207:6862535,6832752:pet_clair:4207:6877923,6833565:pet_clair:4207:6878035,6834821:pet_clair:4207:6877993,6836050:pet_clair:4207:6877777,6838973:pet_clair:4207:6877677,6842390:pet_clair:4207:6877812,6846972:pet_clair:4207:6869550,6846973:pet_clair:4207:6869466,6848417:pet_clair:4207:6869324,6851003:pet_clair:4207:6868672,6852533:pet_clair:4207:6869102,6861512:pet_clair:4207:6868229,6861514:pet_clair:4207:6868281,6861516:pet_clair:4207:6868248,6861517:pet_clair:4207:6868376,6861519:pet_clair:4207:6862580,6861520:pet_clair:4207:6862650,6861524:pet_clair:4207:6862208,6861635:pet_clair:4207:6862361,6864848:pet_clair:4207:6867917,6876683:pet_clair:4207:6877191,6876685:pet_clair:4207:6877011,6876686:pet_clair:4207:6877046,6886258:pet_clair:4207:6886875,6887695:pet_clair:4207:6888290,6889190:pet_clair:4207:6891353,6895749:pet_clair:4207:6896153,6898175:pet_clair:4207:6898498,6904057:pet_clair:4207:6904509,6906036:pet_clair:4207:6907044,6917033:pet_clair:4207:6917257,6921897:pet_clair:4207:6922719,6'}, {'unwanted_material': 'pet_clair', 'main_material': 'emr', 'pht_type': 4209, 'ratio': 0.00038788845724592604, 'nb_photo': 52, 'list_port_cont': '6613103,6648162,6655833,6657176,6658378,6660889,6666083,6666651,6666947,6668915,6669550,6669705,6669777,6671157,6700228,6704711,6706879,6709548,6712610,6720621,6722887,6723439,6744920,6748621,6748942,6761453,6774102,6776478,6837016,6841130,6846026,6853934', 'assoc_port': '6612572:6613103,6630822:6666083,6631385:6668915,6631618:6669777,6632901:6671157,6635653:6660889,6647202:6648162,6655088:6655833,6656505:6657176,6656506:6658378,6665067:6666947,6665718:6666651,6668654:6669705,6668657:6669550,6699726:6700228,6700555:6704711,6706262:6706879,6707499:6709548,6708643:6712610,6720202:6720621,6722573:6722887,6723094:6723439,6744086:6744920,6747584:6748621,6748313:6748942,6761126:6761453,6773386:6774102,6776077:6776478,6836050:6837016,6840554:6841130,6845438:6846026,6852534:6853934', 'assoc_mat': '6612572:pet_clair:4209:6613103,6630822:pet_clair:4209:6666083,6631385:pet_clair:4209:6668915,6631618:pet_clair:4209:6669777,6632901:pet_clair:4209:6671157,6635653:pet_clair:4209:6660889,6647202:pet_clair:4209:6648162,6655088:pet_clair:4209:6655833,6656505:pet_clair:4209:6657176,6656506:pet_clair:4209:6658378,6665067:pet_clair:4209:6666947,6665718:pet_clair:4209:6666651,6668654:pet_clair:4209:6669705,6668657:pet_clair:4209:6669550,6699726:pet_clair:4209:6700228,6700555:pet_clair:4209:6704711,6706262:pet_clair:4209:6706879,6707499:pet_clair:4209:6709548,6708643:pet_clair:4209:6712610,6720202:pet_clair:4209:6720621,6722573:pet_clair:4209:6722887,6723094:pet_clair:4209:6723439,6744086:pet_clair:4209:6744920,6747584:pet_clair:4209:6748621,6748313:pet_clair:4209:6748942,6761126:pet_clair:4209:6761453,6773386:pet_clair:4209:6774102,6776077:pet_clair:4209:6776478,6836050:pet_clair:4209:6837016,6840554:pet_clair:4209:6841130,6845438:pet_clair:4209:6846026,6852534:pet_clair:4209:6853934'}, {'unwanted_material': 'pet_clair', 'main_material': 'gm', 'pht_type': 4209, 'ratio': 0.00042088720046359597, 'nb_photo': 1, 'list_port_cont': '6862605', 'assoc_port': '6861515:6862605', 'assoc_mat': '6861515:pet_clair:4209:6862605'}, {'unwanted_material': 'pet_fonce', 'main_material': 'emr', 'pht_type': 4207, 'ratio': 0.0008578698895049885, 'nb_photo': 28, 'list_port_cont': '6860798,6861839,6862207,6868256,6868671,6869549,6877674,6877708,6877816,6877879,6878008,6886869,6888301,6889467,6898496,6904520,6915175,6922716', 'assoc_port': '6832753:6877879,6834821:6878008,6838973:6877674,6840554:6877708,6842390:6877816,6846972:6869549,6851003:6868671,6855642:6860798,6859123:6861839,6861516:6868256,6861524:6862207,6886258:6886869,6887695:6888301,6887698:6889467,6898175:6898496,6904057:6904520,6914259:6915175,6921897:6922716', 'assoc_mat': '6832753:pet_fonce:4207:6877879,6834821:pet_fonce:4207:6878008,6838973:pet_fonce:4207:6877674,6840554:pet_fonce:4207:6877708,6842390:pet_fonce:4207:6877816,6846972:pet_fonce:4207:6869549,6851003:pet_fonce:4207:6868671,6855642:pet_fonce:4207:6860798,6859123:pet_fonce:4207:6861839,6861516:pet_fonce:4207:6868256,6861524:pet_fonce:4207:6862207,6886258:pet_fonce:4207:6886869,6887695:pet_fonce:4207:6888301,6887698:pet_fonce:4207:6889467,6898175:pet_fonce:4207:6898496,6904057:pet_fonce:4207:6904520,6914259:pet_fonce:4207:6915175,6921897:pet_fonce:4207:6922716'}, {'unwanted_material': 'pet_fonce', 'main_material': 'emr', 'pht_type': 4209, 'ratio': 0.002001176734086916, 'nb_photo': 165, 'list_port_cont': '6613106,6614596,6626457,6628830,6629210,6635370,6641607,6642548,6644426,6646347,6647448,6648893,6654377,6659140,6659225,6660883,6661079,6664546,6664700,6665227,6666079,6666644,6666756,6666950,6668662,6669252,6669485,6669785,6671575,6674270,6678461,6683425,6683978,6702227,6704714,6706892,6708972,6709423,6709577,6711293,6712608,6718881,6719276,6719647,6720634,6722892,6723506,6744910,6748597,6762003,6774109,6776983,6841135,6842934,6847565,6859391', 'assoc_port': '6612572:6613106,6614336:6614596,6625827:6626457,6628455:6628830,6628736:6629210,6630577:6664546,6630578:6664700,6630581:6665227,6630822:6666079,6631384:6668662,6631618:6669785,6633545:6635370,6635651:6661079,6635653:6660883,6639123:6644426,6639695:6642548,6640928:6641607,6645791:6646347,6646682:6647448,6648217:6648893,6652800:6654377,6657819:6659140,6659025:6659225,6665067:6666950,6665718:6666644,6665719:6666756,6668655:6669252,6668656:6669485,6670886:6671575,6673850:6674270,6678032:6678461,6682633:6683425,6683289:6683978,6700555:6704714,6701501:6702227,6706262:6706892,6706760:6709423,6707163:6708972,6707499:6709577,6708643:6712608,6708644:6711293,6718520:6719276,6718521:6718881,6719441:6719647,6720202:6720634,6722573:6722892,6723192:6723506,6744086:6744910,6747584:6748597,6759349:6762003,6773386:6774109,6775574:6776983,6840554:6841135,6842390:6842934,6846972:6847565,6859123:6859391', 'assoc_mat': '6612572:pet_fonce:4209:6613106,6614336:pet_fonce:4209:6614596,6625827:pet_fonce:4209:6626457,6628455:pet_fonce:4209:6628830,6628736:pet_fonce:4209:6629210,6630577:pet_fonce:4209:6664546,6630578:pet_fonce:4209:6664700,6630581:pet_fonce:4209:6665227,6630822:pet_fonce:4209:6666079,6631384:pet_fonce:4209:6668662,6631618:pet_fonce:4209:6669785,6633545:pet_fonce:4209:6635370,6635651:pet_fonce:4209:6661079,6635653:pet_fonce:4209:6660883,6639123:pet_fonce:4209:6644426,6639695:pet_fonce:4209:6642548,6640928:pet_fonce:4209:6641607,6645791:pet_fonce:4209:6646347,6646682:pet_fonce:4209:6647448,6648217:pet_fonce:4209:6648893,6652800:pet_fonce:4209:6654377,6657819:pet_fonce:4209:6659140,6659025:pet_fonce:4209:6659225,6665067:pet_fonce:4209:6666950,6665718:pet_fonce:4209:6666644,6665719:pet_fonce:4209:6666756,6668655:pet_fonce:4209:6669252,6668656:pet_fonce:4209:6669485,6670886:pet_fonce:4209:6671575,6673850:pet_fonce:4209:6674270,6678032:pet_fonce:4209:6678461,6682633:pet_fonce:4209:6683425,6683289:pet_fonce:4209:6683978,6'}, {'unwanted_material': 'pet_fonce', 'main_material': 'gm', 'pht_type': 4209, 'ratio': 0.0009882492230258019, 'nb_photo': 2, 'list_port_cont': '6894805', 'assoc_port': '6894658:6894805', 'assoc_mat': '6894658:pet_fonce:4209:6894805'}, {'unwanted_material': 'pet_fonce', 'main_material': 'pet_fonce', 'pht_type': 4200, 'ratio': 0.9832720072705387, 'nb_photo': 21, 'list_port_cont': '6647700,6861697', 'assoc_port': '6647200:6647700,6861521:6861697', 'assoc_mat': '6647200:pet_fonce:4200:6647700,6861521:pet_fonce:4200:6861697'}, {'unwanted_material': 'pet_opaque', 'main_material': 'emr', 'pht_type': 4207, 'ratio': 0.0006428090611349251, 'nb_photo': 9, 'list_port_cont': '6866496,6868369,6869096,6869546,6878036,6904487,6905142,6905991,6922715', 'assoc_port': '6833565:6878036,6846972:6869546,6852533:6869096,6861517:6868369,6864855:6866496,6903710:6905991,6903712:6904487,6905102:6905142,6921897:6922715', 'assoc_mat': '6833565:pet_opaque:4207:6878036,6846972:pet_opaque:4207:6869546,6852533:pet_opaque:4207:6869096,6861517:pet_opaque:4207:6868369,6864855:pet_opaque:4207:6866496,6903710:pet_opaque:4207:6905991,6903712:pet_opaque:4207:6904487,6905102:pet_opaque:4207:6905142,6921897:pet_opaque:4207:6922715'}, {'unwanted_material': 'pet_opaque', 'main_material': 'emr', 'pht_type': 4209, 'ratio': 0.0005744915736568625, 'nb_photo': 214, 'list_port_cont': '6613105,6614118,6616031,6627858,6628408,6628839,6629216,6629282,6635308,6635367,6639706,6640660,6641595,6644422,6647441,6655823,6657172,6658373,6659149,6660897,6661077,6664543,6664634,6664804,6664940,6665229,6666078,6666656,6666757,6666952,6667994,6668664,6668914,6669254,6669547,6669695,6669784,6669814,6670110,6671566,6671848,6672292,6674152,6676774,6678456,6681180,6683428,6683979,6700223,6704719,6706884,6709575,6711305,6712607,6718352,6718715,6719280,6719890,6720396,6722151,6722589,6722891,6723435,6744915,6748617,6748952,6749035,6760254,6761440,6774110,6776978,6813183,6834135,6834365,6834702,6835809,6839582,6841141,6842938,6853225,6853523,6859402', 'assoc_port': '6612572:6613105,6613636:6614118,6614891:6616031,6627447:6627858,6627801:6628408,6627802:6629282,6628455:6628839,6628736:6629216,6630577:6664543,6630579:6664634,6630580:6664940,6630581:6665229,6630822:6666078,6631154:6667994,6631384:6668664,6631385:6668914,6631618:6669784,6631619:6669814,6631901:6670110,6633543:6635308,6633544:6671848,6633545:6635367,6633546:6672292,6635651:6661077,6635653:6660897,6639123:6644422,6639124:6639706,6640066:6640660,6640928:6641595,6646682:6647441,6655088:6655823,6656505:6657172,6656506:6658373,6657819:6659149,6663042:6664804,6665067:6666952,6665718:6666656,6665719:6666757,6668654:6669695,6668655:6669254,6668657:6669547,6670886:6671566,6671756:6676774,6673385:6674152,6678032:6678456,6680947:6681180,6682633:6683428,6683289:6683979,6699726:6700223,6700555:6704719,6706262:6706884,6707499:6709575,6708643:6712607,6708644:6711305,6715973:6718352,6716500:6718715,6717201:6719890,6718520:6719280,6719951:6720396,6721826:6722589,6721827:6722151,6722573:6722891,6723094:6723435,6744086:6744915,', 'assoc_mat': '6612572:pet_opaque:4209:6613105,6613636:pet_opaque:4209:6614118,6614891:pet_opaque:4209:6616031,6627447:pet_opaque:4209:6627858,6627801:pet_opaque:4209:6628408,6627802:pet_opaque:4209:6629282,6628455:pet_opaque:4209:6628839,6628736:pet_opaque:4209:6629216,6630577:pet_opaque:4209:6664543,6630579:pet_opaque:4209:6664634,6630580:pet_opaque:4209:6664940,6630581:pet_opaque:4209:6665229,6630822:pet_opaque:4209:6666078,6631154:pet_opaque:4209:6667994,6631384:pet_opaque:4209:6668664,6631385:pet_opaque:4209:6668914,6631618:pet_opaque:4209:6669784,6631619:pet_opaque:4209:6669814,6631901:pet_opaque:4209:6670110,6633543:pet_opaque:4209:6635308,6633544:pet_opaque:4209:6671848,6633545:pet_opaque:4209:6635367,6633546:pet_opaque:4209:6672292,6635651:pet_opaque:4209:6661077,6635653:pet_opaque:4209:6660897,6639123:pet_opaque:4209:6644422,6639124:pet_opaque:4209:6639706,6640066:pet_opaque:4209:6640660,6640928:pet_opaque:4209:6641595,6646682:pet_opaque:4209:6647441,6655088:pet_opaque:4209:6655823,6656505:pet_opaque:4209:6657172,'}) select count(distinct mtr_photo_id) from MTRUser.mtr_portfolio_photos where mtr_portfolio_id in (select mtr_portfolio_id from MTRPhoto.dashboard_results where dashboard_run_id in(448643,449568,454450,454465,454459,454472,456239,458795,461498,454567,457375,457649,459844,460382,461634,463066,472528,465865,469297,468129,475039,472453,474892,474538,475316,476524,479832,481665,479903)); after get_hostname_from_raspi hasthag : emr hasthag that could be used but not yet : _______carton,background hasthag : jrm hasthag that could be used but not yet : _______papier,background hasthag : aluminium hasthag that could be used but not yet : _______metal,background hasthag : pet_fonce hasthag that could be used but not yet : _______pet_fonce,background hasthag : gm hasthag that could be used but not yet : _______papier,background after impurety_average_per_hashtag VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11488 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11496 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11497 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11492 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11492 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11495 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11495 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11489 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11489 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11575 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11575 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11491 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11490 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11490 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11498 send_mail_cod have less outputs used (0) than in the step definition (1) : some outputs may be not used ! Step 11499 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11491 doesn't seem to be define in the database( WARNING : type of input 3 of step 11490 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11488 doesn't seem to be define in the database( WARNING : type of input 2 of step 11492 doesn't seem to be define in the database( WARNING : output 1 of step 11488 have datatype=2 whereas input 1 of step 11495 have datatype=7 WARNING : type of output 2 of step 11495 doesn't seem to be define in the database( WARNING : type of input 1 of step 11489 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11491 have datatype=10 whereas input 3 of step 11498 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11575 doesn't seem to be define in the database( WARNING : output 1 of step 11489 have datatype=7 whereas input 2 of step 11575 have datatype=None WARNING : type of output 3 of step 11575 doesn't seem to be define in the database( WARNING : type of input 1 of step 11491 doesn't seem to be define in the database( WARNING : output 0 of step 11491 have datatype=10 whereas input 0 of step 11581 have datatype=18 WARNING : type of input 5 of step 11498 doesn't seem to be define in the database( WARNING : output 0 of step 11581 have datatype=11 whereas input 5 of step 11498 have datatype=None WARNING : type of output 1 of step 11496 doesn't seem to be define in the database( WARNING : type of input 3 of step 11492 doesn't seem to be define in the database( WARNING : type of output 1 of step 11497 doesn't seem to be define in the database( WARNING : type of input 3 of step 11492 doesn't seem to be define in the database( WARNING : output 0 of step 11495 have datatype=1 whereas input 0 of step 11489 have datatype=2 DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4209, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,metal,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'papier,background', 'hashtag_weights': {'barquette_opaque': 0.7, 'carton': 0.7, 'ela': 0.7, 'etiquette': 0.5, 'film_plastique': 0.5, 'kraft': 0.7, 'metal': 1.5, 'pehd': 0.7, 'pet_clair': 0.7, 'pet_opaque': 0.7, 'textiles_sanitaires': 0.5, 'pet_fonce': 0.7}, 'ETA': 600} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4207, 'hashtag_proportion': 'barquette_opaque,ela,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'carton,background', 'hashtag_weights': {'barquette_opaque': 1, 'ela': 1, 'etiquette': 1.0, 'film_plastique': 0.5, 'kraft': 1, 'metal': 3.0, 'papier': 1, 'pehd': 2, 'pet_clair': 2, 'pet_opaque': 2, 'textiles_sanitaires': 1.0, 'pet_fonce': 2}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3726, 'hashtag_proportion': 'Carton_brun,Carton_gris,Teint_Dans_La_Masse,autre_refus,cartonnette,kraft,metal,plastique', 'hashtag_parmi': 'papier,background', 'hashtag_weights': {'Carton_brun': 1.5, 'Carton_gris': 1.5, 'Teint_Dans_La_Masse': 1.0, 'autre_refus': 1.5, 'cartonnette': 1.0, 'kraft': 1.5, 'metal': 3, 'plastique': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11512 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11521 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11520 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11516 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11516 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11519 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11519 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11513 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11513 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11577 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11577 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11515 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11514 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11514 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11523 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11515 doesn't seem to be define in the database( WARNING : type of input 3 of step 11514 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11512 doesn't seem to be define in the database( WARNING : type of input 2 of step 11516 doesn't seem to be define in the database( WARNING : output 1 of step 11512 have datatype=2 whereas input 1 of step 11519 have datatype=7 WARNING : type of output 2 of step 11519 doesn't seem to be define in the database( WARNING : type of input 1 of step 11513 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11515 have datatype=10 whereas input 3 of step 11522 have datatype=6 WARNING : type of input 2 of step 11577 doesn't seem to be define in the database( WARNING : output 1 of step 11513 have datatype=7 whereas input 2 of step 11577 have datatype=None WARNING : type of output 3 of step 11577 doesn't seem to be define in the database( WARNING : type of input 1 of step 11515 doesn't seem to be define in the database( WARNING : output 0 of step 11515 have datatype=10 whereas input 0 of step 11583 have datatype=18 WARNING : type of input 5 of step 11522 doesn't seem to be define in the database( WARNING : output 0 of step 11583 have datatype=11 whereas input 5 of step 11522 have datatype=None WARNING : type of output 1 of step 11521 doesn't seem to be define in the database( WARNING : type of input 3 of step 11516 doesn't seem to be define in the database( WARNING : type of output 1 of step 11520 doesn't seem to be define in the database( WARNING : type of input 3 of step 11516 doesn't seem to be define in the database( WARNING : output 0 of step 11519 have datatype=1 whereas input 0 of step 11513 have datatype=2 DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4203, 'hashtag_proportion': 'barquette_opaque,carton,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'ela,background', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 1, 'etiquette': 0.5, 'film_plastique': 0.5, 'kraft': 0.8, 'metal': 2, 'papier': 0.8, 'pehd': 0.8, 'pet_clair': 0.8, 'pet_opaque': 0.8, 'textiles_sanitaires': 0.5, 'pet_fonce': 0.8}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11524 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11533 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11532 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11528 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11528 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11531 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11531 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11525 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11525 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11578 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11578 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11527 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11526 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11526 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11535 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11527 doesn't seem to be define in the database( WARNING : type of input 3 of step 11526 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11524 doesn't seem to be define in the database( WARNING : type of input 2 of step 11528 doesn't seem to be define in the database( WARNING : output 1 of step 11524 have datatype=2 whereas input 1 of step 11531 have datatype=7 WARNING : type of output 2 of step 11531 doesn't seem to be define in the database( WARNING : type of input 1 of step 11525 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11527 have datatype=10 whereas input 3 of step 11534 have datatype=6 WARNING : type of input 2 of step 11578 doesn't seem to be define in the database( WARNING : output 1 of step 11525 have datatype=7 whereas input 2 of step 11578 have datatype=None WARNING : type of output 3 of step 11578 doesn't seem to be define in the database( WARNING : type of input 1 of step 11527 doesn't seem to be define in the database( WARNING : output 0 of step 11527 have datatype=10 whereas input 0 of step 11584 have datatype=18 WARNING : type of input 5 of step 11534 doesn't seem to be define in the database( WARNING : output 0 of step 11584 have datatype=11 whereas input 5 of step 11534 have datatype=None WARNING : type of output 1 of step 11533 doesn't seem to be define in the database( WARNING : type of input 3 of step 11528 doesn't seem to be define in the database( WARNING : type of output 1 of step 11532 doesn't seem to be define in the database( WARNING : type of input 3 of step 11528 doesn't seem to be define in the database( WARNING : output 0 of step 11531 have datatype=1 whereas input 0 of step 11525 have datatype=2 DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4211, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,metal,papier,pet_fonce,pet_clair,pet_opaque,textiles_sanitaires', 'hashtag_parmi': 'pehd,background', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 0.3, 'ela': 0.3, 'etiquette': 0.1, 'film_plastique': 0.1, 'kraft': 0.3, 'metal': 1.5, 'papier': 0.3, 'pet_clair': 0.3, 'pet_opaque': 0.3, 'textiles_sanitaires': 0.3, 'pet_fonce': 0.3, 'background': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11548 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11556 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11557 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11552 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11552 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11555 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11555 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11580 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11580 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11551 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11550 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11550 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11559 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11551 doesn't seem to be define in the database( WARNING : type of input 3 of step 11550 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11548 doesn't seem to be define in the database( WARNING : type of input 2 of step 11552 doesn't seem to be define in the database( WARNING : output 1 of step 11548 have datatype=2 whereas input 1 of step 11555 have datatype=7 WARNING : type of output 2 of step 11555 doesn't seem to be define in the database( WARNING : type of input 1 of step 11549 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11551 have datatype=10 whereas input 3 of step 11558 have datatype=6 WARNING : type of input 2 of step 11580 doesn't seem to be define in the database( WARNING : output 1 of step 11549 have datatype=7 whereas input 2 of step 11580 have datatype=None WARNING : type of output 3 of step 11580 doesn't seem to be define in the database( WARNING : type of input 1 of step 11551 doesn't seem to be define in the database( WARNING : output 0 of step 11551 have datatype=10 whereas input 0 of step 11586 have datatype=18 WARNING : type of input 5 of step 11558 doesn't seem to be define in the database( WARNING : output 0 of step 11586 have datatype=11 whereas input 5 of step 11558 have datatype=None WARNING : type of output 1 of step 11556 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : type of output 1 of step 11557 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : output 0 of step 11555 have datatype=1 whereas input 0 of step 11549 have datatype=2 DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4200, 'hashtag_proportion': 'carton,ela,etiquette,film_plastique,kraft,metal,papier,pehd,pet_opaque,textiles_sanitaires,barquette_opaque,pet_clair', 'hashtag_parmi': 'pet_fonce,background', 'hashtag_weights': {'barquette_opaque': 1.5, 'carton': 2.5, 'ela': 1.5, 'etiquette': 1.5, 'film_plastique': 1, 'kraft': 1.5, 'metal': 3.0, 'papier': 1.2, 'pehd': 1.5, 'pet_clair': 1.5, 'pet_opaque': 1.5, 'textiles_sanitaires': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11536 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11545 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11544 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11540 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11540 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11543 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11543 merge_mask_thcl_custom have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 11537 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11579 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11579 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11539 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11538 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11538 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11547 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11539 doesn't seem to be define in the database( WARNING : type of input 3 of step 11538 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11536 doesn't seem to be define in the database( WARNING : type of input 2 of step 11540 doesn't seem to be define in the database( WARNING : output 1 of step 11536 have datatype=2 whereas input 1 of step 11543 have datatype=7 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11539 have datatype=10 whereas input 3 of step 11546 have datatype=6 WARNING : type of input 2 of step 11579 doesn't seem to be define in the database( WARNING : output 1 of step 11537 have datatype=7 whereas input 2 of step 11579 have datatype=None WARNING : type of output 3 of step 11579 doesn't seem to be define in the database( WARNING : type of input 1 of step 11539 doesn't seem to be define in the database( WARNING : output 0 of step 11539 have datatype=10 whereas input 0 of step 11585 have datatype=18 WARNING : type of input 5 of step 11546 doesn't seem to be define in the database( WARNING : output 0 of step 11585 have datatype=11 whereas input 5 of step 11546 have datatype=None WARNING : type of output 1 of step 11545 doesn't seem to be define in the database( WARNING : type of input 3 of step 11540 doesn't seem to be define in the database( WARNING : type of output 1 of step 11544 doesn't seem to be define in the database( WARNING : type of input 3 of step 11540 doesn't seem to be define in the database( WARNING : output 0 of step 11543 have datatype=1 whereas input 0 of step 11537 have datatype=2 DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4205, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'metal,background', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 1.5, 'ela': 1.5, 'etiquette': 1, 'film_plastique': 1, 'kraft': 1, 'papier': 1, 'pehd': 1.5, 'pet_clair': 1.5, 'pet_opaque': 1.5, 'textiles_sanitaires': 1.5, 'pet_fonce': 1.5}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3594, 'hashtag_proportion': 'papier,carton,metal,pet_clair,autre,pehd,pet_fonce', 'hashtag_parmi': 'refus,background', 'hashtag_weights': {'papier': 1, 'carton': 1, 'metal': 1, 'pet_clair': 1, 'autre': 1, 'pehd': 1, 'pet_fonce': 1, 'refus': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11560 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11567 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11567 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11563 crop_condition is not consistent : 4 used against 2 in the step definition ! Step 11563 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11564 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11564 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11573 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11573 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11566 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11566 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 1 of step 11560 have datatype=2 whereas input 1 of step 11564 have datatype=7 WARNING : type of output 2 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11565 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11567 doesn't seem to be define in the database( WARNING : type of input 3 of step 11563 doesn't seem to be define in the database( WARNING : type of output 3 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11568 doesn't seem to be define in the database( WARNING : type of output 1 of step 11568 doesn't seem to be define in the database( WARNING : type of input 3 of step 11566 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11570 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11569 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11570 doesn't seem to be define in the database( WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11569 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11568 have datatype=10 whereas input 3 of step 11571 have datatype=6 WARNING : type of input 2 of step 11573 doesn't seem to be define in the database( WARNING : output 1 of step 11565 have datatype=7 whereas input 2 of step 11573 have datatype=None WARNING : type of output 3 of step 11573 doesn't seem to be define in the database( WARNING : type of input 3 of step 11568 doesn't seem to be define in the database( WARNING : output 0 of step 11568 have datatype=10 whereas input 0 of step 11587 have datatype=18 WARNING : type of input 5 of step 11571 doesn't seem to be define in the database( WARNING : output 0 of step 11587 have datatype=11 whereas input 5 of step 11571 have datatype=None WARNING : output 0 of step 11564 have datatype=1 whereas input 0 of step 11565 have datatype=2 DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3327, 'hashtag_proportion': 'autre,carton,metal,papier,pehd,pet_fonce', 'hashtag_parmi': 'pet_clair,bouchon,etiquette,barquette_avec_film,background', 'hashtag_weights': {'autre': 8.0, 'barquette_avec_film': 6, 'carton': 8.0, 'metal': 12, 'papier': 5, 'pehd': 8, 'pet_fonce': 8, 'bouchon': 8, 'etiquette': 8}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier TODO : Insert select and so on # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11488 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11496 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11497 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11492 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11492 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11495 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11495 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11489 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11489 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11575 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11575 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11491 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11490 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11490 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11498 send_mail_cod have less outputs used (0) than in the step definition (1) : some outputs may be not used ! Step 11499 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11491 doesn't seem to be define in the database( WARNING : type of input 3 of step 11490 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11488 doesn't seem to be define in the database( WARNING : type of input 2 of step 11492 doesn't seem to be define in the database( WARNING : output 1 of step 11488 have datatype=2 whereas input 1 of step 11495 have datatype=7 WARNING : type of output 2 of step 11495 doesn't seem to be define in the database( WARNING : type of input 1 of step 11489 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11491 have datatype=10 whereas input 3 of step 11498 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11575 doesn't seem to be define in the database( WARNING : output 1 of step 11489 have datatype=7 whereas input 2 of step 11575 have datatype=None WARNING : type of output 3 of step 11575 doesn't seem to be define in the database( WARNING : type of input 1 of step 11491 doesn't seem to be define in the database( WARNING : output 0 of step 11491 have datatype=10 whereas input 0 of step 11581 have datatype=18 WARNING : type of input 5 of step 11498 doesn't seem to be define in the database( WARNING : output 0 of step 11581 have datatype=11 whereas input 5 of step 11498 have datatype=None WARNING : type of output 1 of step 11496 doesn't seem to be define in the database( WARNING : type of input 3 of step 11492 doesn't seem to be define in the database( WARNING : type of output 1 of step 11497 doesn't seem to be define in the database( WARNING : type of input 3 of step 11492 doesn't seem to be define in the database( WARNING : output 0 of step 11495 have datatype=1 whereas input 0 of step 11489 have datatype=2 DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4209, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,metal,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'papier,background', 'hashtag_weights': {'barquette_opaque': 0.7, 'carton': 0.7, 'ela': 0.7, 'etiquette': 0.5, 'film_plastique': 0.5, 'kraft': 0.7, 'metal': 1.5, 'pehd': 0.7, 'pet_clair': 0.7, 'pet_opaque': 0.7, 'textiles_sanitaires': 0.5, 'pet_fonce': 0.7}, 'ETA': 600} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4207, 'hashtag_proportion': 'barquette_opaque,ela,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'carton,background', 'hashtag_weights': {'barquette_opaque': 1, 'ela': 1, 'etiquette': 1.0, 'film_plastique': 0.5, 'kraft': 1, 'metal': 3.0, 'papier': 1, 'pehd': 2, 'pet_clair': 2, 'pet_opaque': 2, 'textiles_sanitaires': 1.0, 'pet_fonce': 2}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3726, 'hashtag_proportion': 'Carton_brun,Carton_gris,Teint_Dans_La_Masse,autre_refus,cartonnette,kraft,metal,plastique', 'hashtag_parmi': 'papier,background', 'hashtag_weights': {'Carton_brun': 1.5, 'Carton_gris': 1.5, 'Teint_Dans_La_Masse': 1.0, 'autre_refus': 1.5, 'cartonnette': 1.0, 'kraft': 1.5, 'metal': 3, 'plastique': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11512 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11521 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11520 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11516 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11516 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11519 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11519 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11513 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11513 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11577 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11577 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11515 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11514 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11514 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11523 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11515 doesn't seem to be define in the database( WARNING : type of input 3 of step 11514 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11512 doesn't seem to be define in the database( WARNING : type of input 2 of step 11516 doesn't seem to be define in the database( WARNING : output 1 of step 11512 have datatype=2 whereas input 1 of step 11519 have datatype=7 WARNING : type of output 2 of step 11519 doesn't seem to be define in the database( WARNING : type of input 1 of step 11513 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11515 have datatype=10 whereas input 3 of step 11522 have datatype=6 WARNING : type of input 2 of step 11577 doesn't seem to be define in the database( WARNING : output 1 of step 11513 have datatype=7 whereas input 2 of step 11577 have datatype=None WARNING : type of output 3 of step 11577 doesn't seem to be define in the database( WARNING : type of input 1 of step 11515 doesn't seem to be define in the database( WARNING : output 0 of step 11515 have datatype=10 whereas input 0 of step 11583 have datatype=18 WARNING : type of input 5 of step 11522 doesn't seem to be define in the database( WARNING : output 0 of step 11583 have datatype=11 whereas input 5 of step 11522 have datatype=None WARNING : type of output 1 of step 11521 doesn't seem to be define in the database( WARNING : type of input 3 of step 11516 doesn't seem to be define in the database( WARNING : type of output 1 of step 11520 doesn't seem to be define in the database( WARNING : type of input 3 of step 11516 doesn't seem to be define in the database( WARNING : output 0 of step 11519 have datatype=1 whereas input 0 of step 11513 have datatype=2 DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4203, 'hashtag_proportion': 'barquette_opaque,carton,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'ela,background', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 1, 'etiquette': 0.5, 'film_plastique': 0.5, 'kraft': 0.8, 'metal': 2, 'papier': 0.8, 'pehd': 0.8, 'pet_clair': 0.8, 'pet_opaque': 0.8, 'textiles_sanitaires': 0.5, 'pet_fonce': 0.8}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11524 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11533 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11532 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11528 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11528 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11531 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11531 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11525 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11525 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11578 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11578 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11527 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11526 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11526 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11535 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11527 doesn't seem to be define in the database( WARNING : type of input 3 of step 11526 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11524 doesn't seem to be define in the database( WARNING : type of input 2 of step 11528 doesn't seem to be define in the database( WARNING : output 1 of step 11524 have datatype=2 whereas input 1 of step 11531 have datatype=7 WARNING : type of output 2 of step 11531 doesn't seem to be define in the database( WARNING : type of input 1 of step 11525 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11527 have datatype=10 whereas input 3 of step 11534 have datatype=6 WARNING : type of input 2 of step 11578 doesn't seem to be define in the database( WARNING : output 1 of step 11525 have datatype=7 whereas input 2 of step 11578 have datatype=None WARNING : type of output 3 of step 11578 doesn't seem to be define in the database( WARNING : type of input 1 of step 11527 doesn't seem to be define in the database( WARNING : output 0 of step 11527 have datatype=10 whereas input 0 of step 11584 have datatype=18 WARNING : type of input 5 of step 11534 doesn't seem to be define in the database( WARNING : output 0 of step 11584 have datatype=11 whereas input 5 of step 11534 have datatype=None WARNING : type of output 1 of step 11533 doesn't seem to be define in the database( WARNING : type of input 3 of step 11528 doesn't seem to be define in the database( WARNING : type of output 1 of step 11532 doesn't seem to be define in the database( WARNING : type of input 3 of step 11528 doesn't seem to be define in the database( WARNING : output 0 of step 11531 have datatype=1 whereas input 0 of step 11525 have datatype=2 DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4211, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,metal,papier,pet_fonce,pet_clair,pet_opaque,textiles_sanitaires', 'hashtag_parmi': 'pehd,background', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 0.3, 'ela': 0.3, 'etiquette': 0.1, 'film_plastique': 0.1, 'kraft': 0.3, 'metal': 1.5, 'papier': 0.3, 'pet_clair': 0.3, 'pet_opaque': 0.3, 'textiles_sanitaires': 0.3, 'pet_fonce': 0.3, 'background': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11548 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11556 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11557 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11552 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11552 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11555 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11555 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11580 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11580 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11551 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11550 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11550 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11559 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11551 doesn't seem to be define in the database( WARNING : type of input 3 of step 11550 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11548 doesn't seem to be define in the database( WARNING : type of input 2 of step 11552 doesn't seem to be define in the database( WARNING : output 1 of step 11548 have datatype=2 whereas input 1 of step 11555 have datatype=7 WARNING : type of output 2 of step 11555 doesn't seem to be define in the database( WARNING : type of input 1 of step 11549 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11551 have datatype=10 whereas input 3 of step 11558 have datatype=6 WARNING : type of input 2 of step 11580 doesn't seem to be define in the database( WARNING : output 1 of step 11549 have datatype=7 whereas input 2 of step 11580 have datatype=None WARNING : type of output 3 of step 11580 doesn't seem to be define in the database( WARNING : type of input 1 of step 11551 doesn't seem to be define in the database( WARNING : output 0 of step 11551 have datatype=10 whereas input 0 of step 11586 have datatype=18 WARNING : type of input 5 of step 11558 doesn't seem to be define in the database( WARNING : output 0 of step 11586 have datatype=11 whereas input 5 of step 11558 have datatype=None WARNING : type of output 1 of step 11556 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : type of output 1 of step 11557 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : output 0 of step 11555 have datatype=1 whereas input 0 of step 11549 have datatype=2 DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4200, 'hashtag_proportion': 'carton,ela,etiquette,film_plastique,kraft,metal,papier,pehd,pet_opaque,textiles_sanitaires,barquette_opaque,pet_clair', 'hashtag_parmi': 'pet_fonce,background', 'hashtag_weights': {'barquette_opaque': 1.5, 'carton': 2.5, 'ela': 1.5, 'etiquette': 1.5, 'film_plastique': 1, 'kraft': 1.5, 'metal': 3.0, 'papier': 1.2, 'pehd': 1.5, 'pet_clair': 1.5, 'pet_opaque': 1.5, 'textiles_sanitaires': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11536 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11545 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11544 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11540 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11540 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11543 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11543 merge_mask_thcl_custom have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 11537 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11579 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11579 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11539 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11538 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11538 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11547 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11539 doesn't seem to be define in the database( WARNING : type of input 3 of step 11538 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11536 doesn't seem to be define in the database( WARNING : type of input 2 of step 11540 doesn't seem to be define in the database( WARNING : output 1 of step 11536 have datatype=2 whereas input 1 of step 11543 have datatype=7 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11539 have datatype=10 whereas input 3 of step 11546 have datatype=6 WARNING : type of input 2 of step 11579 doesn't seem to be define in the database( WARNING : output 1 of step 11537 have datatype=7 whereas input 2 of step 11579 have datatype=None WARNING : type of output 3 of step 11579 doesn't seem to be define in the database( WARNING : type of input 1 of step 11539 doesn't seem to be define in the database( WARNING : output 0 of step 11539 have datatype=10 whereas input 0 of step 11585 have datatype=18 WARNING : type of input 5 of step 11546 doesn't seem to be define in the database( WARNING : output 0 of step 11585 have datatype=11 whereas input 5 of step 11546 have datatype=None WARNING : type of output 1 of step 11545 doesn't seem to be define in the database( WARNING : type of input 3 of step 11540 doesn't seem to be define in the database( WARNING : type of output 1 of step 11544 doesn't seem to be define in the database( WARNING : type of input 3 of step 11540 doesn't seem to be define in the database( WARNING : output 0 of step 11543 have datatype=1 whereas input 0 of step 11537 have datatype=2 DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4205, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'metal,background', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 1.5, 'ela': 1.5, 'etiquette': 1, 'film_plastique': 1, 'kraft': 1, 'papier': 1, 'pehd': 1.5, 'pet_clair': 1.5, 'pet_opaque': 1.5, 'textiles_sanitaires': 1.5, 'pet_fonce': 1.5}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3594, 'hashtag_proportion': 'papier,carton,metal,pet_clair,autre,pehd,pet_fonce', 'hashtag_parmi': 'refus,background', 'hashtag_weights': {'papier': 1, 'carton': 1, 'metal': 1, 'pet_clair': 1, 'autre': 1, 'pehd': 1, 'pet_fonce': 1, 'refus': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11560 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11567 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11567 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11563 crop_condition is not consistent : 4 used against 2 in the step definition ! Step 11563 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11564 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11564 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11573 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11573 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11566 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11566 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 1 of step 11560 have datatype=2 whereas input 1 of step 11564 have datatype=7 WARNING : type of output 2 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11565 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11567 doesn't seem to be define in the database( WARNING : type of input 3 of step 11563 doesn't seem to be define in the database( WARNING : type of output 3 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11568 doesn't seem to be define in the database( WARNING : type of output 1 of step 11568 doesn't seem to be define in the database( WARNING : type of input 3 of step 11566 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11570 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11569 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11570 doesn't seem to be define in the database( WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11569 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11568 have datatype=10 whereas input 3 of step 11571 have datatype=6 WARNING : type of input 2 of step 11573 doesn't seem to be define in the database( WARNING : output 1 of step 11565 have datatype=7 whereas input 2 of step 11573 have datatype=None WARNING : type of output 3 of step 11573 doesn't seem to be define in the database( WARNING : type of input 3 of step 11568 doesn't seem to be define in the database( WARNING : output 0 of step 11568 have datatype=10 whereas input 0 of step 11587 have datatype=18 WARNING : type of input 5 of step 11571 doesn't seem to be define in the database( WARNING : output 0 of step 11587 have datatype=11 whereas input 5 of step 11571 have datatype=None WARNING : output 0 of step 11564 have datatype=1 whereas input 0 of step 11565 have datatype=2 DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3327, 'hashtag_proportion': 'autre,carton,metal,papier,pehd,pet_fonce', 'hashtag_parmi': 'pet_clair,bouchon,etiquette,barquette_avec_film,background', 'hashtag_weights': {'autre': 8.0, 'barquette_avec_film': 6, 'carton': 8.0, 'metal': 12, 'papier': 5, 'pehd': 8, 'pet_fonce': 8, 'bouchon': 8, 'etiquette': 8}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier filepath : /home/admin/workarea/git/Velours/python/prod/memo/sla_mensuel/sla_mensuel_Romainville_Presse_2_mois_08_annee_2022.pdf # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? {'emr': {'barquette_opaque': ['barquette_opaque', '0.01%', 44], 'carton': ['carton', '0.78%', 1462], 'ela': ['ela', '0.01%', 3], 'etiquette': ['etiquette', '0.08%', 1049], 'film_plastique': ['film_plastique', '0.01%', 9], 'kraft': ['kraft', '0.11%', 1], 'metal': ['metal', '2.6%', 787], 'papier': ['papier', '96.86%', 148871], 'pehd': ['pehd', '0.0%', 2], 'pet_clair': ['pet_clair', '0.04%', 52], 'pet_fonce': ['pet_fonce', '0.2%', 165], 'pet_opaque': ['pet_opaque', '0.06%', 214]}, 'aluminium': {'carton': ['carton', '1.02%', 16], 'metal': ['metal', '98.97%', 54], 'papier': ['papier', '0.13%', 9]}, 'gm': {'carton': ['carton', '0.29%', 10], 'etiquette': ['etiquette', '0.08%', 16], 'metal': ['metal', '3.43%', 14], 'papier': ['papier', '99.03%', 2955], 'pet_clair': ['pet_clair', '0.04%', 1], 'pet_fonce': ['pet_fonce', '0.1%', 2]}, 'pet_fonce': {'carton': ['carton', '0.59%', 4], 'etiquette': ['etiquette', '0.11%', 5], 'papier': ['papier', '1.02%', 31], 'pet_fonce': ['pet_fonce', '98.33%', 21]}} filepath : /home/admin/workarea/git/Velours/python/prod/memo/sla_mensuel/sla_mensuel_Romainville_Presse_2_mois_08_annee_2022.pdf hash: 9b473a9b7e6f69a2b2147971a7bf4221 for path: /home/admin/workarea/git/Velours/python/prod/memo/sla_mensuel/sla_mensuel_Romainville_Presse_2_mois_08_annee_2022.pdf voici le hostname : marlene hash: 9b473a9b7e6f69a2b2147971a7bf4221 for path: /home/admin/workarea/git/Velours/python/prod/memo/sla_mensuel/sla_mensuel_Romainville_Presse_2_mois_08_annee_2022.pdf ############################### TEST one_day ################################ TODO and TOTEST Removing /home/admin/workarea/git/Velours/python/prod/memo/sla_one_day nb_day : (3, 30) nb deleted : 3 VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11488 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11496 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11497 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11492 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11492 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11495 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11495 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11489 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11489 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11575 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11575 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11491 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11490 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11490 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11498 send_mail_cod have less outputs used (0) than in the step definition (1) : some outputs may be not used ! Step 11499 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11491 doesn't seem to be define in the database( WARNING : type of input 3 of step 11490 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11488 doesn't seem to be define in the database( WARNING : type of input 2 of step 11492 doesn't seem to be define in the database( WARNING : output 1 of step 11488 have datatype=2 whereas input 1 of step 11495 have datatype=7 WARNING : type of output 2 of step 11495 doesn't seem to be define in the database( WARNING : type of input 1 of step 11489 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11491 have datatype=10 whereas input 3 of step 11498 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11575 doesn't seem to be define in the database( WARNING : output 1 of step 11489 have datatype=7 whereas input 2 of step 11575 have datatype=None WARNING : type of output 3 of step 11575 doesn't seem to be define in the database( WARNING : type of input 1 of step 11491 doesn't seem to be define in the database( WARNING : output 0 of step 11491 have datatype=10 whereas input 0 of step 11581 have datatype=18 WARNING : type of input 5 of step 11498 doesn't seem to be define in the database( WARNING : output 0 of step 11581 have datatype=11 whereas input 5 of step 11498 have datatype=None WARNING : type of output 1 of step 11496 doesn't seem to be define in the database( WARNING : type of input 3 of step 11492 doesn't seem to be define in the database( WARNING : type of output 1 of step 11497 doesn't seem to be define in the database( WARNING : type of input 3 of step 11492 doesn't seem to be define in the database( WARNING : output 0 of step 11495 have datatype=1 whereas input 0 of step 11489 have datatype=2 DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4209, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,metal,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'papier,background', 'hashtag_weights': {'barquette_opaque': 0.7, 'carton': 0.7, 'ela': 0.7, 'etiquette': 0.5, 'film_plastique': 0.5, 'kraft': 0.7, 'metal': 1.5, 'pehd': 0.7, 'pet_clair': 0.7, 'pet_opaque': 0.7, 'textiles_sanitaires': 0.5, 'pet_fonce': 0.7}, 'ETA': 600} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4207, 'hashtag_proportion': 'barquette_opaque,ela,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'carton,background', 'hashtag_weights': {'barquette_opaque': 1, 'ela': 1, 'etiquette': 1.0, 'film_plastique': 0.5, 'kraft': 1, 'metal': 3.0, 'papier': 1, 'pehd': 2, 'pet_clair': 2, 'pet_opaque': 2, 'textiles_sanitaires': 1.0, 'pet_fonce': 2}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3726, 'hashtag_proportion': 'Carton_brun,Carton_gris,Teint_Dans_La_Masse,autre_refus,cartonnette,kraft,metal,plastique', 'hashtag_parmi': 'papier,background', 'hashtag_weights': {'Carton_brun': 1.5, 'Carton_gris': 1.5, 'Teint_Dans_La_Masse': 1.0, 'autre_refus': 1.5, 'cartonnette': 1.0, 'kraft': 1.5, 'metal': 3, 'plastique': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11512 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11521 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11520 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11516 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11516 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11519 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11519 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11513 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11513 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11577 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11577 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11515 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11514 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11514 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11523 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11515 doesn't seem to be define in the database( WARNING : type of input 3 of step 11514 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11512 doesn't seem to be define in the database( WARNING : type of input 2 of step 11516 doesn't seem to be define in the database( WARNING : output 1 of step 11512 have datatype=2 whereas input 1 of step 11519 have datatype=7 WARNING : type of output 2 of step 11519 doesn't seem to be define in the database( WARNING : type of input 1 of step 11513 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11515 have datatype=10 whereas input 3 of step 11522 have datatype=6 WARNING : type of input 2 of step 11577 doesn't seem to be define in the database( WARNING : output 1 of step 11513 have datatype=7 whereas input 2 of step 11577 have datatype=None WARNING : type of output 3 of step 11577 doesn't seem to be define in the database( WARNING : type of input 1 of step 11515 doesn't seem to be define in the database( WARNING : output 0 of step 11515 have datatype=10 whereas input 0 of step 11583 have datatype=18 WARNING : type of input 5 of step 11522 doesn't seem to be define in the database( WARNING : output 0 of step 11583 have datatype=11 whereas input 5 of step 11522 have datatype=None WARNING : type of output 1 of step 11521 doesn't seem to be define in the database( WARNING : type of input 3 of step 11516 doesn't seem to be define in the database( WARNING : type of output 1 of step 11520 doesn't seem to be define in the database( WARNING : type of input 3 of step 11516 doesn't seem to be define in the database( WARNING : output 0 of step 11519 have datatype=1 whereas input 0 of step 11513 have datatype=2 DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4203, 'hashtag_proportion': 'barquette_opaque,carton,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'ela,background', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 1, 'etiquette': 0.5, 'film_plastique': 0.5, 'kraft': 0.8, 'metal': 2, 'papier': 0.8, 'pehd': 0.8, 'pet_clair': 0.8, 'pet_opaque': 0.8, 'textiles_sanitaires': 0.5, 'pet_fonce': 0.8}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11560 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11567 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11567 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11563 crop_condition is not consistent : 4 used against 2 in the step definition ! Step 11563 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11564 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11564 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11573 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11573 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11566 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11566 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 1 of step 11560 have datatype=2 whereas input 1 of step 11564 have datatype=7 WARNING : type of output 2 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11565 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11567 doesn't seem to be define in the database( WARNING : type of input 3 of step 11563 doesn't seem to be define in the database( WARNING : type of output 3 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11568 doesn't seem to be define in the database( WARNING : type of output 1 of step 11568 doesn't seem to be define in the database( WARNING : type of input 3 of step 11566 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11570 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11569 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11570 doesn't seem to be define in the database( WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11569 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11568 have datatype=10 whereas input 3 of step 11571 have datatype=6 WARNING : type of input 2 of step 11573 doesn't seem to be define in the database( WARNING : output 1 of step 11565 have datatype=7 whereas input 2 of step 11573 have datatype=None WARNING : type of output 3 of step 11573 doesn't seem to be define in the database( WARNING : type of input 3 of step 11568 doesn't seem to be define in the database( WARNING : output 0 of step 11568 have datatype=10 whereas input 0 of step 11587 have datatype=18 WARNING : type of input 5 of step 11571 doesn't seem to be define in the database( WARNING : output 0 of step 11587 have datatype=11 whereas input 5 of step 11571 have datatype=None WARNING : output 0 of step 11564 have datatype=1 whereas input 0 of step 11565 have datatype=2 DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3327, 'hashtag_proportion': 'autre,carton,metal,papier,pehd,pet_fonce', 'hashtag_parmi': 'pet_clair,bouchon,etiquette,barquette_avec_film,background', 'hashtag_weights': {'autre': 8.0, 'barquette_avec_film': 6, 'carton': 8.0, 'metal': 12, 'papier': 5, 'pehd': 8, 'pet_fonce': 8, 'bouchon': 8, 'etiquette': 8}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11978 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11987 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11986 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11982 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11982 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11985 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11985 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11979 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11979 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11990 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11990 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11981 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11980 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11980 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11989 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11981 doesn't seem to be define in the database( WARNING : type of input 3 of step 11980 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11978 doesn't seem to be define in the database( WARNING : type of input 2 of step 11982 doesn't seem to be define in the database( WARNING : output 1 of step 11978 have datatype=2 whereas input 1 of step 11985 have datatype=7 WARNING : type of output 2 of step 11985 doesn't seem to be define in the database( WARNING : type of input 1 of step 11979 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11981 have datatype=10 whereas input 3 of step 11988 have datatype=6 WARNING : type of input 2 of step 11990 doesn't seem to be define in the database( WARNING : output 1 of step 11979 have datatype=7 whereas input 2 of step 11990 have datatype=None WARNING : type of output 3 of step 11990 doesn't seem to be define in the database( WARNING : type of input 1 of step 11981 doesn't seem to be define in the database( WARNING : output 0 of step 11981 have datatype=10 whereas input 0 of step 11991 have datatype=18 WARNING : type of input 5 of step 11988 doesn't seem to be define in the database( WARNING : output 0 of step 11991 have datatype=11 whereas input 5 of step 11988 have datatype=None WARNING : type of output 1 of step 11987 doesn't seem to be define in the database( WARNING : type of input 3 of step 11982 doesn't seem to be define in the database( WARNING : type of output 1 of step 11986 doesn't seem to be define in the database( WARNING : type of input 3 of step 11982 doesn't seem to be define in the database( WARNING : output 0 of step 11985 have datatype=1 whereas input 0 of step 11979 have datatype=2 DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4461, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,pehd,kraft,metal,papier,pet_fonce,pet_clair,pet_opaque,textiles_sanitaires', 'hashtag_parmi': 'film_plastique', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 0.3, 'ela': 0.3, 'etiquette': 0.1, 'film_plastique': 0.1, 'kraft': 0.3, 'metal': 1.5, 'papier': 0.3, 'pet_clair': 0.3, 'pet_opaque': 0.3, 'textiles_sanitaires': 0.3, 'pet_fonce': 0.3}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11524 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11533 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11532 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11528 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11528 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11531 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11531 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11525 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11525 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11578 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11578 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11527 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11526 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11526 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11535 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11527 doesn't seem to be define in the database( WARNING : type of input 3 of step 11526 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11524 doesn't seem to be define in the database( WARNING : type of input 2 of step 11528 doesn't seem to be define in the database( WARNING : output 1 of step 11524 have datatype=2 whereas input 1 of step 11531 have datatype=7 WARNING : type of output 2 of step 11531 doesn't seem to be define in the database( WARNING : type of input 1 of step 11525 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11527 have datatype=10 whereas input 3 of step 11534 have datatype=6 WARNING : type of input 2 of step 11578 doesn't seem to be define in the database( WARNING : output 1 of step 11525 have datatype=7 whereas input 2 of step 11578 have datatype=None WARNING : type of output 3 of step 11578 doesn't seem to be define in the database( WARNING : type of input 1 of step 11527 doesn't seem to be define in the database( WARNING : output 0 of step 11527 have datatype=10 whereas input 0 of step 11584 have datatype=18 WARNING : type of input 5 of step 11534 doesn't seem to be define in the database( WARNING : output 0 of step 11584 have datatype=11 whereas input 5 of step 11534 have datatype=None WARNING : type of output 1 of step 11533 doesn't seem to be define in the database( WARNING : type of input 3 of step 11528 doesn't seem to be define in the database( WARNING : type of output 1 of step 11532 doesn't seem to be define in the database( WARNING : type of input 3 of step 11528 doesn't seem to be define in the database( WARNING : output 0 of step 11531 have datatype=1 whereas input 0 of step 11525 have datatype=2 DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4211, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,metal,papier,pet_fonce,pet_clair,pet_opaque,textiles_sanitaires', 'hashtag_parmi': 'pehd,background', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 0.3, 'ela': 0.3, 'etiquette': 0.1, 'film_plastique': 0.1, 'kraft': 0.3, 'metal': 1.5, 'papier': 0.3, 'pet_clair': 0.3, 'pet_opaque': 0.3, 'textiles_sanitaires': 0.3, 'pet_fonce': 0.3, 'background': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11548 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11556 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11557 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11552 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11552 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11555 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11555 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11580 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11580 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11551 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11550 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11550 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11559 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11551 doesn't seem to be define in the database( WARNING : type of input 3 of step 11550 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11548 doesn't seem to be define in the database( WARNING : type of input 2 of step 11552 doesn't seem to be define in the database( WARNING : output 1 of step 11548 have datatype=2 whereas input 1 of step 11555 have datatype=7 WARNING : type of output 2 of step 11555 doesn't seem to be define in the database( WARNING : type of input 1 of step 11549 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11551 have datatype=10 whereas input 3 of step 11558 have datatype=6 WARNING : type of input 2 of step 11580 doesn't seem to be define in the database( WARNING : output 1 of step 11549 have datatype=7 whereas input 2 of step 11580 have datatype=None WARNING : type of output 3 of step 11580 doesn't seem to be define in the database( WARNING : type of input 1 of step 11551 doesn't seem to be define in the database( WARNING : output 0 of step 11551 have datatype=10 whereas input 0 of step 11586 have datatype=18 WARNING : type of input 5 of step 11558 doesn't seem to be define in the database( WARNING : output 0 of step 11586 have datatype=11 whereas input 5 of step 11558 have datatype=None WARNING : type of output 1 of step 11556 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : type of output 1 of step 11557 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : output 0 of step 11555 have datatype=1 whereas input 0 of step 11549 have datatype=2 DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4200, 'hashtag_proportion': 'carton,ela,etiquette,film_plastique,kraft,metal,papier,pehd,pet_opaque,textiles_sanitaires,barquette_opaque,pet_clair', 'hashtag_parmi': 'pet_fonce,background', 'hashtag_weights': {'barquette_opaque': 1.5, 'carton': 2.5, 'ela': 1.5, 'etiquette': 1.5, 'film_plastique': 1, 'kraft': 1.5, 'metal': 3.0, 'papier': 1.2, 'pehd': 1.5, 'pet_clair': 1.5, 'pet_opaque': 1.5, 'textiles_sanitaires': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11536 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11545 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11544 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11540 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11540 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11543 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11543 merge_mask_thcl_custom have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 11537 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11579 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11579 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11539 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11538 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11538 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11547 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11539 doesn't seem to be define in the database( WARNING : type of input 3 of step 11538 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11536 doesn't seem to be define in the database( WARNING : type of input 2 of step 11540 doesn't seem to be define in the database( WARNING : output 1 of step 11536 have datatype=2 whereas input 1 of step 11543 have datatype=7 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11539 have datatype=10 whereas input 3 of step 11546 have datatype=6 WARNING : type of input 2 of step 11579 doesn't seem to be define in the database( WARNING : output 1 of step 11537 have datatype=7 whereas input 2 of step 11579 have datatype=None WARNING : type of output 3 of step 11579 doesn't seem to be define in the database( WARNING : type of input 1 of step 11539 doesn't seem to be define in the database( WARNING : output 0 of step 11539 have datatype=10 whereas input 0 of step 11585 have datatype=18 WARNING : type of input 5 of step 11546 doesn't seem to be define in the database( WARNING : output 0 of step 11585 have datatype=11 whereas input 5 of step 11546 have datatype=None WARNING : type of output 1 of step 11545 doesn't seem to be define in the database( WARNING : type of input 3 of step 11540 doesn't seem to be define in the database( WARNING : type of output 1 of step 11544 doesn't seem to be define in the database( WARNING : type of input 3 of step 11540 doesn't seem to be define in the database( WARNING : output 0 of step 11543 have datatype=1 whereas input 0 of step 11537 have datatype=2 DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4205, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'metal,background', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 1.5, 'ela': 1.5, 'etiquette': 1, 'film_plastique': 1, 'kraft': 1, 'papier': 1, 'pehd': 1.5, 'pet_clair': 1.5, 'pet_opaque': 1.5, 'textiles_sanitaires': 1.5, 'pet_fonce': 1.5}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3594, 'hashtag_proportion': 'papier,carton,metal,pet_clair,autre,pehd,pet_fonce', 'hashtag_parmi': 'refus,background', 'hashtag_weights': {'papier': 1, 'carton': 1, 'metal': 1, 'pet_clair': 1, 'autre': 1, 'pehd': 1, 'pet_fonce': 1, 'refus': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier Inconsistency in dashboard_places dashboard_places from input : romainville_petite_presse dashboard_name_from_port found from datou STS from crontab from raspi : Romainville_Presse_1 We force the correct camera_place_name ! TODO : Insert select and so on # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11488 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11496 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11497 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11492 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11492 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11495 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11495 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11489 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11489 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11575 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11575 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11491 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11490 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11490 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11498 send_mail_cod have less outputs used (0) than in the step definition (1) : some outputs may be not used ! Step 11499 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11491 doesn't seem to be define in the database( WARNING : type of input 3 of step 11490 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11488 doesn't seem to be define in the database( WARNING : type of input 2 of step 11492 doesn't seem to be define in the database( WARNING : output 1 of step 11488 have datatype=2 whereas input 1 of step 11495 have datatype=7 WARNING : type of output 2 of step 11495 doesn't seem to be define in the database( WARNING : type of input 1 of step 11489 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11491 have datatype=10 whereas input 3 of step 11498 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11575 doesn't seem to be define in the database( WARNING : output 1 of step 11489 have datatype=7 whereas input 2 of step 11575 have datatype=None WARNING : type of output 3 of step 11575 doesn't seem to be define in the database( WARNING : type of input 1 of step 11491 doesn't seem to be define in the database( WARNING : output 0 of step 11491 have datatype=10 whereas input 0 of step 11581 have datatype=18 WARNING : type of input 5 of step 11498 doesn't seem to be define in the database( WARNING : output 0 of step 11581 have datatype=11 whereas input 5 of step 11498 have datatype=None WARNING : type of output 1 of step 11496 doesn't seem to be define in the database( WARNING : type of input 3 of step 11492 doesn't seem to be define in the database( WARNING : type of output 1 of step 11497 doesn't seem to be define in the database( WARNING : type of input 3 of step 11492 doesn't seem to be define in the database( WARNING : output 0 of step 11495 have datatype=1 whereas input 0 of step 11489 have datatype=2 DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4209, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,metal,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'papier,background', 'hashtag_weights': {'barquette_opaque': 0.7, 'carton': 0.7, 'ela': 0.7, 'etiquette': 0.5, 'film_plastique': 0.5, 'kraft': 0.7, 'metal': 1.5, 'pehd': 0.7, 'pet_clair': 0.7, 'pet_opaque': 0.7, 'textiles_sanitaires': 0.5, 'pet_fonce': 0.7}, 'ETA': 600} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4207, 'hashtag_proportion': 'barquette_opaque,ela,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'carton,background', 'hashtag_weights': {'barquette_opaque': 1, 'ela': 1, 'etiquette': 1.0, 'film_plastique': 0.5, 'kraft': 1, 'metal': 3.0, 'papier': 1, 'pehd': 2, 'pet_clair': 2, 'pet_opaque': 2, 'textiles_sanitaires': 1.0, 'pet_fonce': 2}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3726, 'hashtag_proportion': 'Carton_brun,Carton_gris,Teint_Dans_La_Masse,autre_refus,cartonnette,kraft,metal,plastique', 'hashtag_parmi': 'papier,background', 'hashtag_weights': {'Carton_brun': 1.5, 'Carton_gris': 1.5, 'Teint_Dans_La_Masse': 1.0, 'autre_refus': 1.5, 'cartonnette': 1.0, 'kraft': 1.5, 'metal': 3, 'plastique': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11512 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11521 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11520 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11516 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11516 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11519 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11519 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11513 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11513 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11577 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11577 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11515 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11514 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11514 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11523 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11515 doesn't seem to be define in the database( WARNING : type of input 3 of step 11514 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11512 doesn't seem to be define in the database( WARNING : type of input 2 of step 11516 doesn't seem to be define in the database( WARNING : output 1 of step 11512 have datatype=2 whereas input 1 of step 11519 have datatype=7 WARNING : type of output 2 of step 11519 doesn't seem to be define in the database( WARNING : type of input 1 of step 11513 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11515 have datatype=10 whereas input 3 of step 11522 have datatype=6 WARNING : type of input 2 of step 11577 doesn't seem to be define in the database( WARNING : output 1 of step 11513 have datatype=7 whereas input 2 of step 11577 have datatype=None WARNING : type of output 3 of step 11577 doesn't seem to be define in the database( WARNING : type of input 1 of step 11515 doesn't seem to be define in the database( WARNING : output 0 of step 11515 have datatype=10 whereas input 0 of step 11583 have datatype=18 WARNING : type of input 5 of step 11522 doesn't seem to be define in the database( WARNING : output 0 of step 11583 have datatype=11 whereas input 5 of step 11522 have datatype=None WARNING : type of output 1 of step 11521 doesn't seem to be define in the database( WARNING : type of input 3 of step 11516 doesn't seem to be define in the database( WARNING : type of output 1 of step 11520 doesn't seem to be define in the database( WARNING : type of input 3 of step 11516 doesn't seem to be define in the database( WARNING : output 0 of step 11519 have datatype=1 whereas input 0 of step 11513 have datatype=2 DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4203, 'hashtag_proportion': 'barquette_opaque,carton,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'ela,background', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 1, 'etiquette': 0.5, 'film_plastique': 0.5, 'kraft': 0.8, 'metal': 2, 'papier': 0.8, 'pehd': 0.8, 'pet_clair': 0.8, 'pet_opaque': 0.8, 'textiles_sanitaires': 0.5, 'pet_fonce': 0.8}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11560 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11567 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11567 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11563 crop_condition is not consistent : 4 used against 2 in the step definition ! Step 11563 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11564 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11564 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11573 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11573 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11566 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11566 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 1 of step 11560 have datatype=2 whereas input 1 of step 11564 have datatype=7 WARNING : type of output 2 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11565 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11567 doesn't seem to be define in the database( WARNING : type of input 3 of step 11563 doesn't seem to be define in the database( WARNING : type of output 3 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11568 doesn't seem to be define in the database( WARNING : type of output 1 of step 11568 doesn't seem to be define in the database( WARNING : type of input 3 of step 11566 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11570 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11569 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11570 doesn't seem to be define in the database( WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11569 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11568 have datatype=10 whereas input 3 of step 11571 have datatype=6 WARNING : type of input 2 of step 11573 doesn't seem to be define in the database( WARNING : output 1 of step 11565 have datatype=7 whereas input 2 of step 11573 have datatype=None WARNING : type of output 3 of step 11573 doesn't seem to be define in the database( WARNING : type of input 3 of step 11568 doesn't seem to be define in the database( WARNING : output 0 of step 11568 have datatype=10 whereas input 0 of step 11587 have datatype=18 WARNING : type of input 5 of step 11571 doesn't seem to be define in the database( WARNING : output 0 of step 11587 have datatype=11 whereas input 5 of step 11571 have datatype=None WARNING : output 0 of step 11564 have datatype=1 whereas input 0 of step 11565 have datatype=2 DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3327, 'hashtag_proportion': 'autre,carton,metal,papier,pehd,pet_fonce', 'hashtag_parmi': 'pet_clair,bouchon,etiquette,barquette_avec_film,background', 'hashtag_weights': {'autre': 8.0, 'barquette_avec_film': 6, 'carton': 8.0, 'metal': 12, 'papier': 5, 'pehd': 8, 'pet_fonce': 8, 'bouchon': 8, 'etiquette': 8}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11978 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11987 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11986 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11982 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11982 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11985 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11985 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11979 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11979 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11990 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11990 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11981 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11980 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11980 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11989 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11981 doesn't seem to be define in the database( WARNING : type of input 3 of step 11980 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11978 doesn't seem to be define in the database( WARNING : type of input 2 of step 11982 doesn't seem to be define in the database( WARNING : output 1 of step 11978 have datatype=2 whereas input 1 of step 11985 have datatype=7 WARNING : type of output 2 of step 11985 doesn't seem to be define in the database( WARNING : type of input 1 of step 11979 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11981 have datatype=10 whereas input 3 of step 11988 have datatype=6 WARNING : type of input 2 of step 11990 doesn't seem to be define in the database( WARNING : output 1 of step 11979 have datatype=7 whereas input 2 of step 11990 have datatype=None WARNING : type of output 3 of step 11990 doesn't seem to be define in the database( WARNING : type of input 1 of step 11981 doesn't seem to be define in the database( WARNING : output 0 of step 11981 have datatype=10 whereas input 0 of step 11991 have datatype=18 WARNING : type of input 5 of step 11988 doesn't seem to be define in the database( WARNING : output 0 of step 11991 have datatype=11 whereas input 5 of step 11988 have datatype=None WARNING : type of output 1 of step 11987 doesn't seem to be define in the database( WARNING : type of input 3 of step 11982 doesn't seem to be define in the database( WARNING : type of output 1 of step 11986 doesn't seem to be define in the database( WARNING : type of input 3 of step 11982 doesn't seem to be define in the database( WARNING : output 0 of step 11985 have datatype=1 whereas input 0 of step 11979 have datatype=2 DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4461, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,pehd,kraft,metal,papier,pet_fonce,pet_clair,pet_opaque,textiles_sanitaires', 'hashtag_parmi': 'film_plastique', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 0.3, 'ela': 0.3, 'etiquette': 0.1, 'film_plastique': 0.1, 'kraft': 0.3, 'metal': 1.5, 'papier': 0.3, 'pet_clair': 0.3, 'pet_opaque': 0.3, 'textiles_sanitaires': 0.3, 'pet_fonce': 0.3}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11524 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11533 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11532 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11528 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11528 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11531 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11531 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11525 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11525 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11578 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11578 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11527 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11526 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11526 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11535 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11527 doesn't seem to be define in the database( WARNING : type of input 3 of step 11526 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11524 doesn't seem to be define in the database( WARNING : type of input 2 of step 11528 doesn't seem to be define in the database( WARNING : output 1 of step 11524 have datatype=2 whereas input 1 of step 11531 have datatype=7 WARNING : type of output 2 of step 11531 doesn't seem to be define in the database( WARNING : type of input 1 of step 11525 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11527 have datatype=10 whereas input 3 of step 11534 have datatype=6 WARNING : type of input 2 of step 11578 doesn't seem to be define in the database( WARNING : output 1 of step 11525 have datatype=7 whereas input 2 of step 11578 have datatype=None WARNING : type of output 3 of step 11578 doesn't seem to be define in the database( WARNING : type of input 1 of step 11527 doesn't seem to be define in the database( WARNING : output 0 of step 11527 have datatype=10 whereas input 0 of step 11584 have datatype=18 WARNING : type of input 5 of step 11534 doesn't seem to be define in the database( WARNING : output 0 of step 11584 have datatype=11 whereas input 5 of step 11534 have datatype=None WARNING : type of output 1 of step 11533 doesn't seem to be define in the database( WARNING : type of input 3 of step 11528 doesn't seem to be define in the database( WARNING : type of output 1 of step 11532 doesn't seem to be define in the database( WARNING : type of input 3 of step 11528 doesn't seem to be define in the database( WARNING : output 0 of step 11531 have datatype=1 whereas input 0 of step 11525 have datatype=2 DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4211, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,metal,papier,pet_fonce,pet_clair,pet_opaque,textiles_sanitaires', 'hashtag_parmi': 'pehd,background', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 0.3, 'ela': 0.3, 'etiquette': 0.1, 'film_plastique': 0.1, 'kraft': 0.3, 'metal': 1.5, 'papier': 0.3, 'pet_clair': 0.3, 'pet_opaque': 0.3, 'textiles_sanitaires': 0.3, 'pet_fonce': 0.3, 'background': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11548 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11556 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11557 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11552 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11552 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11555 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11555 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11580 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11580 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11551 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11550 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11550 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11559 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11551 doesn't seem to be define in the database( WARNING : type of input 3 of step 11550 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11548 doesn't seem to be define in the database( WARNING : type of input 2 of step 11552 doesn't seem to be define in the database( WARNING : output 1 of step 11548 have datatype=2 whereas input 1 of step 11555 have datatype=7 WARNING : type of output 2 of step 11555 doesn't seem to be define in the database( WARNING : type of input 1 of step 11549 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11551 have datatype=10 whereas input 3 of step 11558 have datatype=6 WARNING : type of input 2 of step 11580 doesn't seem to be define in the database( WARNING : output 1 of step 11549 have datatype=7 whereas input 2 of step 11580 have datatype=None WARNING : type of output 3 of step 11580 doesn't seem to be define in the database( WARNING : type of input 1 of step 11551 doesn't seem to be define in the database( WARNING : output 0 of step 11551 have datatype=10 whereas input 0 of step 11586 have datatype=18 WARNING : type of input 5 of step 11558 doesn't seem to be define in the database( WARNING : output 0 of step 11586 have datatype=11 whereas input 5 of step 11558 have datatype=None WARNING : type of output 1 of step 11556 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : type of output 1 of step 11557 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : output 0 of step 11555 have datatype=1 whereas input 0 of step 11549 have datatype=2 DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4200, 'hashtag_proportion': 'carton,ela,etiquette,film_plastique,kraft,metal,papier,pehd,pet_opaque,textiles_sanitaires,barquette_opaque,pet_clair', 'hashtag_parmi': 'pet_fonce,background', 'hashtag_weights': {'barquette_opaque': 1.5, 'carton': 2.5, 'ela': 1.5, 'etiquette': 1.5, 'film_plastique': 1, 'kraft': 1.5, 'metal': 3.0, 'papier': 1.2, 'pehd': 1.5, 'pet_clair': 1.5, 'pet_opaque': 1.5, 'textiles_sanitaires': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11536 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11545 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11544 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11540 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11540 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11543 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11543 merge_mask_thcl_custom have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 11537 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11579 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11579 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11539 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11538 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11538 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11547 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11539 doesn't seem to be define in the database( WARNING : type of input 3 of step 11538 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11536 doesn't seem to be define in the database( WARNING : type of input 2 of step 11540 doesn't seem to be define in the database( WARNING : output 1 of step 11536 have datatype=2 whereas input 1 of step 11543 have datatype=7 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11539 have datatype=10 whereas input 3 of step 11546 have datatype=6 WARNING : type of input 2 of step 11579 doesn't seem to be define in the database( WARNING : output 1 of step 11537 have datatype=7 whereas input 2 of step 11579 have datatype=None WARNING : type of output 3 of step 11579 doesn't seem to be define in the database( WARNING : type of input 1 of step 11539 doesn't seem to be define in the database( WARNING : output 0 of step 11539 have datatype=10 whereas input 0 of step 11585 have datatype=18 WARNING : type of input 5 of step 11546 doesn't seem to be define in the database( WARNING : output 0 of step 11585 have datatype=11 whereas input 5 of step 11546 have datatype=None WARNING : type of output 1 of step 11545 doesn't seem to be define in the database( WARNING : type of input 3 of step 11540 doesn't seem to be define in the database( WARNING : type of output 1 of step 11544 doesn't seem to be define in the database( WARNING : type of input 3 of step 11540 doesn't seem to be define in the database( WARNING : output 0 of step 11543 have datatype=1 whereas input 0 of step 11537 have datatype=2 DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4205, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'metal,background', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 1.5, 'ela': 1.5, 'etiquette': 1, 'film_plastique': 1, 'kraft': 1, 'papier': 1, 'pehd': 1.5, 'pet_clair': 1.5, 'pet_opaque': 1.5, 'textiles_sanitaires': 1.5, 'pet_fonce': 1.5}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3594, 'hashtag_proportion': 'papier,carton,metal,pet_clair,autre,pehd,pet_fonce', 'hashtag_parmi': 'refus,background', 'hashtag_weights': {'papier': 1, 'carton': 1, 'metal': 1, 'pet_clair': 1, 'autre': 1, 'pehd': 1, 'pet_fonce': 1, 'refus': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier TODO TODO : Insert select and so on ***** analysis of device with port 20001 for dashboard romainville_petite_presse ***** **** analysis of day 2022/09/01/ **** VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! WARNING: No hour configured for port 20001, from 00:00 to 24:00 used 0:00:00 apple pause between two photos 10 Unable to retrieve photo time from log, find in sqlite. Find filename in sqlite. Info from logs total number of images : 0 coverage for 10 seconds : 0:00:00 (0.00%) coverage for 20 seconds : 0:00:00 (0.00%) max time between two photos : 0:00:00 results of pre-diagnostic : light ok 5716, not duplicated 5865, two criteria ok 5716, nb forced upload 0 end of day status of photos as found in sqllite Unable to find info for dashboard number 181 for day 2022-09-01 00:00:00 Info from dashboard total number of uploaded images : 0 number of useful images : 5716 number of finished photos : 0 (0.00% of two criteria ok) number of finished photos for older algorithm : 0 (0.00% of two criteria ok) number of started photos : 0 (0.00% of two criteria ok) **** analysis of day 2022/09/02/ **** VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! WARNING: No hour configured for port 20001, from 00:00 to 24:00 used 0:00:00 apple pause between two photos 10 Unable to retrieve photo time from log, find in sqlite. Find filename in sqlite. Info from logs total number of images : 0 coverage for 10 seconds : 0:00:00 (0.00%) coverage for 20 seconds : 0:00:00 (0.00%) max time between two photos : 0:00:00 results of pre-diagnostic : light ok 5716, not duplicated 5865, two criteria ok 5716, nb forced upload 0 end of day status of photos as found in sqllite Unable to find info for dashboard number 181 for day 2022-09-02 00:00:00 Info from dashboard total number of uploaded images : 0 number of useful images : 5716 number of finished photos : 0 (0.00% of two criteria ok) number of finished photos for older algorithm : 0 (0.00% of two criteria ok) number of started photos : 0 (0.00% of two criteria ok) **** analysis of day 2022/09/03/ **** VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! WARNING: No hour configured for port 20001, from 00:00 to 24:00 used 0:00:00 apple pause between two photos 10 Unable to retrieve photo time from log, find in sqlite. Find filename in sqlite. Info from logs total number of images : 0 coverage for 10 seconds : 0:00:00 (0.00%) coverage for 20 seconds : 0:00:00 (0.00%) max time between two photos : 0:00:00 results of pre-diagnostic : light ok 5716, not duplicated 5865, two criteria ok 5716, nb forced upload 0 end of day status of photos as found in sqllite Unable to find info for dashboard number 181 for day 2022-09-03 00:00:00 Info from dashboard total number of uploaded images : 0 number of useful images : 5716 number of finished photos : 0 (0.00% of two criteria ok) number of finished photos for older algorithm : 0 (0.00% of two criteria ok) number of started photos : 0 (0.00% of two criteria ok) **** analysis for all days **** Info from logs total number of images : 0 coverage for 10 seconds : 0:00:00 (0.00%) coverage for 20 seconds : 0:00:00 (0.00%) max time between two photos : 0:00:00 results of pre-diagnostic : light ok 17148, not duplicated 17595, two criteria ok 17148, nb forced upload 0 end of day status of photos as found in sqllite Info from dashboard total number of uploaded images : 0 number of useful images : 17148 number of finished photos : 0 (0.00% of two criteria ok) number of finished photos for older algorithm : 0 (0.00% of two criteria ok) number of started photos : 0 (0.00% of two criteria ok) cvs resume : date,nb_photos,% time,nb ok,uploaded,to upload, % uploaded, nb useful, % completed photos, last_update, remark 2022/09/01,0,0.00%,5716,0,0,0.00%,0,0.00%,0000/00/00, 2022/09/02,0,0.00%,5716,0,0,0.00%,0,0.00%,0000/00/00, 2022/09/03,0,0.00%,5716,0,0,0.00%,0,0.00%,0000/00/00, coverage for this period for every 10 second 2022/09/01/ 0.0 2022/09/02/ 0.0 2022/09/03/ 0.0 mean value for this period : 0.0 coverage for this period for every 20 second 2022/09/01/ 0.0 2022/09/02/ 0.0 2022/09/03/ 0.0 mean value for this period : 0.0 ############################### TEST get_data ################################ TODO and TOTEST VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11488 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11496 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11497 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11492 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11492 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11495 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11495 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11489 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11489 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11575 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11575 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11491 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11490 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11490 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11498 send_mail_cod have less outputs used (0) than in the step definition (1) : some outputs may be not used ! Step 11499 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11491 doesn't seem to be define in the database( WARNING : type of input 3 of step 11490 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11488 doesn't seem to be define in the database( WARNING : type of input 2 of step 11492 doesn't seem to be define in the database( WARNING : output 1 of step 11488 have datatype=2 whereas input 1 of step 11495 have datatype=7 WARNING : type of output 2 of step 11495 doesn't seem to be define in the database( WARNING : type of input 1 of step 11489 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11491 have datatype=10 whereas input 3 of step 11498 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11575 doesn't seem to be define in the database( WARNING : output 1 of step 11489 have datatype=7 whereas input 2 of step 11575 have datatype=None WARNING : type of output 3 of step 11575 doesn't seem to be define in the database( WARNING : type of input 1 of step 11491 doesn't seem to be define in the database( WARNING : output 0 of step 11491 have datatype=10 whereas input 0 of step 11581 have datatype=18 WARNING : type of input 5 of step 11498 doesn't seem to be define in the database( WARNING : output 0 of step 11581 have datatype=11 whereas input 5 of step 11498 have datatype=None WARNING : type of output 1 of step 11496 doesn't seem to be define in the database( WARNING : type of input 3 of step 11492 doesn't seem to be define in the database( WARNING : type of output 1 of step 11497 doesn't seem to be define in the database( WARNING : type of input 3 of step 11492 doesn't seem to be define in the database( WARNING : output 0 of step 11495 have datatype=1 whereas input 0 of step 11489 have datatype=2 DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4209, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,metal,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'papier,background', 'hashtag_weights': {'barquette_opaque': 0.7, 'carton': 0.7, 'ela': 0.7, 'etiquette': 0.5, 'film_plastique': 0.5, 'kraft': 0.7, 'metal': 1.5, 'pehd': 0.7, 'pet_clair': 0.7, 'pet_opaque': 0.7, 'textiles_sanitaires': 0.5, 'pet_fonce': 0.7}, 'ETA': 600} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4207, 'hashtag_proportion': 'barquette_opaque,ela,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'carton,background', 'hashtag_weights': {'barquette_opaque': 1, 'ela': 1, 'etiquette': 1.0, 'film_plastique': 0.5, 'kraft': 1, 'metal': 3.0, 'papier': 1, 'pehd': 2, 'pet_clair': 2, 'pet_opaque': 2, 'textiles_sanitaires': 1.0, 'pet_fonce': 2}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3726, 'hashtag_proportion': 'Carton_brun,Carton_gris,Teint_Dans_La_Masse,autre_refus,cartonnette,kraft,metal,plastique', 'hashtag_parmi': 'papier,background', 'hashtag_weights': {'Carton_brun': 1.5, 'Carton_gris': 1.5, 'Teint_Dans_La_Masse': 1.0, 'autre_refus': 1.5, 'cartonnette': 1.0, 'kraft': 1.5, 'metal': 3, 'plastique': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11512 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11521 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11520 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11516 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11516 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11519 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11519 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11513 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11513 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11577 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11577 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11515 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11514 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11514 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11523 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11515 doesn't seem to be define in the database( WARNING : type of input 3 of step 11514 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11512 doesn't seem to be define in the database( WARNING : type of input 2 of step 11516 doesn't seem to be define in the database( WARNING : output 1 of step 11512 have datatype=2 whereas input 1 of step 11519 have datatype=7 WARNING : type of output 2 of step 11519 doesn't seem to be define in the database( WARNING : type of input 1 of step 11513 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11515 have datatype=10 whereas input 3 of step 11522 have datatype=6 WARNING : type of input 2 of step 11577 doesn't seem to be define in the database( WARNING : output 1 of step 11513 have datatype=7 whereas input 2 of step 11577 have datatype=None WARNING : type of output 3 of step 11577 doesn't seem to be define in the database( WARNING : type of input 1 of step 11515 doesn't seem to be define in the database( WARNING : output 0 of step 11515 have datatype=10 whereas input 0 of step 11583 have datatype=18 WARNING : type of input 5 of step 11522 doesn't seem to be define in the database( WARNING : output 0 of step 11583 have datatype=11 whereas input 5 of step 11522 have datatype=None WARNING : type of output 1 of step 11521 doesn't seem to be define in the database( WARNING : type of input 3 of step 11516 doesn't seem to be define in the database( WARNING : type of output 1 of step 11520 doesn't seem to be define in the database( WARNING : type of input 3 of step 11516 doesn't seem to be define in the database( WARNING : output 0 of step 11519 have datatype=1 whereas input 0 of step 11513 have datatype=2 DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4203, 'hashtag_proportion': 'barquette_opaque,carton,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'ela,background', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 1, 'etiquette': 0.5, 'film_plastique': 0.5, 'kraft': 0.8, 'metal': 2, 'papier': 0.8, 'pehd': 0.8, 'pet_clair': 0.8, 'pet_opaque': 0.8, 'textiles_sanitaires': 0.5, 'pet_fonce': 0.8}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11560 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11567 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11567 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11563 crop_condition is not consistent : 4 used against 2 in the step definition ! Step 11563 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11564 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11564 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11573 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11573 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11566 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11566 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 1 of step 11560 have datatype=2 whereas input 1 of step 11564 have datatype=7 WARNING : type of output 2 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11565 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11567 doesn't seem to be define in the database( WARNING : type of input 3 of step 11563 doesn't seem to be define in the database( WARNING : type of output 3 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11568 doesn't seem to be define in the database( WARNING : type of output 1 of step 11568 doesn't seem to be define in the database( WARNING : type of input 3 of step 11566 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11570 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11569 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11570 doesn't seem to be define in the database( WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11569 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11568 have datatype=10 whereas input 3 of step 11571 have datatype=6 WARNING : type of input 2 of step 11573 doesn't seem to be define in the database( WARNING : output 1 of step 11565 have datatype=7 whereas input 2 of step 11573 have datatype=None WARNING : type of output 3 of step 11573 doesn't seem to be define in the database( WARNING : type of input 3 of step 11568 doesn't seem to be define in the database( WARNING : output 0 of step 11568 have datatype=10 whereas input 0 of step 11587 have datatype=18 WARNING : type of input 5 of step 11571 doesn't seem to be define in the database( WARNING : output 0 of step 11587 have datatype=11 whereas input 5 of step 11571 have datatype=None WARNING : output 0 of step 11564 have datatype=1 whereas input 0 of step 11565 have datatype=2 DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3327, 'hashtag_proportion': 'autre,carton,metal,papier,pehd,pet_fonce', 'hashtag_parmi': 'pet_clair,bouchon,etiquette,barquette_avec_film,background', 'hashtag_weights': {'autre': 8.0, 'barquette_avec_film': 6, 'carton': 8.0, 'metal': 12, 'papier': 5, 'pehd': 8, 'pet_fonce': 8, 'bouchon': 8, 'etiquette': 8}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11978 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11987 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11986 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11982 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11982 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11985 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11985 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11979 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11979 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11990 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11990 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11981 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11980 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11980 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11989 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11981 doesn't seem to be define in the database( WARNING : type of input 3 of step 11980 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11978 doesn't seem to be define in the database( WARNING : type of input 2 of step 11982 doesn't seem to be define in the database( WARNING : output 1 of step 11978 have datatype=2 whereas input 1 of step 11985 have datatype=7 WARNING : type of output 2 of step 11985 doesn't seem to be define in the database( WARNING : type of input 1 of step 11979 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11981 have datatype=10 whereas input 3 of step 11988 have datatype=6 WARNING : type of input 2 of step 11990 doesn't seem to be define in the database( WARNING : output 1 of step 11979 have datatype=7 whereas input 2 of step 11990 have datatype=None WARNING : type of output 3 of step 11990 doesn't seem to be define in the database( WARNING : type of input 1 of step 11981 doesn't seem to be define in the database( WARNING : output 0 of step 11981 have datatype=10 whereas input 0 of step 11991 have datatype=18 WARNING : type of input 5 of step 11988 doesn't seem to be define in the database( WARNING : output 0 of step 11991 have datatype=11 whereas input 5 of step 11988 have datatype=None WARNING : type of output 1 of step 11987 doesn't seem to be define in the database( WARNING : type of input 3 of step 11982 doesn't seem to be define in the database( WARNING : type of output 1 of step 11986 doesn't seem to be define in the database( WARNING : type of input 3 of step 11982 doesn't seem to be define in the database( WARNING : output 0 of step 11985 have datatype=1 whereas input 0 of step 11979 have datatype=2 DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4461, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,pehd,kraft,metal,papier,pet_fonce,pet_clair,pet_opaque,textiles_sanitaires', 'hashtag_parmi': 'film_plastique', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 0.3, 'ela': 0.3, 'etiquette': 0.1, 'film_plastique': 0.1, 'kraft': 0.3, 'metal': 1.5, 'papier': 0.3, 'pet_clair': 0.3, 'pet_opaque': 0.3, 'textiles_sanitaires': 0.3, 'pet_fonce': 0.3}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11524 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11533 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11532 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11528 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11528 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11531 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11531 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11525 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11525 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11578 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11578 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11527 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11526 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11526 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11535 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11527 doesn't seem to be define in the database( WARNING : type of input 3 of step 11526 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11524 doesn't seem to be define in the database( WARNING : type of input 2 of step 11528 doesn't seem to be define in the database( WARNING : output 1 of step 11524 have datatype=2 whereas input 1 of step 11531 have datatype=7 WARNING : type of output 2 of step 11531 doesn't seem to be define in the database( WARNING : type of input 1 of step 11525 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11527 have datatype=10 whereas input 3 of step 11534 have datatype=6 WARNING : type of input 2 of step 11578 doesn't seem to be define in the database( WARNING : output 1 of step 11525 have datatype=7 whereas input 2 of step 11578 have datatype=None WARNING : type of output 3 of step 11578 doesn't seem to be define in the database( WARNING : type of input 1 of step 11527 doesn't seem to be define in the database( WARNING : output 0 of step 11527 have datatype=10 whereas input 0 of step 11584 have datatype=18 WARNING : type of input 5 of step 11534 doesn't seem to be define in the database( WARNING : output 0 of step 11584 have datatype=11 whereas input 5 of step 11534 have datatype=None WARNING : type of output 1 of step 11533 doesn't seem to be define in the database( WARNING : type of input 3 of step 11528 doesn't seem to be define in the database( WARNING : type of output 1 of step 11532 doesn't seem to be define in the database( WARNING : type of input 3 of step 11528 doesn't seem to be define in the database( WARNING : output 0 of step 11531 have datatype=1 whereas input 0 of step 11525 have datatype=2 DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4211, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,metal,papier,pet_fonce,pet_clair,pet_opaque,textiles_sanitaires', 'hashtag_parmi': 'pehd,background', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 0.3, 'ela': 0.3, 'etiquette': 0.1, 'film_plastique': 0.1, 'kraft': 0.3, 'metal': 1.5, 'papier': 0.3, 'pet_clair': 0.3, 'pet_opaque': 0.3, 'textiles_sanitaires': 0.3, 'pet_fonce': 0.3, 'background': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11548 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11556 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11557 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11552 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11552 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11555 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11555 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11580 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11580 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11551 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11550 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11550 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11559 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11551 doesn't seem to be define in the database( WARNING : type of input 3 of step 11550 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11548 doesn't seem to be define in the database( WARNING : type of input 2 of step 11552 doesn't seem to be define in the database( WARNING : output 1 of step 11548 have datatype=2 whereas input 1 of step 11555 have datatype=7 WARNING : type of output 2 of step 11555 doesn't seem to be define in the database( WARNING : type of input 1 of step 11549 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11551 have datatype=10 whereas input 3 of step 11558 have datatype=6 WARNING : type of input 2 of step 11580 doesn't seem to be define in the database( WARNING : output 1 of step 11549 have datatype=7 whereas input 2 of step 11580 have datatype=None WARNING : type of output 3 of step 11580 doesn't seem to be define in the database( WARNING : type of input 1 of step 11551 doesn't seem to be define in the database( WARNING : output 0 of step 11551 have datatype=10 whereas input 0 of step 11586 have datatype=18 WARNING : type of input 5 of step 11558 doesn't seem to be define in the database( WARNING : output 0 of step 11586 have datatype=11 whereas input 5 of step 11558 have datatype=None WARNING : type of output 1 of step 11556 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : type of output 1 of step 11557 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : output 0 of step 11555 have datatype=1 whereas input 0 of step 11549 have datatype=2 DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4200, 'hashtag_proportion': 'carton,ela,etiquette,film_plastique,kraft,metal,papier,pehd,pet_opaque,textiles_sanitaires,barquette_opaque,pet_clair', 'hashtag_parmi': 'pet_fonce,background', 'hashtag_weights': {'barquette_opaque': 1.5, 'carton': 2.5, 'ela': 1.5, 'etiquette': 1.5, 'film_plastique': 1, 'kraft': 1.5, 'metal': 3.0, 'papier': 1.2, 'pehd': 1.5, 'pet_clair': 1.5, 'pet_opaque': 1.5, 'textiles_sanitaires': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11536 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11545 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11544 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11540 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11540 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11543 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11543 merge_mask_thcl_custom have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 11537 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11579 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11579 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11539 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11538 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11538 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11547 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11539 doesn't seem to be define in the database( WARNING : type of input 3 of step 11538 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11536 doesn't seem to be define in the database( WARNING : type of input 2 of step 11540 doesn't seem to be define in the database( WARNING : output 1 of step 11536 have datatype=2 whereas input 1 of step 11543 have datatype=7 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11539 have datatype=10 whereas input 3 of step 11546 have datatype=6 WARNING : type of input 2 of step 11579 doesn't seem to be define in the database( WARNING : output 1 of step 11537 have datatype=7 whereas input 2 of step 11579 have datatype=None WARNING : type of output 3 of step 11579 doesn't seem to be define in the database( WARNING : type of input 1 of step 11539 doesn't seem to be define in the database( WARNING : output 0 of step 11539 have datatype=10 whereas input 0 of step 11585 have datatype=18 WARNING : type of input 5 of step 11546 doesn't seem to be define in the database( WARNING : output 0 of step 11585 have datatype=11 whereas input 5 of step 11546 have datatype=None WARNING : type of output 1 of step 11545 doesn't seem to be define in the database( WARNING : type of input 3 of step 11540 doesn't seem to be define in the database( WARNING : type of output 1 of step 11544 doesn't seem to be define in the database( WARNING : type of input 3 of step 11540 doesn't seem to be define in the database( WARNING : output 0 of step 11543 have datatype=1 whereas input 0 of step 11537 have datatype=2 DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4205, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'metal,background', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 1.5, 'ela': 1.5, 'etiquette': 1, 'film_plastique': 1, 'kraft': 1, 'papier': 1, 'pehd': 1.5, 'pet_clair': 1.5, 'pet_opaque': 1.5, 'textiles_sanitaires': 1.5, 'pet_fonce': 1.5}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3594, 'hashtag_proportion': 'papier,carton,metal,pet_clair,autre,pehd,pet_fonce', 'hashtag_parmi': 'refus,background', 'hashtag_weights': {'papier': 1, 'carton': 1, 'metal': 1, 'pet_clair': 1, 'autre': 1, 'pehd': 1, 'pet_fonce': 1, 'refus': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier TODO : Insert select and so on # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11488 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11496 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11497 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11492 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11492 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11495 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11495 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11489 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11489 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11575 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11575 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11491 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11490 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11490 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11498 send_mail_cod have less outputs used (0) than in the step definition (1) : some outputs may be not used ! Step 11499 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11491 doesn't seem to be define in the database( WARNING : type of input 3 of step 11490 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11488 doesn't seem to be define in the database( WARNING : type of input 2 of step 11492 doesn't seem to be define in the database( WARNING : output 1 of step 11488 have datatype=2 whereas input 1 of step 11495 have datatype=7 WARNING : type of output 2 of step 11495 doesn't seem to be define in the database( WARNING : type of input 1 of step 11489 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11491 have datatype=10 whereas input 3 of step 11498 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11575 doesn't seem to be define in the database( WARNING : output 1 of step 11489 have datatype=7 whereas input 2 of step 11575 have datatype=None WARNING : type of output 3 of step 11575 doesn't seem to be define in the database( WARNING : type of input 1 of step 11491 doesn't seem to be define in the database( WARNING : output 0 of step 11491 have datatype=10 whereas input 0 of step 11581 have datatype=18 WARNING : type of input 5 of step 11498 doesn't seem to be define in the database( WARNING : output 0 of step 11581 have datatype=11 whereas input 5 of step 11498 have datatype=None WARNING : type of output 1 of step 11496 doesn't seem to be define in the database( WARNING : type of input 3 of step 11492 doesn't seem to be define in the database( WARNING : type of output 1 of step 11497 doesn't seem to be define in the database( WARNING : type of input 3 of step 11492 doesn't seem to be define in the database( WARNING : output 0 of step 11495 have datatype=1 whereas input 0 of step 11489 have datatype=2 DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4209, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,metal,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'papier,background', 'hashtag_weights': {'barquette_opaque': 0.7, 'carton': 0.7, 'ela': 0.7, 'etiquette': 0.5, 'film_plastique': 0.5, 'kraft': 0.7, 'metal': 1.5, 'pehd': 0.7, 'pet_clair': 0.7, 'pet_opaque': 0.7, 'textiles_sanitaires': 0.5, 'pet_fonce': 0.7}, 'ETA': 600} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4207, 'hashtag_proportion': 'barquette_opaque,ela,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'carton,background', 'hashtag_weights': {'barquette_opaque': 1, 'ela': 1, 'etiquette': 1.0, 'film_plastique': 0.5, 'kraft': 1, 'metal': 3.0, 'papier': 1, 'pehd': 2, 'pet_clair': 2, 'pet_opaque': 2, 'textiles_sanitaires': 1.0, 'pet_fonce': 2}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3726, 'hashtag_proportion': 'Carton_brun,Carton_gris,Teint_Dans_La_Masse,autre_refus,cartonnette,kraft,metal,plastique', 'hashtag_parmi': 'papier,background', 'hashtag_weights': {'Carton_brun': 1.5, 'Carton_gris': 1.5, 'Teint_Dans_La_Masse': 1.0, 'autre_refus': 1.5, 'cartonnette': 1.0, 'kraft': 1.5, 'metal': 3, 'plastique': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11512 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11521 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11520 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11516 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11516 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11519 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11519 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11513 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11513 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11577 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11577 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11515 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11514 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11514 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11523 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11515 doesn't seem to be define in the database( WARNING : type of input 3 of step 11514 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11512 doesn't seem to be define in the database( WARNING : type of input 2 of step 11516 doesn't seem to be define in the database( WARNING : output 1 of step 11512 have datatype=2 whereas input 1 of step 11519 have datatype=7 WARNING : type of output 2 of step 11519 doesn't seem to be define in the database( WARNING : type of input 1 of step 11513 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11515 have datatype=10 whereas input 3 of step 11522 have datatype=6 WARNING : type of input 2 of step 11577 doesn't seem to be define in the database( WARNING : output 1 of step 11513 have datatype=7 whereas input 2 of step 11577 have datatype=None WARNING : type of output 3 of step 11577 doesn't seem to be define in the database( WARNING : type of input 1 of step 11515 doesn't seem to be define in the database( WARNING : output 0 of step 11515 have datatype=10 whereas input 0 of step 11583 have datatype=18 WARNING : type of input 5 of step 11522 doesn't seem to be define in the database( WARNING : output 0 of step 11583 have datatype=11 whereas input 5 of step 11522 have datatype=None WARNING : type of output 1 of step 11521 doesn't seem to be define in the database( WARNING : type of input 3 of step 11516 doesn't seem to be define in the database( WARNING : type of output 1 of step 11520 doesn't seem to be define in the database( WARNING : type of input 3 of step 11516 doesn't seem to be define in the database( WARNING : output 0 of step 11519 have datatype=1 whereas input 0 of step 11513 have datatype=2 DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4203, 'hashtag_proportion': 'barquette_opaque,carton,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'ela,background', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 1, 'etiquette': 0.5, 'film_plastique': 0.5, 'kraft': 0.8, 'metal': 2, 'papier': 0.8, 'pehd': 0.8, 'pet_clair': 0.8, 'pet_opaque': 0.8, 'textiles_sanitaires': 0.5, 'pet_fonce': 0.8}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11560 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11567 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11567 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11563 crop_condition is not consistent : 4 used against 2 in the step definition ! Step 11563 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11564 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11564 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11573 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11573 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11566 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11566 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 1 of step 11560 have datatype=2 whereas input 1 of step 11564 have datatype=7 WARNING : type of output 2 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11565 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11567 doesn't seem to be define in the database( WARNING : type of input 3 of step 11563 doesn't seem to be define in the database( WARNING : type of output 3 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11568 doesn't seem to be define in the database( WARNING : type of output 1 of step 11568 doesn't seem to be define in the database( WARNING : type of input 3 of step 11566 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11570 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11569 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11570 doesn't seem to be define in the database( WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11569 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11568 have datatype=10 whereas input 3 of step 11571 have datatype=6 WARNING : type of input 2 of step 11573 doesn't seem to be define in the database( WARNING : output 1 of step 11565 have datatype=7 whereas input 2 of step 11573 have datatype=None WARNING : type of output 3 of step 11573 doesn't seem to be define in the database( WARNING : type of input 3 of step 11568 doesn't seem to be define in the database( WARNING : output 0 of step 11568 have datatype=10 whereas input 0 of step 11587 have datatype=18 WARNING : type of input 5 of step 11571 doesn't seem to be define in the database( WARNING : output 0 of step 11587 have datatype=11 whereas input 5 of step 11571 have datatype=None WARNING : output 0 of step 11564 have datatype=1 whereas input 0 of step 11565 have datatype=2 DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3327, 'hashtag_proportion': 'autre,carton,metal,papier,pehd,pet_fonce', 'hashtag_parmi': 'pet_clair,bouchon,etiquette,barquette_avec_film,background', 'hashtag_weights': {'autre': 8.0, 'barquette_avec_film': 6, 'carton': 8.0, 'metal': 12, 'papier': 5, 'pehd': 8, 'pet_fonce': 8, 'bouchon': 8, 'etiquette': 8}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11978 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11987 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11986 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11982 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11982 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11985 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11985 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11979 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11979 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11990 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11990 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11981 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11980 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11980 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11989 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11981 doesn't seem to be define in the database( WARNING : type of input 3 of step 11980 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11978 doesn't seem to be define in the database( WARNING : type of input 2 of step 11982 doesn't seem to be define in the database( WARNING : output 1 of step 11978 have datatype=2 whereas input 1 of step 11985 have datatype=7 WARNING : type of output 2 of step 11985 doesn't seem to be define in the database( WARNING : type of input 1 of step 11979 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11981 have datatype=10 whereas input 3 of step 11988 have datatype=6 WARNING : type of input 2 of step 11990 doesn't seem to be define in the database( WARNING : output 1 of step 11979 have datatype=7 whereas input 2 of step 11990 have datatype=None WARNING : type of output 3 of step 11990 doesn't seem to be define in the database( WARNING : type of input 1 of step 11981 doesn't seem to be define in the database( WARNING : output 0 of step 11981 have datatype=10 whereas input 0 of step 11991 have datatype=18 WARNING : type of input 5 of step 11988 doesn't seem to be define in the database( WARNING : output 0 of step 11991 have datatype=11 whereas input 5 of step 11988 have datatype=None WARNING : type of output 1 of step 11987 doesn't seem to be define in the database( WARNING : type of input 3 of step 11982 doesn't seem to be define in the database( WARNING : type of output 1 of step 11986 doesn't seem to be define in the database( WARNING : type of input 3 of step 11982 doesn't seem to be define in the database( WARNING : output 0 of step 11985 have datatype=1 whereas input 0 of step 11979 have datatype=2 DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4461, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,pehd,kraft,metal,papier,pet_fonce,pet_clair,pet_opaque,textiles_sanitaires', 'hashtag_parmi': 'film_plastique', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 0.3, 'ela': 0.3, 'etiquette': 0.1, 'film_plastique': 0.1, 'kraft': 0.3, 'metal': 1.5, 'papier': 0.3, 'pet_clair': 0.3, 'pet_opaque': 0.3, 'textiles_sanitaires': 0.3, 'pet_fonce': 0.3}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11524 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11533 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11532 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11528 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11528 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11531 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11531 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11525 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11525 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11578 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11578 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11527 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11526 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11526 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11535 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11527 doesn't seem to be define in the database( WARNING : type of input 3 of step 11526 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11524 doesn't seem to be define in the database( WARNING : type of input 2 of step 11528 doesn't seem to be define in the database( WARNING : output 1 of step 11524 have datatype=2 whereas input 1 of step 11531 have datatype=7 WARNING : type of output 2 of step 11531 doesn't seem to be define in the database( WARNING : type of input 1 of step 11525 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11527 have datatype=10 whereas input 3 of step 11534 have datatype=6 WARNING : type of input 2 of step 11578 doesn't seem to be define in the database( WARNING : output 1 of step 11525 have datatype=7 whereas input 2 of step 11578 have datatype=None WARNING : type of output 3 of step 11578 doesn't seem to be define in the database( WARNING : type of input 1 of step 11527 doesn't seem to be define in the database( WARNING : output 0 of step 11527 have datatype=10 whereas input 0 of step 11584 have datatype=18 WARNING : type of input 5 of step 11534 doesn't seem to be define in the database( WARNING : output 0 of step 11584 have datatype=11 whereas input 5 of step 11534 have datatype=None WARNING : type of output 1 of step 11533 doesn't seem to be define in the database( WARNING : type of input 3 of step 11528 doesn't seem to be define in the database( WARNING : type of output 1 of step 11532 doesn't seem to be define in the database( WARNING : type of input 3 of step 11528 doesn't seem to be define in the database( WARNING : output 0 of step 11531 have datatype=1 whereas input 0 of step 11525 have datatype=2 DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4211, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,metal,papier,pet_fonce,pet_clair,pet_opaque,textiles_sanitaires', 'hashtag_parmi': 'pehd,background', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 0.3, 'ela': 0.3, 'etiquette': 0.1, 'film_plastique': 0.1, 'kraft': 0.3, 'metal': 1.5, 'papier': 0.3, 'pet_clair': 0.3, 'pet_opaque': 0.3, 'textiles_sanitaires': 0.3, 'pet_fonce': 0.3, 'background': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11548 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11556 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11557 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11552 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11552 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11555 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11555 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11580 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11580 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11551 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11550 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11550 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11559 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11551 doesn't seem to be define in the database( WARNING : type of input 3 of step 11550 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11548 doesn't seem to be define in the database( WARNING : type of input 2 of step 11552 doesn't seem to be define in the database( WARNING : output 1 of step 11548 have datatype=2 whereas input 1 of step 11555 have datatype=7 WARNING : type of output 2 of step 11555 doesn't seem to be define in the database( WARNING : type of input 1 of step 11549 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11551 have datatype=10 whereas input 3 of step 11558 have datatype=6 WARNING : type of input 2 of step 11580 doesn't seem to be define in the database( WARNING : output 1 of step 11549 have datatype=7 whereas input 2 of step 11580 have datatype=None WARNING : type of output 3 of step 11580 doesn't seem to be define in the database( WARNING : type of input 1 of step 11551 doesn't seem to be define in the database( WARNING : output 0 of step 11551 have datatype=10 whereas input 0 of step 11586 have datatype=18 WARNING : type of input 5 of step 11558 doesn't seem to be define in the database( WARNING : output 0 of step 11586 have datatype=11 whereas input 5 of step 11558 have datatype=None WARNING : type of output 1 of step 11556 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : type of output 1 of step 11557 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : output 0 of step 11555 have datatype=1 whereas input 0 of step 11549 have datatype=2 DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4200, 'hashtag_proportion': 'carton,ela,etiquette,film_plastique,kraft,metal,papier,pehd,pet_opaque,textiles_sanitaires,barquette_opaque,pet_clair', 'hashtag_parmi': 'pet_fonce,background', 'hashtag_weights': {'barquette_opaque': 1.5, 'carton': 2.5, 'ela': 1.5, 'etiquette': 1.5, 'film_plastique': 1, 'kraft': 1.5, 'metal': 3.0, 'papier': 1.2, 'pehd': 1.5, 'pet_clair': 1.5, 'pet_opaque': 1.5, 'textiles_sanitaires': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11536 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11545 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11544 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11540 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11540 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11543 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11543 merge_mask_thcl_custom have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 11537 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11579 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11579 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11539 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11538 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11538 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11547 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11539 doesn't seem to be define in the database( WARNING : type of input 3 of step 11538 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11536 doesn't seem to be define in the database( WARNING : type of input 2 of step 11540 doesn't seem to be define in the database( WARNING : output 1 of step 11536 have datatype=2 whereas input 1 of step 11543 have datatype=7 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11539 have datatype=10 whereas input 3 of step 11546 have datatype=6 WARNING : type of input 2 of step 11579 doesn't seem to be define in the database( WARNING : output 1 of step 11537 have datatype=7 whereas input 2 of step 11579 have datatype=None WARNING : type of output 3 of step 11579 doesn't seem to be define in the database( WARNING : type of input 1 of step 11539 doesn't seem to be define in the database( WARNING : output 0 of step 11539 have datatype=10 whereas input 0 of step 11585 have datatype=18 WARNING : type of input 5 of step 11546 doesn't seem to be define in the database( WARNING : output 0 of step 11585 have datatype=11 whereas input 5 of step 11546 have datatype=None WARNING : type of output 1 of step 11545 doesn't seem to be define in the database( WARNING : type of input 3 of step 11540 doesn't seem to be define in the database( WARNING : type of output 1 of step 11544 doesn't seem to be define in the database( WARNING : type of input 3 of step 11540 doesn't seem to be define in the database( WARNING : output 0 of step 11543 have datatype=1 whereas input 0 of step 11537 have datatype=2 DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4205, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'metal,background', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 1.5, 'ela': 1.5, 'etiquette': 1, 'film_plastique': 1, 'kraft': 1, 'papier': 1, 'pehd': 1.5, 'pet_clair': 1.5, 'pet_opaque': 1.5, 'textiles_sanitaires': 1.5, 'pet_fonce': 1.5}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3594, 'hashtag_proportion': 'papier,carton,metal,pet_clair,autre,pehd,pet_fonce', 'hashtag_parmi': 'refus,background', 'hashtag_weights': {'papier': 1, 'carton': 1, 'metal': 1, 'pet_clair': 1, 'autre': 1, 'pehd': 1, 'pet_fonce': 1, 'refus': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier nb_day : (0, 31) VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11488 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11496 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11497 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11492 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11492 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11495 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11495 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11489 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11489 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11575 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11575 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11491 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11490 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11490 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11498 send_mail_cod have less outputs used (0) than in the step definition (1) : some outputs may be not used ! Step 11499 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11491 doesn't seem to be define in the database( WARNING : type of input 3 of step 11490 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11488 doesn't seem to be define in the database( WARNING : type of input 2 of step 11492 doesn't seem to be define in the database( WARNING : output 1 of step 11488 have datatype=2 whereas input 1 of step 11495 have datatype=7 WARNING : type of output 2 of step 11495 doesn't seem to be define in the database( WARNING : type of input 1 of step 11489 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11491 have datatype=10 whereas input 3 of step 11498 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11575 doesn't seem to be define in the database( WARNING : output 1 of step 11489 have datatype=7 whereas input 2 of step 11575 have datatype=None WARNING : type of output 3 of step 11575 doesn't seem to be define in the database( WARNING : type of input 1 of step 11491 doesn't seem to be define in the database( WARNING : output 0 of step 11491 have datatype=10 whereas input 0 of step 11581 have datatype=18 WARNING : type of input 5 of step 11498 doesn't seem to be define in the database( WARNING : output 0 of step 11581 have datatype=11 whereas input 5 of step 11498 have datatype=None WARNING : type of output 1 of step 11496 doesn't seem to be define in the database( WARNING : type of input 3 of step 11492 doesn't seem to be define in the database( WARNING : type of output 1 of step 11497 doesn't seem to be define in the database( WARNING : type of input 3 of step 11492 doesn't seem to be define in the database( WARNING : output 0 of step 11495 have datatype=1 whereas input 0 of step 11489 have datatype=2 DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4209, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,metal,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'papier,background', 'hashtag_weights': {'barquette_opaque': 0.7, 'carton': 0.7, 'ela': 0.7, 'etiquette': 0.5, 'film_plastique': 0.5, 'kraft': 0.7, 'metal': 1.5, 'pehd': 0.7, 'pet_clair': 0.7, 'pet_opaque': 0.7, 'textiles_sanitaires': 0.5, 'pet_fonce': 0.7}, 'ETA': 600} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4207, 'hashtag_proportion': 'barquette_opaque,ela,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'carton,background', 'hashtag_weights': {'barquette_opaque': 1, 'ela': 1, 'etiquette': 1.0, 'film_plastique': 0.5, 'kraft': 1, 'metal': 3.0, 'papier': 1, 'pehd': 2, 'pet_clair': 2, 'pet_opaque': 2, 'textiles_sanitaires': 1.0, 'pet_fonce': 2}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3726, 'hashtag_proportion': 'Carton_brun,Carton_gris,Teint_Dans_La_Masse,autre_refus,cartonnette,kraft,metal,plastique', 'hashtag_parmi': 'papier,background', 'hashtag_weights': {'Carton_brun': 1.5, 'Carton_gris': 1.5, 'Teint_Dans_La_Masse': 1.0, 'autre_refus': 1.5, 'cartonnette': 1.0, 'kraft': 1.5, 'metal': 3, 'plastique': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11512 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11521 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11520 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11516 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11516 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11519 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11519 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11513 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11513 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11577 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11577 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11515 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11514 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11514 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11523 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11515 doesn't seem to be define in the database( WARNING : type of input 3 of step 11514 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11512 doesn't seem to be define in the database( WARNING : type of input 2 of step 11516 doesn't seem to be define in the database( WARNING : output 1 of step 11512 have datatype=2 whereas input 1 of step 11519 have datatype=7 WARNING : type of output 2 of step 11519 doesn't seem to be define in the database( WARNING : type of input 1 of step 11513 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11515 have datatype=10 whereas input 3 of step 11522 have datatype=6 WARNING : type of input 2 of step 11577 doesn't seem to be define in the database( WARNING : output 1 of step 11513 have datatype=7 whereas input 2 of step 11577 have datatype=None WARNING : type of output 3 of step 11577 doesn't seem to be define in the database( WARNING : type of input 1 of step 11515 doesn't seem to be define in the database( WARNING : output 0 of step 11515 have datatype=10 whereas input 0 of step 11583 have datatype=18 WARNING : type of input 5 of step 11522 doesn't seem to be define in the database( WARNING : output 0 of step 11583 have datatype=11 whereas input 5 of step 11522 have datatype=None WARNING : type of output 1 of step 11521 doesn't seem to be define in the database( WARNING : type of input 3 of step 11516 doesn't seem to be define in the database( WARNING : type of output 1 of step 11520 doesn't seem to be define in the database( WARNING : type of input 3 of step 11516 doesn't seem to be define in the database( WARNING : output 0 of step 11519 have datatype=1 whereas input 0 of step 11513 have datatype=2 DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4203, 'hashtag_proportion': 'barquette_opaque,carton,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'ela,background', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 1, 'etiquette': 0.5, 'film_plastique': 0.5, 'kraft': 0.8, 'metal': 2, 'papier': 0.8, 'pehd': 0.8, 'pet_clair': 0.8, 'pet_opaque': 0.8, 'textiles_sanitaires': 0.5, 'pet_fonce': 0.8}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11560 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11567 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11567 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11563 crop_condition is not consistent : 4 used against 2 in the step definition ! Step 11563 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11564 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11564 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11573 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11573 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11566 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11566 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 1 of step 11560 have datatype=2 whereas input 1 of step 11564 have datatype=7 WARNING : type of output 2 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11565 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11567 doesn't seem to be define in the database( WARNING : type of input 3 of step 11563 doesn't seem to be define in the database( WARNING : type of output 3 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11568 doesn't seem to be define in the database( WARNING : type of output 1 of step 11568 doesn't seem to be define in the database( WARNING : type of input 3 of step 11566 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11570 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11569 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11570 doesn't seem to be define in the database( WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11569 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11568 have datatype=10 whereas input 3 of step 11571 have datatype=6 WARNING : type of input 2 of step 11573 doesn't seem to be define in the database( WARNING : output 1 of step 11565 have datatype=7 whereas input 2 of step 11573 have datatype=None WARNING : type of output 3 of step 11573 doesn't seem to be define in the database( WARNING : type of input 3 of step 11568 doesn't seem to be define in the database( WARNING : output 0 of step 11568 have datatype=10 whereas input 0 of step 11587 have datatype=18 WARNING : type of input 5 of step 11571 doesn't seem to be define in the database( WARNING : output 0 of step 11587 have datatype=11 whereas input 5 of step 11571 have datatype=None WARNING : output 0 of step 11564 have datatype=1 whereas input 0 of step 11565 have datatype=2 DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3327, 'hashtag_proportion': 'autre,carton,metal,papier,pehd,pet_fonce', 'hashtag_parmi': 'pet_clair,bouchon,etiquette,barquette_avec_film,background', 'hashtag_weights': {'autre': 8.0, 'barquette_avec_film': 6, 'carton': 8.0, 'metal': 12, 'papier': 5, 'pehd': 8, 'pet_fonce': 8, 'bouchon': 8, 'etiquette': 8}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11978 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11987 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11986 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11982 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11982 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11985 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11985 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11979 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11979 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11990 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11990 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11981 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11980 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11980 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11989 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11981 doesn't seem to be define in the database( WARNING : type of input 3 of step 11980 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11978 doesn't seem to be define in the database( WARNING : type of input 2 of step 11982 doesn't seem to be define in the database( WARNING : output 1 of step 11978 have datatype=2 whereas input 1 of step 11985 have datatype=7 WARNING : type of output 2 of step 11985 doesn't seem to be define in the database( WARNING : type of input 1 of step 11979 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11981 have datatype=10 whereas input 3 of step 11988 have datatype=6 WARNING : type of input 2 of step 11990 doesn't seem to be define in the database( WARNING : output 1 of step 11979 have datatype=7 whereas input 2 of step 11990 have datatype=None WARNING : type of output 3 of step 11990 doesn't seem to be define in the database( WARNING : type of input 1 of step 11981 doesn't seem to be define in the database( WARNING : output 0 of step 11981 have datatype=10 whereas input 0 of step 11991 have datatype=18 WARNING : type of input 5 of step 11988 doesn't seem to be define in the database( WARNING : output 0 of step 11991 have datatype=11 whereas input 5 of step 11988 have datatype=None WARNING : type of output 1 of step 11987 doesn't seem to be define in the database( WARNING : type of input 3 of step 11982 doesn't seem to be define in the database( WARNING : type of output 1 of step 11986 doesn't seem to be define in the database( WARNING : type of input 3 of step 11982 doesn't seem to be define in the database( WARNING : output 0 of step 11985 have datatype=1 whereas input 0 of step 11979 have datatype=2 DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4461, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,pehd,kraft,metal,papier,pet_fonce,pet_clair,pet_opaque,textiles_sanitaires', 'hashtag_parmi': 'film_plastique', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 0.3, 'ela': 0.3, 'etiquette': 0.1, 'film_plastique': 0.1, 'kraft': 0.3, 'metal': 1.5, 'papier': 0.3, 'pet_clair': 0.3, 'pet_opaque': 0.3, 'textiles_sanitaires': 0.3, 'pet_fonce': 0.3}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11524 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11533 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11532 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11528 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11528 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11531 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11531 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11525 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11525 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11578 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11578 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11527 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11526 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11526 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11535 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11527 doesn't seem to be define in the database( WARNING : type of input 3 of step 11526 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11524 doesn't seem to be define in the database( WARNING : type of input 2 of step 11528 doesn't seem to be define in the database( WARNING : output 1 of step 11524 have datatype=2 whereas input 1 of step 11531 have datatype=7 WARNING : type of output 2 of step 11531 doesn't seem to be define in the database( WARNING : type of input 1 of step 11525 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11527 have datatype=10 whereas input 3 of step 11534 have datatype=6 WARNING : type of input 2 of step 11578 doesn't seem to be define in the database( WARNING : output 1 of step 11525 have datatype=7 whereas input 2 of step 11578 have datatype=None WARNING : type of output 3 of step 11578 doesn't seem to be define in the database( WARNING : type of input 1 of step 11527 doesn't seem to be define in the database( WARNING : output 0 of step 11527 have datatype=10 whereas input 0 of step 11584 have datatype=18 WARNING : type of input 5 of step 11534 doesn't seem to be define in the database( WARNING : output 0 of step 11584 have datatype=11 whereas input 5 of step 11534 have datatype=None WARNING : type of output 1 of step 11533 doesn't seem to be define in the database( WARNING : type of input 3 of step 11528 doesn't seem to be define in the database( WARNING : type of output 1 of step 11532 doesn't seem to be define in the database( WARNING : type of input 3 of step 11528 doesn't seem to be define in the database( WARNING : output 0 of step 11531 have datatype=1 whereas input 0 of step 11525 have datatype=2 DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4211, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,metal,papier,pet_fonce,pet_clair,pet_opaque,textiles_sanitaires', 'hashtag_parmi': 'pehd,background', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 0.3, 'ela': 0.3, 'etiquette': 0.1, 'film_plastique': 0.1, 'kraft': 0.3, 'metal': 1.5, 'papier': 0.3, 'pet_clair': 0.3, 'pet_opaque': 0.3, 'textiles_sanitaires': 0.3, 'pet_fonce': 0.3, 'background': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11548 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11556 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11557 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11552 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11552 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11555 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11555 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11580 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11580 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11551 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11550 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11550 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11559 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11551 doesn't seem to be define in the database( WARNING : type of input 3 of step 11550 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11548 doesn't seem to be define in the database( WARNING : type of input 2 of step 11552 doesn't seem to be define in the database( WARNING : output 1 of step 11548 have datatype=2 whereas input 1 of step 11555 have datatype=7 WARNING : type of output 2 of step 11555 doesn't seem to be define in the database( WARNING : type of input 1 of step 11549 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11551 have datatype=10 whereas input 3 of step 11558 have datatype=6 WARNING : type of input 2 of step 11580 doesn't seem to be define in the database( WARNING : output 1 of step 11549 have datatype=7 whereas input 2 of step 11580 have datatype=None WARNING : type of output 3 of step 11580 doesn't seem to be define in the database( WARNING : type of input 1 of step 11551 doesn't seem to be define in the database( WARNING : output 0 of step 11551 have datatype=10 whereas input 0 of step 11586 have datatype=18 WARNING : type of input 5 of step 11558 doesn't seem to be define in the database( WARNING : output 0 of step 11586 have datatype=11 whereas input 5 of step 11558 have datatype=None WARNING : type of output 1 of step 11556 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : type of output 1 of step 11557 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : output 0 of step 11555 have datatype=1 whereas input 0 of step 11549 have datatype=2 DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4200, 'hashtag_proportion': 'carton,ela,etiquette,film_plastique,kraft,metal,papier,pehd,pet_opaque,textiles_sanitaires,barquette_opaque,pet_clair', 'hashtag_parmi': 'pet_fonce,background', 'hashtag_weights': {'barquette_opaque': 1.5, 'carton': 2.5, 'ela': 1.5, 'etiquette': 1.5, 'film_plastique': 1, 'kraft': 1.5, 'metal': 3.0, 'papier': 1.2, 'pehd': 1.5, 'pet_clair': 1.5, 'pet_opaque': 1.5, 'textiles_sanitaires': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11536 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11545 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11544 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11540 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11540 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11543 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11543 merge_mask_thcl_custom have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 11537 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11579 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11579 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11539 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11538 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11538 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11547 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11539 doesn't seem to be define in the database( WARNING : type of input 3 of step 11538 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11536 doesn't seem to be define in the database( WARNING : type of input 2 of step 11540 doesn't seem to be define in the database( WARNING : output 1 of step 11536 have datatype=2 whereas input 1 of step 11543 have datatype=7 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11539 have datatype=10 whereas input 3 of step 11546 have datatype=6 WARNING : type of input 2 of step 11579 doesn't seem to be define in the database( WARNING : output 1 of step 11537 have datatype=7 whereas input 2 of step 11579 have datatype=None WARNING : type of output 3 of step 11579 doesn't seem to be define in the database( WARNING : type of input 1 of step 11539 doesn't seem to be define in the database( WARNING : output 0 of step 11539 have datatype=10 whereas input 0 of step 11585 have datatype=18 WARNING : type of input 5 of step 11546 doesn't seem to be define in the database( WARNING : output 0 of step 11585 have datatype=11 whereas input 5 of step 11546 have datatype=None WARNING : type of output 1 of step 11545 doesn't seem to be define in the database( WARNING : type of input 3 of step 11540 doesn't seem to be define in the database( WARNING : type of output 1 of step 11544 doesn't seem to be define in the database( WARNING : type of input 3 of step 11540 doesn't seem to be define in the database( WARNING : output 0 of step 11543 have datatype=1 whereas input 0 of step 11537 have datatype=2 DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4205, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'metal,background', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 1.5, 'ela': 1.5, 'etiquette': 1, 'film_plastique': 1, 'kraft': 1, 'papier': 1, 'pehd': 1.5, 'pet_clair': 1.5, 'pet_opaque': 1.5, 'textiles_sanitaires': 1.5, 'pet_fonce': 1.5}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3594, 'hashtag_proportion': 'papier,carton,metal,pet_clair,autre,pehd,pet_fonce', 'hashtag_parmi': 'refus,background', 'hashtag_weights': {'papier': 1, 'carton': 1, 'metal': 1, 'pet_clair': 1, 'autre': 1, 'pehd': 1, 'pet_fonce': 1, 'refus': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier TODO : Insert select and so on # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11488 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11496 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11497 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11492 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11492 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11495 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11495 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11489 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11489 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11575 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11575 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11491 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11490 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11490 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11498 send_mail_cod have less outputs used (0) than in the step definition (1) : some outputs may be not used ! Step 11499 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11491 doesn't seem to be define in the database( WARNING : type of input 3 of step 11490 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11488 doesn't seem to be define in the database( WARNING : type of input 2 of step 11492 doesn't seem to be define in the database( WARNING : output 1 of step 11488 have datatype=2 whereas input 1 of step 11495 have datatype=7 WARNING : type of output 2 of step 11495 doesn't seem to be define in the database( WARNING : type of input 1 of step 11489 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11491 have datatype=10 whereas input 3 of step 11498 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11575 doesn't seem to be define in the database( WARNING : output 1 of step 11489 have datatype=7 whereas input 2 of step 11575 have datatype=None WARNING : type of output 3 of step 11575 doesn't seem to be define in the database( WARNING : type of input 1 of step 11491 doesn't seem to be define in the database( WARNING : output 0 of step 11491 have datatype=10 whereas input 0 of step 11581 have datatype=18 WARNING : type of input 5 of step 11498 doesn't seem to be define in the database( WARNING : output 0 of step 11581 have datatype=11 whereas input 5 of step 11498 have datatype=None WARNING : type of output 1 of step 11496 doesn't seem to be define in the database( WARNING : type of input 3 of step 11492 doesn't seem to be define in the database( WARNING : type of output 1 of step 11497 doesn't seem to be define in the database( WARNING : type of input 3 of step 11492 doesn't seem to be define in the database( WARNING : output 0 of step 11495 have datatype=1 whereas input 0 of step 11489 have datatype=2 DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4209, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,metal,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'papier,background', 'hashtag_weights': {'barquette_opaque': 0.7, 'carton': 0.7, 'ela': 0.7, 'etiquette': 0.5, 'film_plastique': 0.5, 'kraft': 0.7, 'metal': 1.5, 'pehd': 0.7, 'pet_clair': 0.7, 'pet_opaque': 0.7, 'textiles_sanitaires': 0.5, 'pet_fonce': 0.7}, 'ETA': 600} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4207, 'hashtag_proportion': 'barquette_opaque,ela,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'carton,background', 'hashtag_weights': {'barquette_opaque': 1, 'ela': 1, 'etiquette': 1.0, 'film_plastique': 0.5, 'kraft': 1, 'metal': 3.0, 'papier': 1, 'pehd': 2, 'pet_clair': 2, 'pet_opaque': 2, 'textiles_sanitaires': 1.0, 'pet_fonce': 2}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3726, 'hashtag_proportion': 'Carton_brun,Carton_gris,Teint_Dans_La_Masse,autre_refus,cartonnette,kraft,metal,plastique', 'hashtag_parmi': 'papier,background', 'hashtag_weights': {'Carton_brun': 1.5, 'Carton_gris': 1.5, 'Teint_Dans_La_Masse': 1.0, 'autre_refus': 1.5, 'cartonnette': 1.0, 'kraft': 1.5, 'metal': 3, 'plastique': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11512 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11521 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11520 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11516 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11516 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11519 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11519 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11513 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11513 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11577 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11577 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11515 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11514 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11514 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11523 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11515 doesn't seem to be define in the database( WARNING : type of input 3 of step 11514 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11512 doesn't seem to be define in the database( WARNING : type of input 2 of step 11516 doesn't seem to be define in the database( WARNING : output 1 of step 11512 have datatype=2 whereas input 1 of step 11519 have datatype=7 WARNING : type of output 2 of step 11519 doesn't seem to be define in the database( WARNING : type of input 1 of step 11513 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11515 have datatype=10 whereas input 3 of step 11522 have datatype=6 WARNING : type of input 2 of step 11577 doesn't seem to be define in the database( WARNING : output 1 of step 11513 have datatype=7 whereas input 2 of step 11577 have datatype=None WARNING : type of output 3 of step 11577 doesn't seem to be define in the database( WARNING : type of input 1 of step 11515 doesn't seem to be define in the database( WARNING : output 0 of step 11515 have datatype=10 whereas input 0 of step 11583 have datatype=18 WARNING : type of input 5 of step 11522 doesn't seem to be define in the database( WARNING : output 0 of step 11583 have datatype=11 whereas input 5 of step 11522 have datatype=None WARNING : type of output 1 of step 11521 doesn't seem to be define in the database( WARNING : type of input 3 of step 11516 doesn't seem to be define in the database( WARNING : type of output 1 of step 11520 doesn't seem to be define in the database( WARNING : type of input 3 of step 11516 doesn't seem to be define in the database( WARNING : output 0 of step 11519 have datatype=1 whereas input 0 of step 11513 have datatype=2 DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4203, 'hashtag_proportion': 'barquette_opaque,carton,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'ela,background', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 1, 'etiquette': 0.5, 'film_plastique': 0.5, 'kraft': 0.8, 'metal': 2, 'papier': 0.8, 'pehd': 0.8, 'pet_clair': 0.8, 'pet_opaque': 0.8, 'textiles_sanitaires': 0.5, 'pet_fonce': 0.8}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11560 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11567 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11567 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11563 crop_condition is not consistent : 4 used against 2 in the step definition ! Step 11563 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11564 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11564 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11573 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11573 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11566 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11566 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 1 of step 11560 have datatype=2 whereas input 1 of step 11564 have datatype=7 WARNING : type of output 2 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11565 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11567 doesn't seem to be define in the database( WARNING : type of input 3 of step 11563 doesn't seem to be define in the database( WARNING : type of output 3 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11568 doesn't seem to be define in the database( WARNING : type of output 1 of step 11568 doesn't seem to be define in the database( WARNING : type of input 3 of step 11566 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11570 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11569 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11570 doesn't seem to be define in the database( WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11569 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11568 have datatype=10 whereas input 3 of step 11571 have datatype=6 WARNING : type of input 2 of step 11573 doesn't seem to be define in the database( WARNING : output 1 of step 11565 have datatype=7 whereas input 2 of step 11573 have datatype=None WARNING : type of output 3 of step 11573 doesn't seem to be define in the database( WARNING : type of input 3 of step 11568 doesn't seem to be define in the database( WARNING : output 0 of step 11568 have datatype=10 whereas input 0 of step 11587 have datatype=18 WARNING : type of input 5 of step 11571 doesn't seem to be define in the database( WARNING : output 0 of step 11587 have datatype=11 whereas input 5 of step 11571 have datatype=None WARNING : output 0 of step 11564 have datatype=1 whereas input 0 of step 11565 have datatype=2 DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3327, 'hashtag_proportion': 'autre,carton,metal,papier,pehd,pet_fonce', 'hashtag_parmi': 'pet_clair,bouchon,etiquette,barquette_avec_film,background', 'hashtag_weights': {'autre': 8.0, 'barquette_avec_film': 6, 'carton': 8.0, 'metal': 12, 'papier': 5, 'pehd': 8, 'pet_fonce': 8, 'bouchon': 8, 'etiquette': 8}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11978 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11987 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11986 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11982 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11982 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11985 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11985 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11979 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11979 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11990 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11990 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11981 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11980 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11980 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11989 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11981 doesn't seem to be define in the database( WARNING : type of input 3 of step 11980 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11978 doesn't seem to be define in the database( WARNING : type of input 2 of step 11982 doesn't seem to be define in the database( WARNING : output 1 of step 11978 have datatype=2 whereas input 1 of step 11985 have datatype=7 WARNING : type of output 2 of step 11985 doesn't seem to be define in the database( WARNING : type of input 1 of step 11979 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11981 have datatype=10 whereas input 3 of step 11988 have datatype=6 WARNING : type of input 2 of step 11990 doesn't seem to be define in the database( WARNING : output 1 of step 11979 have datatype=7 whereas input 2 of step 11990 have datatype=None WARNING : type of output 3 of step 11990 doesn't seem to be define in the database( WARNING : type of input 1 of step 11981 doesn't seem to be define in the database( WARNING : output 0 of step 11981 have datatype=10 whereas input 0 of step 11991 have datatype=18 WARNING : type of input 5 of step 11988 doesn't seem to be define in the database( WARNING : output 0 of step 11991 have datatype=11 whereas input 5 of step 11988 have datatype=None WARNING : type of output 1 of step 11987 doesn't seem to be define in the database( WARNING : type of input 3 of step 11982 doesn't seem to be define in the database( WARNING : type of output 1 of step 11986 doesn't seem to be define in the database( WARNING : type of input 3 of step 11982 doesn't seem to be define in the database( WARNING : output 0 of step 11985 have datatype=1 whereas input 0 of step 11979 have datatype=2 DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4461, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,pehd,kraft,metal,papier,pet_fonce,pet_clair,pet_opaque,textiles_sanitaires', 'hashtag_parmi': 'film_plastique', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 0.3, 'ela': 0.3, 'etiquette': 0.1, 'film_plastique': 0.1, 'kraft': 0.3, 'metal': 1.5, 'papier': 0.3, 'pet_clair': 0.3, 'pet_opaque': 0.3, 'textiles_sanitaires': 0.3, 'pet_fonce': 0.3}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11524 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11533 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11532 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11528 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11528 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11531 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11531 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11525 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11525 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11578 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11578 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11527 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11526 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11526 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11535 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11527 doesn't seem to be define in the database( WARNING : type of input 3 of step 11526 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11524 doesn't seem to be define in the database( WARNING : type of input 2 of step 11528 doesn't seem to be define in the database( WARNING : output 1 of step 11524 have datatype=2 whereas input 1 of step 11531 have datatype=7 WARNING : type of output 2 of step 11531 doesn't seem to be define in the database( WARNING : type of input 1 of step 11525 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11527 have datatype=10 whereas input 3 of step 11534 have datatype=6 WARNING : type of input 2 of step 11578 doesn't seem to be define in the database( WARNING : output 1 of step 11525 have datatype=7 whereas input 2 of step 11578 have datatype=None WARNING : type of output 3 of step 11578 doesn't seem to be define in the database( WARNING : type of input 1 of step 11527 doesn't seem to be define in the database( WARNING : output 0 of step 11527 have datatype=10 whereas input 0 of step 11584 have datatype=18 WARNING : type of input 5 of step 11534 doesn't seem to be define in the database( WARNING : output 0 of step 11584 have datatype=11 whereas input 5 of step 11534 have datatype=None WARNING : type of output 1 of step 11533 doesn't seem to be define in the database( WARNING : type of input 3 of step 11528 doesn't seem to be define in the database( WARNING : type of output 1 of step 11532 doesn't seem to be define in the database( WARNING : type of input 3 of step 11528 doesn't seem to be define in the database( WARNING : output 0 of step 11531 have datatype=1 whereas input 0 of step 11525 have datatype=2 DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4211, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,metal,papier,pet_fonce,pet_clair,pet_opaque,textiles_sanitaires', 'hashtag_parmi': 'pehd,background', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 0.3, 'ela': 0.3, 'etiquette': 0.1, 'film_plastique': 0.1, 'kraft': 0.3, 'metal': 1.5, 'papier': 0.3, 'pet_clair': 0.3, 'pet_opaque': 0.3, 'textiles_sanitaires': 0.3, 'pet_fonce': 0.3, 'background': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11548 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11556 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11557 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11552 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11552 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11555 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11555 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11580 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11580 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11551 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11550 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11550 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11559 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11551 doesn't seem to be define in the database( WARNING : type of input 3 of step 11550 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11548 doesn't seem to be define in the database( WARNING : type of input 2 of step 11552 doesn't seem to be define in the database( WARNING : output 1 of step 11548 have datatype=2 whereas input 1 of step 11555 have datatype=7 WARNING : type of output 2 of step 11555 doesn't seem to be define in the database( WARNING : type of input 1 of step 11549 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11551 have datatype=10 whereas input 3 of step 11558 have datatype=6 WARNING : type of input 2 of step 11580 doesn't seem to be define in the database( WARNING : output 1 of step 11549 have datatype=7 whereas input 2 of step 11580 have datatype=None WARNING : type of output 3 of step 11580 doesn't seem to be define in the database( WARNING : type of input 1 of step 11551 doesn't seem to be define in the database( WARNING : output 0 of step 11551 have datatype=10 whereas input 0 of step 11586 have datatype=18 WARNING : type of input 5 of step 11558 doesn't seem to be define in the database( WARNING : output 0 of step 11586 have datatype=11 whereas input 5 of step 11558 have datatype=None WARNING : type of output 1 of step 11556 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : type of output 1 of step 11557 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : output 0 of step 11555 have datatype=1 whereas input 0 of step 11549 have datatype=2 DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4200, 'hashtag_proportion': 'carton,ela,etiquette,film_plastique,kraft,metal,papier,pehd,pet_opaque,textiles_sanitaires,barquette_opaque,pet_clair', 'hashtag_parmi': 'pet_fonce,background', 'hashtag_weights': {'barquette_opaque': 1.5, 'carton': 2.5, 'ela': 1.5, 'etiquette': 1.5, 'film_plastique': 1, 'kraft': 1.5, 'metal': 3.0, 'papier': 1.2, 'pehd': 1.5, 'pet_clair': 1.5, 'pet_opaque': 1.5, 'textiles_sanitaires': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11536 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11545 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11544 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11540 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11540 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11543 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11543 merge_mask_thcl_custom have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 11537 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11579 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11579 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11539 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11538 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11538 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11547 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11539 doesn't seem to be define in the database( WARNING : type of input 3 of step 11538 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11536 doesn't seem to be define in the database( WARNING : type of input 2 of step 11540 doesn't seem to be define in the database( WARNING : output 1 of step 11536 have datatype=2 whereas input 1 of step 11543 have datatype=7 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11539 have datatype=10 whereas input 3 of step 11546 have datatype=6 WARNING : type of input 2 of step 11579 doesn't seem to be define in the database( WARNING : output 1 of step 11537 have datatype=7 whereas input 2 of step 11579 have datatype=None WARNING : type of output 3 of step 11579 doesn't seem to be define in the database( WARNING : type of input 1 of step 11539 doesn't seem to be define in the database( WARNING : output 0 of step 11539 have datatype=10 whereas input 0 of step 11585 have datatype=18 WARNING : type of input 5 of step 11546 doesn't seem to be define in the database( WARNING : output 0 of step 11585 have datatype=11 whereas input 5 of step 11546 have datatype=None WARNING : type of output 1 of step 11545 doesn't seem to be define in the database( WARNING : type of input 3 of step 11540 doesn't seem to be define in the database( WARNING : type of output 1 of step 11544 doesn't seem to be define in the database( WARNING : type of input 3 of step 11540 doesn't seem to be define in the database( WARNING : output 0 of step 11543 have datatype=1 whereas input 0 of step 11537 have datatype=2 DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4205, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'metal,background', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 1.5, 'ela': 1.5, 'etiquette': 1, 'film_plastique': 1, 'kraft': 1, 'papier': 1, 'pehd': 1.5, 'pet_clair': 1.5, 'pet_opaque': 1.5, 'textiles_sanitaires': 1.5, 'pet_fonce': 1.5}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3594, 'hashtag_proportion': 'papier,carton,metal,pet_clair,autre,pehd,pet_fonce', 'hashtag_parmi': 'refus,background', 'hashtag_weights': {'papier': 1, 'carton': 1, 'metal': 1, 'pet_clair': 1, 'autre': 1, 'pehd': 1, 'pet_fonce': 1, 'refus': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier select count(distinct mtr_photo_id) from MTRUser.mtr_portfolio_photos where mtr_portfolio_id in (select id from MTRUser.mtr_portfolios where id in (select mtr_portfolio_id from MTRPhoto.dashboard_results where dashboard_run_id in(select last_run_id from MTRPhoto.dashboard_entry_day where dashboard_place_id in (select id from MTRPhoto.dashboard_places where name = 'Romainville_Presse_1' and date like '%2022-08%') and created_at like '%2022-08%'))); nb_day : (0, 31) after unwanted_material_data nb_day : (0, 31) after coverage_data after number_of_batch date_start : 2022-08-01 : dt_date_just_month_year : 2022-08-01 00:00:00 : VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! after pl.get_datou_sts_from_crontab : verbose : False no sts found, try to find from database SELECT dri.id FROM MTRPhoto.dashboard_run_ids dri, MTRPhoto.dashboard_entry_day ded, MTRPhoto.dashboard_places dp WHERE dp.name= "Romainville_Presse_1" AND ded.dashboard_place_id=dp.id AND dri.dashboard_entry_day=ded.id AND dri.id=ded.last_run_id AND ded.date >= "2022-08-01" AND ded.date <= "2022-08-31" apple3 {'gm': {'mat': 'gm', 'pht': 4209, 'datou_carac_id': 3994, 'unwanted_material': [], 'hashtag_majoritaire_from_carac': 'papier,background'}, 'emr': {'mat': 'emr', 'pht': 4207, 'datou_carac_id': 3993, 'unwanted_material': [], 'hashtag_majoritaire_from_carac': 'carton,background'}, 'jrm': {'mat': 'jrm', 'pht': 3726, 'datou_carac_id': 3459, 'unwanted_material': [], 'hashtag_majoritaire_from_carac': 'papier,background'}, 'ela': {'mat': 'ela', 'pht': 4203, 'datou_carac_id': 3991, 'unwanted_material': [], 'hashtag_majoritaire_from_carac': 'ela,background'}, 'pet_clair': {'mat': 'pet_clair', 'pht': 3327, 'datou_carac_id': 3804, 'unwanted_material': [], 'hashtag_majoritaire_from_carac': 'pet_clair,bouchon,etiquette,barquette_avec_film,background'}, 'film_pedb': {'mat': 'film_pedb', 'pht': 4461, 'datou_carac_id': 4322, 'unwanted_material': [], 'hashtag_majoritaire_from_carac': 'film_plastique'}, 'pehd_pp': {'mat': 'pehd_pp', 'pht': 4211, 'datou_carac_id': 3995, 'unwanted_material': [], 'hashtag_majoritaire_from_carac': 'pehd,background'}, 'pet_fonce': {'mat': 'pet_fonce', 'pht': 4200, 'datou_carac_id': 4153, 'unwanted_material': [], 'hashtag_majoritaire_from_carac': 'pet_fonce,background'}, 'aluminium': {'mat': 'aluminium', 'pht': 4205, 'datou_carac_id': 3992, 'unwanted_material': [], 'hashtag_majoritaire_from_carac': 'metal,background'}, 'refus': {'mat': 'refus', 'pht': 3594, 'datou_carac_id': 3318, 'unwanted_material': [], 'hashtag_majoritaire_from_carac': 'refus,background'}} SELECT h.hashtag as unwanted_material, substr(dr.hashtag,8) as main_material, ptp.type as pht_type, sum(pcr.value*dr.nombre_balle)/sum(dr.nombre_balle) as ratio, count(distinct mpp.mtr_photo_id) as nb_photo, group_concat(distinct ptp.mtr_portfolio_id_2) as list_port_cont, group_concat(distinct concat(cast(ptp.mtr_portfolio_id_1 as char), ":", cast(ptp.mtr_portfolio_id_2 as char))) as assoc_port, group_concat(distinct concat(cast(ptp.mtr_portfolio_id_1 as char), ":", h.hashtag, ":", cast(ptp.type as char), ":", cast(ptp.mtr_portfolio_id_2 as char))) as assoc_mat FROM MTRPhoto.dashboard_results dr, MTRPhoto.mtr_port_to_port_ids ptp, MTRUser.mtr_portfolio_photos mpp, MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h WHERE dr.dashboard_run_id IN (449271,454376,454388,454411,454399,454424,451519,452689,468274,455185,456478,457640,459828,461074,462392,463490,464885,465870,469411,470781,897152,474755,474338,475306,477478,478927,479886) AND dr.mtr_portfolio_id=ptp.mtr_portfolio_id_1 AND dr.qualite >= 0 AND mpp.mtr_portfolio_id=ptp.mtr_portfolio_id_2 AND pcr.portfolio_id=ptp.mtr_portfolio_id_1 AND h.hashtag_id = pcr.hashtag_id AND ptp.type = pcr.hashtag_type AND mpp.hide_status = 0 AND ptp.hashtag_id=h.hashtag_id AND ptp.type IN (4209,4207,3726,4203,3327,4461,4211,4200,4205,3594) group by h.hashtag, dr.hashtag, ptp.type; VR TODO TO BETTER PARSE ! ({'unwanted_material': 'autre', 'main_material': 'pet_clair', 'pht_type': 3327, 'ratio': 0.025985557831013643, 'nb_photo': 16651, 'list_port_cont': '6601211,6601249,6601319,6601376,6601558,6601691,6601783,6601837,6602312,6603611,6603837,6603984,6604939,6606283,6606361,6607127,6607396,6607889,6608318,6608592,6608684,6608960,6609911,6610060,6610278,6610907,6611078,6613725,6614148,6615899,6616064,6616199,6616975,6617461,6617846,6618177,6618947,6620505,6620992,6621119,6621146,6621174,6621388,6621447,6621537,6622105,6622162,6622311,6622378,6622426,6622514,6622647,6622758,6626372,6626974,6626997,6627200,6627837,6628024,6628557,6628624,6629354,6629396,6635806,6635864,6635897,6635947,6635974,6636029,6636109,6636139,6636295,6636316,6636423,6636599,6636674,6636727,6636791,6637048,6637689,6637708,6637756,6637854,6637954,6637974,6638095,6638421,6638597,6638696,6638833,6638947,6638968,6639187,6639299,6639353,6639652,6639761,6639844,6639904,6639965,6640123,6640725,6640745,6640776,6640959,6641209,6641306,6641333,6641484,6641521,6641655,6641820,6641954,6642026,6642079,6642285,6643237,6643372,6643479,6643603,6643631,6643664,6643695,6643718,6643895,6644078,6644458,6644663,', 'assoc_port': '6600535:6601249,6600537:6601691,6600543:6601211,6600545:6601376,6600547:6601558,6600550:6601783,6600553:6601319,6601140:6602312,6601199:6601837,6602727:6603837,6602729:6603984,6602732:6603611,6604400:6604939,6604702:6606361,6605500:6606283,6605502:6607127,6606682:6608318,6606685:6607889,6606687:6607396,6607836:6608592,6607838:6608684,6608144:6608960,6609197:6610060,6609198:6609911,6609963:6610278,6610497:6611078,6610499:6610907,6612953:6613725,6613333:6614148,6614966:6616199,6614968:6616064,6615360:6615899,6616171:6616975,6616960:6618177,6616966:6617461,6616967:6617846,6618310:6618947,6620036:6620505,6620039:6621388,6620042:6620992,6620404:6621146,6620441:6621447,6620445:6621174,6620446:6621537,6620449:6621119,6621639:6622647,6621642:6622758,6621645:6622514,6621650:6622378,6621652:6622426,6621655:6622162,6621656:6622105,6621661:6622311,6625901:6626372,6626270:6626974,6626272:6626997,6626275:6627200,6627097:6627837,6627099:6628024,6627946:6628557,6627948:6628624,6628988:6629354,6628991:6629396,6630847:6635947,', 'assoc_mat': '6600535:autre:3327:6601249,6600537:autre:3327:6601691,6600543:autre:3327:6601211,6600545:autre:3327:6601376,6600547:autre:3327:6601558,6600550:autre:3327:6601783,6600553:autre:3327:6601319,6601140:autre:3327:6602312,6601199:autre:3327:6601837,6602727:autre:3327:6603837,6602729:autre:3327:6603984,6602732:autre:3327:6603611,6604400:autre:3327:6604939,6604702:autre:3327:6606361,6605500:autre:3327:6606283,6605502:autre:3327:6607127,6606682:autre:3327:6608318,6606685:autre:3327:6607889,6606687:autre:3327:6607396,6607836:autre:3327:6608592,6607838:autre:3327:6608684,6608144:autre:3327:6608960,6609197:autre:3327:6610060,6609198:autre:3327:6609911,6609963:autre:3327:6610278,6610497:autre:3327:6611078,6610499:autre:3327:6610907,6612953:autre:3327:6613725,6613333:autre:3327:6614148,6614966:autre:3327:6616199,6614968:autre:3327:6616064,6615360:autre:3327:6615899,6616171:autre:3327:6616975,6616960:autre:3327:6618177,6616966:autre:3327:6617461,6616967:autre:3327:6617846,6618310:autre:3327:6618947,6620036:autre:3327:662050'}, {'unwanted_material': 'barquette_avec_film', 'main_material': 'pet_clair', 'pht_type': 3327, 'ratio': 0.0050634087913797535, 'nb_photo': 1051, 'list_port_cont': '6601216,6601255,6601316,6601366,6601556,6601694,6601795,6601849,6602314,6603610,6603845,6603981,6604938,6606272,6606380,6607136,6607388,6607885,6608324,6608593,6608675,6608967,6609910,6610048,6610273,6611082,6613721,6614147,6615898,6616193,6616972,6617468,6618176,6618950,6620509,6620988,6621144,6621167,6621391,6621449,6622102,6622163,6622316,6622379,6622436,6622519,6622752,6626364,6626973,6627004,6627197,6627840,6628023,6628564,6628623,6629352,6629394,6635811,6635862,6635901,6635945,6635972,6636036,6636112,6636138,6636318,6636424,6636724,6637044,6637685,6637716,6637764,6637852,6637945,6637984,6638094,6638596,6638700,6638835,6638944,6638974,6639298,6639361,6639645,6639764,6639852,6639896,6639968,6640121,6640722,6640783,6640963,6641211,6641294,6641332,6641486,6641520,6641652,6641944,6642022,6642080,6642290,6643373,6643478,6643608,6643683,6643716,6643902,6644079,6644456,6644652,6645162,6645304,6645766,6647408,6648376,6648805,6649738,6651383,6651686,6654487,6654608,6655045,6655877,6656213,6656668,6659085,6660221,', 'assoc_port': '6600535:6601255,6600537:6601694,6600543:6601216,6600545:6601366,6600547:6601556,6600550:6601795,6600553:6601316,6601140:6602314,6601199:6601849,6602727:6603845,6602729:6603981,6602732:6603610,6604400:6604938,6604702:6606380,6605500:6606272,6605502:6607136,6606682:6608324,6606685:6607885,6606687:6607388,6607836:6608593,6607838:6608675,6608144:6608967,6609197:6610048,6609198:6609910,6609963:6610273,6610497:6611082,6612953:6613721,6613333:6614147,6614966:6616193,6615360:6615898,6616171:6616972,6616960:6618176,6616966:6617468,6618310:6618950,6620036:6620509,6620039:6621391,6620042:6620988,6620404:6621144,6620441:6621449,6620445:6621167,6621642:6622752,6621645:6622519,6621650:6622379,6621652:6622436,6621655:6622163,6621656:6622102,6621661:6622316,6625901:6626364,6626270:6626973,6626272:6627004,6626275:6627197,6627097:6627840,6627099:6628023,6627946:6628564,6627948:6628623,6628988:6629352,6628991:6629394,6630847:6635945,6630849:6636036,6630851:6635972,6630854:6637685,6630934:6637764,6630936:6637716,6630938:6638094,', 'assoc_mat': '6600535:barquette_avec_film:3327:6601255,6600537:barquette_avec_film:3327:6601694,6600543:barquette_avec_film:3327:6601216,6600545:barquette_avec_film:3327:6601366,6600547:barquette_avec_film:3327:6601556,6600550:barquette_avec_film:3327:6601795,6600553:barquette_avec_film:3327:6601316,6601140:barquette_avec_film:3327:6602314,6601199:barquette_avec_film:3327:6601849,6602727:barquette_avec_film:3327:6603845,6602729:barquette_avec_film:3327:6603981,6602732:barquette_avec_film:3327:6603610,6604400:barquette_avec_film:3327:6604938,6604702:barquette_avec_film:3327:6606380,6605500:barquette_avec_film:3327:6606272,6605502:barquette_avec_film:3327:6607136,6606682:barquette_avec_film:3327:6608324,6606685:barquette_avec_film:3327:6607885,6606687:barquette_avec_film:3327:6607388,6607836:barquette_avec_film:3327:6608593,6607838:barquette_avec_film:3327:6608675,6608144:barquette_avec_film:3327:6608967,6609197:barquette_avec_film:3327:6610048,6609198:barquette_avec_film:3327:6609910,6609963:barquette_avec_film:3327:6610273'}, {'unwanted_material': 'barquette_opaque', 'main_material': 'ela', 'pht_type': 4203, 'ratio': 0.0006065490165070008, 'nb_photo': 9, 'list_port_cont': '6603426,6627334,6634749,6723417,6780640,6834099,6852168', 'assoc_port': '6602731:6603426,6626721:6627334,6630937:6634749,6671808:6834099,6722813:6723417,6780026:6780640,6851650:6852168', 'assoc_mat': '6602731:barquette_opaque:4203:6603426,6626721:barquette_opaque:4203:6627334,6630937:barquette_opaque:4203:6634749,6671808:barquette_opaque:4203:6834099,6722813:barquette_opaque:4203:6723417,6780026:barquette_opaque:4203:6780640,6851650:barquette_opaque:4203:6852168'}, {'unwanted_material': 'barquette_opaque', 'main_material': 'emr', 'pht_type': 4209, 'ratio': 0.0005293780694215035, 'nb_photo': 1, 'list_port_cont': '6692906', 'assoc_port': '6691778:6692906', 'assoc_mat': '6691778:barquette_opaque:4209:6692906'}, {'unwanted_material': 'barquette_opaque', 'main_material': 'pehd_pp', 'pht_type': 4211, 'ratio': 0.008662761320534096, 'nb_photo': 659, 'list_port_cont': '6600860,6600903,6601023,6601433,6602273,6602593,6603403,6606082,6607689,6608069,6608289,6609462,6610653,6614532,6615427,6615792,6616525,6618779,6618922,6620328,6621053,6621664,6621960,6622002,6622135,6622199,6624057,6626607,6627268,6628481,6629183,6629252,6634382,6635139,6638289,6638441,6640989,6642058,6642706,6650155,6650276,6650959,6658495,6664041,6668175,6669610,6672035,6674014,6674549,6674630,6674772,6675081,6675105,6675139,6675482,6676524,6677132,6677217,6678042,6678216,6678577,6678660,6678688,6678769,6678960,6678988,6681252,6687138,6692292,6693194,6693681,6693891,6694045,6694217,6694420,6698421,6698805,6699377,6699427,6700669,6707231,6711232,6711409,6711495,6712142,6713437,6713607,6713753,6714397,6716562,6717498,6717555,6718025,6719023,6719736,6720660,6720723,6721143,6721925,6722677,6723045,6723102,6724740,6724912,6724973,6725830,6729866,6730263,6730718,6731855,6732324,6732440,6735375,6738136,6740197,6740602,6741090,6741939,6743256,6743597,6743876,6745278,6747827,6751581,6751678,6751683,6752336,6754140,', 'assoc_port': '10844008:10846065,10844009:10845784,10844011:10845552,10844012:10845981,10844014:10845176,10844016:10845161,10844017:10845129,10844018:10844946,10844019:10845048,10844020:10844679,12107427:12108055,12107429:12107821,6600536:6601433,6600544:6600860,6600546:6601023,6600551:6600903,6601138:6602593,6601649:6602273,6602733:6603403,6604399:6608069,6605499:6610653,6605688:6606082,6606683:6607689,6607839:6608289,6609199:6609462,6614199:6614532,6614969:6615427,6615362:6615792,6616173:6616525,6618307:6618779,6618311:6618922,6620040:6620328,6620422:6621664,6620444:6621053,6621638:6624057,6621647:6622199,6621651:6622135,6621654:6621960,6621659:6622002,6626268:6626607,6627098:6627268,6627945:6628481,6628987:6629183,6628989:6629252,6630852:6674014,6630932:6674630,6630935:6674772,6630939:6675105,6631065:6675081,6631069:6675482,6631193:6635139,6631477:6676524,6631489:6677132,6631492:6677217,6631967:6634382,6632585:6678216,6632660:6678577,6632663:6678660,6632714:6678769,6632787:6678688,6632877:6678960,6632881:6678988,6635669:', 'assoc_mat': '10844008:barquette_opaque:4211:10846065,10844009:barquette_opaque:4211:10845784,10844011:barquette_opaque:4211:10845552,10844012:barquette_opaque:4211:10845981,10844014:barquette_opaque:4211:10845176,10844016:barquette_opaque:4211:10845161,10844017:barquette_opaque:4211:10845129,10844018:barquette_opaque:4211:10844946,10844019:barquette_opaque:4211:10845048,10844020:barquette_opaque:4211:10844679,12107427:barquette_opaque:4211:12108055,12107429:barquette_opaque:4211:12107821,6600536:barquette_opaque:4211:6601433,6600544:barquette_opaque:4211:6600860,6600546:barquette_opaque:4211:6601023,6600551:barquette_opaque:4211:6600903,6601138:barquette_opaque:4211:6602593,6601649:barquette_opaque:4211:6602273,6602733:barquette_opaque:4211:6603403,6604399:barquette_opaque:4211:6608069,6605499:barquette_opaque:4211:6610653,6605688:barquette_opaque:4211:6606082,6606683:barquette_opaque:4211:6607689,6607839:barquette_opaque:4211:6608289,6609199:barquette_opaque:4211:6609462,6614199:barquette_opaque:4211:6614532,6614969:barq'}, {'unwanted_material': 'barquette_opaque', 'main_material': 'pet_fonce', 'pht_type': 4200, 'ratio': 0.0009915902324084817, 'nb_photo': 5, 'list_port_cont': '6649286,6687459,6784020,6813915,6920756', 'assoc_port': '6631070:6649286,6686295:6687459,6782249:6784020,6813389:6813915,6920100:6920756', 'assoc_mat': '6631070:barquette_opaque:4200:6649286,6686295:barquette_opaque:4200:6687459,6782249:barquette_opaque:4200:6784020,6813389:barquette_opaque:4200:6813915,6920100:barquette_opaque:4200:6920756'}, {'unwanted_material': 'bouchon', 'main_material': 'pet_clair', 'pht_type': 3327, 'ratio': 0.002148587132747826, 'nb_photo': 2481, 'list_port_cont': '6601204,6601258,6601320,6601369,6601559,6601701,6601789,6601838,6602303,6603616,6603840,6603991,6604940,6606271,6606371,6607138,6607392,6607893,6608314,6608584,6608679,6608959,6609909,6610052,6610283,6610913,6611085,6613733,6614158,6615892,6616060,6616205,6616979,6617470,6617845,6618175,6618953,6620508,6620996,6621149,6621177,6621393,6621437,6621531,6622101,6622159,6622323,6622381,6622429,6622524,6622659,6622748,6626363,6626980,6626996,6627191,6627830,6628020,6628559,6628625,6629350,6629387,6635807,6635871,6635902,6635950,6635976,6636031,6636142,6636288,6636337,6636425,6636596,6636683,6636733,6636798,6637042,6637681,6637704,6637763,6637859,6637953,6637977,6638087,6638418,6638605,6638699,6638834,6638943,6638976,6639182,6639296,6639351,6639643,6639763,6639846,6639907,6639971,6640125,6640715,6640780,6640955,6641210,6641300,6641327,6641485,6641509,6641661,6641818,6641952,6642084,6642292,6643375,6643473,6643600,6643630,6643663,6643691,6643711,6643907,6644068,6644455,6644662,6645166,6645298,6645757,6647406,6648003,', 'assoc_port': '6600535:6601258,6600537:6601701,6600543:6601204,6600545:6601369,6600547:6601559,6600550:6601789,6600553:6601320,6601140:6602303,6601199:6601838,6602727:6603840,6602729:6603991,6602732:6603616,6604400:6604940,6604702:6606371,6605500:6606271,6605502:6607138,6606682:6608314,6606685:6607893,6606687:6607392,6607836:6608584,6607838:6608679,6608144:6608959,6609197:6610052,6609198:6609909,6609963:6610283,6610497:6611085,6610499:6610913,6612953:6613733,6613333:6614158,6614966:6616205,6614968:6616060,6615360:6615892,6616171:6616979,6616960:6618175,6616966:6617470,6616967:6617845,6618310:6618953,6620036:6620508,6620039:6621393,6620042:6620996,6620404:6621149,6620441:6621437,6620445:6621177,6620446:6621531,6621639:6622659,6621642:6622748,6621645:6622524,6621650:6622381,6621652:6622429,6621655:6622159,6621656:6622101,6621661:6622323,6625901:6626363,6626270:6626980,6626272:6626996,6626275:6627191,6627097:6627830,6627099:6628020,6627946:6628559,6627948:6628625,6628988:6629350,6628991:6629387,6630847:6635950,6630849:6636031,', 'assoc_mat': '6600535:bouchon:3327:6601258,6600537:bouchon:3327:6601701,6600543:bouchon:3327:6601204,6600545:bouchon:3327:6601369,6600547:bouchon:3327:6601559,6600550:bouchon:3327:6601789,6600553:bouchon:3327:6601320,6601140:bouchon:3327:6602303,6601199:bouchon:3327:6601838,6602727:bouchon:3327:6603840,6602729:bouchon:3327:6603991,6602732:bouchon:3327:6603616,6604400:bouchon:3327:6604940,6604702:bouchon:3327:6606371,6605500:bouchon:3327:6606271,6605502:bouchon:3327:6607138,6606682:bouchon:3327:6608314,6606685:bouchon:3327:6607893,6606687:bouchon:3327:6607392,6607836:bouchon:3327:6608584,6607838:bouchon:3327:6608679,6608144:bouchon:3327:6608959,6609197:bouchon:3327:6610052,6609198:bouchon:3327:6609909,6609963:bouchon:3327:6610283,6610497:bouchon:3327:6611085,6610499:bouchon:3327:6610913,6612953:bouchon:3327:6613733,6613333:bouchon:3327:6614158,6614966:bouchon:3327:6616205,6614968:bouchon:3327:6616060,6615360:bouchon:3327:6615892,6616171:bouchon:3327:6616979,6616960:bouchon:3327:6618175,6616966:bouchon:3327:6617470,6616967:b'}, {'unwanted_material': 'carton', 'main_material': 'ela', 'pht_type': 4203, 'ratio': 0.015781843756573148, 'nb_photo': 1998, 'list_port_cont': '6603428,6608804,6618325,6624159,6627335,6634751,6634798,6660090,6698369,6704158,6712719,6720528,6723218,6723410,6735159,6735455,6741137,6754060,6761153,6768731,6775020,6780639,6799269,6800310,6801317,6806363,6808106,6808745,6810123,6812813,6822554,6826369,6834087,6838770,6846433,6852159,6863267,6865659,6869925,6876020,6924800,6930493,6940832,10844173', 'assoc_port': '10844025:10844173,6602731:6603428,6608146:6608804,6617603:6618325,6620405:6624159,6626721:6627335,6630937:6634751,6631483:6634798,6632879:6660090,6638160:6704158,6653521:6723218,6664117:6735455,6671808:6834087,6682068:6768731,6685476:6799269,6685991:6800310,6686304:6801317,6690887:6735159,6696473:6698369,6712332:6712719,6718634:6720528,6722813:6723410,6740022:6741137,6745199:6810123,6753416:6754060,6760133:6761153,6765566:6808745,6774410:6775020,6780026:6780639,6786466:6808106,6793236:6806363,6811950:6812813,6820599:6822554,6825858:6826369,6837012:6838770,6846007:6846433,6851650:6852159,6863104:6863267,6865559:6865659,6869544:6869925,6875674:6876020,6894306:6930493,6900378:6940832,6923650:6924800', 'assoc_mat': '10844025:carton:4203:10844173,6602731:carton:4203:6603428,6608146:carton:4203:6608804,6617603:carton:4203:6618325,6620405:carton:4203:6624159,6626721:carton:4203:6627335,6630937:carton:4203:6634751,6631483:carton:4203:6634798,6632879:carton:4203:6660090,6638160:carton:4203:6704158,6653521:carton:4203:6723218,6664117:carton:4203:6735455,6671808:carton:4203:6834087,6682068:carton:4203:6768731,6685476:carton:4203:6799269,6685991:carton:4203:6800310,6686304:carton:4203:6801317,6690887:carton:4203:6735159,6696473:carton:4203:6698369,6712332:carton:4203:6712719,6718634:carton:4203:6720528,6722813:carton:4203:6723410,6740022:carton:4203:6741137,6745199:carton:4203:6810123,6753416:carton:4203:6754060,6760133:carton:4203:6761153,6765566:carton:4203:6808745,6774410:carton:4203:6775020,6780026:carton:4203:6780639,6786466:carton:4203:6808106,6793236:carton:4203:6806363,6811950:carton:4203:6812813,6820599:carton:4203:6822554,6825858:carton:4203:6826369,6837012:carton:4203:6838770,6846007:carton:4203:6846433,6851650:carton'}, {'unwanted_material': 'carton', 'main_material': 'emr', 'pht_type': 4207, 'ratio': 0.9743551532309155, 'nb_photo': 4, 'list_port_cont': '12107738,12108208', 'assoc_port': '12107419:12108208,12107426:12107738', 'assoc_mat': '12107419:carton:4207:12108208,12107426:carton:4207:12107738'}, {'unwanted_material': 'carton', 'main_material': 'emr', 'pht_type': 4209, 'ratio': 0.004418352534261281, 'nb_photo': 161, 'list_port_cont': '6600769,6601467,6602156,6616727,6617535,6617707,6618976,6620415,6621476,6621927,6622071,6625405,6627053,6637137,6638503,6641082,6644340,6647280,6648123,6651932,6655484,6657576,6664017,6666562,6667513,6668138,6668212,6669002,6669287,6669404,6670447,6670556,6670902,6672181,6673400,6674363,6678083,6682353,6690824,6692905,6694179,6695453,6695907,6697455,6699015,6711039,6712083,6712246,6716814,6721878,6723683,6740491,6742328,6751444,6754763,6812438,6824357', 'assoc_port': '6600533:6601467,6600540:6602156,6600552:6600769,6616168:6616727,6616961:6617707,6616963:6617535,6618302:6618976,6620037:6620415,6620443:6621476,6621640:6622071,6621646:6621927,6625237:6625405,6626722:6627053,6631064:6666562,6631190:6668138,6631196:6668212,6631480:6669002,6631482:6669287,6631491:6669404,6632580:6670447,6632661:6670556,6632883:6670902,6633864:6637137,6638162:6638503,6638777:6644340,6640593:6641082,6646444:6647280,6647214:6648123,6650509:6651932,6654838:6655484,6656897:6657576,6663620:6664017,6664426:6667513,6671806:6672181,6672700:6673400,6673893:6674363,6677866:6678083,6681682:6682353,6682898:6690824,6685513:6697455,6688873:6699015,6691778:6692905,6692502:6694179,6694731:6695907,6694740:6695453,6709375:6711039,6710867:6712246,6711682:6712083,6716079:6716814,6721779:6721878,6723504:6723683,6739465:6742328,6740030:6740491,6741911:6754763,6750987:6751444,6811912:6812438,6823971:6824357', 'assoc_mat': '6600533:carton:4209:6601467,6600540:carton:4209:6602156,6600552:carton:4209:6600769,6616168:carton:4209:6616727,6616961:carton:4209:6617707,6616963:carton:4209:6617535,6618302:carton:4209:6618976,6620037:carton:4209:6620415,6620443:carton:4209:6621476,6621640:carton:4209:6622071,6621646:carton:4209:6621927,6625237:carton:4209:6625405,6626722:carton:4209:6627053,6631064:carton:4209:6666562,6631190:carton:4209:6668138,6631196:carton:4209:6668212,6631480:carton:4209:6669002,6631482:carton:4209:6669287,6631491:carton:4209:6669404,6632580:carton:4209:6670447,6632661:carton:4209:6670556,6632883:carton:4209:6670902,6633864:carton:4209:6637137,6638162:carton:4209:6638503,6638777:carton:4209:6644340,6640593:carton:4209:6641082,6646444:carton:4209:6647280,6647214:carton:4209:6648123,6650509:carton:4209:6651932,6654838:carton:4209:6655484,6656897:carton:4209:6657576,6663620:carton:4209:6664017,6664426:carton:4209:6667513,6671806:carton:4209:6672181,6672700:carton:4209:6673400,6673893:carton:4209:6674363,6677866:carton:4'}, {'unwanted_material': 'carton', 'main_material': 'gm', 'pht_type': 4209, 'ratio': 0.0034360485265016666, 'nb_photo': 74, 'list_port_cont': '6846228,6863059,6869289,6886849,6890963,6894674,6908912,6914945,6920514,6922344,6960443,12107789,12108019,12108273,12108337,12108377,12108542,12108682,12151219', 'assoc_port': '12107418:12151219,12107420:12108682,12107421:12108542,12107422:12108377,12107424:12108273,12107425:12108337,12107428:12108019,12107430:12107789,6845636:6846228,6862271:6863059,6868823:6869289,6886556:6886849,6890813:6890963,6894304:6894674,6902262:6908912,6914405:6914945,6919130:6920514,6919131:6960443,6920918:6922344', 'assoc_mat': '12107418:carton:4209:12151219,12107420:carton:4209:12108682,12107421:carton:4209:12108542,12107422:carton:4209:12108377,12107424:carton:4209:12108273,12107425:carton:4209:12108337,12107428:carton:4209:12108019,12107430:carton:4209:12107789,6845636:carton:4209:6846228,6862271:carton:4209:6863059,6868823:carton:4209:6869289,6886556:carton:4209:6886849,6890813:carton:4209:6890963,6894304:carton:4209:6894674,6902262:carton:4209:6908912,6914405:carton:4209:6914945,6919130:carton:4209:6920514,6919131:carton:4209:6960443,6920918:carton:4209:6922344'}, {'unwanted_material': 'carton', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 0.7882882989748035, 'nb_photo': 99, 'list_port_cont': '6617257,6617678,6633558,6659532', 'assoc_port': '6616962:6617257,6616964:6617678,6631478:6633558,6652939:6659532', 'assoc_mat': '6616962:carton:4207:6617257,6616964:carton:4207:6617678,6631478:carton:4207:6633558,6652939:carton:4207:6659532'}, {'unwanted_material': 'carton', 'main_material': 'pehd_pp', 'pht_type': 4211, 'ratio': 0.005541745404523602, 'nb_photo': 10072, 'list_port_cont': '6600862,6600896,6601025,6601432,6601509,6602274,6602602,6603017,6603405,6605885,6606079,6607679,6608062,6608285,6609455,6610403,6610610,6610646,6611147,6613688,6614029,6614524,6615392,6615433,6615557,6615807,6616523,6617433,6618778,6618919,6620209,6620333,6620915,6621055,6621679,6621959,6621994,6622138,6622194,6622460,6624060,6625559,6626610,6626645,6627278,6628471,6629181,6629246,6634380,6634648,6634846,6635132,6635839,6638277,6638440,6639151,6640998,6642060,6642703,6648971,6650047,6650147,6650271,6650967,6658510,6664044,6666448,6668089,6668177,6669622,6672030,6674022,6674547,6674632,6674763,6675077,6675104,6675135,6675473,6676026,6676537,6676625,6677127,6677221,6677812,6678043,6678220,6678576,6678652,6678765,6678931,6678963,6678994,6679223,6681249,6687137,6691499,6691652,6692287,6693204,6693679,6693897,6694010,6694038,6694216,6694416,6695511,6697512,6698426,6698766,6698791,6699371,6699423,6700624,6700657,6705442,6706626,6706767,6707236,6707810,6709732,6711227,6711402,6711481,6712143,6712484,6712643,6712742,', 'assoc_port': '10844008:10846058,10844009:10845786,10844010:10846035,10844011:10845555,10844012:10845974,10844013:10845417,10844014:10845188,10844015:10845076,10844016:10845159,10844017:10845134,10844018:10844944,10844019:10845036,10844020:10844680,10844021:10844446,12107423:12108311,12107427:12108078,12107429:12107832,6600536:6601432,6600541:6601509,6600544:6600862,6600546:6601025,6600551:6600896,6601138:6602602,6601649:6602274,6602728:6603017,6602733:6603405,6604399:6608062,6605499:6610646,6605503:6605885,6605688:6606079,6606683:6607679,6607835:6610403,6607839:6608285,6609199:6609455,6610498:6610610,6610992:6611147,6613334:6613688,6613876:6614029,6614199:6614524,6614967:6615392,6614969:6615433,6615340:6615557,6615362:6615807,6616173:6616523,6616982:6617433,6618307:6618778,6618311:6618919,6620038:6620209,6620040:6620333,6620422:6621679,6620444:6621055,6620447:6620915,6621638:6624060,6621643:6622460,6621647:6622194,6621651:6622138,6621654:6621959,6621659:6621994,6625236:6625559,6626268:6626610,6626274:6626645,6627098:662727', 'assoc_mat': '10844008:carton:4211:10846058,10844009:carton:4211:10845786,10844010:carton:4211:10846035,10844011:carton:4211:10845555,10844012:carton:4211:10845974,10844013:carton:4211:10845417,10844014:carton:4211:10845188,10844015:carton:4211:10845076,10844016:carton:4211:10845159,10844017:carton:4211:10845134,10844018:carton:4211:10844944,10844019:carton:4211:10845036,10844020:carton:4211:10844680,10844021:carton:4211:10844446,12107423:carton:4211:12108311,12107427:carton:4211:12108078,12107429:carton:4211:12107832,6600536:carton:4211:6601432,6600541:carton:4211:6601509,6600544:carton:4211:6600862,6600546:carton:4211:6601025,6600551:carton:4211:6600896,6601138:carton:4211:6602602,6601649:carton:4211:6602274,6602728:carton:4211:6603017,6602733:carton:4211:6603405,6604399:carton:4211:6608062,6605499:carton:4211:6610646,6605503:carton:4211:6605885,6605688:carton:4211:6606079,6606683:carton:4211:6607679,6607835:carton:4211:6610403,6607839:carton:4211:6608285,6609199:carton:4211:6609455,6610498:carton:4211:6610610,6610992:ca'}, {'unwanted_material': 'carton', 'main_material': 'pet_clair', 'pht_type': 3327, 'ratio': 0.021265796174868765, 'nb_photo': 11055, 'list_port_cont': '6601215,6601254,6601311,6601365,6601560,6601690,6601782,6601848,6602311,6603606,6603844,6603989,6604932,6606278,6606384,6607129,6607398,6607888,6608321,6608587,6608682,6608971,6609916,6610055,6610284,6610912,6611077,6613728,6614151,6615888,6616062,6616202,6616976,6617459,6617851,6618180,6618944,6620516,6620989,6621115,6621137,6621173,6621387,6621436,6621535,6622109,6622160,6622315,6622373,6622427,6622513,6622655,6622753,6626373,6626971,6627002,6627199,6627839,6628013,6628560,6628619,6629361,6629384,6635813,6635874,6635895,6635941,6635971,6636033,6636118,6636148,6636296,6636333,6636418,6636592,6636681,6636726,6636802,6637043,6637688,6637712,6637762,6637860,6637949,6637973,6638091,6638425,6638595,6638701,6638837,6638945,6638981,6639192,6639297,6639349,6639651,6639755,6639845,6639906,6639972,6640117,6640719,6640754,6640781,6640958,6641217,6641305,6641322,6641489,6641514,6641657,6641813,6641946,6642029,6642085,6642288,6643238,6643376,6643471,6643599,6643635,6643658,6643688,6643713,6643897,6644067,6644460,6644654,', 'assoc_port': '6600535:6601254,6600537:6601690,6600543:6601215,6600545:6601365,6600547:6601560,6600550:6601782,6600553:6601311,6601140:6602311,6601199:6601848,6602727:6603844,6602729:6603989,6602732:6603606,6604400:6604932,6604702:6606384,6605500:6606278,6605502:6607129,6606682:6608321,6606685:6607888,6606687:6607398,6607836:6608587,6607838:6608682,6608144:6608971,6609197:6610055,6609198:6609916,6609963:6610284,6610497:6611077,6610499:6610912,6612953:6613728,6613333:6614151,6614966:6616202,6614968:6616062,6615360:6615888,6616171:6616976,6616960:6618180,6616966:6617459,6616967:6617851,6618310:6618944,6620036:6620516,6620039:6621387,6620042:6620989,6620404:6621137,6620441:6621436,6620445:6621173,6620446:6621535,6620449:6621115,6621639:6622655,6621642:6622753,6621645:6622513,6621650:6622373,6621652:6622427,6621655:6622160,6621656:6622109,6621661:6622315,6625901:6626373,6626270:6626971,6626272:6627002,6626275:6627199,6627097:6627839,6627099:6628013,6627946:6628560,6627948:6628619,6628988:6629361,6628991:6629384,6630847:6635941,', 'assoc_mat': '6600535:carton:3327:6601254,6600537:carton:3327:6601690,6600543:carton:3327:6601215,6600545:carton:3327:6601365,6600547:carton:3327:6601560,6600550:carton:3327:6601782,6600553:carton:3327:6601311,6601140:carton:3327:6602311,6601199:carton:3327:6601848,6602727:carton:3327:6603844,6602729:carton:3327:6603989,6602732:carton:3327:6603606,6604400:carton:3327:6604932,6604702:carton:3327:6606384,6605500:carton:3327:6606278,6605502:carton:3327:6607129,6606682:carton:3327:6608321,6606685:carton:3327:6607888,6606687:carton:3327:6607398,6607836:carton:3327:6608587,6607838:carton:3327:6608682,6608144:carton:3327:6608971,6609197:carton:3327:6610055,6609198:carton:3327:6609916,6609963:carton:3327:6610284,6610497:carton:3327:6611077,6610499:carton:3327:6610912,6612953:carton:3327:6613728,6613333:carton:3327:6614151,6614966:carton:3327:6616202,6614968:carton:3327:6616062,6615360:carton:3327:6615888,6616171:carton:3327:6616976,6616960:carton:3327:6618180,6616966:carton:3327:6617459,6616967:carton:3327:6617851,6618310:carton:3'}, {'unwanted_material': 'carton', 'main_material': 'pet_fonce', 'pht_type': 4200, 'ratio': 0.0030077102589759186, 'nb_photo': 188, 'list_port_cont': '6600928,6602053,6613067,6615617,6620856,6626789,6634257,6637078,6637444,6638372,6639234,6641575,6646017,6647334,6649471,6649914,6653437,6654689,6655701,6658478,6662382,6670056,6672616,6674513,6683667,6684475,6687238,6687457,6696453,6696810,6698452,6711567,6712284,6712773,6714498,6717605,6719822,6720209,6720249,6720369,6721251,6722524,6740808,6745523,6745785,6750251,6754193,6754563,6765279,6766693,6780395,6780519,6784030,6786852,6788641,6791341,6793689,6795536,6817651,6821378,6824090,6835185,6836549,6840202,6849237,6852379,6854531,6859034,6862722,6865777,6866323,6867980,6869264,6874412,6875751,6875979,6882733,6886815,6888107,6889496,6902501,6904840,6914439,6920752,6921621,6924262', 'assoc_port': '6600538:6600928,6601136:6602053,6612632:6613067,6615365:6615617,6620439:6620856,6626271:6626789,6630848:6646017,6631186:6634257,6631194:6649914,6631961:6655701,6632583:6662382,6632966:6670056,6635673:6637444,6635681:6637078,6637843:6638372,6638774:6639234,6641286:6641575,6646447:6647334,6648940:6649471,6650951:6653437,6654041:6654689,6657889:6658478,6671809:6672616,6673895:6674513,6681680:6683667,6683618:6684475,6685440:6720369,6685511:6720209,6686027:6719822,6686295:6687457,6686312:6687238,6688871:6714498,6690894:6698452,6693641:6696453,6696476:6696810,6710860:6711567,6711680:6712284,6712324:6712773,6716688:6717605,6718843:6720249,6720803:6721251,6722354:6722524,6740018:6740808,6740709:6745523,6744268:6745785,6748062:6750251,6753406:6754563,6753419:6754193,6764848:6765279,6765563:6766693,6779977:6780519,6780017:6780395,6782249:6784030,6786463:6786852,6787690:6788641,6790918:6791341,6793238:6793689,6795258:6795536,6817300:6817651,6820776:6821378,6823753:6824090,6833510:6835185,6835942:6836549,6839793:6840202,', 'assoc_mat': '6600538:carton:4200:6600928,6601136:carton:4200:6602053,6612632:carton:4200:6613067,6615365:carton:4200:6615617,6620439:carton:4200:6620856,6626271:carton:4200:6626789,6630848:carton:4200:6646017,6631186:carton:4200:6634257,6631194:carton:4200:6649914,6631961:carton:4200:6655701,6632583:carton:4200:6662382,6632966:carton:4200:6670056,6635673:carton:4200:6637444,6635681:carton:4200:6637078,6637843:carton:4200:6638372,6638774:carton:4200:6639234,6641286:carton:4200:6641575,6646447:carton:4200:6647334,6648940:carton:4200:6649471,6650951:carton:4200:6653437,6654041:carton:4200:6654689,6657889:carton:4200:6658478,6671809:carton:4200:6672616,6673895:carton:4200:6674513,6681680:carton:4200:6683667,6683618:carton:4200:6684475,6685440:carton:4200:6720369,6685511:carton:4200:6720209,6686027:carton:4200:6719822,6686295:carton:4200:6687457,6686312:carton:4200:6687238,6688871:carton:4200:6714498,6690894:carton:4200:6698452,6693641:carton:4200:6696453,6696476:carton:4200:6696810,6710860:carton:4200:6711567,6711680:carton:4'}, {'unwanted_material': 'ela', 'main_material': 'ela', 'pht_type': 4203, 'ratio': 0.9213990406858268, 'nb_photo': 851, 'list_port_cont': '6603436,6608816,6618318,6624164,6627339,6634755,6634797,6660094,6660517,6698372,6704166,6712720,6720539,6723233,6723408,6735149,6735451,6741141,6754061,6761154,6768736,6775025,6780642,6799277,6800318,6801314,6806353,6808104,6808746,6810130,6812814,6822548,6826377,6834092,6838771,6846432,6852158,6863258,6865673,6869916,6876021,6930479,6940847,10844172', 'assoc_port': '10844025:10844172,6602731:6603436,6608146:6608816,6617603:6618318,6620405:6624164,6626721:6627339,6630937:6634755,6631483:6634797,6631962:6660517,6632879:6660094,6638160:6704166,6653521:6723233,6664117:6735451,6671808:6834092,6682068:6768736,6685476:6799277,6685991:6800318,6686304:6801314,6690887:6735149,6696473:6698372,6712332:6712720,6718634:6720539,6722813:6723408,6740022:6741141,6745199:6810130,6753416:6754061,6760133:6761154,6765566:6808746,6774410:6775025,6780026:6780642,6786466:6808104,6793236:6806353,6811950:6812814,6820599:6822548,6825858:6826377,6837012:6838771,6846007:6846432,6851650:6852158,6863104:6863258,6865559:6865673,6869544:6869916,6875674:6876021,6894306:6930479,6900378:6940847', 'assoc_mat': '10844025:ela:4203:10844172,6602731:ela:4203:6603436,6608146:ela:4203:6608816,6617603:ela:4203:6618318,6620405:ela:4203:6624164,6626721:ela:4203:6627339,6630937:ela:4203:6634755,6631483:ela:4203:6634797,6631962:ela:4203:6660517,6632879:ela:4203:6660094,6638160:ela:4203:6704166,6653521:ela:4203:6723233,6664117:ela:4203:6735451,6671808:ela:4203:6834092,6682068:ela:4203:6768736,6685476:ela:4203:6799277,6685991:ela:4203:6800318,6686304:ela:4203:6801314,6690887:ela:4203:6735149,6696473:ela:4203:6698372,6712332:ela:4203:6712720,6718634:ela:4203:6720539,6722813:ela:4203:6723408,6740022:ela:4203:6741141,6745199:ela:4203:6810130,6753416:ela:4203:6754061,6760133:ela:4203:6761154,6765566:ela:4203:6808746,6774410:ela:4203:6775025,6780026:ela:4203:6780642,6786466:ela:4203:6808104,6793236:ela:4203:6806353,6811950:ela:4203:6812814,6820599:ela:4203:6822548,6825858:ela:4203:6826377,6837012:ela:4203:6838771,6846007:ela:4203:6846432,6851650:ela:4203:6852158,6863104:ela:4203:6863258,6865559:ela:4203:6865673,6869544:ela:4203:68699'}, {'unwanted_material': 'ela', 'main_material': 'emr', 'pht_type': 4209, 'ratio': 0.0007116836898320703, 'nb_photo': 13, 'list_port_cont': '6622066,6638510,6668140,6674367,6682359,6692900,6699027,6751454,6812448', 'assoc_port': '6621640:6622066,6631190:6668140,6638162:6638510,6673893:6674367,6681682:6682359,6688873:6699027,6691778:6692900,6750987:6751454,6811912:6812448', 'assoc_mat': '6621640:ela:4209:6622066,6631190:ela:4209:6668140,6638162:ela:4209:6638510,6673893:ela:4209:6674367,6681682:ela:4209:6682359,6688873:ela:4209:6699027,6691778:ela:4209:6692900,6750987:ela:4209:6751454,6811912:ela:4209:6812448'}, {'unwanted_material': 'ela', 'main_material': 'gm', 'pht_type': 4209, 'ratio': 0.00032398461757896294, 'nb_photo': 4, 'list_port_cont': '6846232,6863050,6869299,6922346', 'assoc_port': '6845636:6846232,6862271:6863050,6868823:6869299,6920918:6922346', 'assoc_mat': '6845636:ela:4209:6846232,6862271:ela:4209:6863050,6868823:ela:4209:6869299,6920918:ela:4209:6922346'}, {'unwanted_material': 'ela', 'main_material': 'pehd_pp', 'pht_type': 4211, 'ratio': 0.00015698953627416628, 'nb_photo': 147, 'list_port_cont': '6606078,6610614,6610650,6611153,6618777,6621995,6624051,6626615,6629238,6634390,6638443,6650283,6668181,6674761,6676619,6687148,6691488,6692283,6693901,6697509,6698420,6712139,6712495,6712638,6713763,6714406,6719444,6721923,6723047,6725696,6725822,6730328,6732327,6732432,6735373,6735646,6743245,6748843,6752335,6753734,6754131,6754280,6755113,6756969,6757867,6757971,6759593,6762164,6768398,6778929,6780252,6780740,6780892,6784776,6785335,6790082,6794260,6795576,6797595,6799113,6799411,6799545,6799693,6800458,6800536,6800674,6800830,6808649,6808671,6808798,6809166,6810011,6810258,6812213,6835747,6840031,6842616,6854223,6855219,6855451,6869220,6889386,6889562,6917712,6920224,6922983,6961422,10844945,10845415,10846062,12107826', 'assoc_port': '10844008:10846062,10844013:10845415,10844018:10844945,12107429:12107826,6605499:6610650,6605688:6606078,6610498:6610614,6610992:6611153,6618307:6618777,6621638:6624051,6621659:6621995,6626268:6626615,6628989:6629238,6630935:6674761,6631484:6676619,6631967:6634390,6635671:6693901,6638161:6638443,6649833:6650283,6653520:6723047,6653523:6725696,6654837:6725822,6663625:6735646,6666361:6668181,6671801:6755113,6683616:6790082,6683620:6691488,6685431:6799113,6685484:6854223,6685489:6799411,6685506:6799545,6685519:6799693,6685533:6697509,6686006:6855219,6686021:6855451,6686031:6800458,6686094:6800536,6686289:6800674,6686298:6800830,6686321:6687148,6688870:6732432,6688875:6732327,6690891:6735373,6691780:6730328,6691869:6692283,6696477:6698420,6710862:6713763,6711681:6712139,6711684:6714406,6712328:6712638,6712336:6712495,6718636:6719444,6721635:6721923,6738742:6810258,6740001:6752335,6740031:6743245,6743340:6757867,6748058:6810011,6748061:6748843,6748064:6756969,6753412:6754131,6753415:6754280,6753418:6753734,6757493:', 'assoc_mat': '10844008:ela:4211:10846062,10844013:ela:4211:10845415,10844018:ela:4211:10844945,12107429:ela:4211:12107826,6605499:ela:4211:6610650,6605688:ela:4211:6606078,6610498:ela:4211:6610614,6610992:ela:4211:6611153,6618307:ela:4211:6618777,6621638:ela:4211:6624051,6621659:ela:4211:6621995,6626268:ela:4211:6626615,6628989:ela:4211:6629238,6630935:ela:4211:6674761,6631484:ela:4211:6676619,6631967:ela:4211:6634390,6635671:ela:4211:6693901,6638161:ela:4211:6638443,6649833:ela:4211:6650283,6653520:ela:4211:6723047,6653523:ela:4211:6725696,6654837:ela:4211:6725822,6663625:ela:4211:6735646,6666361:ela:4211:6668181,6671801:ela:4211:6755113,6683616:ela:4211:6790082,6683620:ela:4211:6691488,6685431:ela:4211:6799113,6685484:ela:4211:6854223,6685489:ela:4211:6799411,6685506:ela:4211:6799545,6685519:ela:4211:6799693,6685533:ela:4211:6697509,6686006:ela:4211:6855219,6686021:ela:4211:6855451,6686031:ela:4211:6800458,6686094:ela:4211:6800536,6686289:ela:4211:6800674,6686298:ela:4211:6800830,6686321:ela:4211:6687148,6688870:ela:4211'}, {'unwanted_material': 'ela', 'main_material': 'pet_fonce', 'pht_type': 4200, 'ratio': 0.0010348878985054983, 'nb_photo': 35, 'list_port_cont': '6604882,6609168,6620173,6628355,6637450,6641567,6654693,6665190,6684476,6719824,6754201,6754550,6780397,6797660,6813919,6835187,6842436,6852373,6859023,6862721,6866325,6867974,6875989,6888099,6895293,6920760', 'assoc_port': '6604397:6604882,6608145:6609168,6620043:6620173,6627944:6628355,6635673:6637450,6641286:6641567,6654041:6654693,6664429:6665190,6683618:6684476,6686027:6719824,6753406:6754550,6753419:6754201,6780017:6780397,6797266:6797660,6813389:6813919,6833510:6835187,6842061:6842436,6852123:6852373,6858797:6859023,6862270:6862721,6865552:6866325,6867749:6867974,6875675:6875989,6887861:6888099,6894305:6895293,6920100:6920760', 'assoc_mat': '6604397:ela:4200:6604882,6608145:ela:4200:6609168,6620043:ela:4200:6620173,6627944:ela:4200:6628355,6635673:ela:4200:6637450,6641286:ela:4200:6641567,6654041:ela:4200:6654693,6664429:ela:4200:6665190,6683618:ela:4200:6684476,6686027:ela:4200:6719824,6753406:ela:4200:6754550,6753419:ela:4200:6754201,6780017:ela:4200:6780397,6797266:ela:4200:6797660,6813389:ela:4200:6813919,6833510:ela:4200:6835187,6842061:ela:4200:6842436,6852123:ela:4200:6852373,6858797:ela:4200:6859023,6862270:ela:4200:6862721,6865552:ela:4200:6866325,6867749:ela:4200:6867974,6875675:ela:4200:6875989,6887861:ela:4200:6888099,6894305:ela:4200:6895293,6920100:ela:4200:6920760'}, {'unwanted_material': 'etiquette', 'main_material': 'ela', 'pht_type': 4203, 'ratio': 0.00021900090159665767, 'nb_photo': 78, 'list_port_cont': '6603427,6608805,6624167,6634748,6634790,6660096,6698374,6704172,6712723,6720540,6723232,6723415,6735146,6741134,6754075,6761156,6775024,6780647,6799267,6800315,6801318,6806348,6808094,6808744,6810125,6822562,6826365,6834101,6838767,6852166,6863265,6865664,6869922,6876013,6930484,10844168', 'assoc_port': '10844025:10844168,6602731:6603427,6608146:6608805,6620405:6624167,6630937:6634748,6631483:6634790,6632879:6660096,6638160:6704172,6653521:6723232,6671808:6834101,6685476:6799267,6685991:6800315,6686304:6801318,6690887:6735146,6696473:6698374,6712332:6712723,6718634:6720540,6722813:6723415,6740022:6741134,6745199:6810125,6753416:6754075,6760133:6761156,6765566:6808744,6774410:6775024,6780026:6780647,6786466:6808094,6793236:6806348,6820599:6822562,6825858:6826365,6837012:6838767,6851650:6852166,6863104:6863265,6865559:6865664,6869544:6869922,6875674:6876013,6894306:6930484', 'assoc_mat': '10844025:etiquette:4203:10844168,6602731:etiquette:4203:6603427,6608146:etiquette:4203:6608805,6620405:etiquette:4203:6624167,6630937:etiquette:4203:6634748,6631483:etiquette:4203:6634790,6632879:etiquette:4203:6660096,6638160:etiquette:4203:6704172,6653521:etiquette:4203:6723232,6671808:etiquette:4203:6834101,6685476:etiquette:4203:6799267,6685991:etiquette:4203:6800315,6686304:etiquette:4203:6801318,6690887:etiquette:4203:6735146,6696473:etiquette:4203:6698374,6712332:etiquette:4203:6712723,6718634:etiquette:4203:6720540,6722813:etiquette:4203:6723415,6740022:etiquette:4203:6741134,6745199:etiquette:4203:6810125,6753416:etiquette:4203:6754075,6760133:etiquette:4203:6761156,6765566:etiquette:4203:6808744,6774410:etiquette:4203:6775024,6780026:etiquette:4203:6780647,6786466:etiquette:4203:6808094,6793236:etiquette:4203:6806348,6820599:etiquette:4203:6822562,6825858:etiquette:4203:6826365,6837012:etiquette:4203:6838767,6851650:etiquette:4203:6852166,6863104:etiquette:4203:6863265,6865559:etiquette:4203:6865664'}, {'unwanted_material': 'etiquette', 'main_material': 'emr', 'pht_type': 4209, 'ratio': 0.00030922441233135133, 'nb_photo': 45, 'list_port_cont': '6600778,6617522,6618983,6620411,6621477,6621941,6625401,6641076,6647266,6648129,6651936,6667511,6669411,6670890,6672171,6673397,6674364,6678090,6682348,6690825,6695447,6695912,6697467,6699022,6711044,6712233,6723686,6740487,6742318,6751446,6754766', 'assoc_port': '6600552:6600778,6616963:6617522,6618302:6618983,6620037:6620411,6620443:6621477,6621646:6621941,6625237:6625401,6631491:6669411,6632883:6670890,6640593:6641076,6646444:6647266,6647214:6648129,6650509:6651936,6664426:6667511,6671806:6672171,6672700:6673397,6673893:6674364,6677866:6678090,6681682:6682348,6682898:6690825,6685513:6697467,6688873:6699022,6694731:6695912,6694740:6695447,6709375:6711044,6710867:6712233,6723504:6723686,6739465:6742318,6740030:6740487,6741911:6754766,6750987:6751446', 'assoc_mat': '6600552:etiquette:4209:6600778,6616963:etiquette:4209:6617522,6618302:etiquette:4209:6618983,6620037:etiquette:4209:6620411,6620443:etiquette:4209:6621477,6621646:etiquette:4209:6621941,6625237:etiquette:4209:6625401,6631491:etiquette:4209:6669411,6632883:etiquette:4209:6670890,6640593:etiquette:4209:6641076,6646444:etiquette:4209:6647266,6647214:etiquette:4209:6648129,6650509:etiquette:4209:6651936,6664426:etiquette:4209:6667511,6671806:etiquette:4209:6672171,6672700:etiquette:4209:6673397,6673893:etiquette:4209:6674364,6677866:etiquette:4209:6678090,6681682:etiquette:4209:6682348,6682898:etiquette:4209:6690825,6685513:etiquette:4209:6697467,6688873:etiquette:4209:6699022,6694731:etiquette:4209:6695912,6694740:etiquette:4209:6695447,6709375:etiquette:4209:6711044,6710867:etiquette:4209:6712233,6723504:etiquette:4209:6723686,6739465:etiquette:4209:6742318,6740030:etiquette:4209:6740487,6741911:etiquette:4209:6754766,6750987:etiquette:4209:6751446'}, {'unwanted_material': 'etiquette', 'main_material': 'gm', 'pht_type': 4209, 'ratio': 0.00022776236187163268, 'nb_photo': 13, 'list_port_cont': '6869297,6890964,6908904,6960438,12108034,12108669', 'assoc_port': '12107420:12108669,12107428:12108034,6868823:6869297,6890813:6890964,6902262:6908904,6919131:6960438', 'assoc_mat': '12107420:etiquette:4209:12108669,12107428:etiquette:4209:12108034,6868823:etiquette:4209:6869297,6890813:etiquette:4209:6890964,6902262:etiquette:4209:6908904,6919131:etiquette:4209:6960438'}, {'unwanted_material': 'etiquette', 'main_material': 'pehd_pp', 'pht_type': 4211, 'ratio': 9.761859113588492e-05, 'nb_photo': 731, 'list_port_cont': '6600902,6602270,6608065,6608287,6609459,6610411,6610617,6611154,6614525,6615396,6615423,6615803,6617425,6620339,6620925,6621056,6621665,6621973,6621996,6622127,6622201,6622459,6624053,6625563,6628477,6634393,6634662,6634854,6635143,6635844,6639158,6640993,6650044,6650156,6650281,6658498,6664049,6666450,6669614,6672026,6674393,6674548,6674635,6674760,6675108,6675142,6675485,6676526,6676614,6677128,6677225,6677804,6678044,6678223,6678571,6678768,6678969,6679218,6681248,6687147,6691498,6691665,6692288,6694047,6694207,6694414,6695513,6697508,6698432,6698802,6699435,6700656,6705444,6706636,6706768,6707239,6707826,6709730,6711224,6711404,6711483,6712141,6712483,6712632,6712743,6713443,6713604,6713764,6714402,6716469,6716553,6717496,6717550,6718035,6718534,6719031,6719449,6719733,6720659,6721132,6721831,6722611,6722685,6723046,6723113,6723251,6723786,6724921,6724969,6725105,6725687,6729864,6730275,6730327,6730721,6731860,6732320,6732438,6735374,6735654,6738119,6740200,6740600,6741082,6741932,6743253,6743387,6743591,', 'assoc_port': '10844009:10845795,10844011:10845547,10844012:10845968,10844014:10845181,10844016:10845171,10844017:10845140,10844018:10844947,10844019:10845034,10844020:10844676,10844021:10844452,12107427:12108051,12107429:12107825,6600551:6600902,6601649:6602270,6604399:6608065,6607835:6610411,6607839:6608287,6609199:6609459,6610498:6610617,6610992:6611154,6614199:6614525,6614967:6615396,6614969:6615423,6615362:6615803,6616982:6617425,6620040:6620339,6620422:6621665,6620444:6621056,6620447:6620925,6621638:6624053,6621643:6622459,6621647:6622201,6621651:6622127,6621654:6621973,6621659:6621996,6625236:6625563,6627945:6628477,6630850:6634854,6630856:6634662,6630932:6674635,6630935:6674760,6630939:6675108,6631069:6675485,6631193:6635143,6631477:6676526,6631484:6676614,6631489:6677128,6631492:6677225,6631960:6677804,6631967:6634393,6632585:6678223,6632660:6678571,6632714:6678768,6632877:6678969,6632963:6679218,6633862:6635844,6635676:6694047,6635682:6694207,6637840:6700656,6638773:6705444,6638776:6639158,6640587:6706636,6640590:', 'assoc_mat': '10844009:etiquette:4211:10845795,10844011:etiquette:4211:10845547,10844012:etiquette:4211:10845968,10844014:etiquette:4211:10845181,10844016:etiquette:4211:10845171,10844017:etiquette:4211:10845140,10844018:etiquette:4211:10844947,10844019:etiquette:4211:10845034,10844020:etiquette:4211:10844676,10844021:etiquette:4211:10844452,12107427:etiquette:4211:12108051,12107429:etiquette:4211:12107825,6600551:etiquette:4211:6600902,6601649:etiquette:4211:6602270,6604399:etiquette:4211:6608065,6607835:etiquette:4211:6610411,6607839:etiquette:4211:6608287,6609199:etiquette:4211:6609459,6610498:etiquette:4211:6610617,6610992:etiquette:4211:6611154,6614199:etiquette:4211:6614525,6614967:etiquette:4211:6615396,6614969:etiquette:4211:6615423,6615362:etiquette:4211:6615803,6616982:etiquette:4211:6617425,6620040:etiquette:4211:6620339,6620422:etiquette:4211:6621665,6620444:etiquette:4211:6621056,6620447:etiquette:4211:6620925,6621638:etiquette:4211:6624053,6621643:etiquette:4211:6622459,6621647:etiquette:4211:6622201,6621651:'}, {'unwanted_material': 'etiquette', 'main_material': 'pet_clair', 'pht_type': 3327, 'ratio': 0.004348080716206635, 'nb_photo': 2177, 'list_port_cont': '6601212,6601260,6601313,6601368,6601566,6601697,6601794,6601839,6602310,6603617,6603847,6603990,6604929,6606281,6606358,6607128,6607393,6607886,6608319,6608595,6609912,6610053,6610275,6610911,6611081,6613732,6614155,6615891,6616068,6616203,6616981,6617464,6617847,6618173,6618943,6620503,6620995,6621113,6621139,6621170,6621386,6621441,6621536,6622158,6622312,6622433,6622517,6622652,6622759,6626361,6626978,6626999,6627195,6627832,6628014,6628554,6628614,6629363,6629389,6635808,6635870,6635898,6635951,6635977,6636117,6636143,6636289,6636331,6636428,6636605,6636678,6636737,6636797,6637045,6637679,6637710,6637767,6637948,6637983,6638086,6638422,6638600,6638706,6638840,6638940,6638970,6639190,6639289,6639354,6639650,6639754,6639847,6639897,6639975,6640120,6640716,6640750,6640777,6640954,6641212,6641304,6641334,6641488,6641517,6641651,6641811,6641945,6642027,6642087,6642291,6643242,6643378,6643477,6643637,6643657,6643690,6643720,6643900,6644076,6644462,6644664,6645167,6645306,6645763,6648004,6648352,6648373,6649645,', 'assoc_port': '6600535:6601260,6600537:6601697,6600543:6601212,6600545:6601368,6600547:6601566,6600550:6601794,6600553:6601313,6601140:6602310,6601199:6601839,6602727:6603847,6602729:6603990,6602732:6603617,6604400:6604929,6604702:6606358,6605500:6606281,6605502:6607128,6606682:6608319,6606685:6607886,6606687:6607393,6607836:6608595,6609197:6610053,6609198:6609912,6609963:6610275,6610497:6611081,6610499:6610911,6612953:6613732,6613333:6614155,6614966:6616203,6614968:6616068,6615360:6615891,6616171:6616981,6616960:6618173,6616966:6617464,6616967:6617847,6618310:6618943,6620036:6620503,6620039:6621386,6620042:6620995,6620404:6621139,6620441:6621441,6620445:6621170,6620446:6621536,6620449:6621113,6621639:6622652,6621642:6622759,6621645:6622517,6621652:6622433,6621655:6622158,6621661:6622312,6625901:6626361,6626270:6626978,6626272:6626999,6626275:6627195,6627097:6627832,6627099:6628014,6627946:6628554,6627948:6628614,6628988:6629363,6628991:6629389,6630847:6635951,6630851:6635977,6630853:6636678,6630854:6637679,6630934:6637767,', 'assoc_mat': '6600535:etiquette:3327:6601260,6600537:etiquette:3327:6601697,6600543:etiquette:3327:6601212,6600545:etiquette:3327:6601368,6600547:etiquette:3327:6601566,6600550:etiquette:3327:6601794,6600553:etiquette:3327:6601313,6601140:etiquette:3327:6602310,6601199:etiquette:3327:6601839,6602727:etiquette:3327:6603847,6602729:etiquette:3327:6603990,6602732:etiquette:3327:6603617,6604400:etiquette:3327:6604929,6604702:etiquette:3327:6606358,6605500:etiquette:3327:6606281,6605502:etiquette:3327:6607128,6606682:etiquette:3327:6608319,6606685:etiquette:3327:6607886,6606687:etiquette:3327:6607393,6607836:etiquette:3327:6608595,6609197:etiquette:3327:6610053,6609198:etiquette:3327:6609912,6609963:etiquette:3327:6610275,6610497:etiquette:3327:6611081,6610499:etiquette:3327:6610911,6612953:etiquette:3327:6613732,6613333:etiquette:3327:6614155,6614966:etiquette:3327:6616203,6614968:etiquette:3327:6616068,6615360:etiquette:3327:6615891,6616171:etiquette:3327:6616981,6616960:etiquette:3327:6618173,6616966:etiquette:3327:6617464,6'}, {'unwanted_material': 'etiquette', 'main_material': 'pet_fonce', 'pht_type': 4200, 'ratio': 0.00042222109924499836, 'nb_photo': 28, 'list_port_cont': '6613076,6621900,6635395,6637437,6638359,6641572,6654692,6665194,6669586,6670051,6686808,6687472,6714497,6717610,6719817,6745800,6765266,6766701,6780408,6780724,6797654,6836540,6840198,6865778,6874405,6886806,6902498,6904836', 'assoc_port': '6612632:6613076,6621653:6621900,6632786:6635395,6632966:6670051,6635673:6637437,6637843:6638359,6641286:6641572,6654041:6654692,6664429:6665194,6668950:6669586,6686027:6719817,6686295:6687472,6686325:6686808,6688871:6714497,6716688:6717610,6744268:6745800,6764848:6765266,6765563:6766701,6779960:6780724,6780017:6780408,6797266:6797654,6835942:6836540,6839793:6840198,6865562:6865778,6873774:6874405,6886550:6886806,6899435:6902498,6904395:6904836', 'assoc_mat': '6612632:etiquette:4200:6613076,6621653:etiquette:4200:6621900,6632786:etiquette:4200:6635395,6632966:etiquette:4200:6670051,6635673:etiquette:4200:6637437,6637843:etiquette:4200:6638359,6641286:etiquette:4200:6641572,6654041:etiquette:4200:6654692,6664429:etiquette:4200:6665194,6668950:etiquette:4200:6669586,6686027:etiquette:4200:6719817,6686295:etiquette:4200:6687472,6686325:etiquette:4200:6686808,6688871:etiquette:4200:6714497,6716688:etiquette:4200:6717610,6744268:etiquette:4200:6745800,6764848:etiquette:4200:6765266,6765563:etiquette:4200:6766701,6779960:etiquette:4200:6780724,6780017:etiquette:4200:6780408,6797266:etiquette:4200:6797654,6835942:etiquette:4200:6836540,6839793:etiquette:4200:6840198,6865562:etiquette:4200:6865778,6873774:etiquette:4200:6874405,6886550:etiquette:4200:6886806,6899435:etiquette:4200:6902498,6904395:etiquette:4200:6904836'}, {'unwanted_material': 'film_plastique', 'main_material': 'ela', 'pht_type': 4203, 'ratio': 0.0010375570916267033, 'nb_photo': 51, 'list_port_cont': '6603435,6618321,6624160,6627326,6698377,6704173,6723230,6735453,6741145,6754070,6761155,6768723,6775026,6780641,6799270,6800313,6801310,6808096,6810127,6822556,6826374,6834088,6838769,6846429,6852169,6869926,6876022,6930487,6940833', 'assoc_port': '6602731:6603435,6617603:6618321,6620405:6624160,6626721:6627326,6638160:6704173,6653521:6723230,6664117:6735453,6671808:6834088,6682068:6768723,6685476:6799270,6685991:6800313,6686304:6801310,6696473:6698377,6740022:6741145,6745199:6810127,6753416:6754070,6760133:6761155,6774410:6775026,6780026:6780641,6786466:6808096,6820599:6822556,6825858:6826374,6837012:6838769,6846007:6846429,6851650:6852169,6869544:6869926,6875674:6876022,6894306:6930487,6900378:6940833', 'assoc_mat': '6602731:film_plastique:4203:6603435,6617603:film_plastique:4203:6618321,6620405:film_plastique:4203:6624160,6626721:film_plastique:4203:6627326,6638160:film_plastique:4203:6704173,6653521:film_plastique:4203:6723230,6664117:film_plastique:4203:6735453,6671808:film_plastique:4203:6834088,6682068:film_plastique:4203:6768723,6685476:film_plastique:4203:6799270,6685991:film_plastique:4203:6800313,6686304:film_plastique:4203:6801310,6696473:film_plastique:4203:6698377,6740022:film_plastique:4203:6741145,6745199:film_plastique:4203:6810127,6753416:film_plastique:4203:6754070,6760133:film_plastique:4203:6761155,6774410:film_plastique:4203:6775026,6780026:film_plastique:4203:6780641,6786466:film_plastique:4203:6808096,6820599:film_plastique:4203:6822556,6825858:film_plastique:4203:6826374,6837012:film_plastique:4203:6838769,6846007:film_plastique:4203:6846429,6851650:film_plastique:4203:6852169,6869544:film_plastique:4203:6869926,6875674:film_plastique:4203:6876022,6894306:film_plastique:4203:6930487,6900378:film_pla'}, {'unwanted_material': 'film_plastique', 'main_material': 'emr', 'pht_type': 4209, 'ratio': 0.0024536770792147593, 'nb_photo': 69, 'list_port_cont': '6600779,6602159,6617705,6618987,6620421,6620776,6621929,6622078,6627041,6638509,6641074,6648120,6655495,6664009,6667518,6668136,6668210,6670551,6670887,6672176,6673393,6674366,6678097,6690827,6692895,6694182,6695921,6697464,6699019,6712090,6712235,6716808,6721888,6723150,6723675,6724773,6740489,6742332,6751452,6824345', 'assoc_port': '6600540:6602159,6600552:6600779,6616961:6617705,6618302:6618987,6620037:6620421,6620448:6620776,6621640:6622078,6621646:6621929,6626722:6627041,6631190:6668136,6631196:6668210,6632661:6670551,6632883:6670887,6638162:6638509,6640593:6641074,6647214:6648120,6654838:6655495,6663620:6664009,6664426:6667518,6671806:6672176,6672700:6673393,6673893:6674366,6677866:6678097,6682898:6690827,6685513:6697464,6688873:6699019,6691778:6692895,6692502:6694182,6694731:6695921,6710867:6712235,6711682:6712090,6716079:6716808,6721779:6721888,6722817:6723150,6723504:6723675,6724593:6724773,6739465:6742332,6740030:6740489,6750987:6751452,6823971:6824345', 'assoc_mat': '6600540:film_plastique:4209:6602159,6600552:film_plastique:4209:6600779,6616961:film_plastique:4209:6617705,6618302:film_plastique:4209:6618987,6620037:film_plastique:4209:6620421,6620448:film_plastique:4209:6620776,6621640:film_plastique:4209:6622078,6621646:film_plastique:4209:6621929,6626722:film_plastique:4209:6627041,6631190:film_plastique:4209:6668136,6631196:film_plastique:4209:6668210,6632661:film_plastique:4209:6670551,6632883:film_plastique:4209:6670887,6638162:film_plastique:4209:6638509,6640593:film_plastique:4209:6641074,6647214:film_plastique:4209:6648120,6654838:film_plastique:4209:6655495,6663620:film_plastique:4209:6664009,6664426:film_plastique:4209:6667518,6671806:film_plastique:4209:6672176,6672700:film_plastique:4209:6673393,6673893:film_plastique:4209:6674366,6677866:film_plastique:4209:6678097,6682898:film_plastique:4209:6690827,6685513:film_plastique:4209:6697464,6688873:film_plastique:4209:6699019,6691778:film_plastique:4209:6692895,6692502:film_plastique:4209:6694182,6694731:film_pla'}, {'unwanted_material': 'film_plastique', 'main_material': 'gm', 'pht_type': 4209, 'ratio': 0.004405144558639858, 'nb_photo': 50, 'list_port_cont': '6846222,6863051,6869293,6869651,6886840,6890965,6908908,6914944,6917082,6920507,6922345,6960431,12107792,12108029,12108283,12108676', 'assoc_port': '12107420:12108676,12107424:12108283,12107428:12108029,12107430:12107792,6845636:6846222,6862271:6863051,6868823:6869293,6869543:6869651,6886556:6886840,6890813:6890965,6902262:6908908,6914405:6914944,6916368:6917082,6919130:6920507,6919131:6960431,6920918:6922345', 'assoc_mat': '12107420:film_plastique:4209:12108676,12107424:film_plastique:4209:12108283,12107428:film_plastique:4209:12108029,12107430:film_plastique:4209:12107792,6845636:film_plastique:4209:6846222,6862271:film_plastique:4209:6863051,6868823:film_plastique:4209:6869293,6869543:film_plastique:4209:6869651,6886556:film_plastique:4209:6886840,6890813:film_plastique:4209:6890965,6902262:film_plastique:4209:6908908,6914405:film_plastique:4209:6914944,6916368:film_plastique:4209:6917082,6919130:film_plastique:4209:6920507,6919131:film_plastique:4209:6960431,6920918:film_plastique:4209:6922345'}, {'unwanted_material': 'film_plastique', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 0.006753454742247015, 'nb_photo': 34, 'list_port_cont': '6617254,6617671,6659522', 'assoc_port': '6616962:6617254,6616964:6617671,6652939:6659522', 'assoc_mat': '6616962:film_plastique:4207:6617254,6616964:film_plastique:4207:6617671,6652939:film_plastique:4207:6659522'}, {'unwanted_material': 'film_plastique', 'main_material': 'pehd_pp', 'pht_type': 4211, 'ratio': 0.002259746608148063, 'nb_photo': 5499, 'list_port_cont': '6600849,6600890,6601017,6601442,6602275,6602592,6603008,6603406,6606076,6607678,6608058,6608295,6609456,6610404,6610609,6610652,6611148,6614536,6615399,6615435,6615793,6616511,6617424,6618766,6618925,6620326,6620921,6621065,6621674,6621974,6622008,6622128,6622208,6622454,6624061,6625573,6626621,6626647,6627282,6628485,6629175,6629247,6634383,6634658,6634850,6635144,6635829,6638283,6638444,6639153,6641001,6642062,6642716,6650045,6650153,6650270,6650961,6658508,6664038,6666449,6668094,6668173,6669613,6672032,6674008,6674546,6674641,6674770,6675073,6675109,6675137,6675474,6676525,6676617,6677121,6677223,6677802,6678045,6678212,6678572,6678654,6678774,6678959,6678990,6679232,6681260,6687145,6691518,6691651,6692290,6693202,6693680,6693906,6694032,6694214,6694412,6695522,6697517,6698427,6698760,6698790,6699374,6699429,6700667,6705446,6706630,6706777,6707225,6707821,6709736,6711239,6711396,6711489,6712153,6712493,6712628,6712756,6713442,6713595,6713761,6714400,6716476,6716567,6717500,6717544,6718036,6718525,6719027,', 'assoc_port': '10844008:10846072,10844009:10845794,10844010:10846040,10844011:10845549,10844012:10845979,10844013:10845414,10844014:10845182,10844015:10845079,10844016:10845170,10844017:10845132,10844018:10844951,10844019:10845054,10844020:10844687,10844021:10844442,12107423:12108313,12107427:12108076,12107429:12107822,6600536:6601442,6600544:6600849,6600546:6601017,6600551:6600890,6601138:6602592,6601649:6602275,6602728:6603008,6602733:6603406,6604399:6608058,6605499:6610652,6605688:6606076,6606683:6607678,6607835:6610404,6607839:6608295,6609199:6609456,6610498:6610609,6610992:6611148,6614199:6614536,6614967:6615399,6614969:6615435,6615362:6615793,6616173:6616511,6616982:6617424,6618307:6618766,6618311:6618925,6620040:6620326,6620422:6621674,6620444:6621065,6620447:6620921,6621638:6624061,6621643:6622454,6621647:6622208,6621651:6622128,6621654:6621974,6621659:6622008,6625236:6625573,6626268:6626621,6626274:6626647,6627098:6627282,6627945:6628485,6628987:6629175,6628989:6629247,6630850:6634850,6630852:6674008,6630856:663465', 'assoc_mat': '10844008:film_plastique:4211:10846072,10844009:film_plastique:4211:10845794,10844010:film_plastique:4211:10846040,10844011:film_plastique:4211:10845549,10844012:film_plastique:4211:10845979,10844013:film_plastique:4211:10845414,10844014:film_plastique:4211:10845182,10844015:film_plastique:4211:10845079,10844016:film_plastique:4211:10845170,10844017:film_plastique:4211:10845132,10844018:film_plastique:4211:10844951,10844019:film_plastique:4211:10845054,10844020:film_plastique:4211:10844687,10844021:film_plastique:4211:10844442,12107423:film_plastique:4211:12108313,12107427:film_plastique:4211:12108076,12107429:film_plastique:4211:12107822,6600536:film_plastique:4211:6601442,6600544:film_plastique:4211:6600849,6600546:film_plastique:4211:6601017,6600551:film_plastique:4211:6600890,6601138:film_plastique:4211:6602592,6601649:film_plastique:4211:6602275,6602728:film_plastique:4211:6603008,6602733:film_plastique:4211:6603406,6604399:film_plastique:4211:6608058,6605499:film_plastique:4211:6610652,6605688:film_plast'}, {'unwanted_material': 'film_plastique', 'main_material': 'pet_fonce', 'pht_type': 4200, 'ratio': 0.009562760165995879, 'nb_photo': 651, 'list_port_cont': '6600935,6602065,6604873,6606113,6609166,6613072,6615619,6618496,6620183,6620863,6621894,6626781,6628361,6634253,6635399,6637071,6637439,6638362,6639237,6641573,6646019,6647326,6649276,6649481,6649910,6653428,6654681,6655699,6658476,6662389,6665188,6669588,6670057,6672611,6674515,6683658,6684468,6686795,6687232,6687468,6696454,6696813,6698466,6711565,6712273,6712779,6714502,6717597,6719828,6720160,6720216,6720243,6720362,6721257,6722534,6724152,6739287,6740805,6745514,6745792,6750253,6754188,6754560,6759424,6765277,6766706,6767355,6780405,6780527,6780713,6784028,6786844,6788649,6791328,6793700,6795545,6797658,6813918,6817663,6821381,6824093,6835171,6836542,6840210,6842440,6849225,6851785,6852368,6854521,6859028,6862726,6865775,6866336,6867967,6869257,6874408,6875757,6882725,6886810,6888104,6889508,6895295,6900331,6902499,6904843,6914441,6920747,6921624,6924250', 'assoc_port': '6600538:6600935,6601136:6602065,6604397:6604873,6605689:6606113,6608145:6609166,6612632:6613072,6615365:6615619,6618309:6618496,6620043:6620183,6620439:6620863,6621653:6621894,6626271:6626781,6627944:6628361,6630848:6646019,6631070:6649276,6631186:6634253,6631194:6649910,6631961:6655699,6632583:6662389,6632786:6635399,6632966:6670057,6635673:6637439,6635681:6637071,6637843:6638362,6638774:6639237,6641286:6641573,6646447:6647326,6648940:6649481,6650951:6653428,6654041:6654681,6657889:6658476,6664429:6665188,6668950:6669588,6671809:6672611,6673895:6674515,6681680:6683658,6683618:6684468,6685440:6720362,6685511:6720216,6686027:6719828,6686041:6720160,6686295:6687468,6686312:6687232,6686325:6686795,6688871:6714502,6690894:6698466,6693641:6696454,6696476:6696813,6710860:6711565,6711680:6712273,6712324:6712779,6716688:6717597,6718843:6720243,6720803:6721257,6722354:6722534,6723892:6724152,6738748:6739287,6740018:6740805,6740709:6745514,6744268:6745792,6748062:6750253,6753406:6754560,6753419:6754188,6759057:6759424,', 'assoc_mat': '6600538:film_plastique:4200:6600935,6601136:film_plastique:4200:6602065,6604397:film_plastique:4200:6604873,6605689:film_plastique:4200:6606113,6608145:film_plastique:4200:6609166,6612632:film_plastique:4200:6613072,6615365:film_plastique:4200:6615619,6618309:film_plastique:4200:6618496,6620043:film_plastique:4200:6620183,6620439:film_plastique:4200:6620863,6621653:film_plastique:4200:6621894,6626271:film_plastique:4200:6626781,6627944:film_plastique:4200:6628361,6630848:film_plastique:4200:6646019,6631070:film_plastique:4200:6649276,6631186:film_plastique:4200:6634253,6631194:film_plastique:4200:6649910,6631961:film_plastique:4200:6655699,6632583:film_plastique:4200:6662389,6632786:film_plastique:4200:6635399,6632966:film_plastique:4200:6670057,6635673:film_plastique:4200:6637439,6635681:film_plastique:4200:6637071,6637843:film_plastique:4200:6638362,6638774:film_plastique:4200:6639237,6641286:film_plastique:4200:6641573,6646447:film_plastique:4200:6647326,6648940:film_plastique:4200:6649481,6650951:film_pla'}, {'unwanted_material': 'kraft', 'main_material': 'ela', 'pht_type': 4203, 'ratio': 0.0013476688860348137, 'nb_photo': 25, 'list_port_cont': '6603437,6608810,6624174,6698367,6704169,6720534,6723222,6723404,6735448,6754066,6768737,6775016,6799274,6806349,6808099,6808748,6822563,6826367,6930490', 'assoc_port': '6602731:6603437,6608146:6608810,6620405:6624174,6638160:6704169,6653521:6723222,6664117:6735448,6682068:6768737,6685476:6799274,6696473:6698367,6718634:6720534,6722813:6723404,6753416:6754066,6765566:6808748,6774410:6775016,6786466:6808099,6793236:6806349,6820599:6822563,6825858:6826367,6894306:6930490', 'assoc_mat': '6602731:kraft:4203:6603437,6608146:kraft:4203:6608810,6620405:kraft:4203:6624174,6638160:kraft:4203:6704169,6653521:kraft:4203:6723222,6664117:kraft:4203:6735448,6682068:kraft:4203:6768737,6685476:kraft:4203:6799274,6696473:kraft:4203:6698367,6718634:kraft:4203:6720534,6722813:kraft:4203:6723404,6753416:kraft:4203:6754066,6765566:kraft:4203:6808748,6774410:kraft:4203:6775016,6786466:kraft:4203:6808099,6793236:kraft:4203:6806349,6820599:kraft:4203:6822563,6825858:kraft:4203:6826367,6894306:kraft:4203:6930490'}, {'unwanted_material': 'kraft', 'main_material': 'pehd_pp', 'pht_type': 4211, 'ratio': 0.0002605400427680809, 'nb_photo': 31, 'list_port_cont': '6602597,6603402,6608291,6621971,6629173,6635141,6674012,6675078,6718038,6721839,6731861,6756973,6763094,6767267,6782609,6783130,6786055,6787764,6799513,6800227,6800537,6806177,6808705,6863473,6869206,6917724', 'assoc_port': '6601138:6602597,6602733:6603402,6607839:6608291,6621654:6621971,6628987:6629173,6630852:6674012,6631065:6675078,6631193:6635141,6640595:6806177,6651292:6721839,6657891:6731861,6685502:6799513,6685989:6800227,6686094:6800537,6717679:6718038,6748064:6756973,6762546:6763094,6765565:6808705,6766922:6767267,6779975:6786055,6782244:6783130,6782282:6782609,6787218:6787764,6862775:6863473,6868825:6869206,6916370:6917724', 'assoc_mat': '6601138:kraft:4211:6602597,6602733:kraft:4211:6603402,6607839:kraft:4211:6608291,6621654:kraft:4211:6621971,6628987:kraft:4211:6629173,6630852:kraft:4211:6674012,6631065:kraft:4211:6675078,6631193:kraft:4211:6635141,6640595:kraft:4211:6806177,6651292:kraft:4211:6721839,6657891:kraft:4211:6731861,6685502:kraft:4211:6799513,6685989:kraft:4211:6800227,6686094:kraft:4211:6800537,6717679:kraft:4211:6718038,6748064:kraft:4211:6756973,6762546:kraft:4211:6763094,6765565:kraft:4211:6808705,6766922:kraft:4211:6767267,6779975:kraft:4211:6786055,6782244:kraft:4211:6783130,6782282:kraft:4211:6782609,6787218:kraft:4211:6787764,6862775:kraft:4211:6863473,6868825:kraft:4211:6869206,6916370:kraft:4211:6917724'}, {'unwanted_material': 'kraft', 'main_material': 'pet_fonce', 'pht_type': 4200, 'ratio': 0.002080903131306298, 'nb_photo': 8, 'list_port_cont': '6654687,6665187,6711559,6739285,6786851,6875988,6895294', 'assoc_port': '6654041:6654687,6664429:6665187,6710860:6711559,6738748:6739285,6786463:6786851,6875675:6875988,6894305:6895294', 'assoc_mat': '6654041:kraft:4200:6654687,6664429:kraft:4200:6665187,6710860:kraft:4200:6711559,6738748:kraft:4200:6739285,6786463:kraft:4200:6786851,6875675:kraft:4200:6875988,6894305:kraft:4200:6895294'}, {'unwanted_material': 'metal', 'main_material': 'ela', 'pht_type': 4203, 'ratio': 0.0025689075464105384, 'nb_photo': 116, 'list_port_cont': '6603439,6608802,6618323,6624168,6627336,6634744,6634804,6698366,6704170,6712714,6720531,6723221,6723414,6735153,6741143,6754064,6768738,6775029,6780637,6799279,6800304,6801309,6806355,6808095,6808740,6810126,6812819,6822550,6826362,6834102,6838768,6846434,6852156,6863255,6865671,6869930,6876016,6930480,6940846,10844182', 'assoc_port': '10844025:10844182,6602731:6603439,6608146:6608802,6617603:6618323,6620405:6624168,6626721:6627336,6630937:6634744,6631483:6634804,6638160:6704170,6653521:6723221,6671808:6834102,6682068:6768738,6685476:6799279,6685991:6800304,6686304:6801309,6690887:6735153,6696473:6698366,6712332:6712714,6718634:6720531,6722813:6723414,6740022:6741143,6745199:6810126,6753416:6754064,6765566:6808740,6774410:6775029,6780026:6780637,6786466:6808095,6793236:6806355,6811950:6812819,6820599:6822550,6825858:6826362,6837012:6838768,6846007:6846434,6851650:6852156,6863104:6863255,6865559:6865671,6869544:6869930,6875674:6876016,6894306:6930480,6900378:6940846', 'assoc_mat': '10844025:metal:4203:10844182,6602731:metal:4203:6603439,6608146:metal:4203:6608802,6617603:metal:4203:6618323,6620405:metal:4203:6624168,6626721:metal:4203:6627336,6630937:metal:4203:6634744,6631483:metal:4203:6634804,6638160:metal:4203:6704170,6653521:metal:4203:6723221,6671808:metal:4203:6834102,6682068:metal:4203:6768738,6685476:metal:4203:6799279,6685991:metal:4203:6800304,6686304:metal:4203:6801309,6690887:metal:4203:6735153,6696473:metal:4203:6698366,6712332:metal:4203:6712714,6718634:metal:4203:6720531,6722813:metal:4203:6723414,6740022:metal:4203:6741143,6745199:metal:4203:6810126,6753416:metal:4203:6754064,6765566:metal:4203:6808740,6774410:metal:4203:6775029,6780026:metal:4203:6780637,6786466:metal:4203:6808095,6793236:metal:4203:6806355,6811950:metal:4203:6812819,6820599:metal:4203:6822550,6825858:metal:4203:6826362,6837012:metal:4203:6838768,6846007:metal:4203:6846434,6851650:metal:4203:6852156,6863104:metal:4203:6863255,6865559:metal:4203:6865671,6869544:metal:4203:6869930,6875674:metal:4203:6876'}, {'unwanted_material': 'metal', 'main_material': 'emr', 'pht_type': 4209, 'ratio': 0.01620320652826406, 'nb_photo': 95, 'list_port_cont': '6600765,6601464,6602163,6616735,6618978,6620417,6620780,6621471,6622065,6625394,6627054,6638506,6641080,6644333,6647279,6648126,6651921,6655492,6664016,6666561,6668141,6668996,6669285,6669399,6670444,6670900,6672174,6673388,6678096,6690826,6692907,6695450,6695916,6697457,6711036,6712095,6712243,6716818,6721890,6723141,6723677,6740494,6751439,6754759,6791206,6812443', 'assoc_port': '6600533:6601464,6600540:6602163,6600552:6600765,6616168:6616735,6618302:6618978,6620037:6620417,6620443:6621471,6620448:6620780,6621640:6622065,6625237:6625394,6626722:6627054,6631064:6666561,6631190:6668141,6631480:6668996,6631482:6669285,6631491:6669399,6632580:6670444,6632883:6670900,6638162:6638506,6638777:6644333,6640593:6641080,6646444:6647279,6647214:6648126,6650509:6651921,6654838:6655492,6663620:6664016,6671806:6672174,6672700:6673388,6677866:6678096,6682898:6690826,6685513:6697457,6691778:6692907,6694731:6695916,6694740:6695450,6709375:6711036,6710867:6712243,6711682:6712095,6716079:6716818,6721779:6721890,6722817:6723141,6723504:6723677,6740030:6740494,6741911:6754759,6750987:6751439,6790915:6791206,6811912:6812443', 'assoc_mat': '6600533:metal:4209:6601464,6600540:metal:4209:6602163,6600552:metal:4209:6600765,6616168:metal:4209:6616735,6618302:metal:4209:6618978,6620037:metal:4209:6620417,6620443:metal:4209:6621471,6620448:metal:4209:6620780,6621640:metal:4209:6622065,6625237:metal:4209:6625394,6626722:metal:4209:6627054,6631064:metal:4209:6666561,6631190:metal:4209:6668141,6631480:metal:4209:6668996,6631482:metal:4209:6669285,6631491:metal:4209:6669399,6632580:metal:4209:6670444,6632883:metal:4209:6670900,6638162:metal:4209:6638506,6638777:metal:4209:6644333,6640593:metal:4209:6641080,6646444:metal:4209:6647279,6647214:metal:4209:6648126,6650509:metal:4209:6651921,6654838:metal:4209:6655492,6663620:metal:4209:6664016,6671806:metal:4209:6672174,6672700:metal:4209:6673388,6677866:metal:4209:6678096,6682898:metal:4209:6690826,6685513:metal:4209:6697457,6691778:metal:4209:6692907,6694731:metal:4209:6695916,6694740:metal:4209:6695450,6709375:metal:4209:6711036,6710867:metal:4209:6712243,6711682:metal:4209:6712095,6716079:metal:4209:671681'}, {'unwanted_material': 'metal', 'main_material': 'gm', 'pht_type': 4209, 'ratio': 0.03813640273004401, 'nb_photo': 50, 'list_port_cont': '6846234,6869292,6869658,6886838,6890968,6894664,6908915,6914949,6920506,6922343,6960437,12108025,12108375,12108683', 'assoc_port': '12107420:12108683,12107422:12108375,12107428:12108025,6845636:6846234,6868823:6869292,6869543:6869658,6886556:6886838,6890813:6890968,6894304:6894664,6902262:6908915,6914405:6914949,6919130:6920506,6919131:6960437,6920918:6922343', 'assoc_mat': '12107420:metal:4209:12108683,12107422:metal:4209:12108375,12107428:metal:4209:12108025,6845636:metal:4209:6846234,6868823:metal:4209:6869292,6869543:metal:4209:6869658,6886556:metal:4209:6886838,6890813:metal:4209:6890968,6894304:metal:4209:6894664,6902262:metal:4209:6908915,6914405:metal:4209:6914949,6919130:metal:4209:6920506,6919131:metal:4209:6960437,6920918:metal:4209:6922343'}, {'unwanted_material': 'metal', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 0.28424781729752074, 'nb_photo': 15, 'list_port_cont': '6617261,6617679,6659518', 'assoc_port': '6616962:6617261,6616964:6617679,6652939:6659518', 'assoc_mat': '6616962:metal:4207:6617261,6616964:metal:4207:6617679,6652939:metal:4207:6659518'}, {'unwanted_material': 'metal', 'main_material': 'pehd_pp', 'pht_type': 4211, 'ratio': 0.014105013759782188, 'nb_photo': 4099, 'list_port_cont': '6600856,6600899,6601011,6601438,6601603,6602271,6602596,6603016,6603404,6606080,6607692,6608057,6608280,6609447,6610406,6610603,6610660,6611150,6613941,6614530,6615402,6615431,6615798,6616522,6617438,6618772,6618911,6620212,6620337,6620916,6621058,6621671,6621967,6622006,6622131,6622198,6622469,6624050,6625565,6626622,6626649,6627272,6628473,6629174,6629239,6634384,6634649,6634849,6635130,6635842,6638288,6638454,6639155,6641000,6642050,6642701,6649970,6650051,6650148,6650282,6650968,6653714,6658501,6664036,6666452,6668086,6668172,6669618,6672033,6674018,6674395,6674559,6674640,6674768,6675067,6675113,6675145,6675475,6676538,6676615,6677120,6677227,6677799,6678035,6678225,6678304,6678567,6678655,6678773,6678968,6679000,6679222,6681257,6687134,6691497,6691663,6692286,6693199,6693683,6693905,6694046,6694218,6694411,6695512,6697510,6698424,6698770,6698800,6699365,6699425,6700612,6700659,6705447,6706623,6706766,6707227,6707825,6709724,6711225,6711407,6711492,6712148,6712489,6712634,6712755,6713434,6713596,6713751,', 'assoc_port': '10844008:10846070,10844009:10845782,10844010:10846037,10844011:10845544,10844012:10845982,10844013:10845413,10844014:10845190,10844015:10845088,10844016:10845174,10844017:10845137,10844018:10844954,10844019:10845038,10844020:10844683,10844021:10844455,12107423:12108305,12107427:12108080,12107429:12107834,6600536:6601438,6600544:6600856,6600546:6601011,6600551:6600899,6601138:6602596,6601142:6601603,6601649:6602271,6602728:6603016,6602733:6603404,6604399:6608057,6605499:6610660,6605688:6606080,6606683:6607692,6607835:6610406,6607839:6608280,6609199:6609447,6610498:6610603,6610992:6611150,6613877:6613941,6614199:6614530,6614967:6615402,6614969:6615431,6615362:6615798,6616173:6616522,6616982:6617438,6618307:6618772,6618311:6618911,6620038:6620212,6620040:6620337,6620422:6621671,6620444:6621058,6620447:6620916,6621638:6624050,6621643:6622469,6621647:6622198,6621651:6622131,6621654:6621967,6621659:6622006,6625236:6625565,6626268:6626622,6626274:6626649,6627098:6627272,6627945:6628473,6628987:6629174,6628989:662923', 'assoc_mat': '10844008:metal:4211:10846070,10844009:metal:4211:10845782,10844010:metal:4211:10846037,10844011:metal:4211:10845544,10844012:metal:4211:10845982,10844013:metal:4211:10845413,10844014:metal:4211:10845190,10844015:metal:4211:10845088,10844016:metal:4211:10845174,10844017:metal:4211:10845137,10844018:metal:4211:10844954,10844019:metal:4211:10845038,10844020:metal:4211:10844683,10844021:metal:4211:10844455,12107423:metal:4211:12108305,12107427:metal:4211:12108080,12107429:metal:4211:12107834,6600536:metal:4211:6601438,6600544:metal:4211:6600856,6600546:metal:4211:6601011,6600551:metal:4211:6600899,6601138:metal:4211:6602596,6601142:metal:4211:6601603,6601649:metal:4211:6602271,6602728:metal:4211:6603016,6602733:metal:4211:6603404,6604399:metal:4211:6608057,6605499:metal:4211:6610660,6605688:metal:4211:6606080,6606683:metal:4211:6607692,6607835:metal:4211:6610406,6607839:metal:4211:6608280,6609199:metal:4211:6609447,6610498:metal:4211:6610603,6610992:metal:4211:6611150,6613877:metal:4211:6613941,6614199:metal:4211'}, {'unwanted_material': 'metal', 'main_material': 'pet_clair', 'pht_type': 3327, 'ratio': 0.0018611932504713049, 'nb_photo': 168, 'list_port_cont': '6602309,6606381,6607132,6607892,6608676,6609913,6610058,6613724,6618178,6621382,6621446,6622317,6622515,6622750,6627836,6629357,6635868,6636122,6636323,6636736,6637761,6638093,6638417,6638705,6638836,6638971,6639356,6639756,6639841,6640772,6640965,6642021,6642089,6643659,6643689,6644080,6648806,6652946,6664581,6668616,6674494,6675599,6676588,6681849,6685021,6686471,6687366,6687492,6688258,6688984,6689512,6689535,6690288,6690633,6692197,6692683,6693648,6696369,6697176,6697873,6698735,6698882,6699062,6699467,6700152,6712810,6712846,6713279,6718380,6719374,6721461,6722064,6723542,6724041,6725336,6740417,6745471,6746032,6750024,6751761,6754361,6754498,6754531,6756337,6760376,6761240,6765850,6767303,6767722,6781605,6782080,6783162,6784119,6788824,6789101,6789299,6790666,6792153,6792401,6797280,6797781,6798013,6817846,6821598,6833582,6834267,6840067,6843272,6851938,6852133,6852491,6854288,6865690,6865866,6869175,6875951,6876047,6876102,6876518,6887363,6887386,6888987,6890298,6891134,6895349,6904238,6904578,6915036', 'assoc_port': '6601140:6602309,6604702:6606381,6605502:6607132,6606685:6607892,6607838:6608676,6609197:6610058,6609198:6609913,6612953:6613724,6616960:6618178,6620039:6621382,6620441:6621446,6621642:6622750,6621645:6622515,6621661:6622317,6627097:6627836,6628988:6629357,6630934:6637761,6630938:6638093,6631068:6638836,6631071:6638971,6631076:6639356,6631490:6640772,6631493:6640965,6631964:6642089,6632713:6648806,6632788:6643659,6632880:6636323,6632882:6644080,6633863:6635868,6635683:6636736,6635684:6636122,6637839:6638705,6637844:6638417,6638772:6639841,6638775:6639756,6640596:6643689,6641258:6642021,6650952:6652946,6663623:6664581,6667559:6668616,6673888:6675599,6673890:6674494,6674743:6676588,6681004:6681849,6683621:6685021,6685438:6699467,6685448:6698882,6685487:6698735,6685490:6699062,6685495:6700152,6685528:6687366,6685534:6686471,6686008:6697873,6686056:6697176,6686063:6689512,6686284:6689535,6686287:6690633,6686297:6688984,6686305:6688258,6686329:6687492,6688867:6690288,6690873:6692197,6691781:6692683,6692503:6693648,', 'assoc_mat': '6601140:metal:3327:6602309,6604702:metal:3327:6606381,6605502:metal:3327:6607132,6606685:metal:3327:6607892,6607838:metal:3327:6608676,6609197:metal:3327:6610058,6609198:metal:3327:6609913,6612953:metal:3327:6613724,6616960:metal:3327:6618178,6620039:metal:3327:6621382,6620441:metal:3327:6621446,6621642:metal:3327:6622750,6621645:metal:3327:6622515,6621661:metal:3327:6622317,6627097:metal:3327:6627836,6628988:metal:3327:6629357,6630934:metal:3327:6637761,6630938:metal:3327:6638093,6631068:metal:3327:6638836,6631071:metal:3327:6638971,6631076:metal:3327:6639356,6631490:metal:3327:6640772,6631493:metal:3327:6640965,6631964:metal:3327:6642089,6632713:metal:3327:6648806,6632788:metal:3327:6643659,6632880:metal:3327:6636323,6632882:metal:3327:6644080,6633863:metal:3327:6635868,6635683:metal:3327:6636736,6635684:metal:3327:6636122,6637839:metal:3327:6638705,6637844:metal:3327:6638417,6638772:metal:3327:6639841,6638775:metal:3327:6639756,6640596:metal:3327:6643689,6641258:metal:3327:6642021,6650952:metal:3327:665294'}, {'unwanted_material': 'metal', 'main_material': 'pet_fonce', 'pht_type': 4200, 'ratio': 0.008187433477581552, 'nb_photo': 161, 'list_port_cont': '6600924,6604874,6606109,6609169,6613066,6615621,6618495,6620180,6620864,6621895,6628356,6635390,6637077,6637440,6638365,6639245,6646018,6649283,6649472,6649917,6653439,6654695,6655708,6662393,6672612,6674525,6683669,6684477,6686796,6687223,6687470,6696448,6696812,6698463,6711552,6712278,6714493,6719818,6720151,6720203,6720239,6720363,6721248,6722529,6724153,6740811,6745799,6750239,6754562,6759423,6765268,6767356,6780402,6780532,6784026,6786842,6788648,6791326,6793698,6797669,6813916,6824104,6835192,6836545,6840197,6842435,6849222,6851783,6852365,6854532,6859036,6862724,6866334,6867975,6869267,6874413,6875761,6875987,6882735,6895285,6900330,6902505,6904844,6914446,6920751,6921633', 'assoc_port': '6600538:6600924,6604397:6604874,6605689:6606109,6608145:6609169,6612632:6613066,6615365:6615621,6618309:6618495,6620043:6620180,6620439:6620864,6621653:6621895,6627944:6628356,6630848:6646018,6631070:6649283,6631194:6649917,6631961:6655708,6632583:6662393,6632786:6635390,6635673:6637440,6635681:6637077,6637843:6638365,6638774:6639245,6648940:6649472,6650951:6653439,6654041:6654695,6671809:6672612,6673895:6674525,6681680:6683669,6683618:6684477,6685440:6720363,6685511:6720203,6686027:6719818,6686041:6720151,6686295:6687470,6686312:6687223,6686325:6686796,6688871:6714493,6690894:6698463,6693641:6696448,6696476:6696812,6710860:6711552,6711680:6712278,6718843:6720239,6720803:6721248,6722354:6722529,6723892:6724153,6740018:6740811,6744268:6745799,6748062:6750239,6753406:6754562,6759057:6759423,6764848:6765268,6766924:6767356,6779977:6780532,6780017:6780402,6782249:6784026,6786463:6786842,6787690:6788648,6790918:6791326,6793238:6793698,6797266:6797669,6813389:6813916,6823753:6824104,6833510:6835192,6835942:6836545,', 'assoc_mat': '6600538:metal:4200:6600924,6604397:metal:4200:6604874,6605689:metal:4200:6606109,6608145:metal:4200:6609169,6612632:metal:4200:6613066,6615365:metal:4200:6615621,6618309:metal:4200:6618495,6620043:metal:4200:6620180,6620439:metal:4200:6620864,6621653:metal:4200:6621895,6627944:metal:4200:6628356,6630848:metal:4200:6646018,6631070:metal:4200:6649283,6631194:metal:4200:6649917,6631961:metal:4200:6655708,6632583:metal:4200:6662393,6632786:metal:4200:6635390,6635673:metal:4200:6637440,6635681:metal:4200:6637077,6637843:metal:4200:6638365,6638774:metal:4200:6639245,6648940:metal:4200:6649472,6650951:metal:4200:6653439,6654041:metal:4200:6654695,6671809:metal:4200:6672612,6673895:metal:4200:6674525,6681680:metal:4200:6683669,6683618:metal:4200:6684477,6685440:metal:4200:6720363,6685511:metal:4200:6720203,6686027:metal:4200:6719818,6686041:metal:4200:6720151,6686295:metal:4200:6687470,6686312:metal:4200:6687223,6686325:metal:4200:6686796,6688871:metal:4200:6714493,6690894:metal:4200:6698463,6693641:metal:4200:669644'}, {'unwanted_material': 'papier', 'main_material': 'ela', 'pht_type': 4203, 'ratio': 0.061231730810446236, 'nb_photo': 10116, 'list_port_cont': '6603432,6608812,6618330,6624173,6627328,6634747,6634795,6660087,6698364,6704163,6712713,6720535,6723229,6723411,6735156,6735458,6741135,6754073,6761149,6768728,6775022,6780633,6799278,6800307,6801306,6806356,6808105,6808742,6810131,6812817,6822555,6826373,6834089,6838762,6846431,6852157,6863266,6865666,6869918,6876010,6930481,6940835,10844177', 'assoc_port': '10844025:10844177,6602731:6603432,6608146:6608812,6617603:6618330,6620405:6624173,6626721:6627328,6630937:6634747,6631483:6634795,6632879:6660087,6638160:6704163,6653521:6723229,6664117:6735458,6671808:6834089,6682068:6768728,6685476:6799278,6685991:6800307,6686304:6801306,6690887:6735156,6696473:6698364,6712332:6712713,6718634:6720535,6722813:6723411,6740022:6741135,6745199:6810131,6753416:6754073,6760133:6761149,6765566:6808742,6774410:6775022,6780026:6780633,6786466:6808105,6793236:6806356,6811950:6812817,6820599:6822555,6825858:6826373,6837012:6838762,6846007:6846431,6851650:6852157,6863104:6863266,6865559:6865666,6869544:6869918,6875674:6876010,6894306:6930481,6900378:6940835', 'assoc_mat': '10844025:papier:4203:10844177,6602731:papier:4203:6603432,6608146:papier:4203:6608812,6617603:papier:4203:6618330,6620405:papier:4203:6624173,6626721:papier:4203:6627328,6630937:papier:4203:6634747,6631483:papier:4203:6634795,6632879:papier:4203:6660087,6638160:papier:4203:6704163,6653521:papier:4203:6723229,6664117:papier:4203:6735458,6671808:papier:4203:6834089,6682068:papier:4203:6768728,6685476:papier:4203:6799278,6685991:papier:4203:6800307,6686304:papier:4203:6801306,6690887:papier:4203:6735156,6696473:papier:4203:6698364,6712332:papier:4203:6712713,6718634:papier:4203:6720535,6722813:papier:4203:6723411,6740022:papier:4203:6741135,6745199:papier:4203:6810131,6753416:papier:4203:6754073,6760133:papier:4203:6761149,6765566:papier:4203:6808742,6774410:papier:4203:6775022,6780026:papier:4203:6780633,6786466:papier:4203:6808105,6793236:papier:4203:6806356,6811950:papier:4203:6812817,6820599:papier:4203:6822555,6825858:papier:4203:6826373,6837012:papier:4203:6838762,6846007:papier:4203:6846431,6851650:papier'}, {'unwanted_material': 'papier', 'main_material': 'emr', 'pht_type': 4207, 'ratio': 0.026271390056728197, 'nb_photo': 8, 'list_port_cont': '12107737,12108213', 'assoc_port': '12107419:12108213,12107426:12107737', 'assoc_mat': '12107419:papier:4207:12108213,12107426:papier:4207:12107737'}, {'unwanted_material': 'papier', 'main_material': 'emr', 'pht_type': 4209, 'ratio': 0.9818228416534489, 'nb_photo': 22895, 'list_port_cont': '6600771,6601474,6602161,6616739,6617534,6617710,6618973,6620407,6620774,6621480,6621932,6622068,6625404,6627042,6637128,6638496,6641078,6644338,6647274,6648128,6651923,6655481,6657574,6664005,6666560,6667526,6668133,6668203,6668997,6669282,6669400,6670442,6670550,6670895,6672175,6673389,6674361,6678087,6682355,6690830,6692892,6694186,6695449,6695911,6697461,6699021,6711049,6712084,6712241,6716813,6721889,6723151,6723680,6724781,6740492,6742323,6751441,6754771,6791212,6812437,6824349', 'assoc_port': '6600533:6601474,6600540:6602161,6600552:6600771,6616168:6616739,6616961:6617710,6616963:6617534,6618302:6618973,6620037:6620407,6620443:6621480,6620448:6620774,6621640:6622068,6621646:6621932,6625237:6625404,6626722:6627042,6631064:6666560,6631190:6668133,6631196:6668203,6631480:6668997,6631482:6669282,6631491:6669400,6632580:6670442,6632661:6670550,6632883:6670895,6633864:6637128,6638162:6638496,6638777:6644338,6640593:6641078,6646444:6647274,6647214:6648128,6650509:6651923,6654838:6655481,6656897:6657574,6663620:6664005,6664426:6667526,6671806:6672175,6672700:6673389,6673893:6674361,6677866:6678087,6681682:6682355,6682898:6690830,6685513:6697461,6688873:6699021,6691778:6692892,6692502:6694186,6694731:6695911,6694740:6695449,6709375:6711049,6710867:6712241,6711682:6712084,6716079:6716813,6721779:6721889,6722817:6723151,6723504:6723680,6724593:6724781,6739465:6742323,6740030:6740492,6741911:6754771,6750987:6751441,6790915:6791212,6811912:6812437,6823971:6824349', 'assoc_mat': '6600533:papier:4209:6601474,6600540:papier:4209:6602161,6600552:papier:4209:6600771,6616168:papier:4209:6616739,6616961:papier:4209:6617710,6616963:papier:4209:6617534,6618302:papier:4209:6618973,6620037:papier:4209:6620407,6620443:papier:4209:6621480,6620448:papier:4209:6620774,6621640:papier:4209:6622068,6621646:papier:4209:6621932,6625237:papier:4209:6625404,6626722:papier:4209:6627042,6631064:papier:4209:6666560,6631190:papier:4209:6668133,6631196:papier:4209:6668203,6631480:papier:4209:6668997,6631482:papier:4209:6669282,6631491:papier:4209:6669400,6632580:papier:4209:6670442,6632661:papier:4209:6670550,6632883:papier:4209:6670895,6633864:papier:4209:6637128,6638162:papier:4209:6638496,6638777:papier:4209:6644338,6640593:papier:4209:6641078,6646444:papier:4209:6647274,6647214:papier:4209:6648128,6650509:papier:4209:6651923,6654838:papier:4209:6655481,6656897:papier:4209:6657574,6663620:papier:4209:6664005,6664426:papier:4209:6667526,6671806:papier:4209:6672175,6672700:papier:4209:6673389,6673893:papier:4'}, {'unwanted_material': 'papier', 'main_material': 'gm', 'pht_type': 4209, 'ratio': 0.9778679543860948, 'nb_photo': 9654, 'list_port_cont': '6846225,6863052,6869290,6869652,6886839,6890954,6894669,6908902,6914938,6917074,6920517,6922339,6960439,12107799,12108033,12108279,12108335,12108368,12108547,12108681,12151216', 'assoc_port': '12107418:12151216,12107420:12108681,12107421:12108547,12107422:12108368,12107424:12108279,12107425:12108335,12107428:12108033,12107430:12107799,6845636:6846225,6862271:6863052,6868823:6869290,6869543:6869652,6886556:6886839,6890813:6890954,6894304:6894669,6902262:6908902,6914405:6914938,6916368:6917074,6919130:6920517,6919131:6960439,6920918:6922339', 'assoc_mat': '12107418:papier:4209:12151216,12107420:papier:4209:12108681,12107421:papier:4209:12108547,12107422:papier:4209:12108368,12107424:papier:4209:12108279,12107425:papier:4209:12108335,12107428:papier:4209:12108033,12107430:papier:4209:12107799,6845636:papier:4209:6846225,6862271:papier:4209:6863052,6868823:papier:4209:6869290,6869543:papier:4209:6869652,6886556:papier:4209:6886839,6890813:papier:4209:6890954,6894304:papier:4209:6894669,6902262:papier:4209:6908902,6914405:papier:4209:6914938,6916368:papier:4209:6917074,6919130:papier:4209:6920517,6919131:papier:4209:6960439,6920918:papier:4209:6922339'}, {'unwanted_material': 'papier', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 0.01913239060931627, 'nb_photo': 173, 'list_port_cont': '6617263,6617672,6633555,6659520', 'assoc_port': '6616962:6617263,6616964:6617672,6631478:6633555,6652939:6659520', 'assoc_mat': '6616962:papier:4207:6617263,6616964:papier:4207:6617672,6631478:papier:4207:6633555,6652939:papier:4207:6659520'}, {'unwanted_material': 'papier', 'main_material': 'pehd_pp', 'pht_type': 4211, 'ratio': 0.02200696110253512, 'nb_photo': 44767, 'list_port_cont': '6600859,6600889,6601024,6601441,6601504,6602279,6602446,6602594,6603004,6603395,6605883,6606067,6607684,6608067,6608284,6609460,6610408,6610604,6610647,6611155,6613695,6614035,6614526,6615395,6615430,6615802,6616513,6617436,6618598,6618775,6618915,6620220,6620329,6620926,6621066,6621670,6621709,6621963,6621993,6622136,6622195,6622456,6624056,6625570,6626617,6626659,6627281,6628480,6629180,6629253,6634378,6634445,6634659,6634723,6634856,6635137,6635833,6638284,6638445,6639159,6640995,6642056,6642709,6648980,6650056,6650154,6650269,6650966,6653712,6658497,6664045,6666459,6668084,6668174,6669620,6672034,6674013,6674557,6674636,6674758,6674902,6675068,6675112,6675138,6675487,6676025,6676535,6676626,6677122,6677215,6677813,6678048,6678214,6678566,6678657,6678767,6678938,6678965,6679003,6679162,6679227,6681256,6687142,6691490,6691666,6692285,6693203,6693684,6693895,6694008,6694043,6694209,6694415,6695514,6697518,6698423,6698761,6698796,6699375,6699424,6700614,6700670,6704525,6705435,6706448,6706631,6706771,6707237,', 'assoc_port': '10844008:10846064,10844009:10845789,10844010:10846038,10844011:10845545,10844012:10845980,10844013:10845418,10844014:10845180,10844015:10845083,10844016:10845173,10844017:10845135,10844018:10844948,10844019:10845046,10844020:10844685,10844021:10844451,12107423:12108307,12107427:12108063,12107429:12107830,6600536:6601441,6600541:6601504,6600544:6600859,6600546:6601024,6600551:6600889,6601134:6602446,6601138:6602594,6601649:6602279,6602728:6603004,6602733:6603395,6604399:6608067,6605499:6610647,6605503:6605883,6605688:6606067,6606683:6607684,6607835:6610408,6607839:6608284,6609199:6609460,6610498:6610604,6610992:6611155,6613334:6613695,6613876:6614035,6614199:6614526,6614967:6615395,6614969:6615430,6615362:6615802,6616173:6616513,6616982:6617436,6618305:6618598,6618307:6618775,6618311:6618915,6620038:6620220,6620040:6620329,6620422:6621670,6620440:6621709,6620444:6621066,6620447:6620926,6621638:6624056,6621643:6622456,6621647:6622195,6621651:6622136,6621654:6621963,6621659:6621993,6625236:6625570,6626268:662661', 'assoc_mat': '10844008:papier:4211:10846064,10844009:papier:4211:10845789,10844010:papier:4211:10846038,10844011:papier:4211:10845545,10844012:papier:4211:10845980,10844013:papier:4211:10845418,10844014:papier:4211:10845180,10844015:papier:4211:10845083,10844016:papier:4211:10845173,10844017:papier:4211:10845135,10844018:papier:4211:10844948,10844019:papier:4211:10845046,10844020:papier:4211:10844685,10844021:papier:4211:10844451,12107423:papier:4211:12108307,12107427:papier:4211:12108063,12107429:papier:4211:12107830,6600536:papier:4211:6601441,6600541:papier:4211:6601504,6600544:papier:4211:6600859,6600546:papier:4211:6601024,6600551:papier:4211:6600889,6601134:papier:4211:6602446,6601138:papier:4211:6602594,6601649:papier:4211:6602279,6602728:papier:4211:6603004,6602733:papier:4211:6603395,6604399:papier:4211:6608067,6605499:papier:4211:6610647,6605503:papier:4211:6605883,6605688:papier:4211:6606067,6606683:papier:4211:6607684,6607835:papier:4211:6610408,6607839:papier:4211:6608284,6609199:papier:4211:6609460,6610498:pa'}, {'unwanted_material': 'papier', 'main_material': 'pet_clair', 'pht_type': 3327, 'ratio': 0.009355240101605987, 'nb_photo': 6285, 'list_port_cont': '6601213,6601256,6601317,6601373,6601553,6601698,6601785,6601845,6602306,6603618,6603848,6603983,6604941,6606282,6606355,6607130,6607397,6607894,6608325,6608588,6608678,6608962,6609907,6610050,6610277,6610916,6611080,6613729,6614150,6615896,6616066,6616196,6616978,6617467,6617840,6618171,6618951,6620513,6620986,6621120,6621143,6621171,6621389,6621444,6621532,6622103,6622164,6622319,6622375,6622434,6622526,6622660,6622747,6626370,6626972,6627003,6627196,6627833,6628017,6628555,6628622,6629355,6629386,6635801,6635866,6635899,6635944,6635981,6636042,6636111,6636140,6636285,6636315,6636430,6636597,6636684,6636728,6636793,6637051,6637686,6637707,6637760,6637847,6637947,6637985,6638092,6638415,6638592,6638709,6638831,6638953,6638977,6639183,6639295,6639358,6639648,6639762,6639839,6639905,6639970,6640128,6640718,6640743,6640775,6640957,6641216,6641307,6641324,6641487,6641516,6641659,6641814,6641948,6642020,6642091,6642283,6643241,6643369,6643482,6643610,6643638,6643667,6643692,6643717,6643898,6644077,6644463,6644658,', 'assoc_port': '6600535:6601256,6600537:6601698,6600543:6601213,6600545:6601373,6600547:6601553,6600550:6601785,6600553:6601317,6601140:6602306,6601199:6601845,6602727:6603848,6602729:6603983,6602732:6603618,6604400:6604941,6604702:6606355,6605500:6606282,6605502:6607130,6606682:6608325,6606685:6607894,6606687:6607397,6607836:6608588,6607838:6608678,6608144:6608962,6609197:6610050,6609198:6609907,6609963:6610277,6610497:6611080,6610499:6610916,6612953:6613729,6613333:6614150,6614966:6616196,6614968:6616066,6615360:6615896,6616171:6616978,6616960:6618171,6616966:6617467,6616967:6617840,6618310:6618951,6620036:6620513,6620039:6621389,6620042:6620986,6620404:6621143,6620441:6621444,6620445:6621171,6620446:6621532,6620449:6621120,6621639:6622660,6621642:6622747,6621645:6622526,6621650:6622375,6621652:6622434,6621655:6622164,6621656:6622103,6621661:6622319,6625901:6626370,6626270:6626972,6626272:6627003,6626275:6627196,6627097:6627833,6627099:6628017,6627946:6628555,6627948:6628622,6628988:6629355,6628991:6629386,6630847:6635944,', 'assoc_mat': '6600535:papier:3327:6601256,6600537:papier:3327:6601698,6600543:papier:3327:6601213,6600545:papier:3327:6601373,6600547:papier:3327:6601553,6600550:papier:3327:6601785,6600553:papier:3327:6601317,6601140:papier:3327:6602306,6601199:papier:3327:6601845,6602727:papier:3327:6603848,6602729:papier:3327:6603983,6602732:papier:3327:6603618,6604400:papier:3327:6604941,6604702:papier:3327:6606355,6605500:papier:3327:6606282,6605502:papier:3327:6607130,6606682:papier:3327:6608325,6606685:papier:3327:6607894,6606687:papier:3327:6607397,6607836:papier:3327:6608588,6607838:papier:3327:6608678,6608144:papier:3327:6608962,6609197:papier:3327:6610050,6609198:papier:3327:6609907,6609963:papier:3327:6610277,6610497:papier:3327:6611080,6610499:papier:3327:6610916,6612953:papier:3327:6613729,6613333:papier:3327:6614150,6614966:papier:3327:6616196,6614968:papier:3327:6616066,6615360:papier:3327:6615896,6616171:papier:3327:6616978,6616960:papier:3327:6618171,6616966:papier:3327:6617467,6616967:papier:3327:6617840,6618310:papier:3'}, {'unwanted_material': 'papier', 'main_material': 'pet_fonce', 'pht_type': 4200, 'ratio': 0.017125275841086585, 'nb_photo': 2971, 'list_port_cont': '6600926,6602063,6604875,6606104,6609174,6613071,6615626,6618500,6620184,6620854,6621908,6626783,6628360,6634243,6635396,6637073,6637446,6638360,6639247,6641571,6646008,6647325,6649284,6649479,6649902,6653435,6654683,6655706,6658468,6662396,6665198,6669579,6670065,6672619,6674516,6683662,6684471,6686799,6687236,6687458,6696447,6696824,6698461,6711553,6712279,6712781,6714496,6717599,6719829,6720164,6720215,6720241,6720368,6721253,6722530,6724154,6739279,6740796,6745518,6745791,6750249,6754202,6754551,6759426,6765269,6766705,6767366,6780400,6780521,6780722,6784029,6786845,6788639,6791340,6793690,6795542,6797664,6813924,6817658,6821374,6824105,6835188,6836541,6840208,6842437,6849226,6851792,6852378,6854525,6859024,6862734,6865779,6866332,6867973,6869258,6874411,6875759,6875982,6882729,6886818,6888094,6889509,6895296,6902512,6904831,6914440,6920757,6921627,6924261', 'assoc_port': '6600538:6600926,6601136:6602063,6604397:6604875,6605689:6606104,6608145:6609174,6612632:6613071,6615365:6615626,6618309:6618500,6620043:6620184,6620439:6620854,6621653:6621908,6626271:6626783,6627944:6628360,6630848:6646008,6631070:6649284,6631186:6634243,6631194:6649902,6631961:6655706,6632583:6662396,6632786:6635396,6632966:6670065,6635673:6637446,6635681:6637073,6637843:6638360,6638774:6639247,6641286:6641571,6646447:6647325,6648940:6649479,6650951:6653435,6654041:6654683,6657889:6658468,6664429:6665198,6668950:6669579,6671809:6672619,6673895:6674516,6681680:6683662,6683618:6684471,6685440:6720368,6685511:6720215,6686027:6719829,6686041:6720164,6686295:6687458,6686312:6687236,6686325:6686799,6688871:6714496,6690894:6698461,6693641:6696447,6696476:6696824,6710860:6711553,6711680:6712279,6712324:6712781,6716688:6717599,6718843:6720241,6720803:6721253,6722354:6722530,6723892:6724154,6738748:6739279,6740018:6740796,6740709:6745518,6744268:6745791,6748062:6750249,6753406:6754551,6753419:6754202,6759057:6759426,', 'assoc_mat': '6600538:papier:4200:6600926,6601136:papier:4200:6602063,6604397:papier:4200:6604875,6605689:papier:4200:6606104,6608145:papier:4200:6609174,6612632:papier:4200:6613071,6615365:papier:4200:6615626,6618309:papier:4200:6618500,6620043:papier:4200:6620184,6620439:papier:4200:6620854,6621653:papier:4200:6621908,6626271:papier:4200:6626783,6627944:papier:4200:6628360,6630848:papier:4200:6646008,6631070:papier:4200:6649284,6631186:papier:4200:6634243,6631194:papier:4200:6649902,6631961:papier:4200:6655706,6632583:papier:4200:6662396,6632786:papier:4200:6635396,6632966:papier:4200:6670065,6635673:papier:4200:6637446,6635681:papier:4200:6637073,6637843:papier:4200:6638360,6638774:papier:4200:6639247,6641286:papier:4200:6641571,6646447:papier:4200:6647325,6648940:papier:4200:6649479,6650951:papier:4200:6653435,6654041:papier:4200:6654683,6657889:papier:4200:6658468,6664429:papier:4200:6665198,6668950:papier:4200:6669579,6671809:papier:4200:6672619,6673895:papier:4200:6674516,6681680:papier:4200:6683662,6683618:papier:4'}, {'unwanted_material': 'pehd', 'main_material': 'ela', 'pht_type': 4203, 'ratio': 0.0013604158722732354, 'nb_photo': 67, 'list_port_cont': '6603441,6608813,6618332,6624169,6627324,6634752,6634796,6698371,6704167,6712710,6720530,6723225,6723402,6735152,6735445,6754074,6761147,6775031,6799271,6801313,6806359,6808097,6808736,6826372,6834093,6838765,6852167,6865667,6876014,6930485,6940839,10844181', 'assoc_port': '10844025:10844181,6602731:6603441,6608146:6608813,6617603:6618332,6620405:6624169,6626721:6627324,6630937:6634752,6631483:6634796,6638160:6704167,6653521:6723225,6664117:6735445,6671808:6834093,6685476:6799271,6686304:6801313,6690887:6735152,6696473:6698371,6712332:6712710,6718634:6720530,6722813:6723402,6753416:6754074,6760133:6761147,6765566:6808736,6774410:6775031,6786466:6808097,6793236:6806359,6825858:6826372,6837012:6838765,6851650:6852167,6865559:6865667,6875674:6876014,6894306:6930485,6900378:6940839', 'assoc_mat': '10844025:pehd:4203:10844181,6602731:pehd:4203:6603441,6608146:pehd:4203:6608813,6617603:pehd:4203:6618332,6620405:pehd:4203:6624169,6626721:pehd:4203:6627324,6630937:pehd:4203:6634752,6631483:pehd:4203:6634796,6638160:pehd:4203:6704167,6653521:pehd:4203:6723225,6664117:pehd:4203:6735445,6671808:pehd:4203:6834093,6685476:pehd:4203:6799271,6686304:pehd:4203:6801313,6690887:pehd:4203:6735152,6696473:pehd:4203:6698371,6712332:pehd:4203:6712710,6718634:pehd:4203:6720530,6722813:pehd:4203:6723402,6753416:pehd:4203:6754074,6760133:pehd:4203:6761147,6765566:pehd:4203:6808736,6774410:pehd:4203:6775031,6786466:pehd:4203:6808097,6793236:pehd:4203:6806359,6825858:pehd:4203:6826372,6837012:pehd:4203:6838765,6851650:pehd:4203:6852167,6865559:pehd:4203:6865667,6875674:pehd:4203:6876014,6894306:pehd:4203:6930485,6900378:pehd:4203:6940839'}, {'unwanted_material': 'pehd', 'main_material': 'emr', 'pht_type': 4209, 'ratio': 0.0004041124511179276, 'nb_photo': 6, 'list_port_cont': '6618980,6620778,6655493,6669280,6711051,6751445', 'assoc_port': '6618302:6618980,6620448:6620778,6631482:6669280,6654838:6655493,6709375:6711051,6750987:6751445', 'assoc_mat': '6618302:pehd:4209:6618980,6620448:pehd:4209:6620778,6631482:pehd:4209:6669280,6654838:pehd:4209:6655493,6709375:pehd:4209:6711051,6750987:pehd:4209:6751445'}, {'unwanted_material': 'pehd', 'main_material': 'gm', 'pht_type': 4209, 'ratio': 0.0005712244972110796, 'nb_photo': 6, 'list_port_cont': '6869288,6869648,6922350,12108027,12108673', 'assoc_port': '12107420:12108673,12107428:12108027,6868823:6869288,6869543:6869648,6920918:6922350', 'assoc_mat': '12107420:pehd:4209:12108673,12107428:pehd:4209:12108027,6868823:pehd:4209:6869288,6869543:pehd:4209:6869648,6920918:pehd:4209:6922350'}, {'unwanted_material': 'pehd', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 0.07610095728061055, 'nb_photo': 1, 'list_port_cont': '6659525', 'assoc_port': '6652939:6659525', 'assoc_mat': '6652939:pehd:4207:6659525'}, {'unwanted_material': 'pehd', 'main_material': 'pehd_pp', 'pht_type': 4211, 'ratio': 0.9648891206027819, 'nb_photo': 8269, 'list_port_cont': '6600597,6600702,6600852,6600891,6601022,6601052,6601428,6601500,6601604,6602281,6602444,6602601,6603006,6603409,6605890,6606075,6607690,6608072,6608288,6609448,6610185,6610407,6610605,6610648,6611149,6613701,6613906,6613939,6614041,6614531,6615390,6615428,6615558,6615799,6616519,6617435,6618606,6618771,6618913,6620221,6620341,6620928,6621057,6621666,6621699,6621790,6621962,6622001,6622037,6622126,6622206,6622461,6624054,6625571,6626612,6626650,6627283,6628486,6629182,6629248,6634392,6634439,6634652,6634721,6634852,6635131,6635834,6638285,6638453,6639157,6640992,6642047,6642713,6648978,6649961,6650055,6650160,6650275,6650956,6653710,6658507,6664051,6666446,6668093,6668166,6669619,6672027,6674019,6674406,6674558,6674637,6674764,6674895,6675069,6675098,6675131,6675486,6676018,6676531,6676620,6677123,6677226,6677805,6678033,6678221,6678316,6678581,6678659,6678689,6678763,6678928,6678955,6678997,6679159,6679231,6681253,6687144,6691496,6691661,6692281,6693207,6693677,6693893,6694000,6694040,6694208,6694413,6695519,', 'assoc_port': '10844008:10846067,10844009:10845792,10844010:10846032,10844011:10845548,10844012:10845975,10844013:10845405,10844014:10845186,10844015:10845082,10844016:10845169,10844017:10845131,10844018:10844955,10844019:10845040,10844020:10844684,10844021:10844450,12107423:12108306,12107427:12108068,12107429:12107833,6600532:6601052,6600536:6601428,6600541:6601500,6600544:6600852,6600546:6601022,6600548:6600702,6600551:6600891,6600554:6600597,6601134:6602444,6601138:6602601,6601142:6601604,6601649:6602281,6602728:6603006,6602733:6603409,6604399:6608072,6605499:6610648,6605503:6605890,6605688:6606075,6606683:6607690,6607835:6610407,6607837:6610185,6607839:6608288,6609199:6609448,6610498:6610605,6610992:6611149,6613334:6613701,6613876:6614041,6613877:6613939,6613878:6613906,6614199:6614531,6614967:6615390,6614969:6615428,6615340:6615558,6615362:6615799,6616173:6616519,6616982:6617435,6618305:6618606,6618307:6618771,6618311:6618913,6620038:6620221,6620040:6620341,6620422:6621666,6620440:6621699,6620444:6621057,6620447:662092', 'assoc_mat': '10844008:pehd:4211:10846067,10844009:pehd:4211:10845792,10844010:pehd:4211:10846032,10844011:pehd:4211:10845548,10844012:pehd:4211:10845975,10844013:pehd:4211:10845405,10844014:pehd:4211:10845186,10844015:pehd:4211:10845082,10844016:pehd:4211:10845169,10844017:pehd:4211:10845131,10844018:pehd:4211:10844955,10844019:pehd:4211:10845040,10844020:pehd:4211:10844684,10844021:pehd:4211:10844450,12107423:pehd:4211:12108306,12107427:pehd:4211:12108068,12107429:pehd:4211:12107833,6600532:pehd:4211:6601052,6600536:pehd:4211:6601428,6600541:pehd:4211:6601500,6600544:pehd:4211:6600852,6600546:pehd:4211:6601022,6600548:pehd:4211:6600702,6600551:pehd:4211:6600891,6600554:pehd:4211:6600597,6601134:pehd:4211:6602444,6601138:pehd:4211:6602601,6601142:pehd:4211:6601604,6601649:pehd:4211:6602281,6602728:pehd:4211:6603006,6602733:pehd:4211:6603409,6604399:pehd:4211:6608072,6605499:pehd:4211:6610648,6605503:pehd:4211:6605890,6605688:pehd:4211:6606075,6606683:pehd:4211:6607690,6607835:pehd:4211:6610407,6607837:pehd:4211:6610185,66'}, {'unwanted_material': 'pehd', 'main_material': 'pet_clair', 'pht_type': 3327, 'ratio': 0.0019293084660709505, 'nb_photo': 273, 'list_port_cont': '6601307,6601555,6601786,6602308,6603607,6603836,6604931,6606273,6606378,6607134,6607399,6607896,6608317,6608582,6609917,6610054,6610919,6611086,6613723,6616969,6621109,6621147,6621175,6621381,6621443,6622372,6622653,6622754,6626366,6626981,6628626,6629353,6629393,6635973,6636120,6636144,6636682,6637052,6637758,6638416,6638593,6638979,6639653,6639753,6639840,6639973,6640752,6640773,6640962,6641208,6641482,6641513,6641943,6642092,6643483,6643627,6643714,6643896,6645157,6645307,6645764,6648008,6648357,6648811,6649737,6652023,6652944,6654490,6655049,6656662,6657953,6663978,6670191,6671021,6672471,6673060,6674484,6675451,6675589,6676584,6681848,6682438,6684388,6686711,6687374,6687704,6688265,6689126,6689282,6689505,6690578,6690632,6692194,6692352,6692541,6692686,6693519,6694785,6696037,6697044,6697601,6697680,6698233,6698691,6698892,6698922,6699065,6710963,6711527,6712030,6712064,6712351,6712522,6712805,6712843,6713118,6713310,6717346,6720929,6721463,6723979,6724042,6725337,6725396,6727508,6740875,6741549,6742203,', 'assoc_port': '6600547:6601555,6600550:6601786,6600553:6601307,6601140:6602308,6602727:6603836,6602732:6603607,6604400:6604931,6604702:6606378,6605500:6606273,6605502:6607134,6606682:6608317,6606685:6607896,6606687:6607399,6607836:6608582,6609197:6610054,6609198:6609917,6610497:6611086,6610499:6610919,6612953:6613723,6616171:6616969,6620039:6621381,6620404:6621147,6620441:6621443,6620445:6621175,6620449:6621109,6621639:6622653,6621642:6622754,6621650:6622372,6625901:6626366,6626270:6626981,6627948:6628626,6628988:6629353,6628991:6629393,6630851:6635973,6630853:6636682,6630934:6637758,6631071:6638979,6631073:6639653,6631075:6639973,6631486:6641482,6631488:6640752,6631490:6640773,6631493:6640962,6631964:6642092,6631965:6641513,6632579:6645157,6632584:6645764,6632662:6643483,6632711:6643714,6632713:6648811,6632876:6643896,6632968:6645307,6633861:6637052,6635680:6636144,6635684:6636120,6637842:6638593,6637844:6638416,6638772:6639840,6638775:6639753,6640591:6641208,6641288:6643627,6641292:6641943,6646445:6648008,6647213:6648357,', 'assoc_mat': '6600547:pehd:3327:6601555,6600550:pehd:3327:6601786,6600553:pehd:3327:6601307,6601140:pehd:3327:6602308,6602727:pehd:3327:6603836,6602732:pehd:3327:6603607,6604400:pehd:3327:6604931,6604702:pehd:3327:6606378,6605500:pehd:3327:6606273,6605502:pehd:3327:6607134,6606682:pehd:3327:6608317,6606685:pehd:3327:6607896,6606687:pehd:3327:6607399,6607836:pehd:3327:6608582,6609197:pehd:3327:6610054,6609198:pehd:3327:6609917,6610497:pehd:3327:6611086,6610499:pehd:3327:6610919,6612953:pehd:3327:6613723,6616171:pehd:3327:6616969,6620039:pehd:3327:6621381,6620404:pehd:3327:6621147,6620441:pehd:3327:6621443,6620445:pehd:3327:6621175,6620449:pehd:3327:6621109,6621639:pehd:3327:6622653,6621642:pehd:3327:6622754,6621650:pehd:3327:6622372,6625901:pehd:3327:6626366,6626270:pehd:3327:6626981,6627948:pehd:3327:6628626,6628988:pehd:3327:6629353,6628991:pehd:3327:6629393,6630851:pehd:3327:6635973,6630853:pehd:3327:6636682,6630934:pehd:3327:6637758,6631071:pehd:3327:6638979,6631073:pehd:3327:6639653,6631075:pehd:3327:6639973,6631486:pe'}, {'unwanted_material': 'pehd', 'main_material': 'pet_fonce', 'pht_type': 4200, 'ratio': 0.0051100227990344554, 'nb_photo': 146, 'list_port_cont': '6604877,6609170,6613068,6615614,6618503,6620187,6620866,6621902,6628367,6634250,6637080,6637448,6641565,6653431,6654691,6655698,6658465,6662390,6665200,6669580,6670050,6672621,6674514,6683659,6684464,6687228,6696451,6698464,6711561,6712283,6712785,6714507,6717609,6719826,6720245,6720364,6721249,6740804,6745511,6745786,6750247,6754189,6754553,6759422,6765273,6766697,6780403,6780526,6780710,6786856,6788637,6791338,6793691,6795538,6797665,6821369,6824092,6842448,6849223,6851780,6852369,6854529,6859027,6862725,6866337,6867970,6869263,6875756,6882722,6888109,6895287,6902508,6914447,6920759,6921629,6924255', 'assoc_port': '6604397:6604877,6608145:6609170,6612632:6613068,6615365:6615614,6618309:6618503,6620043:6620187,6620439:6620866,6621653:6621902,6627944:6628367,6631186:6634250,6631961:6655698,6632583:6662390,6632966:6670050,6635673:6637448,6635681:6637080,6641286:6641565,6650951:6653431,6654041:6654691,6657889:6658465,6664429:6665200,6668950:6669580,6671809:6672621,6673895:6674514,6681680:6683659,6683618:6684464,6685440:6720364,6686027:6719826,6686312:6687228,6688871:6714507,6690894:6698464,6693641:6696451,6710860:6711561,6711680:6712283,6712324:6712785,6716688:6717609,6718843:6720245,6720803:6721249,6740018:6740804,6740709:6745511,6744268:6745786,6748062:6750247,6753406:6754553,6753419:6754189,6759057:6759422,6764848:6765273,6765563:6766697,6779960:6780710,6779977:6780526,6780017:6780403,6786463:6786856,6787690:6788637,6790918:6791338,6793238:6793691,6795258:6795538,6797266:6797665,6820776:6821369,6823753:6824092,6842061:6842448,6848832:6849223,6850353:6851780,6852123:6852369,6854184:6854529,6858797:6859027,6862270:6862725,', 'assoc_mat': '6604397:pehd:4200:6604877,6608145:pehd:4200:6609170,6612632:pehd:4200:6613068,6615365:pehd:4200:6615614,6618309:pehd:4200:6618503,6620043:pehd:4200:6620187,6620439:pehd:4200:6620866,6621653:pehd:4200:6621902,6627944:pehd:4200:6628367,6631186:pehd:4200:6634250,6631961:pehd:4200:6655698,6632583:pehd:4200:6662390,6632966:pehd:4200:6670050,6635673:pehd:4200:6637448,6635681:pehd:4200:6637080,6641286:pehd:4200:6641565,6650951:pehd:4200:6653431,6654041:pehd:4200:6654691,6657889:pehd:4200:6658465,6664429:pehd:4200:6665200,6668950:pehd:4200:6669580,6671809:pehd:4200:6672621,6673895:pehd:4200:6674514,6681680:pehd:4200:6683659,6683618:pehd:4200:6684464,6685440:pehd:4200:6720364,6686027:pehd:4200:6719826,6686312:pehd:4200:6687228,6688871:pehd:4200:6714507,6690894:pehd:4200:6698464,6693641:pehd:4200:6696451,6710860:pehd:4200:6711561,6711680:pehd:4200:6712283,6712324:pehd:4200:6712785,6716688:pehd:4200:6717609,6718843:pehd:4200:6720245,6720803:pehd:4200:6721249,6740018:pehd:4200:6740804,6740709:pehd:4200:6745511,6744268:pe'}, {'unwanted_material': 'pet_clair', 'main_material': 'ela', 'pht_type': 4203, 'ratio': 0.0005167916399878171, 'nb_photo': 10, 'list_port_cont': '6608803,6712721,6754068,6800312,6806350,6808098,6876008,6940836', 'assoc_port': '6608146:6608803,6685991:6800312,6712332:6712721,6753416:6754068,6786466:6808098,6793236:6806350,6875674:6876008,6900378:6940836', 'assoc_mat': '6608146:pet_clair:4203:6608803,6685991:pet_clair:4203:6800312,6712332:pet_clair:4203:6712721,6753416:pet_clair:4203:6754068,6786466:pet_clair:4203:6808098,6793236:pet_clair:4203:6806350,6875674:pet_clair:4203:6876008,6900378:pet_clair:4203:6940836'}, {'unwanted_material': 'pet_clair', 'main_material': 'emr', 'pht_type': 4209, 'ratio': 0.002615200546649331, 'nb_photo': 21, 'list_port_cont': '6600774,6602155,6638508,6669283,6673392,6694184,6695455,6712247,6723146,6740495,6742322,6751442,6754773', 'assoc_port': '6600540:6602155,6600552:6600774,6631482:6669283,6638162:6638508,6672700:6673392,6692502:6694184,6694740:6695455,6710867:6712247,6722817:6723146,6739465:6742322,6740030:6740495,6741911:6754773,6750987:6751442', 'assoc_mat': '6600540:pet_clair:4209:6602155,6600552:pet_clair:4209:6600774,6631482:pet_clair:4209:6669283,6638162:pet_clair:4209:6638508,6672700:pet_clair:4209:6673392,6692502:pet_clair:4209:6694184,6694740:pet_clair:4209:6695455,6710867:pet_clair:4209:6712247,6722817:pet_clair:4209:6723146,6739465:pet_clair:4209:6742322,6740030:pet_clair:4209:6740495,6741911:pet_clair:4209:6754773,6750987:pet_clair:4209:6751442'}, {'unwanted_material': 'pet_clair', 'main_material': 'gm', 'pht_type': 4209, 'ratio': 0.0001938470394354349, 'nb_photo': 4, 'list_port_cont': '6869295,6869655,6914936,6960440', 'assoc_port': '6868823:6869295,6869543:6869655,6914405:6914936,6919131:6960440', 'assoc_mat': '6868823:pet_clair:4209:6869295,6869543:pet_clair:4209:6869655,6914405:pet_clair:4209:6914936,6919131:pet_clair:4209:6960440'}, {'unwanted_material': 'pet_clair', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 0.0010334097253368944, 'nb_photo': 3, 'list_port_cont': '6617252,6617677,6633560', 'assoc_port': '6616962:6617252,6616964:6617677,6631478:6633560', 'assoc_mat': '6616962:pet_clair:4207:6617252,6616964:pet_clair:4207:6617677,6631478:pet_clair:4207:6633560'}, {'unwanted_material': 'pet_clair', 'main_material': 'pehd_pp', 'pht_type': 4211, 'ratio': 0.0015524153897367723, 'nb_photo': 1500, 'list_port_cont': '6600858,6600897,6601013,6601431,6602282,6602595,6603012,6603407,6606068,6607680,6608064,6608283,6609454,6610409,6610606,6610649,6611145,6614534,6615393,6615436,6615797,6616526,6617426,6618921,6620330,6620914,6621054,6621668,6621965,6621997,6622134,6622196,6622457,6624048,6625562,6626620,6626654,6627270,6628482,6629176,6629250,6634388,6634656,6634855,6635135,6635836,6638280,6638446,6639162,6640996,6642051,6642710,6650049,6650151,6650272,6650962,6658506,6664046,6666445,6668082,6668178,6669608,6672025,6674016,6674544,6674638,6674762,6675076,6675106,6675132,6675480,6676532,6676622,6677125,6677222,6677808,6678040,6678226,6678568,6678651,6678771,6678961,6678993,6679220,6681247,6687136,6691495,6691657,6692280,6693193,6693673,6693892,6694033,6694210,6694409,6695508,6697514,6698425,6698773,6698798,6699368,6699436,6705438,6706628,6706772,6707230,6709725,6711231,6711405,6711487,6712154,6712633,6712745,6713436,6713606,6713756,6714401,6716473,6716566,6717505,6717554,6718023,6718524,6719029,6719453,6719723,6720668,6720734,', 'assoc_port': '10844008:10846061,10844009:10845791,10844010:10846028,10844011:10845556,10844012:10845977,10844014:10845189,10844015:10845087,10844017:10845127,10844018:10844952,10844019:10845053,10844020:10844681,10844021:10844449,12107423:12108303,12107427:12108066,12107429:12107823,6600536:6601431,6600544:6600858,6600546:6601013,6600551:6600897,6601138:6602595,6601649:6602282,6602728:6603012,6602733:6603407,6604399:6608064,6605499:6610649,6605688:6606068,6606683:6607680,6607835:6610409,6607839:6608283,6609199:6609454,6610498:6610606,6610992:6611145,6614199:6614534,6614967:6615393,6614969:6615436,6615362:6615797,6616173:6616526,6616982:6617426,6618311:6618921,6620040:6620330,6620422:6621668,6620444:6621054,6620447:6620914,6621638:6624048,6621643:6622457,6621647:6622196,6621651:6622134,6621654:6621965,6621659:6621997,6625236:6625562,6626268:6626620,6626274:6626654,6627098:6627270,6627945:6628482,6628987:6629176,6628989:6629250,6630850:6634855,6630852:6674016,6630856:6634656,6630932:6674638,6630935:6674762,6630939:6675106,66', 'assoc_mat': '10844008:pet_clair:4211:10846061,10844009:pet_clair:4211:10845791,10844010:pet_clair:4211:10846028,10844011:pet_clair:4211:10845556,10844012:pet_clair:4211:10845977,10844014:pet_clair:4211:10845189,10844015:pet_clair:4211:10845087,10844017:pet_clair:4211:10845127,10844018:pet_clair:4211:10844952,10844019:pet_clair:4211:10845053,10844020:pet_clair:4211:10844681,10844021:pet_clair:4211:10844449,12107423:pet_clair:4211:12108303,12107427:pet_clair:4211:12108066,12107429:pet_clair:4211:12107823,6600536:pet_clair:4211:6601431,6600544:pet_clair:4211:6600858,6600546:pet_clair:4211:6601013,6600551:pet_clair:4211:6600897,6601138:pet_clair:4211:6602595,6601649:pet_clair:4211:6602282,6602728:pet_clair:4211:6603012,6602733:pet_clair:4211:6603407,6604399:pet_clair:4211:6608064,6605499:pet_clair:4211:6610649,6605688:pet_clair:4211:6606068,6606683:pet_clair:4211:6607680,6607835:pet_clair:4211:6610409,6607839:pet_clair:4211:6608283,6609199:pet_clair:4211:6609454,6610498:pet_clair:4211:6610606,6610992:pet_clair:4211:6611145,66'}, {'unwanted_material': 'pet_clair', 'main_material': 'pet_clair', 'pht_type': 3327, 'ratio': 0.9599310617320319, 'nb_photo': 267351, 'list_port_cont': '6601210,6601259,6601315,6601372,6601561,6601699,6601793,6601843,6602315,6603612,6603846,6603988,6604935,6606277,6606379,6607135,6607387,6607887,6608320,6608594,6608685,6608963,6609915,6610051,6610272,6610908,6611079,6613731,6614159,6615900,6616061,6616197,6616980,6617460,6617848,6618172,6618946,6620507,6620990,6621111,6621145,6621178,6621380,6621448,6621534,6622108,6622166,6622320,6622376,6622431,6622522,6622656,6622746,6626362,6626970,6627008,6627198,6627829,6628015,6628553,6628621,6629351,6629395,6635805,6635872,6635894,6635946,6635979,6636038,6636114,6636146,6636284,6636327,6636427,6636595,6636676,6636732,6636800,6637047,6637357,6637676,6637709,6637759,6637850,6637946,6637981,6638089,6638412,6638604,6638708,6638827,6638952,6638975,6639189,6639290,6639357,6639644,6639751,6639842,6639900,6639967,6640118,6640724,6640748,6640771,6640953,6641215,6641298,6641330,6641481,6641511,6641662,6641812,6641955,6642028,6642082,6642295,6643245,6643371,6643476,6643601,6643634,6643665,6643684,6643715,6643904,6644075,6644466,', 'assoc_port': '6600535:6601259,6600537:6601699,6600543:6601210,6600545:6601372,6600547:6601561,6600550:6601793,6600553:6601315,6601140:6602315,6601199:6601843,6602727:6603846,6602729:6603988,6602732:6603612,6604400:6604935,6604702:6606379,6605500:6606277,6605502:6607135,6606682:6608320,6606685:6607887,6606687:6607387,6607836:6608594,6607838:6608685,6608144:6608963,6609197:6610051,6609198:6609915,6609963:6610272,6610497:6611079,6610499:6610908,6612953:6613731,6613333:6614159,6614966:6616197,6614968:6616061,6615360:6615900,6616171:6616980,6616960:6618172,6616966:6617460,6616967:6617848,6618310:6618946,6620036:6620507,6620039:6621380,6620042:6620990,6620404:6621145,6620441:6621448,6620445:6621178,6620446:6621534,6620449:6621111,6621639:6622656,6621642:6622746,6621645:6622522,6621650:6622376,6621652:6622431,6621655:6622166,6621656:6622108,6621661:6622320,6625901:6626362,6626270:6626970,6626272:6627008,6626275:6627198,6627097:6627829,6627099:6628015,6627946:6628553,6627948:6628621,6628988:6629351,6628991:6629395,6630847:6635946,', 'assoc_mat': '6600535:pet_clair:3327:6601259,6600537:pet_clair:3327:6601699,6600543:pet_clair:3327:6601210,6600545:pet_clair:3327:6601372,6600547:pet_clair:3327:6601561,6600550:pet_clair:3327:6601793,6600553:pet_clair:3327:6601315,6601140:pet_clair:3327:6602315,6601199:pet_clair:3327:6601843,6602727:pet_clair:3327:6603846,6602729:pet_clair:3327:6603988,6602732:pet_clair:3327:6603612,6604400:pet_clair:3327:6604935,6604702:pet_clair:3327:6606379,6605500:pet_clair:3327:6606277,6605502:pet_clair:3327:6607135,6606682:pet_clair:3327:6608320,6606685:pet_clair:3327:6607887,6606687:pet_clair:3327:6607387,6607836:pet_clair:3327:6608594,6607838:pet_clair:3327:6608685,6608144:pet_clair:3327:6608963,6609197:pet_clair:3327:6610051,6609198:pet_clair:3327:6609915,6609963:pet_clair:3327:6610272,6610497:pet_clair:3327:6611079,6610499:pet_clair:3327:6610908,6612953:pet_clair:3327:6613731,6613333:pet_clair:3327:6614159,6614966:pet_clair:3327:6616197,6614968:pet_clair:3327:6616061,6615360:pet_clair:3327:6615900,6616171:pet_clair:3327:6616980,6'}, {'unwanted_material': 'pet_clair', 'main_material': 'pet_fonce', 'pht_type': 4200, 'ratio': 0.013850132418607056, 'nb_photo': 729, 'list_port_cont': '6600932,6602056,6604868,6606116,6609176,6613074,6615622,6618504,6620175,6620851,6621896,6626788,6628359,6634256,6635400,6637083,6637447,6638371,6639240,6641570,6646011,6647331,6649288,6649483,6649916,6653442,6654690,6655705,6658463,6662388,6665196,6669581,6670064,6672613,6674519,6683665,6684474,6686801,6687235,6687462,6696450,6696819,6698459,6711564,6712276,6712777,6714501,6717602,6719815,6720155,6720212,6720236,6720365,6721245,6722531,6724155,6739274,6740798,6745510,6745796,6750242,6754194,6754554,6759416,6765275,6766695,6767363,6780396,6780522,6780718,6784027,6786850,6788647,6791335,6793696,6795535,6797659,6813917,6817661,6821368,6824094,6835198,6836547,6840209,6842441,6849227,6851786,6852367,6854528,6859033,6862731,6865772,6866324,6867968,6869265,6874404,6875758,6875978,6882732,6886808,6888105,6889504,6895291,6900326,6902507,6904839,6914449,6920746,6921620,6924256', 'assoc_port': '6600538:6600932,6601136:6602056,6604397:6604868,6605689:6606116,6608145:6609176,6612632:6613074,6615365:6615622,6618309:6618504,6620043:6620175,6620439:6620851,6621653:6621896,6626271:6626788,6627944:6628359,6630848:6646011,6631070:6649288,6631186:6634256,6631194:6649916,6631961:6655705,6632583:6662388,6632786:6635400,6632966:6670064,6635673:6637447,6635681:6637083,6637843:6638371,6638774:6639240,6641286:6641570,6646447:6647331,6648940:6649483,6650951:6653442,6654041:6654690,6657889:6658463,6664429:6665196,6668950:6669581,6671809:6672613,6673895:6674519,6681680:6683665,6683618:6684474,6685440:6720365,6685511:6720212,6686027:6719815,6686041:6720155,6686295:6687462,6686312:6687235,6686325:6686801,6688871:6714501,6690894:6698459,6693641:6696450,6696476:6696819,6710860:6711564,6711680:6712276,6712324:6712777,6716688:6717602,6718843:6720236,6720803:6721245,6722354:6722531,6723892:6724155,6738748:6739274,6740018:6740798,6740709:6745510,6744268:6745796,6748062:6750242,6753406:6754554,6753419:6754194,6759057:6759416,', 'assoc_mat': '6600538:pet_clair:4200:6600932,6601136:pet_clair:4200:6602056,6604397:pet_clair:4200:6604868,6605689:pet_clair:4200:6606116,6608145:pet_clair:4200:6609176,6612632:pet_clair:4200:6613074,6615365:pet_clair:4200:6615622,6618309:pet_clair:4200:6618504,6620043:pet_clair:4200:6620175,6620439:pet_clair:4200:6620851,6621653:pet_clair:4200:6621896,6626271:pet_clair:4200:6626788,6627944:pet_clair:4200:6628359,6630848:pet_clair:4200:6646011,6631070:pet_clair:4200:6649288,6631186:pet_clair:4200:6634256,6631194:pet_clair:4200:6649916,6631961:pet_clair:4200:6655705,6632583:pet_clair:4200:6662388,6632786:pet_clair:4200:6635400,6632966:pet_clair:4200:6670064,6635673:pet_clair:4200:6637447,6635681:pet_clair:4200:6637083,6637843:pet_clair:4200:6638371,6638774:pet_clair:4200:6639240,6641286:pet_clair:4200:6641570,6646447:pet_clair:4200:6647331,6648940:pet_clair:4200:6649483,6650951:pet_clair:4200:6653442,6654041:pet_clair:4200:6654690,6657889:pet_clair:4200:6658463,6664429:pet_clair:4200:6665196,6668950:pet_clair:4200:6669581,6'}, {'unwanted_material': 'pet_fonce', 'main_material': 'ela', 'pht_type': 4203, 'ratio': 0.00022092315643821876, 'nb_photo': 2, 'list_port_cont': '6712712,6806360', 'assoc_port': '6712332:6712712,6793236:6806360', 'assoc_mat': '6712332:pet_fonce:4203:6712712,6793236:pet_fonce:4203:6806360'}, {'unwanted_material': 'pet_fonce', 'main_material': 'pehd_pp', 'pht_type': 4211, 'ratio': 0.0003846699616495868, 'nb_photo': 87, 'list_port_cont': '6600861,6603394,6607677,6615422,6622000,6622197,6624062,6627276,6628479,6629185,6634858,6635145,6672029,6674545,6675144,6675478,6677810,6678775,6691486,6694039,6698430,6699376,6699426,6707232,6719024,6720655,6721843,6723783,6724752,6724915,6725834,6730262,6732433,6741928,6743868,6751578,6751686,6754292,6756063,6768401,6769194,6775051,6780889,6782985,6783127,6789494,6789900,6792092,6794401,6795573,6800465,6800534,6800819,6801501,6808800,6808842,6835780,6855452,6869892,6885665,6917719,6920225,6922977,10844443', 'assoc_port': '10844021:10844443,6600544:6600861,6602733:6603394,6606683:6607677,6614969:6615422,6621638:6624062,6621647:6622197,6621659:6622000,6627098:6627276,6627945:6628479,6628987:6629185,6630850:6634858,6631069:6675478,6631193:6635145,6631960:6677810,6632714:6678775,6635676:6694039,6640592:6707232,6647212:6719024,6651292:6721843,6654038:6724915,6654837:6725834,6668952:6751578,6671805:6756063,6671810:6672029,6673889:6674545,6674723:6675144,6683614:6789900,6683620:6691486,6686021:6855452,6686031:6800465,6686094:6800534,6686298:6800819,6686318:6801501,6688870:6732433,6690893:6730262,6694730:6699426,6696471:6699376,6696477:6698430,6720298:6720655,6723498:6723783,6724591:6724752,6741314:6741928,6743337:6743868,6750985:6751686,6753415:6754292,6764851:6808842,6765559:6808800,6767894:6768401,6768944:6769194,6773721:6775051,6780010:6780889,6782241:6782985,6782244:6783127,6788947:6789494,6791774:6792092,6793940:6794401,6795260:6795573,6833511:6869892,6835299:6835780,6885269:6885665,6916370:6917719,6919132:6920225,6920914:692297', 'assoc_mat': '10844021:pet_fonce:4211:10844443,6600544:pet_fonce:4211:6600861,6602733:pet_fonce:4211:6603394,6606683:pet_fonce:4211:6607677,6614969:pet_fonce:4211:6615422,6621638:pet_fonce:4211:6624062,6621647:pet_fonce:4211:6622197,6621659:pet_fonce:4211:6622000,6627098:pet_fonce:4211:6627276,6627945:pet_fonce:4211:6628479,6628987:pet_fonce:4211:6629185,6630850:pet_fonce:4211:6634858,6631069:pet_fonce:4211:6675478,6631193:pet_fonce:4211:6635145,6631960:pet_fonce:4211:6677810,6632714:pet_fonce:4211:6678775,6635676:pet_fonce:4211:6694039,6640592:pet_fonce:4211:6707232,6647212:pet_fonce:4211:6719024,6651292:pet_fonce:4211:6721843,6654038:pet_fonce:4211:6724915,6654837:pet_fonce:4211:6725834,6668952:pet_fonce:4211:6751578,6671805:pet_fonce:4211:6756063,6671810:pet_fonce:4211:6672029,6673889:pet_fonce:4211:6674545,6674723:pet_fonce:4211:6675144,6683614:pet_fonce:4211:6789900,6683620:pet_fonce:4211:6691486,6686021:pet_fonce:4211:6855452,6686031:pet_fonce:4211:6800465,6686094:pet_fonce:4211:6800534,6686298:pet_fonce:4211:6800819'}, {'unwanted_material': 'pet_fonce', 'main_material': 'pet_clair', 'pht_type': 3327, 'ratio': 0.0027937857287839945, 'nb_photo': 263, 'list_port_cont': '6601312,6601378,6602302,6604937,6607386,6607897,6609918,6610056,6614156,6616198,6617469,6618949,6621166,6621524,6622171,6622318,6622432,6622523,6627007,6627194,6628022,6628558,6628620,6629360,6629385,6635890,6636150,6636335,6637041,6637956,6638951,6639300,6639360,6639649,6639843,6639963,6640116,6641206,6641660,6642031,6642088,6643666,6643686,6644074,6645311,6645758,6647413,6648013,6648348,6651389,6651678,6652033,6652947,6653022,6654605,6655887,6658048,6659096,6660216,6665644,6665949,6668610,6672473,6673067,6674828,6675455,6682558,6684379,6686720,6687693,6687751,6688499,6688987,6689537,6689587,6689850,6690097,6690214,6690635,6692361,6692530,6692691,6693861,6694779,6695712,6696111,6697041,6697340,6697715,6697768,6697941,6698112,6698730,6698987,6711529,6712340,6712870,6713125,6713218,6713281,6719368,6721992,6722018,6722072,6722229,6723374,6723733,6724035,6725340,6740139,6740418,6742670,6743702,6744133,6748415,6748972,6749009,6749528,6750026,6751763,6754264,6754530,6758447,6759452,6760150,6760421,6765840,6766308,', 'assoc_port': '6600545:6601378,6600553:6601312,6601140:6602302,6604400:6604937,6606685:6607897,6606687:6607386,6609197:6610056,6609198:6609918,6613333:6614156,6614966:6616198,6616966:6617469,6618310:6618949,6620445:6621166,6620446:6621524,6621645:6622523,6621652:6622432,6621655:6622171,6621661:6622318,6626272:6627007,6626275:6627194,6627099:6628022,6627946:6628558,6627948:6628620,6628988:6629360,6628991:6629385,6631066:6641660,6631073:6639649,6631075:6639963,6631076:6639360,6631185:6638951,6631476:6640116,6631964:6642088,6632584:6645758,6632785:6635890,6632788:6643666,6632880:6636335,6632882:6644074,6632968:6645311,6633861:6637041,6635680:6636150,6637237:6637956,6637846:6639300,6638772:6639843,6640591:6641206,6640596:6643686,6641258:6642031,6646445:6648013,6646448:6647413,6647213:6648348,6649832:6652033,6650508:6651389,6650511:6651678,6650952:6652947,6652019:6653022,6653519:6654605,6654835:6655887,6654836:6659096,6656899:6658048,6657892:6660216,6664425:6665644,6664427:6665949,6667559:6668610,6671807:6672473,6671811:6673067,', 'assoc_mat': '6600545:pet_fonce:3327:6601378,6600553:pet_fonce:3327:6601312,6601140:pet_fonce:3327:6602302,6604400:pet_fonce:3327:6604937,6606685:pet_fonce:3327:6607897,6606687:pet_fonce:3327:6607386,6609197:pet_fonce:3327:6610056,6609198:pet_fonce:3327:6609918,6613333:pet_fonce:3327:6614156,6614966:pet_fonce:3327:6616198,6616966:pet_fonce:3327:6617469,6618310:pet_fonce:3327:6618949,6620445:pet_fonce:3327:6621166,6620446:pet_fonce:3327:6621524,6621645:pet_fonce:3327:6622523,6621652:pet_fonce:3327:6622432,6621655:pet_fonce:3327:6622171,6621661:pet_fonce:3327:6622318,6626272:pet_fonce:3327:6627007,6626275:pet_fonce:3327:6627194,6627099:pet_fonce:3327:6628022,6627946:pet_fonce:3327:6628558,6627948:pet_fonce:3327:6628620,6628988:pet_fonce:3327:6629360,6628991:pet_fonce:3327:6629385,6631066:pet_fonce:3327:6641660,6631073:pet_fonce:3327:6639649,6631075:pet_fonce:3327:6639963,6631076:pet_fonce:3327:6639360,6631185:pet_fonce:3327:6638951,6631476:pet_fonce:3327:6640116,6631964:pet_fonce:3327:6642088,6632584:pet_fonce:3327:6645758,6'}, {'unwanted_material': 'pet_fonce', 'main_material': 'pet_fonce', 'pht_type': 4200, 'ratio': 0.9433959349191054, 'nb_photo': 1865, 'list_port_cont': '6600921,6602052,6604879,6606107,6609173,6613064,6615625,6618497,6620185,6620862,6621905,6626786,6628358,6634244,6635391,6637070,6637445,6638364,6639248,6641566,6646009,6647335,6649279,6649476,6649915,6653441,6654686,6655703,6658466,6662391,6665191,6669589,6670061,6672609,6674517,6683670,6684465,6686804,6687227,6687466,6696439,6696818,6698462,6711554,6712271,6712775,6714495,6717596,6719814,6720150,6720211,6720250,6720367,6721247,6722527,6724149,6739286,6740801,6745519,6745787,6750252,6754190,6754558,6759425,6765276,6766699,6767360,6780401,6780523,6780723,6784025,6786849,6788646,6791336,6793695,6795539,6797667,6813921,6817652,6821383,6824097,6835196,6836551,6840207,6842434,6849224,6851782,6852366,6854523,6859029,6862727,6865773,6866335,6867976,6869266,6874407,6875753,6875975,6882723,6886803,6888103,6889495,6895281,6900334,6902509,6904835,6914448,6920755,6921623,6924260', 'assoc_port': '6600538:6600921,6601136:6602052,6604397:6604879,6605689:6606107,6608145:6609173,6612632:6613064,6615365:6615625,6618309:6618497,6620043:6620185,6620439:6620862,6621653:6621905,6626271:6626786,6627944:6628358,6630848:6646009,6631070:6649279,6631186:6634244,6631194:6649915,6631961:6655703,6632583:6662391,6632786:6635391,6632966:6670061,6635673:6637445,6635681:6637070,6637843:6638364,6638774:6639248,6641286:6641566,6646447:6647335,6648940:6649476,6650951:6653441,6654041:6654686,6657889:6658466,6664429:6665191,6668950:6669589,6671809:6672609,6673895:6674517,6681680:6683670,6683618:6684465,6685440:6720367,6685511:6720211,6686027:6719814,6686041:6720150,6686295:6687466,6686312:6687227,6686325:6686804,6688871:6714495,6690894:6698462,6693641:6696439,6696476:6696818,6710860:6711554,6711680:6712271,6712324:6712775,6716688:6717596,6718843:6720250,6720803:6721247,6722354:6722527,6723892:6724149,6738748:6739286,6740018:6740801,6740709:6745519,6744268:6745787,6748062:6750252,6753406:6754558,6753419:6754190,6759057:6759425,', 'assoc_mat': '6600538:pet_fonce:4200:6600921,6601136:pet_fonce:4200:6602052,6604397:pet_fonce:4200:6604879,6605689:pet_fonce:4200:6606107,6608145:pet_fonce:4200:6609173,6612632:pet_fonce:4200:6613064,6615365:pet_fonce:4200:6615625,6618309:pet_fonce:4200:6618497,6620043:pet_fonce:4200:6620185,6620439:pet_fonce:4200:6620862,6621653:pet_fonce:4200:6621905,6626271:pet_fonce:4200:6626786,6627944:pet_fonce:4200:6628358,6630848:pet_fonce:4200:6646009,6631070:pet_fonce:4200:6649279,6631186:pet_fonce:4200:6634244,6631194:pet_fonce:4200:6649915,6631961:pet_fonce:4200:6655703,6632583:pet_fonce:4200:6662391,6632786:pet_fonce:4200:6635391,6632966:pet_fonce:4200:6670061,6635673:pet_fonce:4200:6637445,6635681:pet_fonce:4200:6637070,6637843:pet_fonce:4200:6638364,6638774:pet_fonce:4200:6639248,6641286:pet_fonce:4200:6641566,6646447:pet_fonce:4200:6647335,6648940:pet_fonce:4200:6649476,6650951:pet_fonce:4200:6653441,6654041:pet_fonce:4200:6654686,6657889:pet_fonce:4200:6658466,6664429:pet_fonce:4200:6665191,6668950:pet_fonce:4200:6669589,6'}, {'unwanted_material': 'pet_opaque', 'main_material': 'ela', 'pht_type': 4203, 'ratio': 0.0009264502462378221, 'nb_photo': 9, 'list_port_cont': '6608814,6660097,6712722,6735145,6799275,6808109,6869931', 'assoc_port': '6608146:6608814,6632879:6660097,6685476:6799275,6690887:6735145,6712332:6712722,6786466:6808109,6869544:6869931', 'assoc_mat': '6608146:pet_opaque:4203:6608814,6632879:pet_opaque:4203:6660097,6685476:pet_opaque:4203:6799275,6690887:pet_opaque:4203:6735145,6712332:pet_opaque:4203:6712722,6786466:pet_opaque:4203:6808109,6869544:pet_opaque:4203:6869931'}, {'unwanted_material': 'pet_opaque', 'main_material': 'emr', 'pht_type': 4209, 'ratio': 0.007255625347838711, 'nb_photo': 19, 'list_port_cont': '6616740,6617521,6620419,6621938,6627043,6638500,6668139,6668209,6670564,6670896,6678093,6740485,6791207', 'assoc_port': '6616168:6616740,6616963:6617521,6620037:6620419,6621646:6621938,6626722:6627043,6631190:6668139,6631196:6668209,6632661:6670564,6632883:6670896,6638162:6638500,6677866:6678093,6740030:6740485,6790915:6791207', 'assoc_mat': '6616168:pet_opaque:4209:6616740,6616963:pet_opaque:4209:6617521,6620037:pet_opaque:4209:6620419,6621646:pet_opaque:4209:6621938,6626722:pet_opaque:4209:6627043,6631190:pet_opaque:4209:6668139,6631196:pet_opaque:4209:6668209,6632661:pet_opaque:4209:6670564,6632883:pet_opaque:4209:6670896,6638162:pet_opaque:4209:6638500,6677866:pet_opaque:4209:6678093,6740030:pet_opaque:4209:6740485,6790915:pet_opaque:4209:6791207'}, {'unwanted_material': 'pet_opaque', 'main_material': 'pehd_pp', 'pht_type': 4211, 'ratio': 0.0016345171833525593, 'nb_photo': 222, 'list_port_cont': '6600901,6602283,6603013,6606069,6608294,6610401,6610657,6611146,6614528,6615400,6621062,6621675,6621998,6622129,6622205,6626613,6629184,6629244,6634651,6635837,6638286,6639164,6650157,6668179,6669616,6672038,6674023,6674634,6674773,6675099,6675136,6677119,6677811,6678215,6678578,6678957,6679224,6681250,6691510,6691659,6693900,6694213,6694417,6698434,6698768,6698799,6699430,6711411,6711493,6712146,6712497,6712754,6713439,6716561,6717501,6717546,6718028,6719452,6720657,6720722,6724914,6725690,6725833,6728841,6729870,6730329,6730727,6731863,6732437,6735376,6738126,6740205,6740607,6741938,6743382,6745286,6751579,6751673,6754142,6754990,6755968,6756060,6756975,6762171,6763524,6767274,6768410,6773018,6774679,6775056,6778932,6780264,6780486,6783061,6791499,6793831,6794248,6794400,6795572,6796823,6799103,6799441,6799779,6800492,6800530,6801272,6801402,6806174,6808133,6808682,6808713,6808832,6808873,6809086,6810005,6815419,6822330,6839899,6842610,6853846,6855228,6855448,6863478,6866679,6869888,6870654,6875922,6890225,', 'assoc_port': '10844011:10845551,10844021:10844440,6600551:6600901,6601649:6602283,6602728:6603013,6605499:6610657,6605688:6606069,6607835:6610401,6607839:6608294,6610992:6611146,6614199:6614528,6614967:6615400,6620422:6621675,6620444:6621062,6621647:6622205,6621651:6622129,6621659:6621998,6626268:6626613,6628987:6629184,6628989:6629244,6630852:6674023,6630856:6634651,6630932:6674634,6630935:6674773,6630939:6675099,6631489:6677119,6631960:6677811,6632585:6678215,6632660:6678578,6632877:6678957,6632963:6679224,6633862:6635837,6635671:6693900,6635682:6694213,6637236:6698768,6637845:6638286,6638776:6639164,6640595:6806174,6647215:6717546,6648944:6650157,6653523:6725690,6654038:6724914,6654837:6725833,6655426:6728841,6656895:6729870,6657891:6731863,6666361:6668179,6668952:6751579,6668953:6669616,6671805:6756060,6671810:6672038,6672701:6755968,6674723:6675136,6681005:6681250,6683620:6691510,6685431:6799103,6685494:6799441,6685525:6799779,6686006:6855228,6686021:6855448,6686094:6800530,6686269:6800492,6686302:6801272,6686308:6801', 'assoc_mat': '10844011:pet_opaque:4211:10845551,10844021:pet_opaque:4211:10844440,6600551:pet_opaque:4211:6600901,6601649:pet_opaque:4211:6602283,6602728:pet_opaque:4211:6603013,6605499:pet_opaque:4211:6610657,6605688:pet_opaque:4211:6606069,6607835:pet_opaque:4211:6610401,6607839:pet_opaque:4211:6608294,6610992:pet_opaque:4211:6611146,6614199:pet_opaque:4211:6614528,6614967:pet_opaque:4211:6615400,6620422:pet_opaque:4211:6621675,6620444:pet_opaque:4211:6621062,6621647:pet_opaque:4211:6622205,6621651:pet_opaque:4211:6622129,6621659:pet_opaque:4211:6621998,6626268:pet_opaque:4211:6626613,6628987:pet_opaque:4211:6629184,6628989:pet_opaque:4211:6629244,6630852:pet_opaque:4211:6674023,6630856:pet_opaque:4211:6634651,6630932:pet_opaque:4211:6674634,6630935:pet_opaque:4211:6674773,6630939:pet_opaque:4211:6675099,6631489:pet_opaque:4211:6677119,6631960:pet_opaque:4211:6677811,6632585:pet_opaque:4211:6678215,6632660:pet_opaque:4211:6678578,6632877:pet_opaque:4211:6678957,6632963:pet_opaque:4211:6679224,6633862:pet_opaque:4211:6635'}, {'unwanted_material': 'pet_opaque', 'main_material': 'pet_fonce', 'pht_type': 4200, 'ratio': 0.006625372408584668, 'nb_photo': 447, 'list_port_cont': '6600927,6602060,6604867,6606114,6609165,6613073,6615618,6618507,6620186,6620865,6621897,6626785,6628362,6634254,6635389,6637069,6637443,6638357,6639233,6641563,6646016,6647330,6649289,6649475,6649908,6653440,6654682,6655700,6658472,6662384,6665186,6669577,6670052,6672606,6674518,6683671,6684478,6686802,6687225,6687464,6696442,6696817,6698458,6711562,6712277,6712786,6714508,6717607,6719819,6720158,6720206,6720247,6720358,6721243,6722532,6724146,6739282,6740800,6745521,6745789,6750245,6754191,6754564,6759415,6765265,6766702,6767358,6780406,6780528,6780714,6784016,6786843,6788645,6791330,6793704,6795548,6797668,6817665,6821371,6824096,6835190,6840200,6842443,6849228,6851781,6852374,6854530,6859022,6862735,6865768,6866326,6867982,6869259,6874403,6875763,6882730,6886804,6888096,6889498,6895283,6900338,6902503,6904834,6914452,6920753,6921628,6924247', 'assoc_port': '6600538:6600927,6601136:6602060,6604397:6604867,6605689:6606114,6608145:6609165,6612632:6613073,6615365:6615618,6618309:6618507,6620043:6620186,6620439:6620865,6621653:6621897,6626271:6626785,6627944:6628362,6630848:6646016,6631070:6649289,6631186:6634254,6631194:6649908,6631961:6655700,6632583:6662384,6632786:6635389,6632966:6670052,6635673:6637443,6635681:6637069,6637843:6638357,6638774:6639233,6641286:6641563,6646447:6647330,6648940:6649475,6650951:6653440,6654041:6654682,6657889:6658472,6664429:6665186,6668950:6669577,6671809:6672606,6673895:6674518,6681680:6683671,6683618:6684478,6685440:6720358,6685511:6720206,6686027:6719819,6686041:6720158,6686295:6687464,6686312:6687225,6686325:6686802,6688871:6714508,6690894:6698458,6693641:6696442,6696476:6696817,6710860:6711562,6711680:6712277,6712324:6712786,6716688:6717607,6718843:6720247,6720803:6721243,6722354:6722532,6723892:6724146,6738748:6739282,6740018:6740800,6740709:6745521,6744268:6745789,6748062:6750245,6753406:6754564,6753419:6754191,6759057:6759415,', 'assoc_mat': '6600538:pet_opaque:4200:6600927,6601136:pet_opaque:4200:6602060,6604397:pet_opaque:4200:6604867,6605689:pet_opaque:4200:6606114,6608145:pet_opaque:4200:6609165,6612632:pet_opaque:4200:6613073,6615365:pet_opaque:4200:6615618,6618309:pet_opaque:4200:6618507,6620043:pet_opaque:4200:6620186,6620439:pet_opaque:4200:6620865,6621653:pet_opaque:4200:6621897,6626271:pet_opaque:4200:6626785,6627944:pet_opaque:4200:6628362,6630848:pet_opaque:4200:6646016,6631070:pet_opaque:4200:6649289,6631186:pet_opaque:4200:6634254,6631194:pet_opaque:4200:6649908,6631961:pet_opaque:4200:6655700,6632583:pet_opaque:4200:6662384,6632786:pet_opaque:4200:6635389,6632966:pet_opaque:4200:6670052,6635673:pet_opaque:4200:6637443,6635681:pet_opaque:4200:6637069,6637843:pet_opaque:4200:6638357,6638774:pet_opaque:4200:6639233,6641286:pet_opaque:4200:6641563,6646447:pet_opaque:4200:6647330,6648940:pet_opaque:4200:6649475,6650951:pet_opaque:4200:6653440,6654041:pet_opaque:4200:6654682,6657889:pet_opaque:4200:6658472,6664429:pet_opaque:4200:6665186,'}, {'unwanted_material': 'textiles_sanitaires', 'main_material': 'ela', 'pht_type': 4203, 'ratio': 5.317677982697793e-05, 'nb_photo': 1, 'list_port_cont': '6754069', 'assoc_port': '6753416:6754069', 'assoc_mat': '6753416:textiles_sanitaires:4203:6754069'}, {'unwanted_material': 'textiles_sanitaires', 'main_material': 'pehd_pp', 'pht_type': 4211, 'ratio': 0.00014015295179752374, 'nb_photo': 14, 'list_port_cont': '6608063,6675111,6678967,6709734,6720656,6724749,6725824,6735649,6787860,6791503,6813248,6828520,6855445,10845973', 'assoc_port': '10844012:10845973,6604399:6608063,6630939:6675111,6632877:6678967,6654837:6725824,6663625:6735649,6686021:6855445,6709374:6709734,6720298:6720656,6724591:6724749,6787210:6787860,6790919:6791503,6812962:6813248,6814154:6828520', 'assoc_mat': '10844012:textiles_sanitaires:4211:10845973,6604399:textiles_sanitaires:4211:6608063,6630939:textiles_sanitaires:4211:6675111,6632877:textiles_sanitaires:4211:6678967,6654837:textiles_sanitaires:4211:6725824,6663625:textiles_sanitaires:4211:6735649,6686021:textiles_sanitaires:4211:6855445,6709374:textiles_sanitaires:4211:6709734,6720298:textiles_sanitaires:4211:6720656,6724591:textiles_sanitaires:4211:6724749,6787210:textiles_sanitaires:4211:6787860,6790919:textiles_sanitaires:4211:6791503,6812962:textiles_sanitaires:4211:6813248,6814154:textiles_sanitaires:4211:6828520'}) select count(distinct mtr_photo_id) from MTRUser.mtr_portfolio_photos where mtr_portfolio_id in (select mtr_portfolio_id from MTRPhoto.dashboard_results where dashboard_run_id in(449271,454376,454388,454411,454399,454424,451519,452689,468274,455185,456478,457640,459828,461074,462392,463490,464885,465870,469411,470781,897152,474755,474338,475306,477478,478927,479886)); after get_hostname_from_raspi hasthag : emr hasthag that could be used but not yet : _______carton,background hasthag : jrm hasthag that could be used but not yet : _______papier,background hasthag : aluminium hasthag that could be used but not yet : _______metal,background hasthag : pet_fonce hasthag that could be used but not yet : _______pet_fonce,background hasthag : gm hasthag that could be used but not yet : _______papier,background after impurety_average_per_hashtag ############################### TEST csv ################################ Removing /home/admin/workarea/git/Velours/python/prod/memo/sla_csv VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11488 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11496 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11497 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11492 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11492 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11495 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11495 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11489 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11489 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11575 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11575 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11491 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11490 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11490 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11498 send_mail_cod have less outputs used (0) than in the step definition (1) : some outputs may be not used ! Step 11499 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11491 doesn't seem to be define in the database( WARNING : type of input 3 of step 11490 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11488 doesn't seem to be define in the database( WARNING : type of input 2 of step 11492 doesn't seem to be define in the database( WARNING : output 1 of step 11488 have datatype=2 whereas input 1 of step 11495 have datatype=7 WARNING : type of output 2 of step 11495 doesn't seem to be define in the database( WARNING : type of input 1 of step 11489 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11491 have datatype=10 whereas input 3 of step 11498 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11575 doesn't seem to be define in the database( WARNING : output 1 of step 11489 have datatype=7 whereas input 2 of step 11575 have datatype=None WARNING : type of output 3 of step 11575 doesn't seem to be define in the database( WARNING : type of input 1 of step 11491 doesn't seem to be define in the database( WARNING : output 0 of step 11491 have datatype=10 whereas input 0 of step 11581 have datatype=18 WARNING : type of input 5 of step 11498 doesn't seem to be define in the database( WARNING : output 0 of step 11581 have datatype=11 whereas input 5 of step 11498 have datatype=None WARNING : type of output 1 of step 11496 doesn't seem to be define in the database( WARNING : type of input 3 of step 11492 doesn't seem to be define in the database( WARNING : type of output 1 of step 11497 doesn't seem to be define in the database( WARNING : type of input 3 of step 11492 doesn't seem to be define in the database( WARNING : output 0 of step 11495 have datatype=1 whereas input 0 of step 11489 have datatype=2 DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4209, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,metal,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'papier,background', 'hashtag_weights': {'barquette_opaque': 0.7, 'carton': 0.7, 'ela': 0.7, 'etiquette': 0.5, 'film_plastique': 0.5, 'kraft': 0.7, 'metal': 1.5, 'pehd': 0.7, 'pet_clair': 0.7, 'pet_opaque': 0.7, 'textiles_sanitaires': 0.5, 'pet_fonce': 0.7}, 'ETA': 600} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4207, 'hashtag_proportion': 'barquette_opaque,ela,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'carton,background', 'hashtag_weights': {'barquette_opaque': 1, 'ela': 1, 'etiquette': 1.0, 'film_plastique': 0.5, 'kraft': 1, 'metal': 3.0, 'papier': 1, 'pehd': 2, 'pet_clair': 2, 'pet_opaque': 2, 'textiles_sanitaires': 1.0, 'pet_fonce': 2}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3726, 'hashtag_proportion': 'Carton_brun,Carton_gris,Teint_Dans_La_Masse,autre_refus,cartonnette,kraft,metal,plastique', 'hashtag_parmi': 'papier,background', 'hashtag_weights': {'Carton_brun': 1.5, 'Carton_gris': 1.5, 'Teint_Dans_La_Masse': 1.0, 'autre_refus': 1.5, 'cartonnette': 1.0, 'kraft': 1.5, 'metal': 3, 'plastique': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11512 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11521 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11520 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11516 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11516 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11519 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11519 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11513 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11513 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11577 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11577 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11515 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11514 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11514 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11523 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11515 doesn't seem to be define in the database( WARNING : type of input 3 of step 11514 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11512 doesn't seem to be define in the database( WARNING : type of input 2 of step 11516 doesn't seem to be define in the database( WARNING : output 1 of step 11512 have datatype=2 whereas input 1 of step 11519 have datatype=7 WARNING : type of output 2 of step 11519 doesn't seem to be define in the database( WARNING : type of input 1 of step 11513 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11515 have datatype=10 whereas input 3 of step 11522 have datatype=6 WARNING : type of input 2 of step 11577 doesn't seem to be define in the database( WARNING : output 1 of step 11513 have datatype=7 whereas input 2 of step 11577 have datatype=None WARNING : type of output 3 of step 11577 doesn't seem to be define in the database( WARNING : type of input 1 of step 11515 doesn't seem to be define in the database( WARNING : output 0 of step 11515 have datatype=10 whereas input 0 of step 11583 have datatype=18 WARNING : type of input 5 of step 11522 doesn't seem to be define in the database( WARNING : output 0 of step 11583 have datatype=11 whereas input 5 of step 11522 have datatype=None WARNING : type of output 1 of step 11521 doesn't seem to be define in the database( WARNING : type of input 3 of step 11516 doesn't seem to be define in the database( WARNING : type of output 1 of step 11520 doesn't seem to be define in the database( WARNING : type of input 3 of step 11516 doesn't seem to be define in the database( WARNING : output 0 of step 11519 have datatype=1 whereas input 0 of step 11513 have datatype=2 DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4203, 'hashtag_proportion': 'barquette_opaque,carton,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'ela,background', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 1, 'etiquette': 0.5, 'film_plastique': 0.5, 'kraft': 0.8, 'metal': 2, 'papier': 0.8, 'pehd': 0.8, 'pet_clair': 0.8, 'pet_opaque': 0.8, 'textiles_sanitaires': 0.5, 'pet_fonce': 0.8}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11560 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11567 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11567 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11563 crop_condition is not consistent : 4 used against 2 in the step definition ! Step 11563 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11564 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11564 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11573 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11573 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11566 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11566 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 1 of step 11560 have datatype=2 whereas input 1 of step 11564 have datatype=7 WARNING : type of output 2 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11565 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11567 doesn't seem to be define in the database( WARNING : type of input 3 of step 11563 doesn't seem to be define in the database( WARNING : type of output 3 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11568 doesn't seem to be define in the database( WARNING : type of output 1 of step 11568 doesn't seem to be define in the database( WARNING : type of input 3 of step 11566 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11570 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11569 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11570 doesn't seem to be define in the database( WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11569 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11568 have datatype=10 whereas input 3 of step 11571 have datatype=6 WARNING : type of input 2 of step 11573 doesn't seem to be define in the database( WARNING : output 1 of step 11565 have datatype=7 whereas input 2 of step 11573 have datatype=None WARNING : type of output 3 of step 11573 doesn't seem to be define in the database( WARNING : type of input 3 of step 11568 doesn't seem to be define in the database( WARNING : output 0 of step 11568 have datatype=10 whereas input 0 of step 11587 have datatype=18 WARNING : type of input 5 of step 11571 doesn't seem to be define in the database( WARNING : output 0 of step 11587 have datatype=11 whereas input 5 of step 11571 have datatype=None WARNING : output 0 of step 11564 have datatype=1 whereas input 0 of step 11565 have datatype=2 DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3327, 'hashtag_proportion': 'autre,carton,metal,papier,pehd,pet_fonce', 'hashtag_parmi': 'pet_clair,bouchon,etiquette,barquette_avec_film,background', 'hashtag_weights': {'autre': 8.0, 'barquette_avec_film': 6, 'carton': 8.0, 'metal': 12, 'papier': 5, 'pehd': 8, 'pet_fonce': 8, 'bouchon': 8, 'etiquette': 8}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11978 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11987 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11986 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11982 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11982 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11985 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11985 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11979 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11979 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11990 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11990 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11981 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11980 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11980 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11989 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11981 doesn't seem to be define in the database( WARNING : type of input 3 of step 11980 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11978 doesn't seem to be define in the database( WARNING : type of input 2 of step 11982 doesn't seem to be define in the database( WARNING : output 1 of step 11978 have datatype=2 whereas input 1 of step 11985 have datatype=7 WARNING : type of output 2 of step 11985 doesn't seem to be define in the database( WARNING : type of input 1 of step 11979 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11981 have datatype=10 whereas input 3 of step 11988 have datatype=6 WARNING : type of input 2 of step 11990 doesn't seem to be define in the database( WARNING : output 1 of step 11979 have datatype=7 whereas input 2 of step 11990 have datatype=None WARNING : type of output 3 of step 11990 doesn't seem to be define in the database( WARNING : type of input 1 of step 11981 doesn't seem to be define in the database( WARNING : output 0 of step 11981 have datatype=10 whereas input 0 of step 11991 have datatype=18 WARNING : type of input 5 of step 11988 doesn't seem to be define in the database( WARNING : output 0 of step 11991 have datatype=11 whereas input 5 of step 11988 have datatype=None WARNING : type of output 1 of step 11987 doesn't seem to be define in the database( WARNING : type of input 3 of step 11982 doesn't seem to be define in the database( WARNING : type of output 1 of step 11986 doesn't seem to be define in the database( WARNING : type of input 3 of step 11982 doesn't seem to be define in the database( WARNING : output 0 of step 11985 have datatype=1 whereas input 0 of step 11979 have datatype=2 DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4461, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,pehd,kraft,metal,papier,pet_fonce,pet_clair,pet_opaque,textiles_sanitaires', 'hashtag_parmi': 'film_plastique', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 0.3, 'ela': 0.3, 'etiquette': 0.1, 'film_plastique': 0.1, 'kraft': 0.3, 'metal': 1.5, 'papier': 0.3, 'pet_clair': 0.3, 'pet_opaque': 0.3, 'textiles_sanitaires': 0.3, 'pet_fonce': 0.3}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11524 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11533 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11532 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11528 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11528 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11531 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11531 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11525 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11525 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11578 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11578 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11527 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11526 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11526 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11535 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11527 doesn't seem to be define in the database( WARNING : type of input 3 of step 11526 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11524 doesn't seem to be define in the database( WARNING : type of input 2 of step 11528 doesn't seem to be define in the database( WARNING : output 1 of step 11524 have datatype=2 whereas input 1 of step 11531 have datatype=7 WARNING : type of output 2 of step 11531 doesn't seem to be define in the database( WARNING : type of input 1 of step 11525 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11527 have datatype=10 whereas input 3 of step 11534 have datatype=6 WARNING : type of input 2 of step 11578 doesn't seem to be define in the database( WARNING : output 1 of step 11525 have datatype=7 whereas input 2 of step 11578 have datatype=None WARNING : type of output 3 of step 11578 doesn't seem to be define in the database( WARNING : type of input 1 of step 11527 doesn't seem to be define in the database( WARNING : output 0 of step 11527 have datatype=10 whereas input 0 of step 11584 have datatype=18 WARNING : type of input 5 of step 11534 doesn't seem to be define in the database( WARNING : output 0 of step 11584 have datatype=11 whereas input 5 of step 11534 have datatype=None WARNING : type of output 1 of step 11533 doesn't seem to be define in the database( WARNING : type of input 3 of step 11528 doesn't seem to be define in the database( WARNING : type of output 1 of step 11532 doesn't seem to be define in the database( WARNING : type of input 3 of step 11528 doesn't seem to be define in the database( WARNING : output 0 of step 11531 have datatype=1 whereas input 0 of step 11525 have datatype=2 DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4211, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,metal,papier,pet_fonce,pet_clair,pet_opaque,textiles_sanitaires', 'hashtag_parmi': 'pehd,background', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 0.3, 'ela': 0.3, 'etiquette': 0.1, 'film_plastique': 0.1, 'kraft': 0.3, 'metal': 1.5, 'papier': 0.3, 'pet_clair': 0.3, 'pet_opaque': 0.3, 'textiles_sanitaires': 0.3, 'pet_fonce': 0.3, 'background': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11548 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11556 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11557 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11552 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11552 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11555 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11555 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11580 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11580 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11551 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11550 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11550 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11559 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11551 doesn't seem to be define in the database( WARNING : type of input 3 of step 11550 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11548 doesn't seem to be define in the database( WARNING : type of input 2 of step 11552 doesn't seem to be define in the database( WARNING : output 1 of step 11548 have datatype=2 whereas input 1 of step 11555 have datatype=7 WARNING : type of output 2 of step 11555 doesn't seem to be define in the database( WARNING : type of input 1 of step 11549 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11551 have datatype=10 whereas input 3 of step 11558 have datatype=6 WARNING : type of input 2 of step 11580 doesn't seem to be define in the database( WARNING : output 1 of step 11549 have datatype=7 whereas input 2 of step 11580 have datatype=None WARNING : type of output 3 of step 11580 doesn't seem to be define in the database( WARNING : type of input 1 of step 11551 doesn't seem to be define in the database( WARNING : output 0 of step 11551 have datatype=10 whereas input 0 of step 11586 have datatype=18 WARNING : type of input 5 of step 11558 doesn't seem to be define in the database( WARNING : output 0 of step 11586 have datatype=11 whereas input 5 of step 11558 have datatype=None WARNING : type of output 1 of step 11556 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : type of output 1 of step 11557 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : output 0 of step 11555 have datatype=1 whereas input 0 of step 11549 have datatype=2 DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4200, 'hashtag_proportion': 'carton,ela,etiquette,film_plastique,kraft,metal,papier,pehd,pet_opaque,textiles_sanitaires,barquette_opaque,pet_clair', 'hashtag_parmi': 'pet_fonce,background', 'hashtag_weights': {'barquette_opaque': 1.5, 'carton': 2.5, 'ela': 1.5, 'etiquette': 1.5, 'film_plastique': 1, 'kraft': 1.5, 'metal': 3.0, 'papier': 1.2, 'pehd': 1.5, 'pet_clair': 1.5, 'pet_opaque': 1.5, 'textiles_sanitaires': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11536 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11545 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11544 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11540 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11540 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11543 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11543 merge_mask_thcl_custom have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 11537 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11579 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11579 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11539 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11538 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11538 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11547 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11539 doesn't seem to be define in the database( WARNING : type of input 3 of step 11538 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11536 doesn't seem to be define in the database( WARNING : type of input 2 of step 11540 doesn't seem to be define in the database( WARNING : output 1 of step 11536 have datatype=2 whereas input 1 of step 11543 have datatype=7 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11539 have datatype=10 whereas input 3 of step 11546 have datatype=6 WARNING : type of input 2 of step 11579 doesn't seem to be define in the database( WARNING : output 1 of step 11537 have datatype=7 whereas input 2 of step 11579 have datatype=None WARNING : type of output 3 of step 11579 doesn't seem to be define in the database( WARNING : type of input 1 of step 11539 doesn't seem to be define in the database( WARNING : output 0 of step 11539 have datatype=10 whereas input 0 of step 11585 have datatype=18 WARNING : type of input 5 of step 11546 doesn't seem to be define in the database( WARNING : output 0 of step 11585 have datatype=11 whereas input 5 of step 11546 have datatype=None WARNING : type of output 1 of step 11545 doesn't seem to be define in the database( WARNING : type of input 3 of step 11540 doesn't seem to be define in the database( WARNING : type of output 1 of step 11544 doesn't seem to be define in the database( WARNING : type of input 3 of step 11540 doesn't seem to be define in the database( WARNING : output 0 of step 11543 have datatype=1 whereas input 0 of step 11537 have datatype=2 DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4205, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'metal,background', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 1.5, 'ela': 1.5, 'etiquette': 1, 'film_plastique': 1, 'kraft': 1, 'papier': 1, 'pehd': 1.5, 'pet_clair': 1.5, 'pet_opaque': 1.5, 'textiles_sanitaires': 1.5, 'pet_fonce': 1.5}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3594, 'hashtag_proportion': 'papier,carton,metal,pet_clair,autre,pehd,pet_fonce', 'hashtag_parmi': 'refus,background', 'hashtag_weights': {'papier': 1, 'carton': 1, 'metal': 1, 'pet_clair': 1, 'autre': 1, 'pehd': 1, 'pet_fonce': 1, 'refus': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier TODO : Insert select and so on # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11488 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11496 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11497 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11492 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11492 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11495 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11495 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11489 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11489 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11575 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11575 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11491 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11490 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11490 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11498 send_mail_cod have less outputs used (0) than in the step definition (1) : some outputs may be not used ! Step 11499 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11491 doesn't seem to be define in the database( WARNING : type of input 3 of step 11490 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11488 doesn't seem to be define in the database( WARNING : type of input 2 of step 11492 doesn't seem to be define in the database( WARNING : output 1 of step 11488 have datatype=2 whereas input 1 of step 11495 have datatype=7 WARNING : type of output 2 of step 11495 doesn't seem to be define in the database( WARNING : type of input 1 of step 11489 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11491 have datatype=10 whereas input 3 of step 11498 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11575 doesn't seem to be define in the database( WARNING : output 1 of step 11489 have datatype=7 whereas input 2 of step 11575 have datatype=None WARNING : type of output 3 of step 11575 doesn't seem to be define in the database( WARNING : type of input 1 of step 11491 doesn't seem to be define in the database( WARNING : output 0 of step 11491 have datatype=10 whereas input 0 of step 11581 have datatype=18 WARNING : type of input 5 of step 11498 doesn't seem to be define in the database( WARNING : output 0 of step 11581 have datatype=11 whereas input 5 of step 11498 have datatype=None WARNING : type of output 1 of step 11496 doesn't seem to be define in the database( WARNING : type of input 3 of step 11492 doesn't seem to be define in the database( WARNING : type of output 1 of step 11497 doesn't seem to be define in the database( WARNING : type of input 3 of step 11492 doesn't seem to be define in the database( WARNING : output 0 of step 11495 have datatype=1 whereas input 0 of step 11489 have datatype=2 DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4209, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,metal,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'papier,background', 'hashtag_weights': {'barquette_opaque': 0.7, 'carton': 0.7, 'ela': 0.7, 'etiquette': 0.5, 'film_plastique': 0.5, 'kraft': 0.7, 'metal': 1.5, 'pehd': 0.7, 'pet_clair': 0.7, 'pet_opaque': 0.7, 'textiles_sanitaires': 0.5, 'pet_fonce': 0.7}, 'ETA': 600} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4207, 'hashtag_proportion': 'barquette_opaque,ela,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'carton,background', 'hashtag_weights': {'barquette_opaque': 1, 'ela': 1, 'etiquette': 1.0, 'film_plastique': 0.5, 'kraft': 1, 'metal': 3.0, 'papier': 1, 'pehd': 2, 'pet_clair': 2, 'pet_opaque': 2, 'textiles_sanitaires': 1.0, 'pet_fonce': 2}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3726, 'hashtag_proportion': 'Carton_brun,Carton_gris,Teint_Dans_La_Masse,autre_refus,cartonnette,kraft,metal,plastique', 'hashtag_parmi': 'papier,background', 'hashtag_weights': {'Carton_brun': 1.5, 'Carton_gris': 1.5, 'Teint_Dans_La_Masse': 1.0, 'autre_refus': 1.5, 'cartonnette': 1.0, 'kraft': 1.5, 'metal': 3, 'plastique': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11512 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11521 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11520 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11516 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11516 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11519 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11519 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11513 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11513 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11577 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11577 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11515 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11514 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11514 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11523 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11515 doesn't seem to be define in the database( WARNING : type of input 3 of step 11514 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11512 doesn't seem to be define in the database( WARNING : type of input 2 of step 11516 doesn't seem to be define in the database( WARNING : output 1 of step 11512 have datatype=2 whereas input 1 of step 11519 have datatype=7 WARNING : type of output 2 of step 11519 doesn't seem to be define in the database( WARNING : type of input 1 of step 11513 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11515 have datatype=10 whereas input 3 of step 11522 have datatype=6 WARNING : type of input 2 of step 11577 doesn't seem to be define in the database( WARNING : output 1 of step 11513 have datatype=7 whereas input 2 of step 11577 have datatype=None WARNING : type of output 3 of step 11577 doesn't seem to be define in the database( WARNING : type of input 1 of step 11515 doesn't seem to be define in the database( WARNING : output 0 of step 11515 have datatype=10 whereas input 0 of step 11583 have datatype=18 WARNING : type of input 5 of step 11522 doesn't seem to be define in the database( WARNING : output 0 of step 11583 have datatype=11 whereas input 5 of step 11522 have datatype=None WARNING : type of output 1 of step 11521 doesn't seem to be define in the database( WARNING : type of input 3 of step 11516 doesn't seem to be define in the database( WARNING : type of output 1 of step 11520 doesn't seem to be define in the database( WARNING : type of input 3 of step 11516 doesn't seem to be define in the database( WARNING : output 0 of step 11519 have datatype=1 whereas input 0 of step 11513 have datatype=2 DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4203, 'hashtag_proportion': 'barquette_opaque,carton,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'ela,background', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 1, 'etiquette': 0.5, 'film_plastique': 0.5, 'kraft': 0.8, 'metal': 2, 'papier': 0.8, 'pehd': 0.8, 'pet_clair': 0.8, 'pet_opaque': 0.8, 'textiles_sanitaires': 0.5, 'pet_fonce': 0.8}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11560 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11567 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11567 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11563 crop_condition is not consistent : 4 used against 2 in the step definition ! Step 11563 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11564 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11564 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11573 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11573 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11566 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11566 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 1 of step 11560 have datatype=2 whereas input 1 of step 11564 have datatype=7 WARNING : type of output 2 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11565 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11567 doesn't seem to be define in the database( WARNING : type of input 3 of step 11563 doesn't seem to be define in the database( WARNING : type of output 3 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11568 doesn't seem to be define in the database( WARNING : type of output 1 of step 11568 doesn't seem to be define in the database( WARNING : type of input 3 of step 11566 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11570 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11569 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11570 doesn't seem to be define in the database( WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11569 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11568 have datatype=10 whereas input 3 of step 11571 have datatype=6 WARNING : type of input 2 of step 11573 doesn't seem to be define in the database( WARNING : output 1 of step 11565 have datatype=7 whereas input 2 of step 11573 have datatype=None WARNING : type of output 3 of step 11573 doesn't seem to be define in the database( WARNING : type of input 3 of step 11568 doesn't seem to be define in the database( WARNING : output 0 of step 11568 have datatype=10 whereas input 0 of step 11587 have datatype=18 WARNING : type of input 5 of step 11571 doesn't seem to be define in the database( WARNING : output 0 of step 11587 have datatype=11 whereas input 5 of step 11571 have datatype=None WARNING : output 0 of step 11564 have datatype=1 whereas input 0 of step 11565 have datatype=2 DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3327, 'hashtag_proportion': 'autre,carton,metal,papier,pehd,pet_fonce', 'hashtag_parmi': 'pet_clair,bouchon,etiquette,barquette_avec_film,background', 'hashtag_weights': {'autre': 8.0, 'barquette_avec_film': 6, 'carton': 8.0, 'metal': 12, 'papier': 5, 'pehd': 8, 'pet_fonce': 8, 'bouchon': 8, 'etiquette': 8}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11978 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11987 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11986 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11982 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11982 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11985 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11985 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11979 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11979 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11990 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11990 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11981 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11980 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11980 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11989 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11981 doesn't seem to be define in the database( WARNING : type of input 3 of step 11980 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11978 doesn't seem to be define in the database( WARNING : type of input 2 of step 11982 doesn't seem to be define in the database( WARNING : output 1 of step 11978 have datatype=2 whereas input 1 of step 11985 have datatype=7 WARNING : type of output 2 of step 11985 doesn't seem to be define in the database( WARNING : type of input 1 of step 11979 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11981 have datatype=10 whereas input 3 of step 11988 have datatype=6 WARNING : type of input 2 of step 11990 doesn't seem to be define in the database( WARNING : output 1 of step 11979 have datatype=7 whereas input 2 of step 11990 have datatype=None WARNING : type of output 3 of step 11990 doesn't seem to be define in the database( WARNING : type of input 1 of step 11981 doesn't seem to be define in the database( WARNING : output 0 of step 11981 have datatype=10 whereas input 0 of step 11991 have datatype=18 WARNING : type of input 5 of step 11988 doesn't seem to be define in the database( WARNING : output 0 of step 11991 have datatype=11 whereas input 5 of step 11988 have datatype=None WARNING : type of output 1 of step 11987 doesn't seem to be define in the database( WARNING : type of input 3 of step 11982 doesn't seem to be define in the database( WARNING : type of output 1 of step 11986 doesn't seem to be define in the database( WARNING : type of input 3 of step 11982 doesn't seem to be define in the database( WARNING : output 0 of step 11985 have datatype=1 whereas input 0 of step 11979 have datatype=2 DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4461, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,pehd,kraft,metal,papier,pet_fonce,pet_clair,pet_opaque,textiles_sanitaires', 'hashtag_parmi': 'film_plastique', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 0.3, 'ela': 0.3, 'etiquette': 0.1, 'film_plastique': 0.1, 'kraft': 0.3, 'metal': 1.5, 'papier': 0.3, 'pet_clair': 0.3, 'pet_opaque': 0.3, 'textiles_sanitaires': 0.3, 'pet_fonce': 0.3}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11524 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11533 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11532 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11528 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11528 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11531 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11531 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11525 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11525 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11578 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11578 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11527 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11526 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11526 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11535 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11527 doesn't seem to be define in the database( WARNING : type of input 3 of step 11526 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11524 doesn't seem to be define in the database( WARNING : type of input 2 of step 11528 doesn't seem to be define in the database( WARNING : output 1 of step 11524 have datatype=2 whereas input 1 of step 11531 have datatype=7 WARNING : type of output 2 of step 11531 doesn't seem to be define in the database( WARNING : type of input 1 of step 11525 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11527 have datatype=10 whereas input 3 of step 11534 have datatype=6 WARNING : type of input 2 of step 11578 doesn't seem to be define in the database( WARNING : output 1 of step 11525 have datatype=7 whereas input 2 of step 11578 have datatype=None WARNING : type of output 3 of step 11578 doesn't seem to be define in the database( WARNING : type of input 1 of step 11527 doesn't seem to be define in the database( WARNING : output 0 of step 11527 have datatype=10 whereas input 0 of step 11584 have datatype=18 WARNING : type of input 5 of step 11534 doesn't seem to be define in the database( WARNING : output 0 of step 11584 have datatype=11 whereas input 5 of step 11534 have datatype=None WARNING : type of output 1 of step 11533 doesn't seem to be define in the database( WARNING : type of input 3 of step 11528 doesn't seem to be define in the database( WARNING : type of output 1 of step 11532 doesn't seem to be define in the database( WARNING : type of input 3 of step 11528 doesn't seem to be define in the database( WARNING : output 0 of step 11531 have datatype=1 whereas input 0 of step 11525 have datatype=2 DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4211, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,metal,papier,pet_fonce,pet_clair,pet_opaque,textiles_sanitaires', 'hashtag_parmi': 'pehd,background', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 0.3, 'ela': 0.3, 'etiquette': 0.1, 'film_plastique': 0.1, 'kraft': 0.3, 'metal': 1.5, 'papier': 0.3, 'pet_clair': 0.3, 'pet_opaque': 0.3, 'textiles_sanitaires': 0.3, 'pet_fonce': 0.3, 'background': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11548 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11556 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11557 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11552 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11552 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11555 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11555 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11580 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11580 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11551 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11550 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11550 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11559 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11551 doesn't seem to be define in the database( WARNING : type of input 3 of step 11550 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11548 doesn't seem to be define in the database( WARNING : type of input 2 of step 11552 doesn't seem to be define in the database( WARNING : output 1 of step 11548 have datatype=2 whereas input 1 of step 11555 have datatype=7 WARNING : type of output 2 of step 11555 doesn't seem to be define in the database( WARNING : type of input 1 of step 11549 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11551 have datatype=10 whereas input 3 of step 11558 have datatype=6 WARNING : type of input 2 of step 11580 doesn't seem to be define in the database( WARNING : output 1 of step 11549 have datatype=7 whereas input 2 of step 11580 have datatype=None WARNING : type of output 3 of step 11580 doesn't seem to be define in the database( WARNING : type of input 1 of step 11551 doesn't seem to be define in the database( WARNING : output 0 of step 11551 have datatype=10 whereas input 0 of step 11586 have datatype=18 WARNING : type of input 5 of step 11558 doesn't seem to be define in the database( WARNING : output 0 of step 11586 have datatype=11 whereas input 5 of step 11558 have datatype=None WARNING : type of output 1 of step 11556 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : type of output 1 of step 11557 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : output 0 of step 11555 have datatype=1 whereas input 0 of step 11549 have datatype=2 DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4200, 'hashtag_proportion': 'carton,ela,etiquette,film_plastique,kraft,metal,papier,pehd,pet_opaque,textiles_sanitaires,barquette_opaque,pet_clair', 'hashtag_parmi': 'pet_fonce,background', 'hashtag_weights': {'barquette_opaque': 1.5, 'carton': 2.5, 'ela': 1.5, 'etiquette': 1.5, 'film_plastique': 1, 'kraft': 1.5, 'metal': 3.0, 'papier': 1.2, 'pehd': 1.5, 'pet_clair': 1.5, 'pet_opaque': 1.5, 'textiles_sanitaires': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11536 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11545 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11544 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11540 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11540 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11543 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11543 merge_mask_thcl_custom have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 11537 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11579 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11579 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11539 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11538 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11538 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11547 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11539 doesn't seem to be define in the database( WARNING : type of input 3 of step 11538 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11536 doesn't seem to be define in the database( WARNING : type of input 2 of step 11540 doesn't seem to be define in the database( WARNING : output 1 of step 11536 have datatype=2 whereas input 1 of step 11543 have datatype=7 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11539 have datatype=10 whereas input 3 of step 11546 have datatype=6 WARNING : type of input 2 of step 11579 doesn't seem to be define in the database( WARNING : output 1 of step 11537 have datatype=7 whereas input 2 of step 11579 have datatype=None WARNING : type of output 3 of step 11579 doesn't seem to be define in the database( WARNING : type of input 1 of step 11539 doesn't seem to be define in the database( WARNING : output 0 of step 11539 have datatype=10 whereas input 0 of step 11585 have datatype=18 WARNING : type of input 5 of step 11546 doesn't seem to be define in the database( WARNING : output 0 of step 11585 have datatype=11 whereas input 5 of step 11546 have datatype=None WARNING : type of output 1 of step 11545 doesn't seem to be define in the database( WARNING : type of input 3 of step 11540 doesn't seem to be define in the database( WARNING : type of output 1 of step 11544 doesn't seem to be define in the database( WARNING : type of input 3 of step 11540 doesn't seem to be define in the database( WARNING : output 0 of step 11543 have datatype=1 whereas input 0 of step 11537 have datatype=2 DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4205, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'metal,background', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 1.5, 'ela': 1.5, 'etiquette': 1, 'film_plastique': 1, 'kraft': 1, 'papier': 1, 'pehd': 1.5, 'pet_clair': 1.5, 'pet_opaque': 1.5, 'textiles_sanitaires': 1.5, 'pet_fonce': 1.5}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3594, 'hashtag_proportion': 'papier,carton,metal,pet_clair,autre,pehd,pet_fonce', 'hashtag_parmi': 'refus,background', 'hashtag_weights': {'papier': 1, 'carton': 1, 'metal': 1, 'pet_clair': 1, 'autre': 1, 'pehd': 1, 'pet_fonce': 1, 'refus': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier create_report_from_API() got an unexpected keyword argument 'outfolder' ERROR csv FAILED #&_#_#&_# TEST memo SUCCEEDED #&_#_#&_# #&_#_#&_# TEST one_day SUCCEEDED #&_#_#&_# #&_#_#&_# TEST get_data SUCCEEDED #&_#_#&_# #&_#_#&_# TEST csv FAILED #&_#_#&_# #&_# TEST FAILED #&_# : prod/memo/memo #&_# #&_# END OF TEST #&_# : prod/memo/memo #&_# /home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python/../../tools/../lib/rpn/proposal_layer.py:28: YAMLLoadWarning: calling yaml.load() without Loader=... is deprecated, as the default Loader is unsafe. Please read https://msg.pyyaml.org/load for full details. layer_params = yaml.load(self.param_str_) /home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python/../../tools/../lib/rpn/proposal_layer.py:28: YAMLLoadWarning: calling yaml.load() without Loader=... is deprecated, as the default Loader is unsafe. Please read https://msg.pyyaml.org/load for full details. layer_params = yaml.load(self.param_str_) /usr/lib/python3/dist-packages/paramiko/transport.py:220: CryptographyDeprecationWarning: Blowfish has been deprecated "class": algorithms.Blowfish, #######all_test_python_finish###### insert result in bdd : Test are not running on charlot, the path should be tested ! /data_2/data_log/job/2025/March/23032025/python_test3/output_tests_python-1133.html new path : /proc/43872/ Data file '/data_2/data_log/job/2025/March/23032025/coverage/.coverage' doesn't seem to be a coverage data file: Couldn't use data file '/data_2/data_log/job/2025/March/23032025/coverage/.coverage': database disk image is malformed Data file '/data_2/data_log/job/2025/March/23032025/coverage/.coverage' doesn't seem to be a coverage data file: Couldn't use data file '/data_2/data_log/job/2025/March/23032025/coverage/.coverage': database disk image is malformed ret : 0 command : coverage3 html -i --omit=/usr/local/lib/python3.8/dist-packages/*,/home/admin/.local/lib/python3.8/site-packages/*,/usr/lib/python3/dist-packages/* -d htmlcov ret : 256 command : coverage3 report -i -m ret : 256 245.37user 99.59system 12:42.79elapsed 45%CPU (0avgtext+0avgdata 6727096maxresident)k 6789336inputs+933272outputs (22055major+12343063minor)pagefaults 0swaps