python /home/admin/mtr/script_for_cron.py -j default -m 20 -a 'python3 /home/admin/workarea/git/Velours/python/prod/memo/memo.py --job=sla_mensuel --raspi=30005 --dashboard_places=sevran --rootfolder_sla=/data_4/data_log/job/memo/sevran -v --mtr_id=1042 --date=`date -d"$nowdate 15 day ago" +%Y-%m` ' -s sla_mensuel -M 0 -S 0 -U 90,80,95 import MySQLdb succeeded Import error (python version) Need env var : LOGRASPI Raspi : 30005, Date : 2025-09 _cr_cnf_ : /home/admin/mtr/.credentials/credentials.py _cr_cnf_ : /home/admin/mtr/.credentials/credentials.py warning , we can't find thcl infos in json_data warning , we can't find pdt infos in json_data nb_day : (0, 30) VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4887 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4887 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4887 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4887 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! {"input_values":[]} SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3993 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3993 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3993 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3993 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4207, 'hashtag_proportion': 'barquette_opaque,ela,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'carton,background', 'hashtag_weights': {'barquette_opaque': 1, 'ela': 1, 'etiquette': 1.0, 'film_plastique': 0.5, 'kraft': 1, 'metal': 3.0, 'papier': 1, 'pehd': 2, 'pet_clair': 2, 'pet_opaque': 2, 'textiles_sanitaires': 1.0, 'pet_fonce': 2}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3994 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3994 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3994 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3994 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11488 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11496 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11497 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11492 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11492 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11495 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11495 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11489 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11489 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11575 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11575 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11491 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11490 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11490 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11498 send_mail_cod have less outputs used (0) than in the step definition (1) : some outputs may be not used ! Step 11499 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11491 doesn't seem to be define in the database( WARNING : type of input 3 of step 11490 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11488 doesn't seem to be define in the database( WARNING : type of input 2 of step 11492 doesn't seem to be define in the database( WARNING : output 1 of step 11488 have datatype=2 whereas input 1 of step 11495 have datatype=7 WARNING : type of output 2 of step 11495 doesn't seem to be define in the database( WARNING : type of input 1 of step 11489 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11491 have datatype=10 whereas input 3 of step 11498 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11575 doesn't seem to be define in the database( WARNING : output 1 of step 11489 have datatype=7 whereas input 2 of step 11575 have datatype=None WARNING : type of output 3 of step 11575 doesn't seem to be define in the database( WARNING : type of input 1 of step 11491 doesn't seem to be define in the database( WARNING : output 0 of step 11491 have datatype=10 whereas input 0 of step 11581 have datatype=18 WARNING : type of input 5 of step 11498 doesn't seem to be define in the database( WARNING : output 0 of step 11581 have datatype=11 whereas input 5 of step 11498 have datatype=None WARNING : type of output 1 of step 11496 doesn't seem to be define in the database( WARNING : type of input 3 of step 11492 doesn't seem to be define in the database( WARNING : type of output 1 of step 11497 doesn't seem to be define in the database( WARNING : type of input 3 of step 11492 doesn't seem to be define in the database( WARNING : output 0 of step 11495 have datatype=1 whereas input 0 of step 11489 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4209, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,metal,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'papier,background', 'hashtag_background': 'papier', 'hashtag_weights': {'barquette_opaque': 0.7, 'carton': 0.7, 'ela': 0.7, 'etiquette': 0.5, 'film_plastique': 0.5, 'kraft': 0.7, 'metal': 1.5, 'pehd': 0.7, 'pet_clair': 0.7, 'pet_opaque': 0.7, 'textiles_sanitaires': 0.5, 'pet_fonce': 0.7}, 'ETA': 600} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3993 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3993 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3993 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3993 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4207, 'hashtag_proportion': 'barquette_opaque,ela,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'carton,background', 'hashtag_weights': {'barquette_opaque': 1, 'ela': 1, 'etiquette': 1.0, 'film_plastique': 0.5, 'kraft': 1, 'metal': 3.0, 'papier': 1, 'pehd': 2, 'pet_clair': 2, 'pet_opaque': 2, 'textiles_sanitaires': 1.0, 'pet_fonce': 2}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3459 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3459 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3459 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3459 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3726, 'hashtag_proportion': 'Carton_brun,Carton_gris,Teint_Dans_La_Masse,autre_refus,cartonnette,kraft,metal,plastique', 'hashtag_parmi': 'papier,background', 'hashtag_weights': {'Carton_brun': 1.5, 'Carton_gris': 1.5, 'Teint_Dans_La_Masse': 1.0, 'autre_refus': 1.5, 'cartonnette': 1.0, 'kraft': 1.5, 'metal': 3, 'plastique': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3991 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3991 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3991 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3991 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11512 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11521 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11520 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11516 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11516 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11519 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11519 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11513 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11513 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11577 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11577 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11515 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11514 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11514 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11523 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11515 doesn't seem to be define in the database( WARNING : type of input 3 of step 11514 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11512 doesn't seem to be define in the database( WARNING : type of input 2 of step 11516 doesn't seem to be define in the database( WARNING : output 1 of step 11512 have datatype=2 whereas input 1 of step 11519 have datatype=7 WARNING : type of output 2 of step 11519 doesn't seem to be define in the database( WARNING : type of input 1 of step 11513 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11515 have datatype=10 whereas input 3 of step 11522 have datatype=6 WARNING : type of input 2 of step 11577 doesn't seem to be define in the database( WARNING : output 1 of step 11513 have datatype=7 whereas input 2 of step 11577 have datatype=None WARNING : type of output 3 of step 11577 doesn't seem to be define in the database( WARNING : type of input 1 of step 11515 doesn't seem to be define in the database( WARNING : output 0 of step 11515 have datatype=10 whereas input 0 of step 11583 have datatype=18 WARNING : type of input 5 of step 11522 doesn't seem to be define in the database( WARNING : output 0 of step 11583 have datatype=11 whereas input 5 of step 11522 have datatype=None WARNING : type of output 1 of step 11521 doesn't seem to be define in the database( WARNING : type of input 3 of step 11516 doesn't seem to be define in the database( WARNING : type of output 1 of step 11520 doesn't seem to be define in the database( WARNING : type of input 3 of step 11516 doesn't seem to be define in the database( WARNING : output 0 of step 11519 have datatype=1 whereas input 0 of step 11513 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4203, 'hashtag_proportion': 'barquette_opaque,carton,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'ela,background', 'hashtag_background': 'ela', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 1, 'etiquette': 0.5, 'film_plastique': 0.5, 'kraft': 0.8, 'metal': 2, 'papier': 0.8, 'pehd': 0.8, 'pet_clair': 0.8, 'pet_opaque': 0.8, 'textiles_sanitaires': 0.5, 'pet_fonce': 0.8}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3804 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3804 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3804 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3804 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11560 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11567 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11567 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11563 crop_condition is not consistent : 4 used against 2 in the step definition ! Step 11563 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11564 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11564 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11573 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11573 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11566 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11566 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 1 of step 11560 have datatype=2 whereas input 1 of step 11564 have datatype=7 WARNING : type of output 2 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11565 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11567 doesn't seem to be define in the database( WARNING : type of input 3 of step 11563 doesn't seem to be define in the database( WARNING : type of output 3 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11568 doesn't seem to be define in the database( WARNING : type of output 1 of step 11568 doesn't seem to be define in the database( WARNING : type of input 3 of step 11566 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11570 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11569 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11570 doesn't seem to be define in the database( WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11569 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11568 have datatype=10 whereas input 3 of step 11571 have datatype=6 WARNING : type of input 2 of step 11573 doesn't seem to be define in the database( WARNING : output 1 of step 11565 have datatype=7 whereas input 2 of step 11573 have datatype=None WARNING : type of output 3 of step 11573 doesn't seem to be define in the database( WARNING : type of input 3 of step 11568 doesn't seem to be define in the database( WARNING : output 0 of step 11568 have datatype=10 whereas input 0 of step 11587 have datatype=18 WARNING : type of input 5 of step 11571 doesn't seem to be define in the database( WARNING : output 0 of step 11587 have datatype=11 whereas input 5 of step 11571 have datatype=None WARNING : output 0 of step 11564 have datatype=1 whereas input 0 of step 11565 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3327, 'hashtag_proportion': 'autre,carton,metal,papier,pehd,pet_fonce', 'hashtag_parmi': 'pet_clair,bouchon,etiquette,barquette_avec_film,background', 'hashtag_background': 'pet_clair', 'hashtag_weights': {'autre': 8.0, 'barquette_avec_film': 6, 'carton': 8.0, 'metal': 12, 'papier': 5, 'pehd': 8, 'pet_fonce': 8, 'bouchon': 8, 'etiquette': 8}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4322 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4322 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4322 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4322 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11978 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11987 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11986 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11982 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11982 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11985 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11985 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11979 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11979 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11990 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11990 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11981 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11980 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11980 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11989 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11981 doesn't seem to be define in the database( WARNING : type of input 3 of step 11980 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11978 doesn't seem to be define in the database( WARNING : type of input 2 of step 11982 doesn't seem to be define in the database( WARNING : output 1 of step 11978 have datatype=2 whereas input 1 of step 11985 have datatype=7 WARNING : type of output 2 of step 11985 doesn't seem to be define in the database( WARNING : type of input 1 of step 11979 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11981 have datatype=10 whereas input 3 of step 11988 have datatype=6 WARNING : type of input 2 of step 11990 doesn't seem to be define in the database( WARNING : output 1 of step 11979 have datatype=7 whereas input 2 of step 11990 have datatype=None WARNING : type of output 3 of step 11990 doesn't seem to be define in the database( WARNING : type of input 1 of step 11981 doesn't seem to be define in the database( WARNING : output 0 of step 11981 have datatype=10 whereas input 0 of step 11991 have datatype=18 WARNING : type of input 5 of step 11988 doesn't seem to be define in the database( WARNING : output 0 of step 11991 have datatype=11 whereas input 5 of step 11988 have datatype=None WARNING : type of output 1 of step 11987 doesn't seem to be define in the database( WARNING : type of input 3 of step 11982 doesn't seem to be define in the database( WARNING : type of output 1 of step 11986 doesn't seem to be define in the database( WARNING : type of input 3 of step 11982 doesn't seem to be define in the database( WARNING : output 0 of step 11985 have datatype=1 whereas input 0 of step 11979 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4461, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,pehd,kraft,metal,papier,pet_fonce,pet_clair,pet_opaque,textiles_sanitaires', 'hashtag_parmi': 'film_plastique', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 0.3, 'ela': 0.3, 'etiquette': 0.1, 'film_plastique': 0.1, 'kraft': 0.3, 'metal': 1.5, 'papier': 0.3, 'pet_clair': 0.3, 'pet_opaque': 0.3, 'textiles_sanitaires': 0.3, 'pet_fonce': 0.3}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3995 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3995 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3995 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3995 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11524 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11533 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11532 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11528 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11528 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11531 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11531 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11525 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11525 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11578 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11578 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11527 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11526 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11526 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11535 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11527 doesn't seem to be define in the database( WARNING : type of input 3 of step 11526 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11524 doesn't seem to be define in the database( WARNING : type of input 2 of step 11528 doesn't seem to be define in the database( WARNING : output 1 of step 11524 have datatype=2 whereas input 1 of step 11531 have datatype=7 WARNING : type of output 2 of step 11531 doesn't seem to be define in the database( WARNING : type of input 1 of step 11525 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11527 have datatype=10 whereas input 3 of step 11534 have datatype=6 WARNING : type of input 2 of step 11578 doesn't seem to be define in the database( WARNING : output 1 of step 11525 have datatype=7 whereas input 2 of step 11578 have datatype=None WARNING : type of output 3 of step 11578 doesn't seem to be define in the database( WARNING : type of input 1 of step 11527 doesn't seem to be define in the database( WARNING : output 0 of step 11527 have datatype=10 whereas input 0 of step 11584 have datatype=18 WARNING : type of input 5 of step 11534 doesn't seem to be define in the database( WARNING : output 0 of step 11584 have datatype=11 whereas input 5 of step 11534 have datatype=None WARNING : type of output 1 of step 11533 doesn't seem to be define in the database( WARNING : type of input 3 of step 11528 doesn't seem to be define in the database( WARNING : type of output 1 of step 11532 doesn't seem to be define in the database( WARNING : type of input 3 of step 11528 doesn't seem to be define in the database( WARNING : output 0 of step 11531 have datatype=1 whereas input 0 of step 11525 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4211, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,metal,papier,pet_fonce,pet_clair,pet_opaque,textiles_sanitaires', 'hashtag_parmi': 'pehd,background', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 0.3, 'ela': 0.3, 'etiquette': 0.1, 'film_plastique': 0.1, 'kraft': 0.3, 'metal': 1.5, 'papier': 0.3, 'pet_clair': 0.3, 'pet_opaque': 0.3, 'textiles_sanitaires': 0.3, 'pet_fonce': 0.3, 'background': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4153 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4153 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4153 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4153 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11548 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11556 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11557 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11552 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11552 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11555 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11555 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11580 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11580 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11551 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11550 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11550 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11559 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11551 doesn't seem to be define in the database( WARNING : type of input 3 of step 11550 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11548 doesn't seem to be define in the database( WARNING : type of input 2 of step 11552 doesn't seem to be define in the database( WARNING : output 1 of step 11548 have datatype=2 whereas input 1 of step 11555 have datatype=7 WARNING : type of output 2 of step 11555 doesn't seem to be define in the database( WARNING : type of input 1 of step 11549 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11551 have datatype=10 whereas input 3 of step 11558 have datatype=6 WARNING : type of input 2 of step 11580 doesn't seem to be define in the database( WARNING : output 1 of step 11549 have datatype=7 whereas input 2 of step 11580 have datatype=None WARNING : type of output 3 of step 11580 doesn't seem to be define in the database( WARNING : type of input 1 of step 11551 doesn't seem to be define in the database( WARNING : output 0 of step 11551 have datatype=10 whereas input 0 of step 11586 have datatype=18 WARNING : type of input 5 of step 11558 doesn't seem to be define in the database( WARNING : output 0 of step 11586 have datatype=11 whereas input 5 of step 11558 have datatype=None WARNING : type of output 1 of step 11556 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : type of output 1 of step 11557 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : output 0 of step 11555 have datatype=1 whereas input 0 of step 11549 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4200, 'hashtag_proportion': 'carton,ela,etiquette,film_plastique,kraft,metal,papier,pehd,pet_opaque,textiles_sanitaires,barquette_opaque,pet_clair', 'hashtag_parmi': 'pet_fonce,background', 'hashtag_weights': {'barquette_opaque': 1.5, 'carton': 2.5, 'ela': 1.5, 'etiquette': 1.5, 'film_plastique': 1, 'kraft': 1.5, 'metal': 3.0, 'papier': 1.2, 'pehd': 1.5, 'pet_clair': 1.5, 'pet_opaque': 1.5, 'textiles_sanitaires': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3992 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3992 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3992 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3992 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11536 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11545 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11544 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11540 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11540 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11543 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11543 merge_mask_thcl_custom have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 11537 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11579 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11579 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11539 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11538 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11538 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11547 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11539 doesn't seem to be define in the database( WARNING : type of input 3 of step 11538 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11536 doesn't seem to be define in the database( WARNING : type of input 2 of step 11540 doesn't seem to be define in the database( WARNING : output 1 of step 11536 have datatype=2 whereas input 1 of step 11543 have datatype=7 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11539 have datatype=10 whereas input 3 of step 11546 have datatype=6 WARNING : type of input 2 of step 11579 doesn't seem to be define in the database( WARNING : output 1 of step 11537 have datatype=7 whereas input 2 of step 11579 have datatype=None WARNING : type of output 3 of step 11579 doesn't seem to be define in the database( WARNING : type of input 1 of step 11539 doesn't seem to be define in the database( WARNING : output 0 of step 11539 have datatype=10 whereas input 0 of step 11585 have datatype=18 WARNING : type of input 5 of step 11546 doesn't seem to be define in the database( WARNING : output 0 of step 11585 have datatype=11 whereas input 5 of step 11546 have datatype=None WARNING : type of output 1 of step 11545 doesn't seem to be define in the database( WARNING : type of input 3 of step 11540 doesn't seem to be define in the database( WARNING : type of output 1 of step 11544 doesn't seem to be define in the database( WARNING : type of input 3 of step 11540 doesn't seem to be define in the database( WARNING : output 0 of step 11543 have datatype=1 whereas input 0 of step 11537 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4205, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'metal,background', 'hashtag_background': 'metal', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 1.5, 'ela': 1.5, 'etiquette': 1, 'film_plastique': 1, 'kraft': 1, 'papier': 1, 'pehd': 1.5, 'pet_clair': 1.5, 'pet_opaque': 1.5, 'textiles_sanitaires': 1.5, 'pet_fonce': 1.5}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3318 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3318 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3318 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3594, 'hashtag_proportion': 'papier,carton,metal,pet_clair,autre,pehd,pet_fonce', 'hashtag_parmi': 'refus,background', 'hashtag_weights': {'papier': 1, 'carton': 1, 'metal': 1, 'pet_clair': 1, 'autre': 1, 'pehd': 1, 'pet_fonce': 1, 'refus': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier Inconsistency in dashboard_places dashboard_places from input : sevran dashboard_name_from_port found from datou STS from crontab from raspi : Sevran We force the correct camera_place_name ! TODO : Insert select and so on SELECT id, name, misc_info, datou_id_for_right FROM MTRPhoto.dashboard_places WHERE name="Sevran"; SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4101 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4101 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4101 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4101 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! {"input_values":[]} SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3993 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3993 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3993 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3993 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4207, 'hashtag_proportion': 'barquette_opaque,ela,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'carton,background', 'hashtag_weights': {'barquette_opaque': 1, 'ela': 1, 'etiquette': 1.0, 'film_plastique': 0.5, 'kraft': 1, 'metal': 3.0, 'papier': 1, 'pehd': 2, 'pet_clair': 2, 'pet_opaque': 2, 'textiles_sanitaires': 1.0, 'pet_fonce': 2}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3994 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3994 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3994 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3994 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11488 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11496 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11497 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11492 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11492 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11495 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11495 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11489 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11489 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11575 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11575 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11491 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11490 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11490 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11498 send_mail_cod have less outputs used (0) than in the step definition (1) : some outputs may be not used ! Step 11499 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11491 doesn't seem to be define in the database( WARNING : type of input 3 of step 11490 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11488 doesn't seem to be define in the database( WARNING : type of input 2 of step 11492 doesn't seem to be define in the database( WARNING : output 1 of step 11488 have datatype=2 whereas input 1 of step 11495 have datatype=7 WARNING : type of output 2 of step 11495 doesn't seem to be define in the database( WARNING : type of input 1 of step 11489 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11491 have datatype=10 whereas input 3 of step 11498 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11575 doesn't seem to be define in the database( WARNING : output 1 of step 11489 have datatype=7 whereas input 2 of step 11575 have datatype=None WARNING : type of output 3 of step 11575 doesn't seem to be define in the database( WARNING : type of input 1 of step 11491 doesn't seem to be define in the database( WARNING : output 0 of step 11491 have datatype=10 whereas input 0 of step 11581 have datatype=18 WARNING : type of input 5 of step 11498 doesn't seem to be define in the database( WARNING : output 0 of step 11581 have datatype=11 whereas input 5 of step 11498 have datatype=None WARNING : type of output 1 of step 11496 doesn't seem to be define in the database( WARNING : type of input 3 of step 11492 doesn't seem to be define in the database( WARNING : type of output 1 of step 11497 doesn't seem to be define in the database( WARNING : type of input 3 of step 11492 doesn't seem to be define in the database( WARNING : output 0 of step 11495 have datatype=1 whereas input 0 of step 11489 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4209, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,metal,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'papier,background', 'hashtag_background': 'papier', 'hashtag_weights': {'barquette_opaque': 0.7, 'carton': 0.7, 'ela': 0.7, 'etiquette': 0.5, 'film_plastique': 0.5, 'kraft': 0.7, 'metal': 1.5, 'pehd': 0.7, 'pet_clair': 0.7, 'pet_opaque': 0.7, 'textiles_sanitaires': 0.5, 'pet_fonce': 0.7}, 'ETA': 600} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3993 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3993 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3993 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3993 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4207, 'hashtag_proportion': 'barquette_opaque,ela,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'carton,background', 'hashtag_weights': {'barquette_opaque': 1, 'ela': 1, 'etiquette': 1.0, 'film_plastique': 0.5, 'kraft': 1, 'metal': 3.0, 'papier': 1, 'pehd': 2, 'pet_clair': 2, 'pet_opaque': 2, 'textiles_sanitaires': 1.0, 'pet_fonce': 2}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3459 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3459 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3459 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3459 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3726, 'hashtag_proportion': 'Carton_brun,Carton_gris,Teint_Dans_La_Masse,autre_refus,cartonnette,kraft,metal,plastique', 'hashtag_parmi': 'papier,background', 'hashtag_weights': {'Carton_brun': 1.5, 'Carton_gris': 1.5, 'Teint_Dans_La_Masse': 1.0, 'autre_refus': 1.5, 'cartonnette': 1.0, 'kraft': 1.5, 'metal': 3, 'plastique': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3991 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3991 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3991 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3991 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11512 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11521 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11520 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11516 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11516 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11519 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11519 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11513 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11513 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11577 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11577 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11515 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11514 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11514 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11523 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11515 doesn't seem to be define in the database( WARNING : type of input 3 of step 11514 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11512 doesn't seem to be define in the database( WARNING : type of input 2 of step 11516 doesn't seem to be define in the database( WARNING : output 1 of step 11512 have datatype=2 whereas input 1 of step 11519 have datatype=7 WARNING : type of output 2 of step 11519 doesn't seem to be define in the database( WARNING : type of input 1 of step 11513 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11515 have datatype=10 whereas input 3 of step 11522 have datatype=6 WARNING : type of input 2 of step 11577 doesn't seem to be define in the database( WARNING : output 1 of step 11513 have datatype=7 whereas input 2 of step 11577 have datatype=None WARNING : type of output 3 of step 11577 doesn't seem to be define in the database( WARNING : type of input 1 of step 11515 doesn't seem to be define in the database( WARNING : output 0 of step 11515 have datatype=10 whereas input 0 of step 11583 have datatype=18 WARNING : type of input 5 of step 11522 doesn't seem to be define in the database( WARNING : output 0 of step 11583 have datatype=11 whereas input 5 of step 11522 have datatype=None WARNING : type of output 1 of step 11521 doesn't seem to be define in the database( WARNING : type of input 3 of step 11516 doesn't seem to be define in the database( WARNING : type of output 1 of step 11520 doesn't seem to be define in the database( WARNING : type of input 3 of step 11516 doesn't seem to be define in the database( WARNING : output 0 of step 11519 have datatype=1 whereas input 0 of step 11513 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4203, 'hashtag_proportion': 'barquette_opaque,carton,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'ela,background', 'hashtag_background': 'ela', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 1, 'etiquette': 0.5, 'film_plastique': 0.5, 'kraft': 0.8, 'metal': 2, 'papier': 0.8, 'pehd': 0.8, 'pet_clair': 0.8, 'pet_opaque': 0.8, 'textiles_sanitaires': 0.5, 'pet_fonce': 0.8}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3804 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3804 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3804 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3804 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11560 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11567 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11567 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11563 crop_condition is not consistent : 4 used against 2 in the step definition ! Step 11563 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11564 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11564 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11573 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11573 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11566 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11566 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 1 of step 11560 have datatype=2 whereas input 1 of step 11564 have datatype=7 WARNING : type of output 2 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11565 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11567 doesn't seem to be define in the database( WARNING : type of input 3 of step 11563 doesn't seem to be define in the database( WARNING : type of output 3 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11568 doesn't seem to be define in the database( WARNING : type of output 1 of step 11568 doesn't seem to be define in the database( WARNING : type of input 3 of step 11566 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11570 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11569 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11570 doesn't seem to be define in the database( WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11569 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11568 have datatype=10 whereas input 3 of step 11571 have datatype=6 WARNING : type of input 2 of step 11573 doesn't seem to be define in the database( WARNING : output 1 of step 11565 have datatype=7 whereas input 2 of step 11573 have datatype=None WARNING : type of output 3 of step 11573 doesn't seem to be define in the database( WARNING : type of input 3 of step 11568 doesn't seem to be define in the database( WARNING : output 0 of step 11568 have datatype=10 whereas input 0 of step 11587 have datatype=18 WARNING : type of input 5 of step 11571 doesn't seem to be define in the database( WARNING : output 0 of step 11587 have datatype=11 whereas input 5 of step 11571 have datatype=None WARNING : output 0 of step 11564 have datatype=1 whereas input 0 of step 11565 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3327, 'hashtag_proportion': 'autre,carton,metal,papier,pehd,pet_fonce', 'hashtag_parmi': 'pet_clair,bouchon,etiquette,barquette_avec_film,background', 'hashtag_background': 'pet_clair', 'hashtag_weights': {'autre': 8.0, 'barquette_avec_film': 6, 'carton': 8.0, 'metal': 12, 'papier': 5, 'pehd': 8, 'pet_fonce': 8, 'bouchon': 8, 'etiquette': 8}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4322 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4322 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4322 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4322 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11978 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11987 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11986 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11982 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11982 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11985 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11985 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11979 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11979 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11990 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11990 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11981 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11980 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11980 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11989 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11981 doesn't seem to be define in the database( WARNING : type of input 3 of step 11980 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11978 doesn't seem to be define in the database( WARNING : type of input 2 of step 11982 doesn't seem to be define in the database( WARNING : output 1 of step 11978 have datatype=2 whereas input 1 of step 11985 have datatype=7 WARNING : type of output 2 of step 11985 doesn't seem to be define in the database( WARNING : type of input 1 of step 11979 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11981 have datatype=10 whereas input 3 of step 11988 have datatype=6 WARNING : type of input 2 of step 11990 doesn't seem to be define in the database( WARNING : output 1 of step 11979 have datatype=7 whereas input 2 of step 11990 have datatype=None WARNING : type of output 3 of step 11990 doesn't seem to be define in the database( WARNING : type of input 1 of step 11981 doesn't seem to be define in the database( WARNING : output 0 of step 11981 have datatype=10 whereas input 0 of step 11991 have datatype=18 WARNING : type of input 5 of step 11988 doesn't seem to be define in the database( WARNING : output 0 of step 11991 have datatype=11 whereas input 5 of step 11988 have datatype=None WARNING : type of output 1 of step 11987 doesn't seem to be define in the database( WARNING : type of input 3 of step 11982 doesn't seem to be define in the database( WARNING : type of output 1 of step 11986 doesn't seem to be define in the database( WARNING : type of input 3 of step 11982 doesn't seem to be define in the database( WARNING : output 0 of step 11985 have datatype=1 whereas input 0 of step 11979 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4461, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,pehd,kraft,metal,papier,pet_fonce,pet_clair,pet_opaque,textiles_sanitaires', 'hashtag_parmi': 'film_plastique', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 0.3, 'ela': 0.3, 'etiquette': 0.1, 'film_plastique': 0.1, 'kraft': 0.3, 'metal': 1.5, 'papier': 0.3, 'pet_clair': 0.3, 'pet_opaque': 0.3, 'textiles_sanitaires': 0.3, 'pet_fonce': 0.3}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3995 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3995 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3995 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3995 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11524 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11533 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11532 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11528 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11528 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11531 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11531 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11525 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11525 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11578 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11578 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11527 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11526 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11526 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11535 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11527 doesn't seem to be define in the database( WARNING : type of input 3 of step 11526 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11524 doesn't seem to be define in the database( WARNING : type of input 2 of step 11528 doesn't seem to be define in the database( WARNING : output 1 of step 11524 have datatype=2 whereas input 1 of step 11531 have datatype=7 WARNING : type of output 2 of step 11531 doesn't seem to be define in the database( WARNING : type of input 1 of step 11525 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11527 have datatype=10 whereas input 3 of step 11534 have datatype=6 WARNING : type of input 2 of step 11578 doesn't seem to be define in the database( WARNING : output 1 of step 11525 have datatype=7 whereas input 2 of step 11578 have datatype=None WARNING : type of output 3 of step 11578 doesn't seem to be define in the database( WARNING : type of input 1 of step 11527 doesn't seem to be define in the database( WARNING : output 0 of step 11527 have datatype=10 whereas input 0 of step 11584 have datatype=18 WARNING : type of input 5 of step 11534 doesn't seem to be define in the database( WARNING : output 0 of step 11584 have datatype=11 whereas input 5 of step 11534 have datatype=None WARNING : type of output 1 of step 11533 doesn't seem to be define in the database( WARNING : type of input 3 of step 11528 doesn't seem to be define in the database( WARNING : type of output 1 of step 11532 doesn't seem to be define in the database( WARNING : type of input 3 of step 11528 doesn't seem to be define in the database( WARNING : output 0 of step 11531 have datatype=1 whereas input 0 of step 11525 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4211, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,metal,papier,pet_fonce,pet_clair,pet_opaque,textiles_sanitaires', 'hashtag_parmi': 'pehd,background', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 0.3, 'ela': 0.3, 'etiquette': 0.1, 'film_plastique': 0.1, 'kraft': 0.3, 'metal': 1.5, 'papier': 0.3, 'pet_clair': 0.3, 'pet_opaque': 0.3, 'textiles_sanitaires': 0.3, 'pet_fonce': 0.3, 'background': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4153 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4153 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4153 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4153 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11548 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11556 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11557 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11552 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11552 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11555 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11555 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11580 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11580 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11551 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11550 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11550 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11559 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11551 doesn't seem to be define in the database( WARNING : type of input 3 of step 11550 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11548 doesn't seem to be define in the database( WARNING : type of input 2 of step 11552 doesn't seem to be define in the database( WARNING : output 1 of step 11548 have datatype=2 whereas input 1 of step 11555 have datatype=7 WARNING : type of output 2 of step 11555 doesn't seem to be define in the database( WARNING : type of input 1 of step 11549 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11551 have datatype=10 whereas input 3 of step 11558 have datatype=6 WARNING : type of input 2 of step 11580 doesn't seem to be define in the database( WARNING : output 1 of step 11549 have datatype=7 whereas input 2 of step 11580 have datatype=None WARNING : type of output 3 of step 11580 doesn't seem to be define in the database( WARNING : type of input 1 of step 11551 doesn't seem to be define in the database( WARNING : output 0 of step 11551 have datatype=10 whereas input 0 of step 11586 have datatype=18 WARNING : type of input 5 of step 11558 doesn't seem to be define in the database( WARNING : output 0 of step 11586 have datatype=11 whereas input 5 of step 11558 have datatype=None WARNING : type of output 1 of step 11556 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : type of output 1 of step 11557 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : output 0 of step 11555 have datatype=1 whereas input 0 of step 11549 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4200, 'hashtag_proportion': 'carton,ela,etiquette,film_plastique,kraft,metal,papier,pehd,pet_opaque,textiles_sanitaires,barquette_opaque,pet_clair', 'hashtag_parmi': 'pet_fonce,background', 'hashtag_weights': {'barquette_opaque': 1.5, 'carton': 2.5, 'ela': 1.5, 'etiquette': 1.5, 'film_plastique': 1, 'kraft': 1.5, 'metal': 3.0, 'papier': 1.2, 'pehd': 1.5, 'pet_clair': 1.5, 'pet_opaque': 1.5, 'textiles_sanitaires': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3992 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3992 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3992 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3992 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11536 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11545 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11544 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11540 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11540 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11543 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11543 merge_mask_thcl_custom have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 11537 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11579 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11579 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11539 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11538 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11538 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11547 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11539 doesn't seem to be define in the database( WARNING : type of input 3 of step 11538 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11536 doesn't seem to be define in the database( WARNING : type of input 2 of step 11540 doesn't seem to be define in the database( WARNING : output 1 of step 11536 have datatype=2 whereas input 1 of step 11543 have datatype=7 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11539 have datatype=10 whereas input 3 of step 11546 have datatype=6 WARNING : type of input 2 of step 11579 doesn't seem to be define in the database( WARNING : output 1 of step 11537 have datatype=7 whereas input 2 of step 11579 have datatype=None WARNING : type of output 3 of step 11579 doesn't seem to be define in the database( WARNING : type of input 1 of step 11539 doesn't seem to be define in the database( WARNING : output 0 of step 11539 have datatype=10 whereas input 0 of step 11585 have datatype=18 WARNING : type of input 5 of step 11546 doesn't seem to be define in the database( WARNING : output 0 of step 11585 have datatype=11 whereas input 5 of step 11546 have datatype=None WARNING : type of output 1 of step 11545 doesn't seem to be define in the database( WARNING : type of input 3 of step 11540 doesn't seem to be define in the database( WARNING : type of output 1 of step 11544 doesn't seem to be define in the database( WARNING : type of input 3 of step 11540 doesn't seem to be define in the database( WARNING : output 0 of step 11543 have datatype=1 whereas input 0 of step 11537 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4205, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'metal,background', 'hashtag_background': 'metal', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 1.5, 'ela': 1.5, 'etiquette': 1, 'film_plastique': 1, 'kraft': 1, 'papier': 1, 'pehd': 1.5, 'pet_clair': 1.5, 'pet_opaque': 1.5, 'textiles_sanitaires': 1.5, 'pet_fonce': 1.5}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3318 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3318 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3318 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3594, 'hashtag_proportion': 'papier,carton,metal,pet_clair,autre,pehd,pet_fonce', 'hashtag_parmi': 'refus,background', 'hashtag_weights': {'papier': 1, 'carton': 1, 'metal': 1, 'pet_clair': 1, 'autre': 1, 'pehd': 1, 'pet_fonce': 1, 'refus': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier Fonction SLA_MENSUEL nb_day : (0, 30) VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4887 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4887 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4887 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4887 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! {"input_values":[]} SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3993 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3993 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3993 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3993 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4207, 'hashtag_proportion': 'barquette_opaque,ela,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'carton,background', 'hashtag_weights': {'barquette_opaque': 1, 'ela': 1, 'etiquette': 1.0, 'film_plastique': 0.5, 'kraft': 1, 'metal': 3.0, 'papier': 1, 'pehd': 2, 'pet_clair': 2, 'pet_opaque': 2, 'textiles_sanitaires': 1.0, 'pet_fonce': 2}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3994 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3994 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3994 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3994 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11488 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11496 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11497 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11492 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11492 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11495 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11495 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11489 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11489 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11575 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11575 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11491 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11490 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11490 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11498 send_mail_cod have less outputs used (0) than in the step definition (1) : some outputs may be not used ! Step 11499 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11491 doesn't seem to be define in the database( WARNING : type of input 3 of step 11490 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11488 doesn't seem to be define in the database( WARNING : type of input 2 of step 11492 doesn't seem to be define in the database( WARNING : output 1 of step 11488 have datatype=2 whereas input 1 of step 11495 have datatype=7 WARNING : type of output 2 of step 11495 doesn't seem to be define in the database( WARNING : type of input 1 of step 11489 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11491 have datatype=10 whereas input 3 of step 11498 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11575 doesn't seem to be define in the database( WARNING : output 1 of step 11489 have datatype=7 whereas input 2 of step 11575 have datatype=None WARNING : type of output 3 of step 11575 doesn't seem to be define in the database( WARNING : type of input 1 of step 11491 doesn't seem to be define in the database( WARNING : output 0 of step 11491 have datatype=10 whereas input 0 of step 11581 have datatype=18 WARNING : type of input 5 of step 11498 doesn't seem to be define in the database( WARNING : output 0 of step 11581 have datatype=11 whereas input 5 of step 11498 have datatype=None WARNING : type of output 1 of step 11496 doesn't seem to be define in the database( WARNING : type of input 3 of step 11492 doesn't seem to be define in the database( WARNING : type of output 1 of step 11497 doesn't seem to be define in the database( WARNING : type of input 3 of step 11492 doesn't seem to be define in the database( WARNING : output 0 of step 11495 have datatype=1 whereas input 0 of step 11489 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4209, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,metal,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'papier,background', 'hashtag_background': 'papier', 'hashtag_weights': {'barquette_opaque': 0.7, 'carton': 0.7, 'ela': 0.7, 'etiquette': 0.5, 'film_plastique': 0.5, 'kraft': 0.7, 'metal': 1.5, 'pehd': 0.7, 'pet_clair': 0.7, 'pet_opaque': 0.7, 'textiles_sanitaires': 0.5, 'pet_fonce': 0.7}, 'ETA': 600} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3993 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3993 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3993 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3993 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4207, 'hashtag_proportion': 'barquette_opaque,ela,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'carton,background', 'hashtag_weights': {'barquette_opaque': 1, 'ela': 1, 'etiquette': 1.0, 'film_plastique': 0.5, 'kraft': 1, 'metal': 3.0, 'papier': 1, 'pehd': 2, 'pet_clair': 2, 'pet_opaque': 2, 'textiles_sanitaires': 1.0, 'pet_fonce': 2}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3459 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3459 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3459 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3459 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3726, 'hashtag_proportion': 'Carton_brun,Carton_gris,Teint_Dans_La_Masse,autre_refus,cartonnette,kraft,metal,plastique', 'hashtag_parmi': 'papier,background', 'hashtag_weights': {'Carton_brun': 1.5, 'Carton_gris': 1.5, 'Teint_Dans_La_Masse': 1.0, 'autre_refus': 1.5, 'cartonnette': 1.0, 'kraft': 1.5, 'metal': 3, 'plastique': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3991 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3991 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3991 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3991 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11512 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11521 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11520 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11516 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11516 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11519 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11519 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11513 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11513 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11577 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11577 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11515 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11514 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11514 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11523 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11515 doesn't seem to be define in the database( WARNING : type of input 3 of step 11514 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11512 doesn't seem to be define in the database( WARNING : type of input 2 of step 11516 doesn't seem to be define in the database( WARNING : output 1 of step 11512 have datatype=2 whereas input 1 of step 11519 have datatype=7 WARNING : type of output 2 of step 11519 doesn't seem to be define in the database( WARNING : type of input 1 of step 11513 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11515 have datatype=10 whereas input 3 of step 11522 have datatype=6 WARNING : type of input 2 of step 11577 doesn't seem to be define in the database( WARNING : output 1 of step 11513 have datatype=7 whereas input 2 of step 11577 have datatype=None WARNING : type of output 3 of step 11577 doesn't seem to be define in the database( WARNING : type of input 1 of step 11515 doesn't seem to be define in the database( WARNING : output 0 of step 11515 have datatype=10 whereas input 0 of step 11583 have datatype=18 WARNING : type of input 5 of step 11522 doesn't seem to be define in the database( WARNING : output 0 of step 11583 have datatype=11 whereas input 5 of step 11522 have datatype=None WARNING : type of output 1 of step 11521 doesn't seem to be define in the database( WARNING : type of input 3 of step 11516 doesn't seem to be define in the database( WARNING : type of output 1 of step 11520 doesn't seem to be define in the database( WARNING : type of input 3 of step 11516 doesn't seem to be define in the database( WARNING : output 0 of step 11519 have datatype=1 whereas input 0 of step 11513 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4203, 'hashtag_proportion': 'barquette_opaque,carton,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'ela,background', 'hashtag_background': 'ela', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 1, 'etiquette': 0.5, 'film_plastique': 0.5, 'kraft': 0.8, 'metal': 2, 'papier': 0.8, 'pehd': 0.8, 'pet_clair': 0.8, 'pet_opaque': 0.8, 'textiles_sanitaires': 0.5, 'pet_fonce': 0.8}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3804 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3804 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3804 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3804 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11560 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11567 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11567 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11563 crop_condition is not consistent : 4 used against 2 in the step definition ! Step 11563 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11564 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11564 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11573 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11573 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11566 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11566 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 1 of step 11560 have datatype=2 whereas input 1 of step 11564 have datatype=7 WARNING : type of output 2 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11565 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11567 doesn't seem to be define in the database( WARNING : type of input 3 of step 11563 doesn't seem to be define in the database( WARNING : type of output 3 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11568 doesn't seem to be define in the database( WARNING : type of output 1 of step 11568 doesn't seem to be define in the database( WARNING : type of input 3 of step 11566 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11570 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11569 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11570 doesn't seem to be define in the database( WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11569 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11568 have datatype=10 whereas input 3 of step 11571 have datatype=6 WARNING : type of input 2 of step 11573 doesn't seem to be define in the database( WARNING : output 1 of step 11565 have datatype=7 whereas input 2 of step 11573 have datatype=None WARNING : type of output 3 of step 11573 doesn't seem to be define in the database( WARNING : type of input 3 of step 11568 doesn't seem to be define in the database( WARNING : output 0 of step 11568 have datatype=10 whereas input 0 of step 11587 have datatype=18 WARNING : type of input 5 of step 11571 doesn't seem to be define in the database( WARNING : output 0 of step 11587 have datatype=11 whereas input 5 of step 11571 have datatype=None WARNING : output 0 of step 11564 have datatype=1 whereas input 0 of step 11565 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3327, 'hashtag_proportion': 'autre,carton,metal,papier,pehd,pet_fonce', 'hashtag_parmi': 'pet_clair,bouchon,etiquette,barquette_avec_film,background', 'hashtag_background': 'pet_clair', 'hashtag_weights': {'autre': 8.0, 'barquette_avec_film': 6, 'carton': 8.0, 'metal': 12, 'papier': 5, 'pehd': 8, 'pet_fonce': 8, 'bouchon': 8, 'etiquette': 8}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4322 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4322 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4322 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4322 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11978 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11987 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11986 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11982 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11982 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11985 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11985 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11979 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11979 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11990 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11990 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11981 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11980 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11980 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11989 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11981 doesn't seem to be define in the database( WARNING : type of input 3 of step 11980 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11978 doesn't seem to be define in the database( WARNING : type of input 2 of step 11982 doesn't seem to be define in the database( WARNING : output 1 of step 11978 have datatype=2 whereas input 1 of step 11985 have datatype=7 WARNING : type of output 2 of step 11985 doesn't seem to be define in the database( WARNING : type of input 1 of step 11979 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11981 have datatype=10 whereas input 3 of step 11988 have datatype=6 WARNING : type of input 2 of step 11990 doesn't seem to be define in the database( WARNING : output 1 of step 11979 have datatype=7 whereas input 2 of step 11990 have datatype=None WARNING : type of output 3 of step 11990 doesn't seem to be define in the database( WARNING : type of input 1 of step 11981 doesn't seem to be define in the database( WARNING : output 0 of step 11981 have datatype=10 whereas input 0 of step 11991 have datatype=18 WARNING : type of input 5 of step 11988 doesn't seem to be define in the database( WARNING : output 0 of step 11991 have datatype=11 whereas input 5 of step 11988 have datatype=None WARNING : type of output 1 of step 11987 doesn't seem to be define in the database( WARNING : type of input 3 of step 11982 doesn't seem to be define in the database( WARNING : type of output 1 of step 11986 doesn't seem to be define in the database( WARNING : type of input 3 of step 11982 doesn't seem to be define in the database( WARNING : output 0 of step 11985 have datatype=1 whereas input 0 of step 11979 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4461, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,pehd,kraft,metal,papier,pet_fonce,pet_clair,pet_opaque,textiles_sanitaires', 'hashtag_parmi': 'film_plastique', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 0.3, 'ela': 0.3, 'etiquette': 0.1, 'film_plastique': 0.1, 'kraft': 0.3, 'metal': 1.5, 'papier': 0.3, 'pet_clair': 0.3, 'pet_opaque': 0.3, 'textiles_sanitaires': 0.3, 'pet_fonce': 0.3}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3995 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3995 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3995 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3995 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11524 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11533 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11532 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11528 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11528 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11531 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11531 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11525 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11525 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11578 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11578 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11527 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11526 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11526 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11535 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11527 doesn't seem to be define in the database( WARNING : type of input 3 of step 11526 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11524 doesn't seem to be define in the database( WARNING : type of input 2 of step 11528 doesn't seem to be define in the database( WARNING : output 1 of step 11524 have datatype=2 whereas input 1 of step 11531 have datatype=7 WARNING : type of output 2 of step 11531 doesn't seem to be define in the database( WARNING : type of input 1 of step 11525 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11527 have datatype=10 whereas input 3 of step 11534 have datatype=6 WARNING : type of input 2 of step 11578 doesn't seem to be define in the database( WARNING : output 1 of step 11525 have datatype=7 whereas input 2 of step 11578 have datatype=None WARNING : type of output 3 of step 11578 doesn't seem to be define in the database( WARNING : type of input 1 of step 11527 doesn't seem to be define in the database( WARNING : output 0 of step 11527 have datatype=10 whereas input 0 of step 11584 have datatype=18 WARNING : type of input 5 of step 11534 doesn't seem to be define in the database( WARNING : output 0 of step 11584 have datatype=11 whereas input 5 of step 11534 have datatype=None WARNING : type of output 1 of step 11533 doesn't seem to be define in the database( WARNING : type of input 3 of step 11528 doesn't seem to be define in the database( WARNING : type of output 1 of step 11532 doesn't seem to be define in the database( WARNING : type of input 3 of step 11528 doesn't seem to be define in the database( WARNING : output 0 of step 11531 have datatype=1 whereas input 0 of step 11525 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4211, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,metal,papier,pet_fonce,pet_clair,pet_opaque,textiles_sanitaires', 'hashtag_parmi': 'pehd,background', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 0.3, 'ela': 0.3, 'etiquette': 0.1, 'film_plastique': 0.1, 'kraft': 0.3, 'metal': 1.5, 'papier': 0.3, 'pet_clair': 0.3, 'pet_opaque': 0.3, 'textiles_sanitaires': 0.3, 'pet_fonce': 0.3, 'background': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4153 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4153 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4153 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4153 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11548 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11556 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11557 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11552 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11552 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11555 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11555 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11580 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11580 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11551 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11550 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11550 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11559 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11551 doesn't seem to be define in the database( WARNING : type of input 3 of step 11550 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11548 doesn't seem to be define in the database( WARNING : type of input 2 of step 11552 doesn't seem to be define in the database( WARNING : output 1 of step 11548 have datatype=2 whereas input 1 of step 11555 have datatype=7 WARNING : type of output 2 of step 11555 doesn't seem to be define in the database( WARNING : type of input 1 of step 11549 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11551 have datatype=10 whereas input 3 of step 11558 have datatype=6 WARNING : type of input 2 of step 11580 doesn't seem to be define in the database( WARNING : output 1 of step 11549 have datatype=7 whereas input 2 of step 11580 have datatype=None WARNING : type of output 3 of step 11580 doesn't seem to be define in the database( WARNING : type of input 1 of step 11551 doesn't seem to be define in the database( WARNING : output 0 of step 11551 have datatype=10 whereas input 0 of step 11586 have datatype=18 WARNING : type of input 5 of step 11558 doesn't seem to be define in the database( WARNING : output 0 of step 11586 have datatype=11 whereas input 5 of step 11558 have datatype=None WARNING : type of output 1 of step 11556 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : type of output 1 of step 11557 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : output 0 of step 11555 have datatype=1 whereas input 0 of step 11549 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4200, 'hashtag_proportion': 'carton,ela,etiquette,film_plastique,kraft,metal,papier,pehd,pet_opaque,textiles_sanitaires,barquette_opaque,pet_clair', 'hashtag_parmi': 'pet_fonce,background', 'hashtag_weights': {'barquette_opaque': 1.5, 'carton': 2.5, 'ela': 1.5, 'etiquette': 1.5, 'film_plastique': 1, 'kraft': 1.5, 'metal': 3.0, 'papier': 1.2, 'pehd': 1.5, 'pet_clair': 1.5, 'pet_opaque': 1.5, 'textiles_sanitaires': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3992 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3992 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3992 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3992 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11536 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11545 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11544 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11540 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11540 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11543 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11543 merge_mask_thcl_custom have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 11537 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11579 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11579 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11539 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11538 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11538 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11547 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11539 doesn't seem to be define in the database( WARNING : type of input 3 of step 11538 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11536 doesn't seem to be define in the database( WARNING : type of input 2 of step 11540 doesn't seem to be define in the database( WARNING : output 1 of step 11536 have datatype=2 whereas input 1 of step 11543 have datatype=7 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11539 have datatype=10 whereas input 3 of step 11546 have datatype=6 WARNING : type of input 2 of step 11579 doesn't seem to be define in the database( WARNING : output 1 of step 11537 have datatype=7 whereas input 2 of step 11579 have datatype=None WARNING : type of output 3 of step 11579 doesn't seem to be define in the database( WARNING : type of input 1 of step 11539 doesn't seem to be define in the database( WARNING : output 0 of step 11539 have datatype=10 whereas input 0 of step 11585 have datatype=18 WARNING : type of input 5 of step 11546 doesn't seem to be define in the database( WARNING : output 0 of step 11585 have datatype=11 whereas input 5 of step 11546 have datatype=None WARNING : type of output 1 of step 11545 doesn't seem to be define in the database( WARNING : type of input 3 of step 11540 doesn't seem to be define in the database( WARNING : type of output 1 of step 11544 doesn't seem to be define in the database( WARNING : type of input 3 of step 11540 doesn't seem to be define in the database( WARNING : output 0 of step 11543 have datatype=1 whereas input 0 of step 11537 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4205, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'metal,background', 'hashtag_background': 'metal', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 1.5, 'ela': 1.5, 'etiquette': 1, 'film_plastique': 1, 'kraft': 1, 'papier': 1, 'pehd': 1.5, 'pet_clair': 1.5, 'pet_opaque': 1.5, 'textiles_sanitaires': 1.5, 'pet_fonce': 1.5}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3318 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3318 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3318 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3594, 'hashtag_proportion': 'papier,carton,metal,pet_clair,autre,pehd,pet_fonce', 'hashtag_parmi': 'refus,background', 'hashtag_weights': {'papier': 1, 'carton': 1, 'metal': 1, 'pet_clair': 1, 'autre': 1, 'pehd': 1, 'pet_fonce': 1, 'refus': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier TODO : Insert select and so on SELECT id, name, misc_info, datou_id_for_right FROM MTRPhoto.dashboard_places WHERE name="Sevran"; SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4101 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4101 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4101 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4101 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! {"input_values":[]} SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3993 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3993 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3993 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3993 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4207, 'hashtag_proportion': 'barquette_opaque,ela,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'carton,background', 'hashtag_weights': {'barquette_opaque': 1, 'ela': 1, 'etiquette': 1.0, 'film_plastique': 0.5, 'kraft': 1, 'metal': 3.0, 'papier': 1, 'pehd': 2, 'pet_clair': 2, 'pet_opaque': 2, 'textiles_sanitaires': 1.0, 'pet_fonce': 2}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3994 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3994 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3994 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3994 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11488 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11496 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11497 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11492 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11492 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11495 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11495 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11489 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11489 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11575 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11575 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11491 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11490 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11490 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11498 send_mail_cod have less outputs used (0) than in the step definition (1) : some outputs may be not used ! Step 11499 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11491 doesn't seem to be define in the database( WARNING : type of input 3 of step 11490 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11488 doesn't seem to be define in the database( WARNING : type of input 2 of step 11492 doesn't seem to be define in the database( WARNING : output 1 of step 11488 have datatype=2 whereas input 1 of step 11495 have datatype=7 WARNING : type of output 2 of step 11495 doesn't seem to be define in the database( WARNING : type of input 1 of step 11489 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11491 have datatype=10 whereas input 3 of step 11498 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11575 doesn't seem to be define in the database( WARNING : output 1 of step 11489 have datatype=7 whereas input 2 of step 11575 have datatype=None WARNING : type of output 3 of step 11575 doesn't seem to be define in the database( WARNING : type of input 1 of step 11491 doesn't seem to be define in the database( WARNING : output 0 of step 11491 have datatype=10 whereas input 0 of step 11581 have datatype=18 WARNING : type of input 5 of step 11498 doesn't seem to be define in the database( WARNING : output 0 of step 11581 have datatype=11 whereas input 5 of step 11498 have datatype=None WARNING : type of output 1 of step 11496 doesn't seem to be define in the database( WARNING : type of input 3 of step 11492 doesn't seem to be define in the database( WARNING : type of output 1 of step 11497 doesn't seem to be define in the database( WARNING : type of input 3 of step 11492 doesn't seem to be define in the database( WARNING : output 0 of step 11495 have datatype=1 whereas input 0 of step 11489 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4209, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,metal,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'papier,background', 'hashtag_background': 'papier', 'hashtag_weights': {'barquette_opaque': 0.7, 'carton': 0.7, 'ela': 0.7, 'etiquette': 0.5, 'film_plastique': 0.5, 'kraft': 0.7, 'metal': 1.5, 'pehd': 0.7, 'pet_clair': 0.7, 'pet_opaque': 0.7, 'textiles_sanitaires': 0.5, 'pet_fonce': 0.7}, 'ETA': 600} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3993 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3993 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3993 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3993 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4207, 'hashtag_proportion': 'barquette_opaque,ela,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'carton,background', 'hashtag_weights': {'barquette_opaque': 1, 'ela': 1, 'etiquette': 1.0, 'film_plastique': 0.5, 'kraft': 1, 'metal': 3.0, 'papier': 1, 'pehd': 2, 'pet_clair': 2, 'pet_opaque': 2, 'textiles_sanitaires': 1.0, 'pet_fonce': 2}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3459 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3459 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3459 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3459 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3726, 'hashtag_proportion': 'Carton_brun,Carton_gris,Teint_Dans_La_Masse,autre_refus,cartonnette,kraft,metal,plastique', 'hashtag_parmi': 'papier,background', 'hashtag_weights': {'Carton_brun': 1.5, 'Carton_gris': 1.5, 'Teint_Dans_La_Masse': 1.0, 'autre_refus': 1.5, 'cartonnette': 1.0, 'kraft': 1.5, 'metal': 3, 'plastique': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3991 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3991 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3991 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3991 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11512 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11521 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11520 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11516 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11516 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11519 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11519 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11513 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11513 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11577 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11577 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11515 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11514 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11514 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11523 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11515 doesn't seem to be define in the database( WARNING : type of input 3 of step 11514 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11512 doesn't seem to be define in the database( WARNING : type of input 2 of step 11516 doesn't seem to be define in the database( WARNING : output 1 of step 11512 have datatype=2 whereas input 1 of step 11519 have datatype=7 WARNING : type of output 2 of step 11519 doesn't seem to be define in the database( WARNING : type of input 1 of step 11513 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11515 have datatype=10 whereas input 3 of step 11522 have datatype=6 WARNING : type of input 2 of step 11577 doesn't seem to be define in the database( WARNING : output 1 of step 11513 have datatype=7 whereas input 2 of step 11577 have datatype=None WARNING : type of output 3 of step 11577 doesn't seem to be define in the database( WARNING : type of input 1 of step 11515 doesn't seem to be define in the database( WARNING : output 0 of step 11515 have datatype=10 whereas input 0 of step 11583 have datatype=18 WARNING : type of input 5 of step 11522 doesn't seem to be define in the database( WARNING : output 0 of step 11583 have datatype=11 whereas input 5 of step 11522 have datatype=None WARNING : type of output 1 of step 11521 doesn't seem to be define in the database( WARNING : type of input 3 of step 11516 doesn't seem to be define in the database( WARNING : type of output 1 of step 11520 doesn't seem to be define in the database( WARNING : type of input 3 of step 11516 doesn't seem to be define in the database( WARNING : output 0 of step 11519 have datatype=1 whereas input 0 of step 11513 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4203, 'hashtag_proportion': 'barquette_opaque,carton,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'ela,background', 'hashtag_background': 'ela', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 1, 'etiquette': 0.5, 'film_plastique': 0.5, 'kraft': 0.8, 'metal': 2, 'papier': 0.8, 'pehd': 0.8, 'pet_clair': 0.8, 'pet_opaque': 0.8, 'textiles_sanitaires': 0.5, 'pet_fonce': 0.8}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3804 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3804 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3804 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3804 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11560 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11567 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11567 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11563 crop_condition is not consistent : 4 used against 2 in the step definition ! Step 11563 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11564 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11564 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11573 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11573 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11566 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11566 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 1 of step 11560 have datatype=2 whereas input 1 of step 11564 have datatype=7 WARNING : type of output 2 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11565 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11567 doesn't seem to be define in the database( WARNING : type of input 3 of step 11563 doesn't seem to be define in the database( WARNING : type of output 3 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11568 doesn't seem to be define in the database( WARNING : type of output 1 of step 11568 doesn't seem to be define in the database( WARNING : type of input 3 of step 11566 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11570 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11569 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11570 doesn't seem to be define in the database( WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11569 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11568 have datatype=10 whereas input 3 of step 11571 have datatype=6 WARNING : type of input 2 of step 11573 doesn't seem to be define in the database( WARNING : output 1 of step 11565 have datatype=7 whereas input 2 of step 11573 have datatype=None WARNING : type of output 3 of step 11573 doesn't seem to be define in the database( WARNING : type of input 3 of step 11568 doesn't seem to be define in the database( WARNING : output 0 of step 11568 have datatype=10 whereas input 0 of step 11587 have datatype=18 WARNING : type of input 5 of step 11571 doesn't seem to be define in the database( WARNING : output 0 of step 11587 have datatype=11 whereas input 5 of step 11571 have datatype=None WARNING : output 0 of step 11564 have datatype=1 whereas input 0 of step 11565 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3327, 'hashtag_proportion': 'autre,carton,metal,papier,pehd,pet_fonce', 'hashtag_parmi': 'pet_clair,bouchon,etiquette,barquette_avec_film,background', 'hashtag_background': 'pet_clair', 'hashtag_weights': {'autre': 8.0, 'barquette_avec_film': 6, 'carton': 8.0, 'metal': 12, 'papier': 5, 'pehd': 8, 'pet_fonce': 8, 'bouchon': 8, 'etiquette': 8}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4322 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4322 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4322 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4322 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11978 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11987 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11986 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11982 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11982 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11985 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11985 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11979 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11979 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11990 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11990 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11981 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11980 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11980 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11989 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11981 doesn't seem to be define in the database( WARNING : type of input 3 of step 11980 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11978 doesn't seem to be define in the database( WARNING : type of input 2 of step 11982 doesn't seem to be define in the database( WARNING : output 1 of step 11978 have datatype=2 whereas input 1 of step 11985 have datatype=7 WARNING : type of output 2 of step 11985 doesn't seem to be define in the database( WARNING : type of input 1 of step 11979 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11981 have datatype=10 whereas input 3 of step 11988 have datatype=6 WARNING : type of input 2 of step 11990 doesn't seem to be define in the database( WARNING : output 1 of step 11979 have datatype=7 whereas input 2 of step 11990 have datatype=None WARNING : type of output 3 of step 11990 doesn't seem to be define in the database( WARNING : type of input 1 of step 11981 doesn't seem to be define in the database( WARNING : output 0 of step 11981 have datatype=10 whereas input 0 of step 11991 have datatype=18 WARNING : type of input 5 of step 11988 doesn't seem to be define in the database( WARNING : output 0 of step 11991 have datatype=11 whereas input 5 of step 11988 have datatype=None WARNING : type of output 1 of step 11987 doesn't seem to be define in the database( WARNING : type of input 3 of step 11982 doesn't seem to be define in the database( WARNING : type of output 1 of step 11986 doesn't seem to be define in the database( WARNING : type of input 3 of step 11982 doesn't seem to be define in the database( WARNING : output 0 of step 11985 have datatype=1 whereas input 0 of step 11979 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4461, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,pehd,kraft,metal,papier,pet_fonce,pet_clair,pet_opaque,textiles_sanitaires', 'hashtag_parmi': 'film_plastique', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 0.3, 'ela': 0.3, 'etiquette': 0.1, 'film_plastique': 0.1, 'kraft': 0.3, 'metal': 1.5, 'papier': 0.3, 'pet_clair': 0.3, 'pet_opaque': 0.3, 'textiles_sanitaires': 0.3, 'pet_fonce': 0.3}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3995 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3995 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3995 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3995 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11524 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11533 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11532 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11528 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11528 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11531 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11531 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11525 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11525 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11578 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11578 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11527 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11526 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11526 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11535 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11527 doesn't seem to be define in the database( WARNING : type of input 3 of step 11526 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11524 doesn't seem to be define in the database( WARNING : type of input 2 of step 11528 doesn't seem to be define in the database( WARNING : output 1 of step 11524 have datatype=2 whereas input 1 of step 11531 have datatype=7 WARNING : type of output 2 of step 11531 doesn't seem to be define in the database( WARNING : type of input 1 of step 11525 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11527 have datatype=10 whereas input 3 of step 11534 have datatype=6 WARNING : type of input 2 of step 11578 doesn't seem to be define in the database( WARNING : output 1 of step 11525 have datatype=7 whereas input 2 of step 11578 have datatype=None WARNING : type of output 3 of step 11578 doesn't seem to be define in the database( WARNING : type of input 1 of step 11527 doesn't seem to be define in the database( WARNING : output 0 of step 11527 have datatype=10 whereas input 0 of step 11584 have datatype=18 WARNING : type of input 5 of step 11534 doesn't seem to be define in the database( WARNING : output 0 of step 11584 have datatype=11 whereas input 5 of step 11534 have datatype=None WARNING : type of output 1 of step 11533 doesn't seem to be define in the database( WARNING : type of input 3 of step 11528 doesn't seem to be define in the database( WARNING : type of output 1 of step 11532 doesn't seem to be define in the database( WARNING : type of input 3 of step 11528 doesn't seem to be define in the database( WARNING : output 0 of step 11531 have datatype=1 whereas input 0 of step 11525 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4211, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,metal,papier,pet_fonce,pet_clair,pet_opaque,textiles_sanitaires', 'hashtag_parmi': 'pehd,background', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 0.3, 'ela': 0.3, 'etiquette': 0.1, 'film_plastique': 0.1, 'kraft': 0.3, 'metal': 1.5, 'papier': 0.3, 'pet_clair': 0.3, 'pet_opaque': 0.3, 'textiles_sanitaires': 0.3, 'pet_fonce': 0.3, 'background': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4153 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4153 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4153 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4153 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11548 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11556 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11557 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11552 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11552 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11555 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11555 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11580 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11580 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11551 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11550 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11550 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11559 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11551 doesn't seem to be define in the database( WARNING : type of input 3 of step 11550 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11548 doesn't seem to be define in the database( WARNING : type of input 2 of step 11552 doesn't seem to be define in the database( WARNING : output 1 of step 11548 have datatype=2 whereas input 1 of step 11555 have datatype=7 WARNING : type of output 2 of step 11555 doesn't seem to be define in the database( WARNING : type of input 1 of step 11549 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11551 have datatype=10 whereas input 3 of step 11558 have datatype=6 WARNING : type of input 2 of step 11580 doesn't seem to be define in the database( WARNING : output 1 of step 11549 have datatype=7 whereas input 2 of step 11580 have datatype=None WARNING : type of output 3 of step 11580 doesn't seem to be define in the database( WARNING : type of input 1 of step 11551 doesn't seem to be define in the database( WARNING : output 0 of step 11551 have datatype=10 whereas input 0 of step 11586 have datatype=18 WARNING : type of input 5 of step 11558 doesn't seem to be define in the database( WARNING : output 0 of step 11586 have datatype=11 whereas input 5 of step 11558 have datatype=None WARNING : type of output 1 of step 11556 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : type of output 1 of step 11557 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : output 0 of step 11555 have datatype=1 whereas input 0 of step 11549 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4200, 'hashtag_proportion': 'carton,ela,etiquette,film_plastique,kraft,metal,papier,pehd,pet_opaque,textiles_sanitaires,barquette_opaque,pet_clair', 'hashtag_parmi': 'pet_fonce,background', 'hashtag_weights': {'barquette_opaque': 1.5, 'carton': 2.5, 'ela': 1.5, 'etiquette': 1.5, 'film_plastique': 1, 'kraft': 1.5, 'metal': 3.0, 'papier': 1.2, 'pehd': 1.5, 'pet_clair': 1.5, 'pet_opaque': 1.5, 'textiles_sanitaires': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3992 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3992 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3992 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3992 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11536 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11545 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11544 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11540 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11540 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11543 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11543 merge_mask_thcl_custom have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 11537 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11579 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11579 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11539 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11538 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11538 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11547 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11539 doesn't seem to be define in the database( WARNING : type of input 3 of step 11538 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11536 doesn't seem to be define in the database( WARNING : type of input 2 of step 11540 doesn't seem to be define in the database( WARNING : output 1 of step 11536 have datatype=2 whereas input 1 of step 11543 have datatype=7 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11539 have datatype=10 whereas input 3 of step 11546 have datatype=6 WARNING : type of input 2 of step 11579 doesn't seem to be define in the database( WARNING : output 1 of step 11537 have datatype=7 whereas input 2 of step 11579 have datatype=None WARNING : type of output 3 of step 11579 doesn't seem to be define in the database( WARNING : type of input 1 of step 11539 doesn't seem to be define in the database( WARNING : output 0 of step 11539 have datatype=10 whereas input 0 of step 11585 have datatype=18 WARNING : type of input 5 of step 11546 doesn't seem to be define in the database( WARNING : output 0 of step 11585 have datatype=11 whereas input 5 of step 11546 have datatype=None WARNING : type of output 1 of step 11545 doesn't seem to be define in the database( WARNING : type of input 3 of step 11540 doesn't seem to be define in the database( WARNING : type of output 1 of step 11544 doesn't seem to be define in the database( WARNING : type of input 3 of step 11540 doesn't seem to be define in the database( WARNING : output 0 of step 11543 have datatype=1 whereas input 0 of step 11537 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4205, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'metal,background', 'hashtag_background': 'metal', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 1.5, 'ela': 1.5, 'etiquette': 1, 'film_plastique': 1, 'kraft': 1, 'papier': 1, 'pehd': 1.5, 'pet_clair': 1.5, 'pet_opaque': 1.5, 'textiles_sanitaires': 1.5, 'pet_fonce': 1.5}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3318 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3318 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3318 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3594, 'hashtag_proportion': 'papier,carton,metal,pet_clair,autre,pehd,pet_fonce', 'hashtag_parmi': 'refus,background', 'hashtag_weights': {'papier': 1, 'carton': 1, 'metal': 1, 'pet_clair': 1, 'autre': 1, 'pehd': 1, 'pet_fonce': 1, 'refus': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier place_id : 94 month : 09 mtr_id : 1042 dashboard_places : Sevran date : 2025-09 year : 2025 raspi : 30005 select count(distinct mtr_photo_id) from MTRUser.mtr_portfolio_photos where mtr_portfolio_id in (select id from MTRUser.mtr_portfolios where id in (select mtr_portfolio_id from MTRPhoto.dashboard_results where dashboard_run_id in(select last_run_id from MTRPhoto.dashboard_entry_day where dashboard_place_id in (select id from MTRPhoto.dashboard_places where name = 'Sevran' and date like '%2025-09%') and created_at like '%2025-09%'))); nb_day : (0, 30) after unwanted_material_data nb_day : (0, 30) SQL: SELECT ms.id, ms.name, mst.name as type, ms.test_group, ms.test_name, ms.server, ms.version_code, ms.result_str, ms.result_bool, ms.result_float, ms.lien, ms.created_at FROM MTRAdmin.monitor_sys ms INNER JOIN MTRAdmin.monitor_sys_type mst on mst.id = ms.type WHERE ms.test_name like '%30005%' AND ms.result_str like '%2025/09%'ORDER BY ms.id desc LIMIT 0, 1000000; No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'last_update': '2025/09/21', 'portfolio_id': 27058711, 'last_run_id': 2335407, 'total_number_of_photos': 8012}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 52, 'nb_images_finished': 2280, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2280, 'last_update': '2025/09/20', 'portfolio_id': 27016138, 'last_run_id': 2332853, 'total_number_of_photos': 6987}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 42, 'nb_images_finished': 2044, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2044, 'last_update': '2025/09/19', 'portfolio_id': 26978068, 'last_run_id': 2325191, 'total_number_of_photos': 8050}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 37, 'nb_images_finished': 1704, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 11, 'nb_images_started': 470, 'nb_selected_images': 2174, 'last_update': '2025/09/18', 'portfolio_id': 26918383, 'last_run_id': 2317497, 'total_number_of_photos': 7367}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 47, 'nb_images_finished': 2615, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2615, 'last_update': '2025/09/18', 'portfolio_id': 26872173, 'last_run_id': 2309617, 'total_number_of_photos': 7573}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 54, 'nb_images_finished': 2190, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2190, 'last_update': '2025/09/16', 'portfolio_id': 26835003, 'last_run_id': 2301213, 'total_number_of_photos': 6502}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 52, 'nb_images_finished': 2280, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2280, 'last_update': '2025/09/20', 'portfolio_id': 27016138, 'last_run_id': 2332853, 'total_number_of_photos': 6987}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 42, 'nb_images_finished': 2044, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2044, 'last_update': '2025/09/19', 'portfolio_id': 26978068, 'last_run_id': 2325191, 'total_number_of_photos': 8050}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 37, 'nb_images_finished': 1704, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 11, 'nb_images_started': 470, 'nb_selected_images': 2174, 'last_update': '2025/09/18', 'portfolio_id': 26918383, 'last_run_id': 2317497, 'total_number_of_photos': 7367}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 47, 'nb_images_finished': 2615, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2615, 'last_update': '2025/09/18', 'portfolio_id': 26872173, 'last_run_id': 2309617, 'total_number_of_photos': 7573}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 54, 'nb_images_finished': 2190, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2190, 'last_update': '2025/09/16', 'portfolio_id': 26835003, 'last_run_id': 2301213, 'total_number_of_photos': 6502}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 44, 'nb_images_finished': 2241, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2241, 'last_update': '2025/09/14', 'portfolio_id': 26814999, 'last_run_id': 2293261, 'total_number_of_photos': 7803}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 42, 'nb_images_finished': 2044, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2044, 'last_update': '2025/09/19', 'portfolio_id': 26978068, 'last_run_id': 2325191, 'total_number_of_photos': 8050}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 37, 'nb_images_finished': 1704, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 11, 'nb_images_started': 470, 'nb_selected_images': 2174, 'last_update': '2025/09/18', 'portfolio_id': 26918383, 'last_run_id': 2317497, 'total_number_of_photos': 7367}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 47, 'nb_images_finished': 2615, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2615, 'last_update': '2025/09/18', 'portfolio_id': 26872173, 'last_run_id': 2309617, 'total_number_of_photos': 7573}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 54, 'nb_images_finished': 2190, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2190, 'last_update': '2025/09/16', 'portfolio_id': 26835003, 'last_run_id': 2301213, 'total_number_of_photos': 6502}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 44, 'nb_images_finished': 2241, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2241, 'last_update': '2025/09/14', 'portfolio_id': 26814999, 'last_run_id': 2293261, 'total_number_of_photos': 7803}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 50, 'nb_images_finished': 1971, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1971, 'last_update': '2025/09/13', 'portfolio_id': 26769761, 'last_run_id': 2289855, 'total_number_of_photos': 7017}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 37, 'nb_images_finished': 1704, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 11, 'nb_images_started': 470, 'nb_selected_images': 2174, 'last_update': '2025/09/18', 'portfolio_id': 26918383, 'last_run_id': 2317497, 'total_number_of_photos': 7367}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 47, 'nb_images_finished': 2615, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2615, 'last_update': '2025/09/17', 'portfolio_id': 26872173, 'last_run_id': 2309617, 'total_number_of_photos': 7573}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 54, 'nb_images_finished': 2190, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2190, 'last_update': '2025/09/16', 'portfolio_id': 26835003, 'last_run_id': 2301213, 'total_number_of_photos': 6502}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 44, 'nb_images_finished': 2241, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2241, 'last_update': '2025/09/14', 'portfolio_id': 26814999, 'last_run_id': 2293261, 'total_number_of_photos': 7803}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 50, 'nb_images_finished': 1971, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1971, 'last_update': '2025/09/13', 'portfolio_id': 26769761, 'last_run_id': 2289855, 'total_number_of_photos': 7017}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 21, 'nb_images_finished': 977, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 2, 'nb_images_started': 235, 'nb_selected_images': 1212, 'last_update': '2025/09/13', 'portfolio_id': 26734745, 'last_run_id': 2283193, 'total_number_of_photos': 7570}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 47, 'nb_images_finished': 2615, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2615, 'last_update': '2025/09/17', 'portfolio_id': 26872173, 'last_run_id': 2309617, 'total_number_of_photos': 7573}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 54, 'nb_images_finished': 2190, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2190, 'last_update': '2025/09/16', 'portfolio_id': 26835003, 'last_run_id': 2301213, 'total_number_of_photos': 6502}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 44, 'nb_images_finished': 2241, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2241, 'last_update': '2025/09/14', 'portfolio_id': 26814999, 'last_run_id': 2293261, 'total_number_of_photos': 7803}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 50, 'nb_images_finished': 1971, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1971, 'last_update': '2025/09/13', 'portfolio_id': 26769761, 'last_run_id': 2289855, 'total_number_of_photos': 7017}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 21, 'nb_images_finished': 977, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 2, 'nb_images_started': 235, 'nb_selected_images': 1212, 'last_update': '2025/09/13', 'portfolio_id': 26734745, 'last_run_id': 2283193, 'total_number_of_photos': 7570}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 48, 'nb_images_finished': 2427, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2427, 'last_update': '2025/09/13', 'portfolio_id': 26704156, 'last_run_id': 2277699, 'total_number_of_photos': 8023}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 54, 'nb_images_finished': 2190, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2190, 'last_update': '2025/09/16', 'portfolio_id': 26835003, 'last_run_id': 2301213, 'total_number_of_photos': 6502}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 44, 'nb_images_finished': 2241, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2241, 'last_update': '2025/09/14', 'portfolio_id': 26814999, 'last_run_id': 2293261, 'total_number_of_photos': 7803}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 50, 'nb_images_finished': 1971, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1971, 'last_update': '2025/09/13', 'portfolio_id': 26769761, 'last_run_id': 2289855, 'total_number_of_photos': 7017}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 21, 'nb_images_finished': 977, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 2, 'nb_images_started': 235, 'nb_selected_images': 1212, 'last_update': '2025/09/13', 'portfolio_id': 26734745, 'last_run_id': 2283193, 'total_number_of_photos': 7570}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 48, 'nb_images_finished': 2427, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2427, 'last_update': '2025/09/13', 'portfolio_id': 26704156, 'last_run_id': 2277699, 'total_number_of_photos': 8023}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 25, 'nb_images_finished': 847, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 19, 'nb_images_started': 963, 'nb_selected_images': 1810, 'last_update': '2025/09/12', 'portfolio_id': 26665693, 'last_run_id': 2269243, 'total_number_of_photos': 7972}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 44, 'nb_images_finished': 2241, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2241, 'last_update': '2025/09/14', 'portfolio_id': 26814999, 'last_run_id': 2293261, 'total_number_of_photos': 7803}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 50, 'nb_images_finished': 1971, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1971, 'last_update': '2025/09/13', 'portfolio_id': 26769761, 'last_run_id': 2289855, 'total_number_of_photos': 7017}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 21, 'nb_images_finished': 977, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 2, 'nb_images_started': 235, 'nb_selected_images': 1212, 'last_update': '2025/09/13', 'portfolio_id': 26734745, 'last_run_id': 2283193, 'total_number_of_photos': 7570}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 48, 'nb_images_finished': 2427, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2427, 'last_update': '2025/09/13', 'portfolio_id': 26704156, 'last_run_id': 2277699, 'total_number_of_photos': 8023}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 25, 'nb_images_finished': 847, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 19, 'nb_images_started': 963, 'nb_selected_images': 1810, 'last_update': '2025/09/12', 'portfolio_id': 26665693, 'last_run_id': 2269243, 'total_number_of_photos': 7972}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 50, 'nb_images_finished': 2298, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2298, 'last_update': '2025/09/09', 'portfolio_id': 26623918, 'last_run_id': 2262551, 'total_number_of_photos': 7457}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 44, 'nb_images_finished': 2241, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2241, 'last_update': '2025/09/14', 'portfolio_id': 26814999, 'last_run_id': 2293261, 'total_number_of_photos': 7803}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 50, 'nb_images_finished': 1971, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1971, 'last_update': '2025/09/13', 'portfolio_id': 26769761, 'last_run_id': 2289855, 'total_number_of_photos': 7017}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 21, 'nb_images_finished': 977, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 2, 'nb_images_started': 235, 'nb_selected_images': 1212, 'last_update': '2025/09/13', 'portfolio_id': 26734745, 'last_run_id': 2283193, 'total_number_of_photos': 7570}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 48, 'nb_images_finished': 2427, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2427, 'last_update': '2025/09/13', 'portfolio_id': 26704156, 'last_run_id': 2277699, 'total_number_of_photos': 8023}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 25, 'nb_images_finished': 847, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 19, 'nb_images_started': 963, 'nb_selected_images': 1810, 'last_update': '2025/09/12', 'portfolio_id': 26665693, 'last_run_id': 2269243, 'total_number_of_photos': 7972}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 50, 'nb_images_finished': 2298, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2298, 'last_update': '2025/09/09', 'portfolio_id': 26623918, 'last_run_id': 2262551, 'total_number_of_photos': 7457}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 50, 'nb_images_finished': 1971, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1971, 'last_update': '2025/09/13', 'portfolio_id': 26769761, 'last_run_id': 2289855, 'total_number_of_photos': 7017}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 21, 'nb_images_finished': 977, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 2, 'nb_images_started': 235, 'nb_selected_images': 1212, 'last_update': '2025/09/13', 'portfolio_id': 26734745, 'last_run_id': 2283193, 'total_number_of_photos': 7570}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 48, 'nb_images_finished': 2427, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2427, 'last_update': '2025/09/13', 'portfolio_id': 26704156, 'last_run_id': 2277699, 'total_number_of_photos': 8023}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 25, 'nb_images_finished': 847, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 19, 'nb_images_started': 963, 'nb_selected_images': 1810, 'last_update': '2025/09/12', 'portfolio_id': 26665693, 'last_run_id': 2269243, 'total_number_of_photos': 7972}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 50, 'nb_images_finished': 2298, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2298, 'last_update': '2025/09/09', 'portfolio_id': 26623918, 'last_run_id': 2262551, 'total_number_of_photos': 7457}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 44, 'nb_images_finished': 2339, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2339, 'last_update': '2025/09/07', 'portfolio_id': 26598361, 'last_run_id': 2253843, 'total_number_of_photos': 7431}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 21, 'nb_images_finished': 977, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 2, 'nb_images_started': 235, 'nb_selected_images': 1212, 'last_update': '2025/09/12', 'portfolio_id': 26734745, 'last_run_id': 2282859, 'total_number_of_photos': 7570}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 48, 'nb_images_finished': 2427, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2427, 'last_update': '2025/09/11', 'portfolio_id': 26704156, 'last_run_id': 2277699, 'total_number_of_photos': 8023}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 25, 'nb_images_finished': 847, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 19, 'nb_images_started': 963, 'nb_selected_images': 1810, 'last_update': '2025/09/11', 'portfolio_id': 26665693, 'last_run_id': 2269243, 'total_number_of_photos': 7972}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 50, 'nb_images_finished': 2298, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2298, 'last_update': '2025/09/09', 'portfolio_id': 26623918, 'last_run_id': 2262551, 'total_number_of_photos': 7457}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 44, 'nb_images_finished': 2339, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2339, 'last_update': '2025/09/07', 'portfolio_id': 26598361, 'last_run_id': 2253843, 'total_number_of_photos': 7431}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 43, 'nb_images_finished': 2869, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2869, 'last_update': '2025/09/06', 'portfolio_id': 26552251, 'last_run_id': 2250301, 'total_number_of_photos': 7082}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 48, 'nb_images_finished': 2427, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2427, 'last_update': '2025/09/11', 'portfolio_id': 26704156, 'last_run_id': 2277699, 'total_number_of_photos': 8023}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 25, 'nb_images_finished': 847, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 19, 'nb_images_started': 963, 'nb_selected_images': 1810, 'last_update': '2025/09/11', 'portfolio_id': 26665693, 'last_run_id': 2269243, 'total_number_of_photos': 7972}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 50, 'nb_images_finished': 2298, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2298, 'last_update': '2025/09/09', 'portfolio_id': 26623918, 'last_run_id': 2262551, 'total_number_of_photos': 7457}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 44, 'nb_images_finished': 2339, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2339, 'last_update': '2025/09/07', 'portfolio_id': 26598361, 'last_run_id': 2253843, 'total_number_of_photos': 7431}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 43, 'nb_images_finished': 2869, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2869, 'last_update': '2025/09/06', 'portfolio_id': 26552251, 'last_run_id': 2250301, 'total_number_of_photos': 7082}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 31, 'nb_images_finished': 1789, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1789, 'last_update': '2025/09/06', 'portfolio_id': 26511077, 'last_run_id': 2242939, 'total_number_of_photos': 8020}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 25, 'nb_images_finished': 847, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 19, 'nb_images_started': 963, 'nb_selected_images': 1810, 'last_update': '2025/09/10', 'portfolio_id': 26665693, 'last_run_id': 2269243, 'total_number_of_photos': 7972}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 50, 'nb_images_finished': 2298, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2298, 'last_update': '2025/09/09', 'portfolio_id': 26623918, 'last_run_id': 2262551, 'total_number_of_photos': 7457}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 44, 'nb_images_finished': 2339, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2339, 'last_update': '2025/09/07', 'portfolio_id': 26598361, 'last_run_id': 2253843, 'total_number_of_photos': 7431}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 43, 'nb_images_finished': 2869, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2869, 'last_update': '2025/09/06', 'portfolio_id': 26552251, 'last_run_id': 2250301, 'total_number_of_photos': 7082}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 31, 'nb_images_finished': 1789, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1789, 'last_update': '2025/09/06', 'portfolio_id': 26511077, 'last_run_id': 2242939, 'total_number_of_photos': 8020}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 45, 'nb_images_finished': 2215, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2215, 'last_update': '2025/09/05', 'portfolio_id': 26463905, 'last_run_id': 2237005, 'total_number_of_photos': 7608}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 50, 'nb_images_finished': 2298, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2298, 'last_update': '2025/09/09', 'portfolio_id': 26623918, 'last_run_id': 2262551, 'total_number_of_photos': 7457}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 44, 'nb_images_finished': 2339, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2339, 'last_update': '2025/09/07', 'portfolio_id': 26598361, 'last_run_id': 2253843, 'total_number_of_photos': 7431}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 43, 'nb_images_finished': 2869, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2869, 'last_update': '2025/09/06', 'portfolio_id': 26552251, 'last_run_id': 2250301, 'total_number_of_photos': 7082}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 31, 'nb_images_finished': 1789, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1789, 'last_update': '2025/09/06', 'portfolio_id': 26511077, 'last_run_id': 2242939, 'total_number_of_photos': 8020}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 45, 'nb_images_finished': 2215, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2215, 'last_update': '2025/09/05', 'portfolio_id': 26463905, 'last_run_id': 2237005, 'total_number_of_photos': 7608}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 44, 'nb_images_finished': 2415, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2415, 'last_update': '2025/09/03', 'portfolio_id': 26419639, 'last_run_id': 2229547, 'total_number_of_photos': 7895}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 44, 'nb_images_finished': 2339, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2339, 'last_update': '2025/09/07', 'portfolio_id': 26598361, 'last_run_id': 2253843, 'total_number_of_photos': 7431}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 43, 'nb_images_finished': 2869, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2869, 'last_update': '2025/09/06', 'portfolio_id': 26552251, 'last_run_id': 2250301, 'total_number_of_photos': 7082}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 31, 'nb_images_finished': 1789, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1789, 'last_update': '2025/09/06', 'portfolio_id': 26511077, 'last_run_id': 2242939, 'total_number_of_photos': 8020}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 45, 'nb_images_finished': 2215, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2215, 'last_update': '2025/09/05', 'portfolio_id': 26463905, 'last_run_id': 2237005, 'total_number_of_photos': 7608}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 44, 'nb_images_finished': 2415, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2415, 'last_update': '2025/09/03', 'portfolio_id': 26419639, 'last_run_id': 2229547, 'total_number_of_photos': 7895}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 39, 'nb_images_finished': 2273, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2273, 'last_update': '2025/09/02', 'portfolio_id': 26380237, 'last_run_id': 2221899, 'total_number_of_photos': 7121}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 44, 'nb_images_finished': 2339, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2339, 'last_update': '2025/09/07', 'portfolio_id': 26598361, 'last_run_id': 2253843, 'total_number_of_photos': 7431}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 43, 'nb_images_finished': 2869, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2869, 'last_update': '2025/09/06', 'portfolio_id': 26552251, 'last_run_id': 2250301, 'total_number_of_photos': 7082}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 31, 'nb_images_finished': 1789, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1789, 'last_update': '2025/09/06', 'portfolio_id': 26511077, 'last_run_id': 2242939, 'total_number_of_photos': 8020}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 45, 'nb_images_finished': 2215, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2215, 'last_update': '2025/09/05', 'portfolio_id': 26463905, 'last_run_id': 2237005, 'total_number_of_photos': 7608}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 44, 'nb_images_finished': 2415, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2415, 'last_update': '2025/09/03', 'portfolio_id': 26419639, 'last_run_id': 2229547, 'total_number_of_photos': 7895}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 39, 'nb_images_finished': 2273, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2273, 'last_update': '2025/09/02', 'portfolio_id': 26380237, 'last_run_id': 2221899, 'total_number_of_photos': 7121}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 43, 'nb_images_finished': 2869, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2869, 'last_update': '2025/09/06', 'portfolio_id': 26552251, 'last_run_id': 2250301, 'total_number_of_photos': 7082}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 31, 'nb_images_finished': 1789, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1789, 'last_update': '2025/09/06', 'portfolio_id': 26511077, 'last_run_id': 2242939, 'total_number_of_photos': 8020}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 45, 'nb_images_finished': 2215, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2215, 'last_update': '2025/09/05', 'portfolio_id': 26463905, 'last_run_id': 2237005, 'total_number_of_photos': 7608}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 44, 'nb_images_finished': 2415, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2415, 'last_update': '2025/09/03', 'portfolio_id': 26419639, 'last_run_id': 2229547, 'total_number_of_photos': 7895}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 39, 'nb_images_finished': 2273, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2273, 'last_update': '2025/09/02', 'portfolio_id': 26380237, 'last_run_id': 2221899, 'total_number_of_photos': 7121}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 31, 'nb_images_finished': 1789, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1789, 'last_update': '2025/09/05', 'portfolio_id': 26511077, 'last_run_id': 2242939, 'total_number_of_photos': 8020}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 45, 'nb_images_finished': 2215, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2215, 'last_update': '2025/09/05', 'portfolio_id': 26463905, 'last_run_id': 2237005, 'total_number_of_photos': 7608}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 44, 'nb_images_finished': 2415, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2415, 'last_update': '2025/09/03', 'portfolio_id': 26419639, 'last_run_id': 2229547, 'total_number_of_photos': 7895}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 39, 'nb_images_finished': 2273, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2273, 'last_update': '2025/09/02', 'portfolio_id': 26380237, 'last_run_id': 2221899, 'total_number_of_photos': 7121}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 45, 'nb_images_finished': 2215, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2215, 'last_update': '2025/09/04', 'portfolio_id': 26463905, 'last_run_id': 2237005, 'total_number_of_photos': 7608}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 44, 'nb_images_finished': 2415, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2415, 'last_update': '2025/09/03', 'portfolio_id': 26419639, 'last_run_id': 2229547, 'total_number_of_photos': 7895}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 39, 'nb_images_finished': 2273, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2273, 'last_update': '2025/09/02', 'portfolio_id': 26380237, 'last_run_id': 2221899, 'total_number_of_photos': 7121}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 44, 'nb_images_finished': 2415, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2415, 'last_update': '2025/09/03', 'portfolio_id': 26419639, 'last_run_id': 2229547, 'total_number_of_photos': 7895}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 39, 'nb_images_finished': 2273, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2273, 'last_update': '2025/09/02', 'portfolio_id': 26380237, 'last_run_id': 2221899, 'total_number_of_photos': 7121}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 39, 'nb_images_finished': 2273, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2273, 'last_update': '2025/09/02', 'portfolio_id': 26380237, 'last_run_id': 2221899, 'total_number_of_photos': 7121}} Since we don't have condition on date we need to verify this lately ! Since we don't have condition on date we need to verify this lately ! Found day : 2025-09-20 00:00:00 Found day : 2025-09-19 00:00:00 Found day : 2025-09-18 00:00:00 Found day : 2025-09-17 00:00:00 Found day : 2025-09-16 00:00:00 Found day : 2025-09-15 00:00:00 Found day : 2025-09-13 00:00:00 Found day : 2025-09-12 00:00:00 Found day : 2025-09-11 00:00:00 Found day : 2025-09-10 00:00:00 Found day : 2025-09-09 00:00:00 Found day : 2025-09-08 00:00:00 Found day : 2025-09-06 00:00:00 Found day : 2025-09-05 00:00:00 Found day : 2025-09-04 00:00:00 Found day : 2025-09-03 00:00:00 Found day : 2025-09-02 00:00:00 Found day : 2025-09-01 00:00:00 Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! We will need to call the sla_per_day for these missing days : 2025-09-22 00:00:00,2025-09-23 00:00:00,2025-09-24 00:00:00,2025-09-25 00:00:00,2025-09-26 00:00:00,2025-09-27 00:00:00,2025-09-29 00:00:00,2025-09-30 00:00:00 after coverage_data SELECT DATE(date_debut) as date, sum(qualite*nombre_balle)/sum(nombre_balle), nombre_balle FROM MTRPhoto.dashboard_results dr, MTRPhoto.dashboard_entry_day ded where ded.dashboard_place_id = 94 and month(ded.date) = 09 and year(ded.date) = 2025 and dr.dashboard_run_id=ded.last_run_id and dr.qualite>=0 GROUP BY ded.date order by dr.date_debut; SELECT DATE(date_debut) as date, sum(qualite*nombre_balle)/sum(nombre_balle), nombre_balle FROM MTRPhoto.dashboard_results dr, MTRPhoto.dashboard_entry_day ded where dr.hashtag = '_______pcnc' and ded.dashboard_place_id = 94 and month(ded.date) = 09 and year(ded.date) = 2025 and dr.dashboard_run_id=ded.last_run_id and dr.qualite>=0 GROUP BY ded.date order by dr.date_debut; SELECT DATE(date_debut) as date, sum(qualite*nombre_balle)/sum(nombre_balle), nombre_balle FROM MTRPhoto.dashboard_results dr, MTRPhoto.dashboard_entry_day ded where dr.hashtag = '_______film_pedb' and ded.dashboard_place_id = 94 and month(ded.date) = 09 and year(ded.date) = 2025 and dr.dashboard_run_id=ded.last_run_id and dr.qualite>=0 GROUP BY ded.date order by dr.date_debut; SELECT DATE(date_debut) as date, sum(qualite*nombre_balle)/sum(nombre_balle), nombre_balle FROM MTRPhoto.dashboard_results dr, MTRPhoto.dashboard_entry_day ded where dr.hashtag = '_______refus' and ded.dashboard_place_id = 94 and month(ded.date) = 09 and year(ded.date) = 2025 and dr.dashboard_run_id=ded.last_run_id and dr.qualite>=0 GROUP BY ded.date order by dr.date_debut; SELECT DATE(date_debut) as date, sum(qualite*nombre_balle)/sum(nombre_balle), nombre_balle FROM MTRPhoto.dashboard_results dr, MTRPhoto.dashboard_entry_day ded where dr.hashtag = '_______jrm' and ded.dashboard_place_id = 94 and month(ded.date) = 09 and year(ded.date) = 2025 and dr.dashboard_run_id=ded.last_run_id and dr.qualite>=0 GROUP BY ded.date order by dr.date_debut; SELECT DATE(date_debut) as date, sum(qualite*nombre_balle)/sum(nombre_balle), nombre_balle FROM MTRPhoto.dashboard_results dr, MTRPhoto.dashboard_entry_day ded where dr.hashtag = '_______pet_clair' and ded.dashboard_place_id = 94 and month(ded.date) = 09 and year(ded.date) = 2025 and dr.dashboard_run_id=ded.last_run_id and dr.qualite>=0 GROUP BY ded.date order by dr.date_debut; select avg(cps.score) as score, SUBSTRING_INDEX(SUBSTRING_INDEX(mp.name,'__', -1), '_', 1) as sbstr, SUBSTRING_INDEX(SUBSTRING_INDEX(mp.name,'_', -2), '_', 1) as sbstr2, SUBSTRING_INDEX(mp.name,'_', -1) as sbstr3 FROM MTRUser.mtr_portfolio_photos mpp, MTRUser.mtr_portfolios mp,MTRPhoto.class_photo_score cps,MTRBack.hashtags h,MTRPhoto.dashboard_results dr,MTRPhoto.dashboard_entry_day ded, MTRPhoto.dashboard_places dp WHERE mp.id=mpp.mtr_portfolio_id and cps.photo_id=mpp.mtr_photo_id and h.hashtag_id=cps.hashtag_id and dr.mtr_portfolio_id = mpp.mtr_portfolio_id and dr.dashboard_run_id = ded.last_run_id and ded.dashboard_place_id = dp.id and h.hashtag in ('blur', 'mean_blur', 'clear') and dp.id = 94 and mp.name like '%092025%' and cps.thcl = 1533 GROUP BY sbstr ; after number_of_batch date_start : 2025-09-01 : dt_date_just_month_year : 2025-09-01 00:00:00 : VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! after pl.get_datou_sts_from_crontab : verbose : True no sts found, try to find from database SELECT dri.id FROM MTRPhoto.dashboard_run_ids dri, MTRPhoto.dashboard_entry_day ded, MTRPhoto.dashboard_places dp WHERE dp.name= "Sevran" AND ded.dashboard_place_id=dp.id AND dri.dashboard_entry_day=ded.id AND dri.id=ded.last_run_id AND ded.date >= "2025-09-01" AND ded.date <= "2025-09-30" apple3 {'emr': {'mat': 'emr', 'pht': 4207, 'datou_carac_id': 3993, 'unwanted_material': [], 'hashtag_majoritaire_from_carac': 'carton,background'}, 'pcm': {'mat': 'pcm', 'pht': 4209, 'datou_carac_id': 3994, 'unwanted_material': [], 'hashtag_majoritaire_from_carac': 'papier,background'}, 'pcnc': {'mat': 'pcnc', 'pht': 4207, 'datou_carac_id': 3993, 'unwanted_material': [], 'hashtag_majoritaire_from_carac': 'carton,background'}, 'jrm': {'mat': 'jrm', 'pht': 3726, 'datou_carac_id': 3459, 'unwanted_material': [], 'hashtag_majoritaire_from_carac': 'papier,background'}, 'ela': {'mat': 'ela', 'pht': 4203, 'datou_carac_id': 3991, 'unwanted_material': [], 'hashtag_majoritaire_from_carac': 'ela,background'}, 'pet_clair': {'mat': 'pet_clair', 'pht': 3327, 'datou_carac_id': 3804, 'unwanted_material': [], 'hashtag_majoritaire_from_carac': 'pet_clair,bouchon,etiquette,barquette_avec_film,background'}, 'film_pedb': {'mat': 'film_pedb', 'pht': 4461, 'datou_carac_id': 4322, 'unwanted_material': [], 'hashtag_majoritaire_from_carac': 'film_plastique'}, 'pehd_pp': {'mat': 'pehd_pp', 'pht': 4211, 'datou_carac_id': 3995, 'unwanted_material': [], 'hashtag_majoritaire_from_carac': 'pehd,background'}, 'flux_dev': {'mat': 'flux_dev', 'pht': 4200, 'datou_carac_id': 4153, 'unwanted_material': [], 'hashtag_majoritaire_from_carac': 'pet_fonce,background'}, 'aluminium': {'mat': 'aluminium', 'pht': 4205, 'datou_carac_id': 3992, 'unwanted_material': [], 'hashtag_majoritaire_from_carac': 'metal,background'}, 'refus': {'mat': 'refus', 'pht': 3594, 'datou_carac_id': 3318, 'unwanted_material': [], 'hashtag_majoritaire_from_carac': 'refus,background'}} SELECT h.hashtag as unwanted_material, substr(dr.hashtag,8) as main_material, ptp.type as pht_type, sum(pcr.value*dr.nombre_balle)/sum(dr.nombre_balle) as ratio, count(distinct mpp.mtr_photo_id) as nb_photo, group_concat(distinct ptp.mtr_portfolio_id_2) as list_port_cont, group_concat(distinct concat(cast(ptp.mtr_portfolio_id_1 as char), ":", cast(ptp.mtr_portfolio_id_2 as char))) as assoc_port, group_concat(distinct concat(cast(ptp.mtr_portfolio_id_1 as char), ":", h.hashtag, ":", cast(ptp.type as char), ":", cast(ptp.mtr_portfolio_id_2 as char))) as assoc_mat FROM MTRPhoto.dashboard_results dr, MTRPhoto.mtr_port_to_port_ids ptp, MTRUser.mtr_portfolio_photos mpp, MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h WHERE dr.dashboard_run_id IN (2221899,2229547,2237005,2242939,2250301,2253843,2254595,2262551,2269243,2277699,2283193,2289855,2293261,2293599,2301213,2309617,2317497,2325191,2332853,2335407) AND dr.mtr_portfolio_id=ptp.mtr_portfolio_id_1 AND dr.qualite >= 0 AND mpp.mtr_portfolio_id=ptp.mtr_portfolio_id_2 AND pcr.portfolio_id=ptp.mtr_portfolio_id_1 AND h.hashtag_id = pcr.hashtag_id AND ptp.type = pcr.hashtag_type AND mpp.hide_status = 0 AND ptp.hashtag_id=h.hashtag_id AND ptp.type IN (4207,4209,4207,3726,4203,3327,4461,4211,4200,4205,3594) group by h.hashtag, dr.hashtag, ptp.type; VR TODO TO BETTER PARSE ! ({'unwanted_material': 'autre', 'main_material': 'pet_clair', 'pht_type': 3327, 'ratio': 0.0010705069599419859, 'nb_photo': 1, 'list_port_cont': '26723047', 'assoc_port': '26722892:26723047', 'assoc_mat': '26722892:autre:3327:26723047'}, {'unwanted_material': 'autre', 'main_material': 'refus', 'pht_type': 3594, 'ratio': 0.001604984101442466, 'nb_photo': 569, 'list_port_cont': '26388448,26390786,26396949,26398301,26398725,26404171,26404705,26406727,26409925,26430216,26436373,26444502,26444649,26445437,26450485,26454080,26454606,26455118,26459010,26481276,26481694,26482046,26487493,26490709,26491830,26493293,26497404,26497571,26533585,26535088,26547997,26548618,26550042,26552691,26566469,26575317,26576787,26587955,26588559,26589160,26593897,26596205,26601922,26605159,26605462,26605765,26609187,26610594,26611515,26613451,26630009,26630168,26631358,26639072,26639674,26639875,26649548,26650391,26652891,26661142,26666561,26666872,26680086,26680769,26681143,26686135,26723725,26724791,26725094,26725496,26725921,26726946,26727074,26727789,26728046,26728785,26729250,26753204,26756717,26761730,26788573,26788896,26789221,26790253,26791389,26793224,26794521,26798288,26799885,26800998,26802419,26807675,26823741,26826795,26827472,26828482,26829080,26830529,26832960,26833315,26833716,26843353,26843712,26845983,26850569,26850752,26851200,26851939,26853897,26862257,26862565,26862859,26863127,2686673', 'assoc_port': '26388369:26388448,26390641:26390786,26395439:26396949,26397835:26398725,26397837:26398301,26404029:26404705,26404030:26404171,26406524:26406727,26409707:26409925,26429659:26430216,26435866:26436373,26444024:26445437,26444026:26444649,26444034:26444502,26450291:26450485,26453906:26455118,26453927:26454606,26453934:26454080,26458929:26459010,26481009:26482046,26481011:26481694,26481032:26481276,26487184:26487493,26487187:26490709,26491587:26491830,26493017:26493293,26497232:26497571,26497234:26497404,26532805:26533585,26534764:26535088,26541041:26547997,26548449:26550042,26548452:26552691,26548459:26548618,26566359:26566469,26574866:26576787,26574891:26575317,26587707:26589160,26587709:26593897,26587716:26587955,26588293:26588559,26594768:26596205,26601766:26601922,26604829:26605765,26604830:26605462,26604831:26605159,26607883:26609187,26609510:26610594,26610351:26611515,26613406:26613451,26629339:26630168,26629340:26630009,26631054:26631358,26638960:26639072,26639467:26639875,26639469:26639674,26649069:2664954', 'assoc_mat': '26388369:autre:3594:26388448,26390641:autre:3594:26390786,26395439:autre:3594:26396949,26397835:autre:3594:26398725,26397837:autre:3594:26398301,26404029:autre:3594:26404705,26404030:autre:3594:26404171,26406524:autre:3594:26406727,26409707:autre:3594:26409925,26429659:autre:3594:26430216,26435866:autre:3594:26436373,26444024:autre:3594:26445437,26444026:autre:3594:26444649,26444034:autre:3594:26444502,26450291:autre:3594:26450485,26453906:autre:3594:26455118,26453927:autre:3594:26454606,26453934:autre:3594:26454080,26458929:autre:3594:26459010,26481009:autre:3594:26482046,26481011:autre:3594:26481694,26481032:autre:3594:26481276,26487184:autre:3594:26487493,26487187:autre:3594:26490709,26491587:autre:3594:26491830,26493017:autre:3594:26493293,26497232:autre:3594:26497571,26497234:autre:3594:26497404,26532805:autre:3594:26533585,26534764:autre:3594:26535088,26541041:autre:3594:26547997,26548449:autre:3594:26550042,26548452:autre:3594:26552691,26548459:autre:3594:26548618,26566359:autre:3594:26566469,26574866:'}, {'unwanted_material': 'autre_refus', 'main_material': 'jrm', 'pht_type': 3726, 'ratio': 0.03659626103142702, 'nb_photo': 1, 'list_port_cont': '26714010', 'assoc_port': '26713945:26714010', 'assoc_mat': '26713945:autre_refus:3726:26714010'}, {'unwanted_material': 'barquette_opaque', 'main_material': 'film_pedb', 'pht_type': 4461, 'ratio': 0.007205310780105326, 'nb_photo': 5, 'list_port_cont': '26576424,26680804,26828541,26866781,26906115', 'assoc_port': '26576342:26576424,26680701:26680804,26828460:26828541,26866563:26866781,26905513:26906115', 'assoc_mat': '26576342:barquette_opaque:4461:26576424,26680701:barquette_opaque:4461:26680804,26828460:barquette_opaque:4461:26828541,26866563:barquette_opaque:4461:26866781,26905513:barquette_opaque:4461:26906115'}, {'unwanted_material': 'barquette_opaque', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 0.0027677355068840637, 'nb_photo': 6006, 'list_port_cont': '26388532,26389563,26389762,26389893,26390975,26390999,26391133,26391213,26395690,26395713,26398976,26399243,26399413,26405095,26405570,26407167,26411057,26415151,26415470,26420010,26420110,26420615,26428195,26429743,26430038,26436078,26436120,26438229,26438316,26438574,26438674,26438721,26438812,26438868,26443004,26444245,26444342,26446135,26454459,26457559,26457763,26457936,26463988,26464214,26466418,26481103,26481745,26481896,26482094,26483596,26483795,26484064,26484313,26484572,26484950,26487318,26487359,26491691,26494654,26497496,26512942,26513974,26514023,26514113,26517215,26517315,26517508,26518870,26519041,26532865,26534818,26547039,26548037,26548684,26553021,26554610,26554692,26554768,26554776,26554828,26554844,26554922,26554976,26555109,26557664,26557810,26558027,26569570,26570481,26570696,26573513,26573702,26573858,26576535,26576687,26576886,26577640,26577673,26577720,26588347,26594609,26594796,26594812,26594865,26595109,26595277,26595486,26595501,26595635,26596446,26596758,26602670,26603065,2660357', 'assoc_port': '26388352:26389563,26388353:26389762,26388354:26389893,26388368:26388532,26390635:26391133,26390637:26391213,26390639:26390999,26390642:26390975,26395436:26395713,26395438:26395690,26397832:26398976,26397834:26399243,26397852:26399413,26404026:26405095,26404326:26405570,26406975:26407167,26409706:26411057,26415088:26415470,26415090:26415151,26419971:26420110,26419972:26420010,26420599:26420615,26427266:26428195,26429657:26430038,26429660:26429743,26435868:26438674,26435869:26438721,26435872:26438812,26435874:26438868,26435877:26436120,26435878:26436078,26438216:26438574,26438218:26438316,26438220:26438229,26442935:26443004,26444023:26446135,26444027:26444342,26444030:26444245,26450292:26454459,26453924:26457559,26453929:26457763,26453932:26457936,26458908:26463988,26458928:26464214,26466363:26466418,26478210:26481745,26478212:26481896,26478213:26482094,26481003:26483596,26481004:26483795,26481006:26484064,26481008:26484313,26481010:26484572,26481012:26481103,26481013:26484950,26487185:26487359,26487188:2648731', 'assoc_mat': '26388352:barquette_opaque:4207:26389563,26388353:barquette_opaque:4207:26389762,26388354:barquette_opaque:4207:26389893,26388368:barquette_opaque:4207:26388532,26390635:barquette_opaque:4207:26391133,26390637:barquette_opaque:4207:26391213,26390639:barquette_opaque:4207:26390999,26390642:barquette_opaque:4207:26390975,26395436:barquette_opaque:4207:26395713,26395438:barquette_opaque:4207:26395690,26397832:barquette_opaque:4207:26398976,26397834:barquette_opaque:4207:26399243,26397852:barquette_opaque:4207:26399413,26404026:barquette_opaque:4207:26405095,26404326:barquette_opaque:4207:26405570,26406975:barquette_opaque:4207:26407167,26409706:barquette_opaque:4207:26411057,26415088:barquette_opaque:4207:26415470,26415090:barquette_opaque:4207:26415151,26419971:barquette_opaque:4207:26420110,26419972:barquette_opaque:4207:26420010,26420599:barquette_opaque:4207:26420615,26427266:barquette_opaque:4207:26428195,26429657:barquette_opaque:4207:26430038,26429660:barquette_opaque:4207:26429743,26435868:barquette_opaqu'}, {'unwanted_material': 'carton', 'main_material': 'film_pedb', 'pht_type': 4461, 'ratio': 0.004167282241694771, 'nb_photo': 102, 'list_port_cont': '26390813,26390880,26395535,26409894,26427489,26435998,26438399,26438536,26462851,26481155,26490759,26497345,26548531,26548874,26574926,26576435,26587828,26591922,26613921,26639112,26658262,26690903,26722946,26727884,26761302,26787927,26807739,26828880,26832983,26850529,26866775,26890593,26902293,26905865,26906112,26910224,26945645,26955542,26964803,27003926,27039141,27047069', 'assoc_port': '26390634:26390880,26390638:26390813,26395437:26395535,26409705:26409894,26427268:26427489,26435875:26435998,26438215:26438536,26438217:26438399,26453931:26462851,26481007:26481155,26490662:26490759,26497248:26497345,26548445:26548531,26548468:26548874,26574911:26574926,26576342:26576435,26587714:26587828,26591763:26591922,26613876:26613921,26638965:26639112,26658032:26658262,26690810:26690903,26722881:26722946,26727637:26727884,26761142:26761302,26787636:26787927,26807540:26807739,26828801:26828880,26832917:26832983,26850412:26850529,26866563:26866775,26890526:26890593,26902186:26902293,26905513:26906112,26905517:26905865,26910032:26910224,26945365:26955542,26945366:26945645,26964643:26964803,27003816:27003926,27038970:27039141,27046878:27047069', 'assoc_mat': '26390634:carton:4461:26390880,26390638:carton:4461:26390813,26395437:carton:4461:26395535,26409705:carton:4461:26409894,26427268:carton:4461:26427489,26435875:carton:4461:26435998,26438215:carton:4461:26438536,26438217:carton:4461:26438399,26453931:carton:4461:26462851,26481007:carton:4461:26481155,26490662:carton:4461:26490759,26497248:carton:4461:26497345,26548445:carton:4461:26548531,26548468:carton:4461:26548874,26574911:carton:4461:26574926,26576342:carton:4461:26576435,26587714:carton:4461:26587828,26591763:carton:4461:26591922,26613876:carton:4461:26613921,26638965:carton:4461:26639112,26658032:carton:4461:26658262,26690810:carton:4461:26690903,26722881:carton:4461:26722946,26727637:carton:4461:26727884,26761142:carton:4461:26761302,26787636:carton:4461:26787927,26807540:carton:4461:26807739,26828801:carton:4461:26828880,26832917:carton:4461:26832983,26850412:carton:4461:26850529,26866563:carton:4461:26866775,26890526:carton:4461:26890593,26902186:carton:4461:26902293,26905513:carton:4461:26906112,2690'}, {'unwanted_material': 'carton', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 0.9757636265286489, 'nb_photo': 6589, 'list_port_cont': '26388521,26389572,26389767,26389899,26391001,26391218,26393664,26395687,26398977,26399248,26399416,26405082,26405580,26407168,26415159,26415478,26420002,26420113,26420605,26429739,26430041,26436076,26436110,26438230,26438310,26438571,26438670,26438725,26438821,26443019,26444253,26444337,26446121,26454462,26457551,26457765,26457934,26463999,26464207,26466431,26481116,26481742,26481904,26482088,26483598,26484316,26484578,26484955,26487325,26487352,26487699,26494662,26497491,26512935,26513973,26514020,26514111,26517212,26517515,26518872,26519035,26532860,26534822,26547040,26548692,26553018,26554601,26554688,26554772,26554780,26554823,26554835,26554840,26554914,26554990,26557654,26557794,26558034,26569564,26570483,26570688,26573523,26573695,26573859,26576410,26576533,26577730,26588345,26594605,26594813,26594832,26594866,26594999,26595113,26595291,26595489,26595508,26595631,26596443,26596766,26601816,26602676,26603056,26603579,26604931,26605092,26606008,26606154,26606190,26606429,26606681,26607084,26607184,2660809', 'assoc_port': '26388352:26389572,26388353:26389767,26388354:26389899,26388368:26388521,26390637:26391218,26390639:26391001,26393344:26393664,26395438:26395687,26397832:26398977,26397834:26399248,26397852:26399416,26404026:26405082,26404326:26405580,26406975:26407168,26415088:26415478,26415090:26415159,26419971:26420113,26419972:26420002,26420599:26420605,26429657:26430041,26429660:26429739,26435868:26438670,26435869:26438725,26435872:26438821,26435877:26436110,26435878:26436076,26438216:26438571,26438218:26438310,26438220:26438230,26442935:26443019,26444023:26446121,26444027:26444337,26444030:26444253,26450292:26454462,26453924:26457551,26453929:26457765,26453932:26457934,26458908:26463999,26458928:26464207,26466363:26466431,26478210:26481742,26478212:26481904,26478213:26482088,26481003:26483598,26481008:26484316,26481010:26484578,26481012:26481116,26481013:26484955,26487185:26487352,26487188:26487325,26487614:26487699,26491584:26518872,26491586:26519035,26493013:26512935,26494594:26494662,26494595:26513973,26494598:2651402', 'assoc_mat': '26388352:carton:4207:26389572,26388353:carton:4207:26389767,26388354:carton:4207:26389899,26388368:carton:4207:26388521,26390637:carton:4207:26391218,26390639:carton:4207:26391001,26393344:carton:4207:26393664,26395438:carton:4207:26395687,26397832:carton:4207:26398977,26397834:carton:4207:26399248,26397852:carton:4207:26399416,26404026:carton:4207:26405082,26404326:carton:4207:26405580,26406975:carton:4207:26407168,26415088:carton:4207:26415478,26415090:carton:4207:26415159,26419971:carton:4207:26420113,26419972:carton:4207:26420002,26420599:carton:4207:26420605,26429657:carton:4207:26430041,26429660:carton:4207:26429739,26435868:carton:4207:26438670,26435869:carton:4207:26438725,26435872:carton:4207:26438821,26435877:carton:4207:26436110,26435878:carton:4207:26436076,26438216:carton:4207:26438571,26438218:carton:4207:26438310,26438220:carton:4207:26438230,26442935:carton:4207:26443019,26444023:carton:4207:26446121,26444027:carton:4207:26444337,26444030:carton:4207:26444253,26450292:carton:4207:26454462,2645'}, {'unwanted_material': 'carton', 'main_material': 'pet_clair', 'pht_type': 3327, 'ratio': 0.010826074944025878, 'nb_photo': 1, 'list_port_cont': '26723054', 'assoc_port': '26722892:26723054', 'assoc_mat': '26722892:carton:3327:26723054'}, {'unwanted_material': 'carton', 'main_material': 'refus', 'pht_type': 3594, 'ratio': 0.011012671675260769, 'nb_photo': 1288, 'list_port_cont': '26388457,26388977,26390780,26395877,26398303,26398719,26404166,26404696,26406726,26409932,26430213,26436160,26436365,26438393,26440731,26444150,26444501,26444656,26445446,26450478,26454085,26454596,26455115,26459008,26478297,26478818,26481275,26481704,26482045,26482628,26487385,26487497,26490708,26491836,26493287,26494883,26497405,26497567,26531309,26533586,26535091,26547994,26548631,26549196,26550040,26566465,26575310,26575765,26576791,26587947,26588560,26589169,26593899,26596197,26601917,26605161,26605456,26605605,26605758,26609194,26610593,26611521,26613460,26629606,26630005,26630171,26631356,26639073,26639677,26639867,26649208,26649555,26650387,26652889,26658567,26661139,26666555,26666876,26677531,26679884,26680082,26680763,26684338,26684533,26686138,26723547,26723720,26724048,26724241,26724314,26724784,26725093,26725293,26725502,26725923,26726176,26726429,26726939,26727079,26727797,26728045,26728781,26729246,26753206,26753665,26754279,26756708,26761729,26772904,26788094,26788569,26788894,26789224,2679025', 'assoc_port': '26388367:26388977,26388369:26388457,26390641:26390780,26395440:26395877,26397835:26398719,26397837:26398303,26404029:26404696,26404030:26404166,26406524:26406726,26409707:26409932,26429659:26430213,26435866:26436365,26435870:26436160,26438219:26438393,26440559:26440731,26444024:26445446,26444026:26444656,26444032:26444150,26444034:26444501,26450291:26450478,26453906:26455115,26453927:26454596,26453934:26454085,26458929:26459008,26478209:26478818,26478214:26478297,26481005:26482628,26481009:26482045,26481011:26481704,26481032:26481275,26487184:26487497,26487187:26490708,26487189:26487385,26491587:26491836,26493017:26493287,26494597:26494883,26497232:26497567,26497234:26497405,26531218:26531309,26532805:26533586,26534764:26535091,26541041:26547994,26548449:26550040,26548456:26549196,26548459:26548631,26566359:26566465,26574866:26576791,26574888:26575765,26574891:26575310,26587707:26589169,26587709:26593899,26587716:26587947,26588293:26588560,26594768:26596197,26601766:26601917,26604828:26605605,26604829:2660575', 'assoc_mat': '26388367:carton:3594:26388977,26388369:carton:3594:26388457,26390641:carton:3594:26390780,26395440:carton:3594:26395877,26397835:carton:3594:26398719,26397837:carton:3594:26398303,26404029:carton:3594:26404696,26404030:carton:3594:26404166,26406524:carton:3594:26406726,26409707:carton:3594:26409932,26429659:carton:3594:26430213,26435866:carton:3594:26436365,26435870:carton:3594:26436160,26438219:carton:3594:26438393,26440559:carton:3594:26440731,26444024:carton:3594:26445446,26444026:carton:3594:26444656,26444032:carton:3594:26444150,26444034:carton:3594:26444501,26450291:carton:3594:26450478,26453906:carton:3594:26455115,26453927:carton:3594:26454596,26453934:carton:3594:26454085,26458929:carton:3594:26459008,26478209:carton:3594:26478818,26478214:carton:3594:26478297,26481005:carton:3594:26482628,26481009:carton:3594:26482045,26481011:carton:3594:26481704,26481032:carton:3594:26481275,26487184:carton:3594:26487497,26487187:carton:3594:26490708,26487189:carton:3594:26487385,26491587:carton:3594:26491836,2649'}, {'unwanted_material': 'Carton_brun', 'main_material': 'jrm', 'pht_type': 3726, 'ratio': 0.02007531817515666, 'nb_photo': 1, 'list_port_cont': '26714006', 'assoc_port': '26713945:26714006', 'assoc_mat': '26713945:Carton_brun:3726:26714006'}, {'unwanted_material': 'ela', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 5.732080497007787e-05, 'nb_photo': 5, 'list_port_cont': '26573867,26576694,26730022,26999834', 'assoc_port': '26573203:26573867,26576341:26576694,26691892:26730022,26999690:26999834', 'assoc_mat': '26573203:ela:4207:26573867,26576341:ela:4207:26576694,26691892:ela:4207:26730022,26999690:ela:4207:26999834'}, {'unwanted_material': 'etiquette', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 0.00031300842563893673, 'nb_photo': 1269, 'list_port_cont': '26388527,26389886,26398971,26399245,26399417,26405096,26405573,26407171,26415152,26420006,26420115,26420610,26430040,26436082,26438677,26438724,26443010,26444241,26444332,26446126,26454468,26457560,26457758,26463998,26466420,26481104,26483595,26484322,26484581,26494660,26497505,26512934,26513980,26514029,26514107,26517217,26518876,26519042,26532851,26534819,26548700,26553019,26554689,26554781,26554832,26557665,26557807,26558026,26570488,26570694,26573521,26573694,26573864,26576531,26576690,26577675,26577732,26588346,26594602,26594873,26594997,26595509,26596445,26602666,26603057,26603567,26604926,26606013,26606149,26607082,26607194,26608769,26608984,26610484,26610534,26613438,26613542,26613559,26614043,26614668,26615679,26630586,26631595,26638979,26639144,26641796,26649807,26649997,26651311,26658696,26659757,26660192,26660401,26666946,26668253,26681771,26681932,26684373,26684475,26691916,26704755,26706701,26712943,26712998,26714166,26717087,26717125,26723599,26724385,26724419,26724474,26724624,26724867,2672487', 'assoc_port': '26388354:26389886,26388368:26388527,26397832:26398971,26397834:26399245,26397852:26399417,26404026:26405096,26404326:26405573,26406975:26407171,26415090:26415152,26419971:26420115,26419972:26420006,26420599:26420610,26429657:26430040,26435868:26438677,26435869:26438724,26435878:26436082,26442935:26443010,26444023:26446126,26444027:26444332,26444030:26444241,26450292:26454468,26453924:26457560,26453929:26457758,26458908:26463998,26466363:26466420,26481003:26483595,26481008:26484322,26481010:26484581,26481012:26481104,26491584:26518876,26491586:26519042,26493013:26512934,26494594:26494660,26494595:26513980,26494598:26514029,26497230:26497505,26497233:26517217,26504679:26514107,26532812:26532851,26534766:26548700,26534767:26534819,26548454:26554689,26552896:26553019,26554752:26557665,26554753:26557807,26554754:26558026,26554755:26554832,26554756:26554781,26566356:26570488,26566357:26570694,26573203:26573864,26573228:26573521,26573229:26573694,26574867:26577732,26574890:26577675,26576341:26576690,26576343:2657653', 'assoc_mat': '26388354:etiquette:4207:26389886,26388368:etiquette:4207:26388527,26397832:etiquette:4207:26398971,26397834:etiquette:4207:26399245,26397852:etiquette:4207:26399417,26404026:etiquette:4207:26405096,26404326:etiquette:4207:26405573,26406975:etiquette:4207:26407171,26415090:etiquette:4207:26415152,26419971:etiquette:4207:26420115,26419972:etiquette:4207:26420006,26420599:etiquette:4207:26420610,26429657:etiquette:4207:26430040,26435868:etiquette:4207:26438677,26435869:etiquette:4207:26438724,26435878:etiquette:4207:26436082,26442935:etiquette:4207:26443010,26444023:etiquette:4207:26446126,26444027:etiquette:4207:26444332,26444030:etiquette:4207:26444241,26450292:etiquette:4207:26454468,26453924:etiquette:4207:26457560,26453929:etiquette:4207:26457758,26458908:etiquette:4207:26463998,26466363:etiquette:4207:26466420,26481003:etiquette:4207:26483595,26481008:etiquette:4207:26484322,26481010:etiquette:4207:26484581,26481012:etiquette:4207:26481104,26491584:etiquette:4207:26518876,26491586:etiquette:4207:26519042,2'}, {'unwanted_material': 'film_plastique', 'main_material': 'film_pedb', 'pht_type': 4461, 'ratio': 0.9158985426908046, 'nb_photo': 1034, 'list_port_cont': '26390743,26390825,26390883,26395524,26409881,26427485,26435989,26438401,26438530,26444140,26462849,26478485,26481152,26487702,26490751,26494653,26497341,26531236,26548522,26548883,26574932,26576430,26587814,26587984,26591918,26604938,26604960,26605922,26608013,26610417,26613915,26629385,26639023,26639119,26657613,26658273,26677790,26680813,26684403,26690902,26691022,26722953,26727873,26761315,26787922,26799719,26807740,26824175,26828547,26828875,26832975,26850530,26853447,26866789,26866837,26890601,26902288,26905851,26906125,26910232,26945646,26955532,26964797,26997264,27003937,27039146,27047071', 'assoc_port': '26390634:26390883,26390638:26390825,26390643:26390743,26395437:26395524,26409705:26409881,26427268:26427485,26435875:26435989,26438215:26438530,26438217:26438401,26444031:26444140,26453931:26462849,26478211:26478485,26481007:26481152,26487615:26487702,26490662:26490751,26494596:26494653,26497248:26497341,26531220:26531236,26548445:26548522,26548468:26548883,26574911:26574932,26576342:26576430,26587712:26587984,26587714:26587814,26591763:26591918,26604826:26604938,26604827:26604960,26605868:26605922,26607891:26608013,26610353:26610417,26613876:26613915,26629341:26629385,26638965:26639119,26638967:26639023,26649075:26657613,26658032:26658273,26677709:26677790,26680701:26680813,26684303:26684403,26690807:26691022,26690810:26690902,26722881:26722953,26727637:26727873,26761142:26761315,26787636:26787922,26799535:26799719,26807540:26807740,26824129:26824175,26828460:26828547,26828801:26828875,26832917:26832975,26850412:26850530,26853355:26853447,26866562:26866837,26866563:26866789,26890526:26890601,26902186:2690228', 'assoc_mat': '26390634:film_plastique:4461:26390883,26390638:film_plastique:4461:26390825,26390643:film_plastique:4461:26390743,26395437:film_plastique:4461:26395524,26409705:film_plastique:4461:26409881,26427268:film_plastique:4461:26427485,26435875:film_plastique:4461:26435989,26438215:film_plastique:4461:26438530,26438217:film_plastique:4461:26438401,26444031:film_plastique:4461:26444140,26453931:film_plastique:4461:26462849,26478211:film_plastique:4461:26478485,26481007:film_plastique:4461:26481152,26487615:film_plastique:4461:26487702,26490662:film_plastique:4461:26490751,26494596:film_plastique:4461:26494653,26497248:film_plastique:4461:26497341,26531220:film_plastique:4461:26531236,26548445:film_plastique:4461:26548522,26548468:film_plastique:4461:26548883,26574911:film_plastique:4461:26574932,26576342:film_plastique:4461:26576430,26587712:film_plastique:4461:26587984,26587714:film_plastique:4461:26587814,26591763:film_plastique:4461:26591918,26604826:film_plastique:4461:26604938,26604827:film_plastique:4461:2660496'}, {'unwanted_material': 'film_plastique', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 0.006449629101592603, 'nb_photo': 17967, 'list_port_cont': '26388535,26389561,26389759,26389894,26390976,26390992,26393668,26395681,26395720,26398970,26399249,26399410,26405086,26405567,26407175,26411059,26415163,26415481,26420004,26420126,26420602,26428196,26429740,26430035,26436083,26436115,26438309,26438577,26438667,26438716,26438807,26438861,26443008,26444252,26444340,26446130,26454466,26457562,26457767,26457942,26463996,26464217,26466422,26481112,26481755,26481893,26482085,26483599,26483802,26484066,26484311,26484579,26484953,26487317,26487362,26487683,26491687,26494666,26497506,26512939,26513978,26514014,26514112,26517205,26517317,26517504,26518865,26519038,26532853,26534809,26547030,26548038,26548694,26553027,26554597,26554691,26554762,26554786,26554811,26554825,26554850,26554908,26554977,26555120,26557660,26557797,26558031,26569563,26570494,26570687,26573512,26573699,26573870,26576411,26576517,26576691,26576885,26577630,26577667,26577724,26588079,26588349,26594614,26594795,26594808,26594822,26594863,26595001,26595114,26595281,26595490,26595500,26595633,2659645', 'assoc_port': '26388352:26389561,26388353:26389759,26388354:26389894,26388368:26388535,26390639:26390992,26390642:26390976,26393344:26393668,26395436:26395720,26395438:26395681,26397832:26398970,26397834:26399249,26397852:26399410,26404026:26405086,26404326:26405567,26406975:26407175,26409706:26411059,26415088:26415481,26415090:26415163,26419971:26420126,26419972:26420004,26420599:26420602,26427266:26428196,26429657:26430035,26429660:26429740,26435868:26438667,26435869:26438716,26435872:26438807,26435874:26438861,26435877:26436115,26435878:26436083,26438216:26438577,26438218:26438309,26442935:26443008,26444023:26446130,26444027:26444340,26444030:26444252,26450292:26454466,26453924:26457562,26453929:26457767,26453932:26457942,26458908:26463996,26458928:26464217,26466363:26466422,26478210:26481755,26478212:26481893,26478213:26482085,26481003:26483599,26481004:26483802,26481006:26484066,26481008:26484311,26481010:26484579,26481012:26481112,26481013:26484953,26487185:26487362,26487188:26487317,26487614:26487683,26491584:2651886', 'assoc_mat': '26388352:film_plastique:4207:26389561,26388353:film_plastique:4207:26389759,26388354:film_plastique:4207:26389894,26388368:film_plastique:4207:26388535,26390639:film_plastique:4207:26390992,26390642:film_plastique:4207:26390976,26393344:film_plastique:4207:26393668,26395436:film_plastique:4207:26395720,26395438:film_plastique:4207:26395681,26397832:film_plastique:4207:26398970,26397834:film_plastique:4207:26399249,26397852:film_plastique:4207:26399410,26404026:film_plastique:4207:26405086,26404326:film_plastique:4207:26405567,26406975:film_plastique:4207:26407175,26409706:film_plastique:4207:26411059,26415088:film_plastique:4207:26415481,26415090:film_plastique:4207:26415163,26419971:film_plastique:4207:26420126,26419972:film_plastique:4207:26420004,26420599:film_plastique:4207:26420602,26427266:film_plastique:4207:26428196,26429657:film_plastique:4207:26430035,26429660:film_plastique:4207:26429740,26435868:film_plastique:4207:26438667,26435869:film_plastique:4207:26438716,26435872:film_plastique:4207:2643880'}, {'unwanted_material': 'kraft', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 0.00013092845221580632, 'nb_photo': 26, 'list_port_cont': '26497503,26569572,26576519,26576688,26595495,26603577,26610537,26613570,26614037,26615680,26641800,26729869,26734795,26800745,26831515,26997286,26998441,27040685,27041401,27056231', 'assoc_port': '26497230:26497503,26566371:26569572,26576341:26576688,26576343:26576519,26589313:26595495,26602936:26603577,26610350:26610537,26613402:26613570,26613856:26614037,26615603:26615680,26638959:26641800,26716824:26734795,26729065:26729869,26787617:26800745,26831416:26831515,26997178:26998441,26997180:26997286,27040463:27040685,27041275:27041401,27054724:27056231', 'assoc_mat': '26497230:kraft:4207:26497503,26566371:kraft:4207:26569572,26576341:kraft:4207:26576688,26576343:kraft:4207:26576519,26589313:kraft:4207:26595495,26602936:kraft:4207:26603577,26610350:kraft:4207:26610537,26613402:kraft:4207:26613570,26613856:kraft:4207:26614037,26615603:kraft:4207:26615680,26638959:kraft:4207:26641800,26716824:kraft:4207:26734795,26729065:kraft:4207:26729869,26787617:kraft:4207:26800745,26831416:kraft:4207:26831515,26997178:kraft:4207:26998441,26997180:kraft:4207:26997286,27040463:kraft:4207:27040685,27041275:kraft:4207:27041401,27054724:kraft:4207:27056231'}, {'unwanted_material': 'metal', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 0.007564132999268331, 'nb_photo': 2940, 'list_port_cont': '26388525,26389562,26389760,26389887,26390993,26391140,26393673,26395688,26398980,26399254,26399414,26405087,26405574,26407172,26411054,26415161,26415473,26420009,26420105,26420608,26428200,26430030,26438243,26438317,26438669,26438726,26438811,26443009,26444244,26444333,26446122,26454465,26457565,26457764,26457939,26463993,26466426,26481118,26483600,26484323,26484583,26484945,26487353,26487692,26491694,26494655,26497492,26512931,26513976,26514026,26514108,26517209,26517310,26517514,26518871,26532861,26534814,26547041,26548688,26553017,26554596,26554693,26554778,26554816,26554836,26554854,26554909,26554975,26555108,26557656,26557796,26558038,26569575,26570486,26570690,26573517,26573700,26573869,26576529,26576697,26577671,26577728,26588351,26594612,26594793,26594875,26594993,26595286,26595491,26595507,26596455,26596763,26601813,26602674,26603064,26603581,26604920,26605093,26606158,26606186,26606418,26606687,26607090,26607197,26608774,26608972,26609152,26609205,26610453,26610488,26610538,26613439,26613549,2661356', 'assoc_port': '26388352:26389562,26388353:26389760,26388354:26389887,26388368:26388525,26390635:26391140,26390639:26390993,26393344:26393673,26395438:26395688,26397832:26398980,26397834:26399254,26397852:26399414,26404026:26405087,26404326:26405574,26406975:26407172,26409706:26411054,26415088:26415473,26415090:26415161,26419971:26420105,26419972:26420009,26420599:26420608,26427266:26428200,26429657:26430030,26435868:26438669,26435869:26438726,26435872:26438811,26438218:26438317,26438220:26438243,26442935:26443009,26444023:26446122,26444027:26444333,26444030:26444244,26450292:26454465,26453924:26457565,26453929:26457764,26453932:26457939,26458908:26463993,26466363:26466426,26481003:26483600,26481008:26484323,26481010:26484583,26481012:26481118,26481013:26484945,26487185:26487353,26487614:26487692,26491584:26518871,26491588:26491694,26493013:26512931,26494594:26494655,26494595:26513976,26494598:26514026,26497230:26497492,26497233:26517209,26497247:26517310,26504678:26517514,26504679:26514108,26532812:26532861,26534757:2654704', 'assoc_mat': '26388352:metal:4207:26389562,26388353:metal:4207:26389760,26388354:metal:4207:26389887,26388368:metal:4207:26388525,26390635:metal:4207:26391140,26390639:metal:4207:26390993,26393344:metal:4207:26393673,26395438:metal:4207:26395688,26397832:metal:4207:26398980,26397834:metal:4207:26399254,26397852:metal:4207:26399414,26404026:metal:4207:26405087,26404326:metal:4207:26405574,26406975:metal:4207:26407172,26409706:metal:4207:26411054,26415088:metal:4207:26415473,26415090:metal:4207:26415161,26419971:metal:4207:26420105,26419972:metal:4207:26420009,26420599:metal:4207:26420608,26427266:metal:4207:26428200,26429657:metal:4207:26430030,26435868:metal:4207:26438669,26435869:metal:4207:26438726,26435872:metal:4207:26438811,26438218:metal:4207:26438317,26438220:metal:4207:26438243,26442935:metal:4207:26443009,26444023:metal:4207:26446122,26444027:metal:4207:26444333,26444030:metal:4207:26444244,26450292:metal:4207:26454465,26453924:metal:4207:26457565,26453929:metal:4207:26457764,26453932:metal:4207:26457939,26458908:'}, {'unwanted_material': 'metal', 'main_material': 'refus', 'pht_type': 3594, 'ratio': 0.0005562321468011147, 'nb_photo': 251, 'list_port_cont': '26388454,26388984,26390788,26395879,26398304,26398722,26404170,26404700,26406724,26430214,26436170,26438394,26444506,26444652,26445444,26450475,26454603,26455124,26459017,26481274,26481699,26491832,26533588,26535089,26550036,26566468,26575314,26575768,26588130,26589165,26593891,26601916,26605164,26605455,26605766,26609197,26610592,26611514,26613461,26629600,26631351,26649551,26650384,26658572,26666562,26679886,26680766,26684341,26686132,26724321,26724788,26725302,26725491,26726944,26727790,26728375,26728782,26753207,26761734,26788574,26788895,26790258,26792644,26793580,26795043,26798292,26799884,26802099,26827469,26828481,26829083,26843345,26850575,26851196,26863120,26884042,26890340,26892156,26895430,26902338,26903698,26932131,26945243,26949340,26957604,26960033,26968713,26969102,26970344,26994995,26998237,27000802,27002324,27007596,27039975,27040562,27041384,27041606,27047037,27047165', 'assoc_port': '26388367:26388984,26388369:26388454,26390641:26390788,26395440:26395879,26397835:26398722,26397837:26398304,26404029:26404700,26404030:26404170,26406524:26406724,26429659:26430214,26435870:26436170,26438219:26438394,26444024:26445444,26444026:26444652,26444034:26444506,26450291:26450475,26453906:26455124,26453927:26454603,26458929:26459017,26481011:26481699,26481032:26481274,26491587:26491832,26532805:26533588,26534764:26535089,26548449:26550036,26566359:26566468,26574888:26575768,26574891:26575314,26587707:26589165,26587709:26593891,26587711:26588130,26601766:26601916,26604829:26605766,26604830:26605455,26604831:26605164,26607883:26609197,26609510:26610592,26610351:26611514,26613406:26613461,26629342:26629600,26631054:26631351,26649069:26649551,26649947:26650384,26658004:26658572,26666423:26666562,26677710:26679886,26680700:26680766,26684306:26684341,26685910:26686132,26690816:26728782,26691894:26728375,26697949:26727790,26713963:26726944,26716830:26725491,26717897:26725302,26722888:26724788,26724007:2672432', 'assoc_mat': '26388367:metal:3594:26388984,26388369:metal:3594:26388454,26390641:metal:3594:26390788,26395440:metal:3594:26395879,26397835:metal:3594:26398722,26397837:metal:3594:26398304,26404029:metal:3594:26404700,26404030:metal:3594:26404170,26406524:metal:3594:26406724,26429659:metal:3594:26430214,26435870:metal:3594:26436170,26438219:metal:3594:26438394,26444024:metal:3594:26445444,26444026:metal:3594:26444652,26444034:metal:3594:26444506,26450291:metal:3594:26450475,26453906:metal:3594:26455124,26453927:metal:3594:26454603,26458929:metal:3594:26459017,26481011:metal:3594:26481699,26481032:metal:3594:26481274,26491587:metal:3594:26491832,26532805:metal:3594:26533588,26534764:metal:3594:26535089,26548449:metal:3594:26550036,26566359:metal:3594:26566468,26574888:metal:3594:26575768,26574891:metal:3594:26575314,26587707:metal:3594:26589165,26587709:metal:3594:26593891,26587711:metal:3594:26588130,26601766:metal:3594:26601916,26604829:metal:3594:26605766,26604830:metal:3594:26605455,26604831:metal:3594:26605164,26607883:'}, {'unwanted_material': 'papier', 'main_material': 'film_pedb', 'pht_type': 4461, 'ratio': 0.0911536273404687, 'nb_photo': 3921, 'list_port_cont': '26390738,26390818,26390882,26395525,26409895,26427490,26435994,26438407,26438532,26444147,26462861,26478483,26481153,26487716,26490754,26494643,26497339,26531247,26548520,26548870,26574930,26576428,26587822,26587976,26591907,26604948,26604967,26605910,26608020,26610406,26613919,26629384,26639035,26639116,26657622,26658267,26677783,26680805,26684413,26690904,26691023,26722945,26727879,26761308,26787920,26799715,26807742,26824162,26828540,26828876,26832977,26850517,26853458,26866778,26866866,26890594,26902290,26905860,26906117,26910246,26945650,26955547,26964802,26997256,27003940,27039143,27047067', 'assoc_port': '26390634:26390882,26390638:26390818,26390643:26390738,26395437:26395525,26409705:26409895,26427268:26427490,26435875:26435994,26438215:26438532,26438217:26438407,26444031:26444147,26453931:26462861,26478211:26478483,26481007:26481153,26487615:26487716,26490662:26490754,26494596:26494643,26497248:26497339,26531220:26531247,26548445:26548520,26548468:26548870,26574911:26574930,26576342:26576428,26587712:26587976,26587714:26587822,26591763:26591907,26604826:26604948,26604827:26604967,26605868:26605910,26607891:26608020,26610353:26610406,26613876:26613919,26629341:26629384,26638965:26639116,26638967:26639035,26649075:26657622,26658032:26658267,26677709:26677783,26680701:26680805,26684303:26684413,26690807:26691023,26690810:26690904,26722881:26722945,26727637:26727879,26761142:26761308,26787636:26787920,26799535:26799715,26807540:26807742,26824129:26824162,26828460:26828540,26828801:26828876,26832917:26832977,26850412:26850517,26853355:26853458,26866562:26866866,26866563:26866778,26890526:26890594,26902186:2690229', 'assoc_mat': '26390634:papier:4461:26390882,26390638:papier:4461:26390818,26390643:papier:4461:26390738,26395437:papier:4461:26395525,26409705:papier:4461:26409895,26427268:papier:4461:26427490,26435875:papier:4461:26435994,26438215:papier:4461:26438532,26438217:papier:4461:26438407,26444031:papier:4461:26444147,26453931:papier:4461:26462861,26478211:papier:4461:26478483,26481007:papier:4461:26481153,26487615:papier:4461:26487716,26490662:papier:4461:26490754,26494596:papier:4461:26494643,26497248:papier:4461:26497339,26531220:papier:4461:26531247,26548445:papier:4461:26548520,26548468:papier:4461:26548870,26574911:papier:4461:26574930,26576342:papier:4461:26576428,26587712:papier:4461:26587976,26587714:papier:4461:26587822,26591763:papier:4461:26591907,26604826:papier:4461:26604948,26604827:papier:4461:26604967,26605868:papier:4461:26605910,26607891:papier:4461:26608020,26610353:papier:4461:26610406,26613876:papier:4461:26613919,26629341:papier:4461:26629384,26638965:papier:4461:26639116,26638967:papier:4461:26639035,2664'}, {'unwanted_material': 'papier', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 0.007630341529969927, 'nb_photo': 27216, 'list_port_cont': '26388533,26389571,26389756,26389896,26390966,26391002,26391142,26391217,26393665,26395682,26395709,26398975,26399244,26399415,26405088,26405569,26407174,26411053,26415160,26415484,26420000,26420114,26420601,26428194,26429747,26430037,26436085,26436113,26438239,26438311,26438567,26438675,26438731,26438818,26443016,26444242,26444336,26446136,26454456,26457561,26457762,26457933,26464000,26464208,26466416,26481105,26481743,26481902,26482087,26483603,26483801,26484065,26484309,26484580,26484949,26487319,26487363,26487688,26491695,26494667,26497494,26512932,26513977,26514013,26514118,26517202,26517316,26517517,26518862,26519044,26532852,26534823,26547027,26548035,26548695,26553031,26554604,26554698,26554758,26554777,26554820,26554824,26554842,26554917,26554981,26555115,26557669,26557798,26558040,26569576,26570493,26570684,26573520,26573696,26573872,26576413,26576540,26576689,26576897,26577635,26577677,26577726,26588083,26588358,26594615,26594788,26594811,26594868,26594996,26595107,26595288,26595479,26595496,2659563', 'assoc_port': '26388352:26389571,26388353:26389756,26388354:26389896,26388368:26388533,26390635:26391142,26390637:26391217,26390639:26391002,26390642:26390966,26393344:26393665,26395436:26395709,26395438:26395682,26397832:26398975,26397834:26399244,26397852:26399415,26404026:26405088,26404326:26405569,26406975:26407174,26409706:26411053,26415088:26415484,26415090:26415160,26419971:26420114,26419972:26420000,26420599:26420601,26427266:26428194,26429657:26430037,26429660:26429747,26435868:26438675,26435869:26438731,26435872:26438818,26435877:26436113,26435878:26436085,26438216:26438567,26438218:26438311,26438220:26438239,26442935:26443016,26444023:26446136,26444027:26444336,26444030:26444242,26450292:26454456,26453924:26457561,26453929:26457762,26453932:26457933,26458908:26464000,26458928:26464208,26466363:26466416,26478210:26481743,26478212:26481902,26478213:26482087,26481003:26483603,26481004:26483801,26481006:26484065,26481008:26484309,26481010:26484580,26481012:26481105,26481013:26484949,26487185:26487363,26487188:2648731', 'assoc_mat': '26388352:papier:4207:26389571,26388353:papier:4207:26389756,26388354:papier:4207:26389896,26388368:papier:4207:26388533,26390635:papier:4207:26391142,26390637:papier:4207:26391217,26390639:papier:4207:26391002,26390642:papier:4207:26390966,26393344:papier:4207:26393665,26395436:papier:4207:26395709,26395438:papier:4207:26395682,26397832:papier:4207:26398975,26397834:papier:4207:26399244,26397852:papier:4207:26399415,26404026:papier:4207:26405088,26404326:papier:4207:26405569,26406975:papier:4207:26407174,26409706:papier:4207:26411053,26415088:papier:4207:26415484,26415090:papier:4207:26415160,26419971:papier:4207:26420114,26419972:papier:4207:26420000,26420599:papier:4207:26420601,26427266:papier:4207:26428194,26429657:papier:4207:26430037,26429660:papier:4207:26429747,26435868:papier:4207:26438675,26435869:papier:4207:26438731,26435872:papier:4207:26438818,26435877:papier:4207:26436113,26435878:papier:4207:26436085,26438216:papier:4207:26438567,26438218:papier:4207:26438311,26438220:papier:4207:26438239,2644'}, {'unwanted_material': 'papier', 'main_material': 'pet_clair', 'pht_type': 3327, 'ratio': 0.03659740777764293, 'nb_photo': 4, 'list_port_cont': '26723051', 'assoc_port': '26722892:26723051', 'assoc_mat': '26722892:papier:3327:26723051'}, {'unwanted_material': 'papier', 'main_material': 'refus', 'pht_type': 3594, 'ratio': 0.01789364747742476, 'nb_photo': 5437, 'list_port_cont': '26388449,26388978,26390790,26395878,26396941,26398306,26398729,26404169,26404703,26406722,26409928,26430220,26436161,26436371,26438043,26438387,26440729,26444151,26444509,26444653,26445445,26450482,26454086,26454600,26455122,26459011,26478299,26478820,26481280,26481703,26482048,26482627,26487383,26487501,26490710,26491828,26493286,26494889,26497403,26497577,26531317,26533584,26535094,26547995,26548625,26549197,26550043,26550454,26552692,26566464,26575311,26575767,26576796,26587948,26588131,26588558,26589161,26593892,26596199,26601926,26605163,26605457,26605610,26605764,26609189,26610586,26611513,26613457,26629601,26630007,26630166,26631359,26639070,26639673,26639866,26649552,26650392,26652892,26658577,26661144,26666565,26666869,26677540,26679881,26680085,26680764,26681138,26684345,26684523,26686136,26723545,26723726,26724044,26724235,26724315,26724435,26724787,26725092,26725294,26725501,26725925,26726183,26726439,26726943,26727077,26727798,26728051,26728366,26728778,26729254,26753210,26753663,26754273,2675671', 'assoc_port': '26388367:26388978,26388369:26388449,26390641:26390790,26395439:26396941,26395440:26395878,26397835:26398729,26397837:26398306,26404029:26404703,26404030:26404169,26406524:26406722,26409707:26409928,26429659:26430220,26435866:26436371,26435870:26436161,26435873:26438043,26438219:26438387,26440559:26440729,26444024:26445445,26444026:26444653,26444032:26444151,26444034:26444509,26450291:26450482,26453906:26455122,26453927:26454600,26453934:26454086,26458929:26459011,26478209:26478820,26478214:26478299,26481005:26482627,26481009:26482048,26481011:26481703,26481032:26481280,26487184:26487501,26487187:26490710,26487189:26487383,26491587:26491828,26493017:26493286,26494597:26494889,26497232:26497577,26497234:26497403,26531218:26531317,26532805:26533584,26534764:26535094,26541041:26547995,26548447:26550454,26548449:26550043,26548452:26552692,26548456:26549197,26548459:26548625,26566359:26566464,26574866:26576796,26574888:26575767,26574891:26575311,26587707:26589161,26587709:26593892,26587711:26588131,26587716:2658794', 'assoc_mat': '26388367:papier:3594:26388978,26388369:papier:3594:26388449,26390641:papier:3594:26390790,26395439:papier:3594:26396941,26395440:papier:3594:26395878,26397835:papier:3594:26398729,26397837:papier:3594:26398306,26404029:papier:3594:26404703,26404030:papier:3594:26404169,26406524:papier:3594:26406722,26409707:papier:3594:26409928,26429659:papier:3594:26430220,26435866:papier:3594:26436371,26435870:papier:3594:26436161,26435873:papier:3594:26438043,26438219:papier:3594:26438387,26440559:papier:3594:26440729,26444024:papier:3594:26445445,26444026:papier:3594:26444653,26444032:papier:3594:26444151,26444034:papier:3594:26444509,26450291:papier:3594:26450482,26453906:papier:3594:26455122,26453927:papier:3594:26454600,26453934:papier:3594:26454086,26458929:papier:3594:26459011,26478209:papier:3594:26478820,26478214:papier:3594:26478299,26481005:papier:3594:26482627,26481009:papier:3594:26482048,26481011:papier:3594:26481703,26481032:papier:3594:26481280,26487184:papier:3594:26487501,26487187:papier:3594:26490710,2648'}, {'unwanted_material': 'pehd', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 0.0005796457880120662, 'nb_photo': 41, 'list_port_cont': '26398982,26420607,26430031,26438727,26438810,26484073,26512940,26513982,26514115,26554827,26576521,26577727,26594994,26603569,26604924,26651305,26729855,26795783,26799266,26799605,26800737,26828527,26831518,26883104,26890749,26915087,27000279,27040115,27040674,27041411,27055884,27056241', 'assoc_port': '26397832:26398982,26420599:26420607,26429657:26430031,26435869:26438727,26435872:26438810,26481006:26484073,26493013:26512940,26494595:26513982,26504679:26514115,26554755:26554827,26574867:26577727,26576343:26576521,26587710:26594994,26602936:26603569,26604832:26604924,26649945:26651305,26729067:26729855,26787582:26799266,26787583:26799605,26787617:26800737,26794166:26795783,26828461:26828527,26831416:26831518,26882770:26883104,26890525:26890749,26910025:26915087,27000109:27000279,27038969:27040115,27040463:27040674,27041275:27041411,27054702:27055884,27054724:27056241', 'assoc_mat': '26397832:pehd:4207:26398982,26420599:pehd:4207:26420607,26429657:pehd:4207:26430031,26435869:pehd:4207:26438727,26435872:pehd:4207:26438810,26481006:pehd:4207:26484073,26493013:pehd:4207:26512940,26494595:pehd:4207:26513982,26504679:pehd:4207:26514115,26554755:pehd:4207:26554827,26574867:pehd:4207:26577727,26576343:pehd:4207:26576521,26587710:pehd:4207:26594994,26602936:pehd:4207:26603569,26604832:pehd:4207:26604924,26649945:pehd:4207:26651305,26729067:pehd:4207:26729855,26787582:pehd:4207:26799266,26787583:pehd:4207:26799605,26787617:pehd:4207:26800737,26794166:pehd:4207:26795783,26828461:pehd:4207:26828527,26831416:pehd:4207:26831518,26882770:pehd:4207:26883104,26890525:pehd:4207:26890749,26910025:pehd:4207:26915087,27000109:pehd:4207:27000279,27038969:pehd:4207:27040115,27040463:pehd:4207:27040674,27041275:pehd:4207:27041411,27054702:pehd:4207:27055884,27054724:pehd:4207:27056241'}, {'unwanted_material': 'pehd', 'main_material': 'refus', 'pht_type': 3594, 'ratio': 0.0005915037016475334, 'nb_photo': 71, 'list_port_cont': '26398299,26404706,26438396,26481696,26482049,26487388,26535095,26575312,26596200,26605162,26639676,26649549,26666559,26725099,26725500,26725927,26728776,26761733,26790259,26802415,26827473,26851199,26891682,26892155,26949337,27000808', 'assoc_port': '26397837:26398299,26404029:26404706,26438219:26438396,26481009:26482049,26481011:26481696,26487189:26487388,26534764:26535095,26574891:26575312,26594768:26596200,26604831:26605162,26639469:26639676,26649069:26649549,26666423:26666559,26690816:26728776,26690817:26725099,26716828:26725927,26716830:26725500,26761139:26761733,26787618:26802415,26787619:26790259,26827350:26827473,26850411:26851199,26891611:26892155,26891614:26891682,26946471:26949337,27000677:27000808', 'assoc_mat': '26397837:pehd:3594:26398299,26404029:pehd:3594:26404706,26438219:pehd:3594:26438396,26481009:pehd:3594:26482049,26481011:pehd:3594:26481696,26487189:pehd:3594:26487388,26534764:pehd:3594:26535095,26574891:pehd:3594:26575312,26594768:pehd:3594:26596200,26604831:pehd:3594:26605162,26639469:pehd:3594:26639676,26649069:pehd:3594:26649549,26666423:pehd:3594:26666559,26690816:pehd:3594:26728776,26690817:pehd:3594:26725099,26716828:pehd:3594:26725927,26716830:pehd:3594:26725500,26761139:pehd:3594:26761733,26787618:pehd:3594:26802415,26787619:pehd:3594:26790259,26827350:pehd:3594:26827473,26850411:pehd:3594:26851199,26891611:pehd:3594:26892155,26891614:pehd:3594:26891682,26946471:pehd:3594:26949337,27000677:pehd:3594:27000808'}, {'unwanted_material': 'pet_clair', 'main_material': 'film_pedb', 'pht_type': 4461, 'ratio': 0.002747718888392497, 'nb_photo': 1, 'list_port_cont': '26828543', 'assoc_port': '26828460:26828543', 'assoc_mat': '26828460:pet_clair:4461:26828543'}, {'unwanted_material': 'pet_clair', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 0.0028962173011650824, 'nb_photo': 1597, 'list_port_cont': '26389892,26390973,26390994,26393678,26398978,26399246,26399406,26405084,26405572,26407169,26411062,26415156,26420606,26428201,26430032,26438663,26438717,26438871,26443005,26444339,26446131,26454469,26457557,26457938,26463987,26466423,26481110,26483605,26483797,26484068,26484317,26484958,26487354,26491686,26494656,26497493,26512933,26513986,26514021,26514116,26517206,26518863,26519039,26532864,26548699,26553022,26554699,26554771,26554789,26554838,26554847,26557666,26557809,26558030,26569566,26570686,26573863,26576525,26576888,26577663,26577723,26588070,26588344,26594603,26594800,26594817,26594825,26594872,26595000,26595120,26595282,26595503,26596449,26601807,26602662,26603069,26603566,26604921,26605097,26606021,26606155,26606188,26606424,26606678,26607091,26608970,26609138,26610459,26610503,26610539,26613552,26613569,26614042,26614678,26615676,26618306,26630389,26631597,26638983,26639549,26641791,26649094,26649813,26651314,26658555,26659763,26660052,26660413,26668264,26681764,26684367,26684464,26684758,2669192', 'assoc_port': '26388354:26389892,26390639:26390994,26390642:26390973,26393344:26393678,26397832:26398978,26397834:26399246,26397852:26399406,26404026:26405084,26404326:26405572,26406975:26407169,26409706:26411062,26415090:26415156,26420599:26420606,26427266:26428201,26429657:26430032,26435868:26438663,26435869:26438717,26435874:26438871,26442935:26443005,26444023:26446131,26444027:26444339,26450292:26454469,26453924:26457557,26453932:26457938,26458908:26463987,26466363:26466423,26481003:26483605,26481004:26483797,26481006:26484068,26481008:26484317,26481012:26481110,26481013:26484958,26487185:26487354,26491584:26518863,26491586:26519039,26491588:26491686,26493013:26512933,26494594:26494656,26494595:26513986,26494598:26514021,26497230:26497493,26497233:26517206,26504679:26514116,26532812:26532864,26534766:26548699,26548454:26554699,26548458:26554771,26548462:26554847,26552896:26553022,26554752:26557666,26554753:26557809,26554754:26558030,26554755:26554838,26554756:26554789,26566357:26570686,26566371:26569566,26573203:2657386', 'assoc_mat': '26388354:pet_clair:4207:26389892,26390639:pet_clair:4207:26390994,26390642:pet_clair:4207:26390973,26393344:pet_clair:4207:26393678,26397832:pet_clair:4207:26398978,26397834:pet_clair:4207:26399246,26397852:pet_clair:4207:26399406,26404026:pet_clair:4207:26405084,26404326:pet_clair:4207:26405572,26406975:pet_clair:4207:26407169,26409706:pet_clair:4207:26411062,26415090:pet_clair:4207:26415156,26420599:pet_clair:4207:26420606,26427266:pet_clair:4207:26428201,26429657:pet_clair:4207:26430032,26435868:pet_clair:4207:26438663,26435869:pet_clair:4207:26438717,26435874:pet_clair:4207:26438871,26442935:pet_clair:4207:26443005,26444023:pet_clair:4207:26446131,26444027:pet_clair:4207:26444339,26450292:pet_clair:4207:26454469,26453924:pet_clair:4207:26457557,26453932:pet_clair:4207:26457938,26458908:pet_clair:4207:26463987,26466363:pet_clair:4207:26466423,26481003:pet_clair:4207:26483605,26481004:pet_clair:4207:26483797,26481006:pet_clair:4207:26484068,26481008:pet_clair:4207:26484317,26481012:pet_clair:4207:26481110,2'}, {'unwanted_material': 'pet_clair', 'main_material': 'pet_clair', 'pht_type': 3327, 'ratio': 0.9515060103183892, 'nb_photo': 73, 'list_port_cont': '26723046', 'assoc_port': '26722892:26723046', 'assoc_mat': '26722892:pet_clair:3327:26723046'}, {'unwanted_material': 'pet_clair', 'main_material': 'refus', 'pht_type': 3594, 'ratio': 0.06290940323697376, 'nb_photo': 4875, 'list_port_cont': '26388456,26388982,26390781,26395873,26396944,26398308,26398720,26404174,26404699,26406717,26409930,26430219,26436167,26436372,26438041,26438395,26440730,26444153,26444511,26444654,26445440,26450484,26454084,26454607,26455114,26459009,26478303,26478821,26481279,26481695,26482047,26482632,26487382,26487495,26490707,26491826,26493290,26494885,26497396,26497573,26531318,26533591,26535087,26547996,26548626,26549193,26550037,26550455,26552690,26566471,26575315,26575771,26576794,26587954,26588128,26588561,26589163,26593896,26596204,26601919,26605158,26605464,26605608,26605761,26609193,26610595,26611516,26613453,26629602,26630003,26630164,26631348,26639069,26639670,26639869,26649203,26649556,26650390,26652894,26658573,26661137,26666564,26666868,26677533,26679888,26680081,26680762,26681144,26684344,26684528,26686141,26723548,26723719,26724051,26724242,26724317,26724440,26724789,26725100,26725300,26725495,26725928,26726178,26726434,26726936,26727080,26727794,26728041,26728369,26728786,26729248,26753205,26753659,2675428', 'assoc_port': '26388367:26388982,26388369:26388456,26390641:26390781,26395439:26396944,26395440:26395873,26397835:26398720,26397837:26398308,26404029:26404699,26404030:26404174,26406524:26406717,26409707:26409930,26429659:26430219,26435866:26436372,26435870:26436167,26435873:26438041,26438219:26438395,26440559:26440730,26444024:26445440,26444026:26444654,26444032:26444153,26444034:26444511,26450291:26450484,26453906:26455114,26453927:26454607,26453934:26454084,26458929:26459009,26478209:26478821,26478214:26478303,26481005:26482632,26481009:26482047,26481011:26481695,26481032:26481279,26487184:26487495,26487187:26490707,26487189:26487382,26491587:26491826,26493017:26493290,26494597:26494885,26497232:26497573,26497234:26497396,26531218:26531318,26532805:26533591,26534764:26535087,26541041:26547996,26548447:26550455,26548449:26550037,26548452:26552690,26548456:26549193,26548459:26548626,26566359:26566471,26574866:26576794,26574888:26575771,26574891:26575315,26587707:26589163,26587709:26593896,26587711:26588128,26587716:2658795', 'assoc_mat': '26388367:pet_clair:3594:26388982,26388369:pet_clair:3594:26388456,26390641:pet_clair:3594:26390781,26395439:pet_clair:3594:26396944,26395440:pet_clair:3594:26395873,26397835:pet_clair:3594:26398720,26397837:pet_clair:3594:26398308,26404029:pet_clair:3594:26404699,26404030:pet_clair:3594:26404174,26406524:pet_clair:3594:26406717,26409707:pet_clair:3594:26409930,26429659:pet_clair:3594:26430219,26435866:pet_clair:3594:26436372,26435870:pet_clair:3594:26436167,26435873:pet_clair:3594:26438041,26438219:pet_clair:3594:26438395,26440559:pet_clair:3594:26440730,26444024:pet_clair:3594:26445440,26444026:pet_clair:3594:26444654,26444032:pet_clair:3594:26444153,26444034:pet_clair:3594:26444511,26450291:pet_clair:3594:26450484,26453906:pet_clair:3594:26455114,26453927:pet_clair:3594:26454607,26453934:pet_clair:3594:26454084,26458929:pet_clair:3594:26459009,26478209:pet_clair:3594:26478821,26478214:pet_clair:3594:26478303,26481005:pet_clair:3594:26482632,26481009:pet_clair:3594:26482047,26481011:pet_clair:3594:26481695,2'}, {'unwanted_material': 'pet_fonce', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 0.00035406561329176327, 'nb_photo': 129, 'list_port_cont': '26389764,26390995,26398983,26405094,26405581,26420616,26446123,26457566,26463990,26466415,26484321,26494668,26497495,26514120,26517207,26519040,26547028,26554829,26577718,26594792,26594805,26596771,26604923,26606417,26614680,26639548,26649091,26649808,26651303,26659764,26684472,26706695,26713003,26724389,26724473,26724854,26733922,26734083,26734800,26738752,26763017,26799260,26799604,26801047,26804337,26804541,26815289,26817649,26824247,26825106,26828666,26829069,26829439,26831476,26850501,26859180,26862359,26862386,26862432,26868255,26868839,26898193,26915088,26915379,26915573,26964755,26980499,26994789,26995470,26996267,26997439,26997938,26998447,27000266,27008616,27018629,27033239,27040111,27056085,27056238', 'assoc_port': '26388353:26389764,26390639:26390995,26397832:26398983,26404026:26405094,26404326:26405581,26420599:26420616,26444023:26446123,26453924:26457566,26458908:26463990,26466363:26466415,26481008:26484321,26491586:26519040,26494594:26494668,26497230:26497495,26497233:26517207,26504679:26514120,26534757:26547028,26554755:26554829,26574867:26577718,26587706:26594792,26591762:26596771,26594770:26594805,26604832:26604923,26605863:26606417,26614594:26614680,26639468:26639548,26649066:26649808,26649076:26649091,26649945:26651303,26657985:26659764,26684300:26684472,26690781:26724473,26697944:26738752,26704713:26724854,26704714:26706695,26712867:26713003,26716824:26734800,26722884:26733922,26722889:26734083,26724004:26724389,26758309:26763017,26787582:26799260,26787583:26799604,26787623:26801047,26794162:26804541,26804237:26804337,26807537:26815289,26817470:26817649,26824134:26824247,26824840:26825106,26828459:26828666,26828799:26829439,26828803:26829069,26831420:26831476,26850410:26850501,26859101:26862359,26859103:2686243', 'assoc_mat': '26388353:pet_fonce:4207:26389764,26390639:pet_fonce:4207:26390995,26397832:pet_fonce:4207:26398983,26404026:pet_fonce:4207:26405094,26404326:pet_fonce:4207:26405581,26420599:pet_fonce:4207:26420616,26444023:pet_fonce:4207:26446123,26453924:pet_fonce:4207:26457566,26458908:pet_fonce:4207:26463990,26466363:pet_fonce:4207:26466415,26481008:pet_fonce:4207:26484321,26491586:pet_fonce:4207:26519040,26494594:pet_fonce:4207:26494668,26497230:pet_fonce:4207:26497495,26497233:pet_fonce:4207:26517207,26504679:pet_fonce:4207:26514120,26534757:pet_fonce:4207:26547028,26554755:pet_fonce:4207:26554829,26574867:pet_fonce:4207:26577718,26587706:pet_fonce:4207:26594792,26591762:pet_fonce:4207:26596771,26594770:pet_fonce:4207:26594805,26604832:pet_fonce:4207:26604923,26605863:pet_fonce:4207:26606417,26614594:pet_fonce:4207:26614680,26639468:pet_fonce:4207:26639548,26649066:pet_fonce:4207:26649808,26649076:pet_fonce:4207:26649091,26649945:pet_fonce:4207:26651303,26657985:pet_fonce:4207:26659764,26684300:pet_fonce:4207:26684472,2'}, {'unwanted_material': 'pet_fonce', 'main_material': 'refus', 'pht_type': 3594, 'ratio': 0.0006382317212277186, 'nb_photo': 99, 'list_port_cont': '26396945,26404702,26444648,26445443,26455116,26481700,26482040,26497401,26497572,26533592,26535085,26575313,26589168,26605166,26611522,26613456,26649205,26649553,26650386,26661146,26666556,26724785,26725097,26725503,26761727,26790252,26798290,26802423,26826800,26827475,26833321,26851198,26886927,26892162,26947587,26960043,26968716,26994508,26998767,27000800,27039972,27040870', 'assoc_port': '26395439:26396945,26404029:26404702,26444024:26445443,26444026:26444648,26453906:26455116,26481009:26482040,26481011:26481700,26497232:26497572,26497234:26497401,26532805:26533592,26534764:26535085,26574891:26575313,26587707:26589168,26604831:26605166,26610351:26611522,26613406:26613456,26649069:26649553,26649074:26649205,26649947:26650386,26658027:26661146,26666423:26666556,26690817:26725097,26716830:26725503,26722888:26724785,26761139:26761727,26787615:26798290,26787618:26802423,26787619:26790252,26826748:26826800,26827350:26827475,26832212:26833321,26850411:26851198,26882772:26886927,26891611:26892162,26946470:26947587,26957198:26960043,26964639:26968716,26994377:26994508,26996058:26998767,27000677:27000800,27038968:27039972,27038977:27040870', 'assoc_mat': '26395439:pet_fonce:3594:26396945,26404029:pet_fonce:3594:26404702,26444024:pet_fonce:3594:26445443,26444026:pet_fonce:3594:26444648,26453906:pet_fonce:3594:26455116,26481009:pet_fonce:3594:26482040,26481011:pet_fonce:3594:26481700,26497232:pet_fonce:3594:26497572,26497234:pet_fonce:3594:26497401,26532805:pet_fonce:3594:26533592,26534764:pet_fonce:3594:26535085,26574891:pet_fonce:3594:26575313,26587707:pet_fonce:3594:26589168,26604831:pet_fonce:3594:26605166,26610351:pet_fonce:3594:26611522,26613406:pet_fonce:3594:26613456,26649069:pet_fonce:3594:26649553,26649074:pet_fonce:3594:26649205,26649947:pet_fonce:3594:26650386,26658027:pet_fonce:3594:26661146,26666423:pet_fonce:3594:26666556,26690817:pet_fonce:3594:26725097,26716830:pet_fonce:3594:26725503,26722888:pet_fonce:3594:26724785,26761139:pet_fonce:3594:26761727,26787615:pet_fonce:3594:26798290,26787618:pet_fonce:3594:26802423,26787619:pet_fonce:3594:26790252,26826748:pet_fonce:3594:26826800,26827350:pet_fonce:3594:26827475,26832212:pet_fonce:3594:26833321,2'}, {'unwanted_material': 'pet_opaque', 'main_material': 'film_pedb', 'pht_type': 4461, 'ratio': 0.0048721482851135775, 'nb_photo': 4, 'list_port_cont': '26409892,26548885,26639031,26799717', 'assoc_port': '26409705:26409892,26548468:26548885,26638967:26639031,26799535:26799717', 'assoc_mat': '26409705:pet_opaque:4461:26409892,26548468:pet_opaque:4461:26548885,26638967:pet_opaque:4461:26639031,26799535:pet_opaque:4461:26799717'}, {'unwanted_material': 'pet_opaque', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 0.003552800640912029, 'nb_photo': 791, 'list_port_cont': '26390967,26390991,26398981,26399403,26405081,26405579,26411052,26415166,26420104,26420609,26429742,26430039,26436086,26436108,26438673,26438820,26438863,26443017,26444334,26446134,26454458,26457563,26457768,26463985,26481899,26483796,26484310,26494658,26512930,26514022,26514119,26517211,26517320,26517510,26518867,26519043,26532858,26534816,26548697,26553023,26554701,26554766,26554788,26554837,26554852,26554919,26554989,26555118,26557663,26557801,26558029,26570697,26573514,26573697,26573868,26576511,26576693,26576898,26577639,26577719,26588078,26588359,26594610,26594809,26594828,26594870,26595289,26595506,26596454,26596757,26602672,26603066,26603574,26604922,26606144,26606180,26606428,26607085,26607191,26608768,26608983,26609143,26609208,26610456,26610497,26610533,26613540,26613561,26614041,26614672,26615686,26630383,26631594,26639153,26639482,26639544,26640140,26641797,26642084,26642549,26649103,26651308,26658171,26659770,26660065,26660411,26668248,26668255,26677835,26681934,26684364,26684476,26684753,2669192', 'assoc_port': '26390639:26390991,26390642:26390967,26397832:26398981,26397852:26399403,26404026:26405081,26404326:26405579,26409706:26411052,26415090:26415166,26419971:26420104,26420599:26420609,26429657:26430039,26429660:26429742,26435868:26438673,26435872:26438820,26435874:26438863,26435877:26436108,26435878:26436086,26442935:26443017,26444023:26446134,26444027:26444334,26450292:26454458,26453924:26457563,26453929:26457768,26458908:26463985,26478212:26481899,26481004:26483796,26481008:26484310,26491584:26518867,26491586:26519043,26493013:26512930,26494594:26494658,26494598:26514022,26497233:26517211,26497247:26517320,26504678:26517510,26504679:26514119,26532812:26532858,26534766:26548697,26534767:26534816,26548454:26554701,26548458:26554766,26548462:26554852,26548465:26554919,26548466:26554989,26548469:26555118,26552896:26553023,26554752:26557663,26554753:26557801,26554754:26558029,26554755:26554837,26554756:26554788,26566357:26570697,26573203:26573868,26573228:26573514,26573229:26573697,26574867:26577719,26574897:2657763', 'assoc_mat': '26390639:pet_opaque:4207:26390991,26390642:pet_opaque:4207:26390967,26397832:pet_opaque:4207:26398981,26397852:pet_opaque:4207:26399403,26404026:pet_opaque:4207:26405081,26404326:pet_opaque:4207:26405579,26409706:pet_opaque:4207:26411052,26415090:pet_opaque:4207:26415166,26419971:pet_opaque:4207:26420104,26420599:pet_opaque:4207:26420609,26429657:pet_opaque:4207:26430039,26429660:pet_opaque:4207:26429742,26435868:pet_opaque:4207:26438673,26435872:pet_opaque:4207:26438820,26435874:pet_opaque:4207:26438863,26435877:pet_opaque:4207:26436108,26435878:pet_opaque:4207:26436086,26442935:pet_opaque:4207:26443017,26444023:pet_opaque:4207:26446134,26444027:pet_opaque:4207:26444334,26450292:pet_opaque:4207:26454458,26453924:pet_opaque:4207:26457563,26453929:pet_opaque:4207:26457768,26458908:pet_opaque:4207:26463985,26478212:pet_opaque:4207:26481899,26481004:pet_opaque:4207:26483796,26481008:pet_opaque:4207:26484310,26491584:pet_opaque:4207:26518867,26491586:pet_opaque:4207:26519043,26493013:pet_opaque:4207:26512930,2649'}, {'unwanted_material': 'Teint_Dans_La_Masse', 'main_material': 'jrm', 'pht_type': 3726, 'ratio': 0.004877121661567973, 'nb_photo': 2, 'list_port_cont': '26714012', 'assoc_port': '26713945:26714012', 'assoc_mat': '26713945:Teint_Dans_La_Masse:3726:26714012'}, {'unwanted_material': 'textiles_sanitaires', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 7.080002124002662e-05, 'nb_photo': 42, 'list_port_cont': '26399412,26405090,26420611,26443014,26466424,26481113,26483607,26497498,26518864,26548032,26548686,26570695,26573857,26577725,26595510,26596442,26613543,26615689,26641793,26668256,26684370,26734798,26738751,26772710,26868838,26869104,26899162,26915567,26980488,27055877,27056081', 'assoc_port': '26397852:26399412,26404026:26405090,26420599:26420611,26442935:26443014,26466363:26466424,26481003:26483607,26481012:26481113,26491584:26518864,26497230:26497498,26534758:26548032,26534766:26548686,26566357:26570695,26573203:26573857,26574867:26577725,26589313:26595510,26596416:26596442,26613401:26613543,26615603:26615689,26638959:26641793,26666424:26668256,26684307:26684370,26697944:26738751,26716824:26734798,26772140:26772710,26866557:26868838,26866561:26869104,26891608:26899162,26910035:26915567,26980192:26980488,27054702:27055877,27054723:27056081', 'assoc_mat': '26397852:textiles_sanitaires:4207:26399412,26404026:textiles_sanitaires:4207:26405090,26420599:textiles_sanitaires:4207:26420611,26442935:textiles_sanitaires:4207:26443014,26466363:textiles_sanitaires:4207:26466424,26481003:textiles_sanitaires:4207:26483607,26481012:textiles_sanitaires:4207:26481113,26491584:textiles_sanitaires:4207:26518864,26497230:textiles_sanitaires:4207:26497498,26534758:textiles_sanitaires:4207:26548032,26534766:textiles_sanitaires:4207:26548686,26566357:textiles_sanitaires:4207:26570695,26573203:textiles_sanitaires:4207:26573857,26574867:textiles_sanitaires:4207:26577725,26589313:textiles_sanitaires:4207:26595510,26596416:textiles_sanitaires:4207:26596442,26613401:textiles_sanitaires:4207:26613543,26615603:textiles_sanitaires:4207:26615689,26638959:textiles_sanitaires:4207:26641793,26666424:textiles_sanitaires:4207:26668256,26684307:textiles_sanitaires:4207:26684370,26697944:textiles_sanitaires:4207:26738751,26716824:textiles_sanitaires:4207:26734798,26772140:textiles_sanitaires:4207:2'}) select count(distinct mtr_photo_id) from MTRUser.mtr_portfolio_photos where mtr_portfolio_id in (select mtr_portfolio_id from MTRPhoto.dashboard_results where dashboard_run_id in(2221899,2229547,2237005,2242939,2250301,2253843,2254595,2262551,2269243,2277699,2283193,2289855,2293261,2293599,2301213,2309617,2317497,2325191,2332853,2335407)); after get_hostname_from_raspi hasthag : pcnc hasthag that could be used but not yet : _______carton,background SELECT substr(hashtag,8), substr(date_debut,1,7) as month, (sum(qualite*nombre_balle)/sum(nombre_balle)) FROM MTRPhoto.dashboard_results WHERE hashtag = '_______pcnc' and mtr_portfolio_id in (select id FROM MTRUser.mtr_portfolios where mtr_user_id=1042) and qualite >=0 and dashboard_run_id in (select last_run_id from MTRPhoto.dashboard_entry_day where dashboard_place_id=94 and date >='2025-09-01' and date <= '2025-09-30') GROUP BY month order by month; hasthag : film_pedb hasthag that could be used but not yet : _______film_plastique SELECT substr(hashtag,8), substr(date_debut,1,7) as month, (sum(qualite*nombre_balle)/sum(nombre_balle)) FROM MTRPhoto.dashboard_results WHERE hashtag = '_______film_pedb' and mtr_portfolio_id in (select id FROM MTRUser.mtr_portfolios where mtr_user_id=1042) and qualite >=0 and dashboard_run_id in (select last_run_id from MTRPhoto.dashboard_entry_day where dashboard_place_id=94 and date >='2025-09-01' and date <= '2025-09-30') GROUP BY month order by month; hasthag : refus hasthag that could be used but not yet : _______refus,background SELECT substr(hashtag,8), substr(date_debut,1,7) as month, (sum(qualite*nombre_balle)/sum(nombre_balle)) FROM MTRPhoto.dashboard_results WHERE hashtag = '_______refus' and mtr_portfolio_id in (select id FROM MTRUser.mtr_portfolios where mtr_user_id=1042) and qualite >=0 and dashboard_run_id in (select last_run_id from MTRPhoto.dashboard_entry_day where dashboard_place_id=94 and date >='2025-09-01' and date <= '2025-09-30') GROUP BY month order by month; hasthag : jrm hasthag that could be used but not yet : _______papier,background SELECT substr(hashtag,8), substr(date_debut,1,7) as month, (sum(qualite*nombre_balle)/sum(nombre_balle)) FROM MTRPhoto.dashboard_results WHERE hashtag = '_______jrm' and mtr_portfolio_id in (select id FROM MTRUser.mtr_portfolios where mtr_user_id=1042) and qualite >=0 and dashboard_run_id in (select last_run_id from MTRPhoto.dashboard_entry_day where dashboard_place_id=94 and date >='2025-09-01' and date <= '2025-09-30') GROUP BY month order by month; hasthag : pet_clair hasthag that could be used but not yet : _______pet_clair,bouchon,etiquette,barquette_avec_film,background SELECT substr(hashtag,8), substr(date_debut,1,7) as month, (sum(qualite*nombre_balle)/sum(nombre_balle)) FROM MTRPhoto.dashboard_results WHERE hashtag = '_______pet_clair' and mtr_portfolio_id in (select id FROM MTRUser.mtr_portfolios where mtr_user_id=1042) and qualite >=0 and dashboard_run_id in (select last_run_id from MTRPhoto.dashboard_entry_day where dashboard_place_id=94 and date >='2025-09-01' and date <= '2025-09-30') GROUP BY month order by month; after impurety_average_per_hashtag {'number_of_analysed_photos': ((37215,),), 'unwanted_material_monthly_percentage': ((0.036292015522133174,),), 'material_repartition': (('pcnc', 32099), ('refus', 3995), ('film_pedb', 1104), ('pet_clair', 9), ('jrm', 8)), 'material_dict': {'pcnc': 32099, 'refus': 3995, 'autres': 1121}, 'coverage_data': (('2025/09/20/', 0.0), ('2025/09/19/', 0.0), ('2025/09/18/', 0.0), ('2025/09/17/', 0.0), ('2025/09/16/', 0.0), ('2025/09/15/', 0.0), ('2025/09/13/', 0.0), ('2025/09/12/', 0.0), ('2025/09/11/', 0.0), ('2025/09/10/', 0.0), ('2025/09/09/', 0.0), ('2025/09/08/', 0.0), ('2025/09/06/', 0.0), ('2025/09/05/', 0.0), ('2025/09/04/', 0.0), ('2025/09/03/', 0.0), ('2025/09/02/', 0.0), ('2025/09/01/', 0.0)), 'impurety_average_data': ((datetime.date(2025, 9, 1), 0.042373614667356, 20), (datetime.date(2025, 9, 2), 0.033328603340253074, 16), (datetime.date(2025, 9, 3), 0.03838334346467932, 130), (datetime.date(2025, 9, 4), 0.028390163134892867, 84), (datetime.date(2025, 9, 5), 0.03284800120418105, 31), (datetime.date(2025, 9, 6), 0.040440254915649426, 30), (datetime.date(2025, 9, 7), 0.004321662791239028, 14), (datetime.date(2025, 9, 8), 0.03975604841424327, 197), (datetime.date(2025, 9, 9), 0.037487706885625936, 28), (datetime.date(2025, 9, 10), 0.04346982142992465, 143), (datetime.date(2025, 9, 11), 0.032644025628419934, 32), (datetime.date(2025, 9, 12), 0.03339808547942257, 226), (datetime.date(2025, 9, 13), 0.027403135827115982, 71), (datetime.date(2025, 9, 14), 0.004624411403925293, 12), (datetime.date(2025, 9, 15), 0.029898571900308858, 135), (datetime.date(2025, 9, 16), 0.03958460425501454, 138), (datetime.date(2025, 9, 17), 0.040388862838240745, 122), (datetime.date(2025, 9, 18), 0.03820287508394967, 64), (datetime.date(2025, 9, 19), 0.03619439669811114, 11)), 'impurety_average_data_per_hashtag': {'pcnc': ((datetime.date(2025, 9, 1), 0.03249371686250528, 20), (datetime.date(2025, 9, 2), 0.02332150974776004, 16), (datetime.date(2025, 9, 3), 0.03051213120072261, 130), (datetime.date(2025, 9, 4), 0.022949801899620686, 84), (datetime.date(2025, 9, 5), 0.027080380361735087, 31), (datetime.date(2025, 9, 6), 0.0349156961031441, 30), (datetime.date(2025, 9, 7), 0.004321662791239028, 14), (datetime.date(2025, 9, 8), 0.031415459254594214, 197), (datetime.date(2025, 9, 9), 0.029064521973250077, 28), (datetime.date(2025, 9, 10), 0.03682100938986683, 143), (datetime.date(2025, 9, 11), 0.026274812964725894, 32), (datetime.date(2025, 9, 12), 0.02537819266456874, 226), (datetime.date(2025, 9, 13), 0.020449513658222975, 71), (datetime.date(2025, 9, 14), 0.004624411403925293, 12), (datetime.date(2025, 9, 15), 0.020916676167879192, 135), (datetime.date(2025, 9, 16), 0.028810122224800328, 138), (datetime.date(2025, 9, 17), 0.025443515822153668, 108), (datetime.date(2025, 9, 18), 0.029619413062166818, 64), (datetime.date(2025, 9, 19), 0.02481319636144952, 11)), 'film_pedb': ((datetime.date(2025, 9, 1), 0.0892693395087305, 13), (datetime.date(2025, 9, 2), 0.07340605571443365, 12), (datetime.date(2025, 9, 3), 0.07116679217824619, 9), (datetime.date(2025, 9, 4), 0.06574014922882049, 8), (datetime.date(2025, 9, 5), 0.06627348786755716, 13), (datetime.date(2025, 9, 6), 0.058856515875085016, 8), (datetime.date(2025, 9, 8), 0.07170955883332084, 8), (datetime.date(2025, 9, 9), 0.07453127010316209, 9), (datetime.date(2025, 9, 10), 0.10899179764984966, 20), (datetime.date(2025, 9, 11), 0.11132801669835199, 25), (datetime.date(2025, 9, 12), 0.07960383854181884, 24), (datetime.date(2025, 9, 13), 0.06551343712753274, 9), (datetime.date(2025, 9, 15), 0.06433345876354286, 39), (datetime.date(2025, 9, 16), 0.0985849655479817, 32), (datetime.date(2025, 9, 17), 0.08730092647842554, 10), (datetime.date(2025, 9, 18), 0.08151115755023078, 21), (datetime.date(2025, 9, 19), 0.07396449393517394, 26)), 'refus': ((datetime.date(2025, 9, 1), 0.11807340029761905, 9), (datetime.date(2025, 9, 2), 0.09630416943782245, 66), (datetime.date(2025, 9, 3), 0.11545823339654918, 9), (datetime.date(2025, 9, 4), 0.08894689527936056, 11), (datetime.date(2025, 9, 5), 0.10595636267185747, 22), (datetime.date(2025, 9, 6), 0.10955163317722387, 10), (datetime.date(2025, 9, 8), 0.08459122384970293, 12), (datetime.date(2025, 9, 9), 0.10157206131718047, 9), (datetime.date(2025, 9, 10), 0.09457640879320262, 11), (datetime.date(2025, 9, 11), 0.07806329125228623, 9), (datetime.date(2025, 9, 12), 0.07412083605751107, 16), (datetime.date(2025, 9, 13), 0.07233777839696692, 13), (datetime.date(2025, 9, 15), 0.06981710443081969, 19), (datetime.date(2025, 9, 16), 0.09557568725792785, 17), (datetime.date(2025, 9, 17), 0.1003637493194216, 122), (datetime.date(2025, 9, 18), 0.08243006539050443, 11), (datetime.date(2025, 9, 19), 0.1053389766719845, 10)), 'jrm': ((datetime.date(2025, 9, 10), 0.12233618812838642, 8),), 'pet_clair': ((datetime.date(2025, 9, 10), 0.04849398968161079, 9),)}, 'quality_array': [['0.6583970907452947', '01092025'], ['0.7314433881715517', '02092025'], ['0.45122153500532036', '03092025'], ['0.47498165405430615', '04092025'], ['0.77518921230246', '05092025'], ['0.792182020028259', '06092025'], ['2.165162455202924', '07092025'], ['0.5277763474210418', '08092025'], ['0.5954286791315171', '09092025'], ['0.7540664835239836', '10092025'], ['0.5886605238829048', '11092025'], ['0.5463592328288531', '12092025'], ['0.551973477408286', '13092025'], ['3.3869562326296503', '14092025'], ['0.3947553447259551', '15092025'], ['0.3586337759005362', '16092025'], ['0.9006281665226135', '17092025'], ['0.1863699269306064', '18092025'], ['0.39046027711096276', '19092025']], 'number_of_batch': ((752,),), 'datou_id_sts': 4101, 'map_hashtag_number_mat': {'hash_to_mat_nb': ({'unwanted_material': 'autre', 'main_material': 'pet_clair', 'pht_type': 3327, 'ratio': 0.0010705069599419859, 'nb_photo': 1, 'list_port_cont': '26723047', 'assoc_port': '26722892:26723047', 'assoc_mat': '26722892:autre:3327:26723047'}, {'unwanted_material': 'autre', 'main_material': 'refus', 'pht_type': 3594, 'ratio': 0.001604984101442466, 'nb_photo': 569, 'list_port_cont': '26388448,26390786,26396949,26398301,26398725,26404171,26404705,26406727,26409925,26430216,26436373,26444502,26444649,26445437,26450485,26454080,26454606,26455118,26459010,26481276,26481694,26482046,26487493,26490709,26491830,26493293,26497404,26497571,26533585,26535088,26547997,26548618,26550042,26552691,26566469,26575317,26576787,26587955,26588559,26589160,26593897,26596205,26601922,26605159,26605462,26605765,26609187,26610594,26611515,26613451,26630009,26630168,26631358,26639072,26639674,26639875,26649548,26650391,26652891,26661142,26666561,26666872,26680086,26680769,26681143,26686135,26723725,26724791,26725094,26725496,26725921,26726946,26727074,26727789,26728046,26728785,26729250,26753204,26756717,26761730,26788573,26788896,26789221,26790253,26791389,26793224,26794521,26798288,26799885,26800998,26802419,26807675,26823741,26826795,26827472,26828482,26829080,26830529,26832960,26833315,26833716,26843353,26843712,26845983,26850569,26850752,26851200,26851939,26853897,26862257,26862565,26862859,26863127,2686673', 'assoc_port': '26388369:26388448,26390641:26390786,26395439:26396949,26397835:26398725,26397837:26398301,26404029:26404705,26404030:26404171,26406524:26406727,26409707:26409925,26429659:26430216,26435866:26436373,26444024:26445437,26444026:26444649,26444034:26444502,26450291:26450485,26453906:26455118,26453927:26454606,26453934:26454080,26458929:26459010,26481009:26482046,26481011:26481694,26481032:26481276,26487184:26487493,26487187:26490709,26491587:26491830,26493017:26493293,26497232:26497571,26497234:26497404,26532805:26533585,26534764:26535088,26541041:26547997,26548449:26550042,26548452:26552691,26548459:26548618,26566359:26566469,26574866:26576787,26574891:26575317,26587707:26589160,26587709:26593897,26587716:26587955,26588293:26588559,26594768:26596205,26601766:26601922,26604829:26605765,26604830:26605462,26604831:26605159,26607883:26609187,26609510:26610594,26610351:26611515,26613406:26613451,26629339:26630168,26629340:26630009,26631054:26631358,26638960:26639072,26639467:26639875,26639469:26639674,26649069:2664954', 'assoc_mat': '26388369:autre:3594:26388448,26390641:autre:3594:26390786,26395439:autre:3594:26396949,26397835:autre:3594:26398725,26397837:autre:3594:26398301,26404029:autre:3594:26404705,26404030:autre:3594:26404171,26406524:autre:3594:26406727,26409707:autre:3594:26409925,26429659:autre:3594:26430216,26435866:autre:3594:26436373,26444024:autre:3594:26445437,26444026:autre:3594:26444649,26444034:autre:3594:26444502,26450291:autre:3594:26450485,26453906:autre:3594:26455118,26453927:autre:3594:26454606,26453934:autre:3594:26454080,26458929:autre:3594:26459010,26481009:autre:3594:26482046,26481011:autre:3594:26481694,26481032:autre:3594:26481276,26487184:autre:3594:26487493,26487187:autre:3594:26490709,26491587:autre:3594:26491830,26493017:autre:3594:26493293,26497232:autre:3594:26497571,26497234:autre:3594:26497404,26532805:autre:3594:26533585,26534764:autre:3594:26535088,26541041:autre:3594:26547997,26548449:autre:3594:26550042,26548452:autre:3594:26552691,26548459:autre:3594:26548618,26566359:autre:3594:26566469,26574866:'}, {'unwanted_material': 'autre_refus', 'main_material': 'jrm', 'pht_type': 3726, 'ratio': 0.03659626103142702, 'nb_photo': 1, 'list_port_cont': '26714010', 'assoc_port': '26713945:26714010', 'assoc_mat': '26713945:autre_refus:3726:26714010'}, {'unwanted_material': 'barquette_opaque', 'main_material': 'film_pedb', 'pht_type': 4461, 'ratio': 0.007205310780105326, 'nb_photo': 5, 'list_port_cont': '26576424,26680804,26828541,26866781,26906115', 'assoc_port': '26576342:26576424,26680701:26680804,26828460:26828541,26866563:26866781,26905513:26906115', 'assoc_mat': '26576342:barquette_opaque:4461:26576424,26680701:barquette_opaque:4461:26680804,26828460:barquette_opaque:4461:26828541,26866563:barquette_opaque:4461:26866781,26905513:barquette_opaque:4461:26906115'}, {'unwanted_material': 'barquette_opaque', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 0.0027677355068840637, 'nb_photo': 6006, 'list_port_cont': '26388532,26389563,26389762,26389893,26390975,26390999,26391133,26391213,26395690,26395713,26398976,26399243,26399413,26405095,26405570,26407167,26411057,26415151,26415470,26420010,26420110,26420615,26428195,26429743,26430038,26436078,26436120,26438229,26438316,26438574,26438674,26438721,26438812,26438868,26443004,26444245,26444342,26446135,26454459,26457559,26457763,26457936,26463988,26464214,26466418,26481103,26481745,26481896,26482094,26483596,26483795,26484064,26484313,26484572,26484950,26487318,26487359,26491691,26494654,26497496,26512942,26513974,26514023,26514113,26517215,26517315,26517508,26518870,26519041,26532865,26534818,26547039,26548037,26548684,26553021,26554610,26554692,26554768,26554776,26554828,26554844,26554922,26554976,26555109,26557664,26557810,26558027,26569570,26570481,26570696,26573513,26573702,26573858,26576535,26576687,26576886,26577640,26577673,26577720,26588347,26594609,26594796,26594812,26594865,26595109,26595277,26595486,26595501,26595635,26596446,26596758,26602670,26603065,2660357', 'assoc_port': '26388352:26389563,26388353:26389762,26388354:26389893,26388368:26388532,26390635:26391133,26390637:26391213,26390639:26390999,26390642:26390975,26395436:26395713,26395438:26395690,26397832:26398976,26397834:26399243,26397852:26399413,26404026:26405095,26404326:26405570,26406975:26407167,26409706:26411057,26415088:26415470,26415090:26415151,26419971:26420110,26419972:26420010,26420599:26420615,26427266:26428195,26429657:26430038,26429660:26429743,26435868:26438674,26435869:26438721,26435872:26438812,26435874:26438868,26435877:26436120,26435878:26436078,26438216:26438574,26438218:26438316,26438220:26438229,26442935:26443004,26444023:26446135,26444027:26444342,26444030:26444245,26450292:26454459,26453924:26457559,26453929:26457763,26453932:26457936,26458908:26463988,26458928:26464214,26466363:26466418,26478210:26481745,26478212:26481896,26478213:26482094,26481003:26483596,26481004:26483795,26481006:26484064,26481008:26484313,26481010:26484572,26481012:26481103,26481013:26484950,26487185:26487359,26487188:2648731', 'assoc_mat': '26388352:barquette_opaque:4207:26389563,26388353:barquette_opaque:4207:26389762,26388354:barquette_opaque:4207:26389893,26388368:barquette_opaque:4207:26388532,26390635:barquette_opaque:4207:26391133,26390637:barquette_opaque:4207:26391213,26390639:barquette_opaque:4207:26390999,26390642:barquette_opaque:4207:26390975,26395436:barquette_opaque:4207:26395713,26395438:barquette_opaque:4207:26395690,26397832:barquette_opaque:4207:26398976,26397834:barquette_opaque:4207:26399243,26397852:barquette_opaque:4207:26399413,26404026:barquette_opaque:4207:26405095,26404326:barquette_opaque:4207:26405570,26406975:barquette_opaque:4207:26407167,26409706:barquette_opaque:4207:26411057,26415088:barquette_opaque:4207:26415470,26415090:barquette_opaque:4207:26415151,26419971:barquette_opaque:4207:26420110,26419972:barquette_opaque:4207:26420010,26420599:barquette_opaque:4207:26420615,26427266:barquette_opaque:4207:26428195,26429657:barquette_opaque:4207:26430038,26429660:barquette_opaque:4207:26429743,26435868:barquette_opaqu'}, {'unwanted_material': 'carton', 'main_material': 'film_pedb', 'pht_type': 4461, 'ratio': 0.004167282241694771, 'nb_photo': 102, 'list_port_cont': '26390813,26390880,26395535,26409894,26427489,26435998,26438399,26438536,26462851,26481155,26490759,26497345,26548531,26548874,26574926,26576435,26587828,26591922,26613921,26639112,26658262,26690903,26722946,26727884,26761302,26787927,26807739,26828880,26832983,26850529,26866775,26890593,26902293,26905865,26906112,26910224,26945645,26955542,26964803,27003926,27039141,27047069', 'assoc_port': '26390634:26390880,26390638:26390813,26395437:26395535,26409705:26409894,26427268:26427489,26435875:26435998,26438215:26438536,26438217:26438399,26453931:26462851,26481007:26481155,26490662:26490759,26497248:26497345,26548445:26548531,26548468:26548874,26574911:26574926,26576342:26576435,26587714:26587828,26591763:26591922,26613876:26613921,26638965:26639112,26658032:26658262,26690810:26690903,26722881:26722946,26727637:26727884,26761142:26761302,26787636:26787927,26807540:26807739,26828801:26828880,26832917:26832983,26850412:26850529,26866563:26866775,26890526:26890593,26902186:26902293,26905513:26906112,26905517:26905865,26910032:26910224,26945365:26955542,26945366:26945645,26964643:26964803,27003816:27003926,27038970:27039141,27046878:27047069', 'assoc_mat': '26390634:carton:4461:26390880,26390638:carton:4461:26390813,26395437:carton:4461:26395535,26409705:carton:4461:26409894,26427268:carton:4461:26427489,26435875:carton:4461:26435998,26438215:carton:4461:26438536,26438217:carton:4461:26438399,26453931:carton:4461:26462851,26481007:carton:4461:26481155,26490662:carton:4461:26490759,26497248:carton:4461:26497345,26548445:carton:4461:26548531,26548468:carton:4461:26548874,26574911:carton:4461:26574926,26576342:carton:4461:26576435,26587714:carton:4461:26587828,26591763:carton:4461:26591922,26613876:carton:4461:26613921,26638965:carton:4461:26639112,26658032:carton:4461:26658262,26690810:carton:4461:26690903,26722881:carton:4461:26722946,26727637:carton:4461:26727884,26761142:carton:4461:26761302,26787636:carton:4461:26787927,26807540:carton:4461:26807739,26828801:carton:4461:26828880,26832917:carton:4461:26832983,26850412:carton:4461:26850529,26866563:carton:4461:26866775,26890526:carton:4461:26890593,26902186:carton:4461:26902293,26905513:carton:4461:26906112,2690'}, {'unwanted_material': 'carton', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 0.9757636265286489, 'nb_photo': 6589, 'list_port_cont': '26388521,26389572,26389767,26389899,26391001,26391218,26393664,26395687,26398977,26399248,26399416,26405082,26405580,26407168,26415159,26415478,26420002,26420113,26420605,26429739,26430041,26436076,26436110,26438230,26438310,26438571,26438670,26438725,26438821,26443019,26444253,26444337,26446121,26454462,26457551,26457765,26457934,26463999,26464207,26466431,26481116,26481742,26481904,26482088,26483598,26484316,26484578,26484955,26487325,26487352,26487699,26494662,26497491,26512935,26513973,26514020,26514111,26517212,26517515,26518872,26519035,26532860,26534822,26547040,26548692,26553018,26554601,26554688,26554772,26554780,26554823,26554835,26554840,26554914,26554990,26557654,26557794,26558034,26569564,26570483,26570688,26573523,26573695,26573859,26576410,26576533,26577730,26588345,26594605,26594813,26594832,26594866,26594999,26595113,26595291,26595489,26595508,26595631,26596443,26596766,26601816,26602676,26603056,26603579,26604931,26605092,26606008,26606154,26606190,26606429,26606681,26607084,26607184,2660809', 'assoc_port': '26388352:26389572,26388353:26389767,26388354:26389899,26388368:26388521,26390637:26391218,26390639:26391001,26393344:26393664,26395438:26395687,26397832:26398977,26397834:26399248,26397852:26399416,26404026:26405082,26404326:26405580,26406975:26407168,26415088:26415478,26415090:26415159,26419971:26420113,26419972:26420002,26420599:26420605,26429657:26430041,26429660:26429739,26435868:26438670,26435869:26438725,26435872:26438821,26435877:26436110,26435878:26436076,26438216:26438571,26438218:26438310,26438220:26438230,26442935:26443019,26444023:26446121,26444027:26444337,26444030:26444253,26450292:26454462,26453924:26457551,26453929:26457765,26453932:26457934,26458908:26463999,26458928:26464207,26466363:26466431,26478210:26481742,26478212:26481904,26478213:26482088,26481003:26483598,26481008:26484316,26481010:26484578,26481012:26481116,26481013:26484955,26487185:26487352,26487188:26487325,26487614:26487699,26491584:26518872,26491586:26519035,26493013:26512935,26494594:26494662,26494595:26513973,26494598:2651402', 'assoc_mat': '26388352:carton:4207:26389572,26388353:carton:4207:26389767,26388354:carton:4207:26389899,26388368:carton:4207:26388521,26390637:carton:4207:26391218,26390639:carton:4207:26391001,26393344:carton:4207:26393664,26395438:carton:4207:26395687,26397832:carton:4207:26398977,26397834:carton:4207:26399248,26397852:carton:4207:26399416,26404026:carton:4207:26405082,26404326:carton:4207:26405580,26406975:carton:4207:26407168,26415088:carton:4207:26415478,26415090:carton:4207:26415159,26419971:carton:4207:26420113,26419972:carton:4207:26420002,26420599:carton:4207:26420605,26429657:carton:4207:26430041,26429660:carton:4207:26429739,26435868:carton:4207:26438670,26435869:carton:4207:26438725,26435872:carton:4207:26438821,26435877:carton:4207:26436110,26435878:carton:4207:26436076,26438216:carton:4207:26438571,26438218:carton:4207:26438310,26438220:carton:4207:26438230,26442935:carton:4207:26443019,26444023:carton:4207:26446121,26444027:carton:4207:26444337,26444030:carton:4207:26444253,26450292:carton:4207:26454462,2645'}, {'unwanted_material': 'carton', 'main_material': 'pet_clair', 'pht_type': 3327, 'ratio': 0.010826074944025878, 'nb_photo': 1, 'list_port_cont': '26723054', 'assoc_port': '26722892:26723054', 'assoc_mat': '26722892:carton:3327:26723054'}, {'unwanted_material': 'carton', 'main_material': 'refus', 'pht_type': 3594, 'ratio': 0.011012671675260769, 'nb_photo': 1288, 'list_port_cont': '26388457,26388977,26390780,26395877,26398303,26398719,26404166,26404696,26406726,26409932,26430213,26436160,26436365,26438393,26440731,26444150,26444501,26444656,26445446,26450478,26454085,26454596,26455115,26459008,26478297,26478818,26481275,26481704,26482045,26482628,26487385,26487497,26490708,26491836,26493287,26494883,26497405,26497567,26531309,26533586,26535091,26547994,26548631,26549196,26550040,26566465,26575310,26575765,26576791,26587947,26588560,26589169,26593899,26596197,26601917,26605161,26605456,26605605,26605758,26609194,26610593,26611521,26613460,26629606,26630005,26630171,26631356,26639073,26639677,26639867,26649208,26649555,26650387,26652889,26658567,26661139,26666555,26666876,26677531,26679884,26680082,26680763,26684338,26684533,26686138,26723547,26723720,26724048,26724241,26724314,26724784,26725093,26725293,26725502,26725923,26726176,26726429,26726939,26727079,26727797,26728045,26728781,26729246,26753206,26753665,26754279,26756708,26761729,26772904,26788094,26788569,26788894,26789224,2679025', 'assoc_port': '26388367:26388977,26388369:26388457,26390641:26390780,26395440:26395877,26397835:26398719,26397837:26398303,26404029:26404696,26404030:26404166,26406524:26406726,26409707:26409932,26429659:26430213,26435866:26436365,26435870:26436160,26438219:26438393,26440559:26440731,26444024:26445446,26444026:26444656,26444032:26444150,26444034:26444501,26450291:26450478,26453906:26455115,26453927:26454596,26453934:26454085,26458929:26459008,26478209:26478818,26478214:26478297,26481005:26482628,26481009:26482045,26481011:26481704,26481032:26481275,26487184:26487497,26487187:26490708,26487189:26487385,26491587:26491836,26493017:26493287,26494597:26494883,26497232:26497567,26497234:26497405,26531218:26531309,26532805:26533586,26534764:26535091,26541041:26547994,26548449:26550040,26548456:26549196,26548459:26548631,26566359:26566465,26574866:26576791,26574888:26575765,26574891:26575310,26587707:26589169,26587709:26593899,26587716:26587947,26588293:26588560,26594768:26596197,26601766:26601917,26604828:26605605,26604829:2660575', 'assoc_mat': '26388367:carton:3594:26388977,26388369:carton:3594:26388457,26390641:carton:3594:26390780,26395440:carton:3594:26395877,26397835:carton:3594:26398719,26397837:carton:3594:26398303,26404029:carton:3594:26404696,26404030:carton:3594:26404166,26406524:carton:3594:26406726,26409707:carton:3594:26409932,26429659:carton:3594:26430213,26435866:carton:3594:26436365,26435870:carton:3594:26436160,26438219:carton:3594:26438393,26440559:carton:3594:26440731,26444024:carton:3594:26445446,26444026:carton:3594:26444656,26444032:carton:3594:26444150,26444034:carton:3594:26444501,26450291:carton:3594:26450478,26453906:carton:3594:26455115,26453927:carton:3594:26454596,26453934:carton:3594:26454085,26458929:carton:3594:26459008,26478209:carton:3594:26478818,26478214:carton:3594:26478297,26481005:carton:3594:26482628,26481009:carton:3594:26482045,26481011:carton:3594:26481704,26481032:carton:3594:26481275,26487184:carton:3594:26487497,26487187:carton:3594:26490708,26487189:carton:3594:26487385,26491587:carton:3594:26491836,2649'}, {'unwanted_material': 'Carton_brun', 'main_material': 'jrm', 'pht_type': 3726, 'ratio': 0.02007531817515666, 'nb_photo': 1, 'list_port_cont': '26714006', 'assoc_port': '26713945:26714006', 'assoc_mat': '26713945:Carton_brun:3726:26714006'}, {'unwanted_material': 'ela', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 5.732080497007787e-05, 'nb_photo': 5, 'list_port_cont': '26573867,26576694,26730022,26999834', 'assoc_port': '26573203:26573867,26576341:26576694,26691892:26730022,26999690:26999834', 'assoc_mat': '26573203:ela:4207:26573867,26576341:ela:4207:26576694,26691892:ela:4207:26730022,26999690:ela:4207:26999834'}, {'unwanted_material': 'etiquette', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 0.00031300842563893673, 'nb_photo': 1269, 'list_port_cont': '26388527,26389886,26398971,26399245,26399417,26405096,26405573,26407171,26415152,26420006,26420115,26420610,26430040,26436082,26438677,26438724,26443010,26444241,26444332,26446126,26454468,26457560,26457758,26463998,26466420,26481104,26483595,26484322,26484581,26494660,26497505,26512934,26513980,26514029,26514107,26517217,26518876,26519042,26532851,26534819,26548700,26553019,26554689,26554781,26554832,26557665,26557807,26558026,26570488,26570694,26573521,26573694,26573864,26576531,26576690,26577675,26577732,26588346,26594602,26594873,26594997,26595509,26596445,26602666,26603057,26603567,26604926,26606013,26606149,26607082,26607194,26608769,26608984,26610484,26610534,26613438,26613542,26613559,26614043,26614668,26615679,26630586,26631595,26638979,26639144,26641796,26649807,26649997,26651311,26658696,26659757,26660192,26660401,26666946,26668253,26681771,26681932,26684373,26684475,26691916,26704755,26706701,26712943,26712998,26714166,26717087,26717125,26723599,26724385,26724419,26724474,26724624,26724867,2672487', 'assoc_port': '26388354:26389886,26388368:26388527,26397832:26398971,26397834:26399245,26397852:26399417,26404026:26405096,26404326:26405573,26406975:26407171,26415090:26415152,26419971:26420115,26419972:26420006,26420599:26420610,26429657:26430040,26435868:26438677,26435869:26438724,26435878:26436082,26442935:26443010,26444023:26446126,26444027:26444332,26444030:26444241,26450292:26454468,26453924:26457560,26453929:26457758,26458908:26463998,26466363:26466420,26481003:26483595,26481008:26484322,26481010:26484581,26481012:26481104,26491584:26518876,26491586:26519042,26493013:26512934,26494594:26494660,26494595:26513980,26494598:26514029,26497230:26497505,26497233:26517217,26504679:26514107,26532812:26532851,26534766:26548700,26534767:26534819,26548454:26554689,26552896:26553019,26554752:26557665,26554753:26557807,26554754:26558026,26554755:26554832,26554756:26554781,26566356:26570488,26566357:26570694,26573203:26573864,26573228:26573521,26573229:26573694,26574867:26577732,26574890:26577675,26576341:26576690,26576343:2657653', 'assoc_mat': '26388354:etiquette:4207:26389886,26388368:etiquette:4207:26388527,26397832:etiquette:4207:26398971,26397834:etiquette:4207:26399245,26397852:etiquette:4207:26399417,26404026:etiquette:4207:26405096,26404326:etiquette:4207:26405573,26406975:etiquette:4207:26407171,26415090:etiquette:4207:26415152,26419971:etiquette:4207:26420115,26419972:etiquette:4207:26420006,26420599:etiquette:4207:26420610,26429657:etiquette:4207:26430040,26435868:etiquette:4207:26438677,26435869:etiquette:4207:26438724,26435878:etiquette:4207:26436082,26442935:etiquette:4207:26443010,26444023:etiquette:4207:26446126,26444027:etiquette:4207:26444332,26444030:etiquette:4207:26444241,26450292:etiquette:4207:26454468,26453924:etiquette:4207:26457560,26453929:etiquette:4207:26457758,26458908:etiquette:4207:26463998,26466363:etiquette:4207:26466420,26481003:etiquette:4207:26483595,26481008:etiquette:4207:26484322,26481010:etiquette:4207:26484581,26481012:etiquette:4207:26481104,26491584:etiquette:4207:26518876,26491586:etiquette:4207:26519042,2'}, {'unwanted_material': 'film_plastique', 'main_material': 'film_pedb', 'pht_type': 4461, 'ratio': 0.9158985426908046, 'nb_photo': 1034, 'list_port_cont': '26390743,26390825,26390883,26395524,26409881,26427485,26435989,26438401,26438530,26444140,26462849,26478485,26481152,26487702,26490751,26494653,26497341,26531236,26548522,26548883,26574932,26576430,26587814,26587984,26591918,26604938,26604960,26605922,26608013,26610417,26613915,26629385,26639023,26639119,26657613,26658273,26677790,26680813,26684403,26690902,26691022,26722953,26727873,26761315,26787922,26799719,26807740,26824175,26828547,26828875,26832975,26850530,26853447,26866789,26866837,26890601,26902288,26905851,26906125,26910232,26945646,26955532,26964797,26997264,27003937,27039146,27047071', 'assoc_port': '26390634:26390883,26390638:26390825,26390643:26390743,26395437:26395524,26409705:26409881,26427268:26427485,26435875:26435989,26438215:26438530,26438217:26438401,26444031:26444140,26453931:26462849,26478211:26478485,26481007:26481152,26487615:26487702,26490662:26490751,26494596:26494653,26497248:26497341,26531220:26531236,26548445:26548522,26548468:26548883,26574911:26574932,26576342:26576430,26587712:26587984,26587714:26587814,26591763:26591918,26604826:26604938,26604827:26604960,26605868:26605922,26607891:26608013,26610353:26610417,26613876:26613915,26629341:26629385,26638965:26639119,26638967:26639023,26649075:26657613,26658032:26658273,26677709:26677790,26680701:26680813,26684303:26684403,26690807:26691022,26690810:26690902,26722881:26722953,26727637:26727873,26761142:26761315,26787636:26787922,26799535:26799719,26807540:26807740,26824129:26824175,26828460:26828547,26828801:26828875,26832917:26832975,26850412:26850530,26853355:26853447,26866562:26866837,26866563:26866789,26890526:26890601,26902186:2690228', 'assoc_mat': '26390634:film_plastique:4461:26390883,26390638:film_plastique:4461:26390825,26390643:film_plastique:4461:26390743,26395437:film_plastique:4461:26395524,26409705:film_plastique:4461:26409881,26427268:film_plastique:4461:26427485,26435875:film_plastique:4461:26435989,26438215:film_plastique:4461:26438530,26438217:film_plastique:4461:26438401,26444031:film_plastique:4461:26444140,26453931:film_plastique:4461:26462849,26478211:film_plastique:4461:26478485,26481007:film_plastique:4461:26481152,26487615:film_plastique:4461:26487702,26490662:film_plastique:4461:26490751,26494596:film_plastique:4461:26494653,26497248:film_plastique:4461:26497341,26531220:film_plastique:4461:26531236,26548445:film_plastique:4461:26548522,26548468:film_plastique:4461:26548883,26574911:film_plastique:4461:26574932,26576342:film_plastique:4461:26576430,26587712:film_plastique:4461:26587984,26587714:film_plastique:4461:26587814,26591763:film_plastique:4461:26591918,26604826:film_plastique:4461:26604938,26604827:film_plastique:4461:2660496'}, {'unwanted_material': 'film_plastique', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 0.006449629101592603, 'nb_photo': 17967, 'list_port_cont': '26388535,26389561,26389759,26389894,26390976,26390992,26393668,26395681,26395720,26398970,26399249,26399410,26405086,26405567,26407175,26411059,26415163,26415481,26420004,26420126,26420602,26428196,26429740,26430035,26436083,26436115,26438309,26438577,26438667,26438716,26438807,26438861,26443008,26444252,26444340,26446130,26454466,26457562,26457767,26457942,26463996,26464217,26466422,26481112,26481755,26481893,26482085,26483599,26483802,26484066,26484311,26484579,26484953,26487317,26487362,26487683,26491687,26494666,26497506,26512939,26513978,26514014,26514112,26517205,26517317,26517504,26518865,26519038,26532853,26534809,26547030,26548038,26548694,26553027,26554597,26554691,26554762,26554786,26554811,26554825,26554850,26554908,26554977,26555120,26557660,26557797,26558031,26569563,26570494,26570687,26573512,26573699,26573870,26576411,26576517,26576691,26576885,26577630,26577667,26577724,26588079,26588349,26594614,26594795,26594808,26594822,26594863,26595001,26595114,26595281,26595490,26595500,26595633,2659645', 'assoc_port': '26388352:26389561,26388353:26389759,26388354:26389894,26388368:26388535,26390639:26390992,26390642:26390976,26393344:26393668,26395436:26395720,26395438:26395681,26397832:26398970,26397834:26399249,26397852:26399410,26404026:26405086,26404326:26405567,26406975:26407175,26409706:26411059,26415088:26415481,26415090:26415163,26419971:26420126,26419972:26420004,26420599:26420602,26427266:26428196,26429657:26430035,26429660:26429740,26435868:26438667,26435869:26438716,26435872:26438807,26435874:26438861,26435877:26436115,26435878:26436083,26438216:26438577,26438218:26438309,26442935:26443008,26444023:26446130,26444027:26444340,26444030:26444252,26450292:26454466,26453924:26457562,26453929:26457767,26453932:26457942,26458908:26463996,26458928:26464217,26466363:26466422,26478210:26481755,26478212:26481893,26478213:26482085,26481003:26483599,26481004:26483802,26481006:26484066,26481008:26484311,26481010:26484579,26481012:26481112,26481013:26484953,26487185:26487362,26487188:26487317,26487614:26487683,26491584:2651886', 'assoc_mat': '26388352:film_plastique:4207:26389561,26388353:film_plastique:4207:26389759,26388354:film_plastique:4207:26389894,26388368:film_plastique:4207:26388535,26390639:film_plastique:4207:26390992,26390642:film_plastique:4207:26390976,26393344:film_plastique:4207:26393668,26395436:film_plastique:4207:26395720,26395438:film_plastique:4207:26395681,26397832:film_plastique:4207:26398970,26397834:film_plastique:4207:26399249,26397852:film_plastique:4207:26399410,26404026:film_plastique:4207:26405086,26404326:film_plastique:4207:26405567,26406975:film_plastique:4207:26407175,26409706:film_plastique:4207:26411059,26415088:film_plastique:4207:26415481,26415090:film_plastique:4207:26415163,26419971:film_plastique:4207:26420126,26419972:film_plastique:4207:26420004,26420599:film_plastique:4207:26420602,26427266:film_plastique:4207:26428196,26429657:film_plastique:4207:26430035,26429660:film_plastique:4207:26429740,26435868:film_plastique:4207:26438667,26435869:film_plastique:4207:26438716,26435872:film_plastique:4207:2643880'}, {'unwanted_material': 'kraft', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 0.00013092845221580632, 'nb_photo': 26, 'list_port_cont': '26497503,26569572,26576519,26576688,26595495,26603577,26610537,26613570,26614037,26615680,26641800,26729869,26734795,26800745,26831515,26997286,26998441,27040685,27041401,27056231', 'assoc_port': '26497230:26497503,26566371:26569572,26576341:26576688,26576343:26576519,26589313:26595495,26602936:26603577,26610350:26610537,26613402:26613570,26613856:26614037,26615603:26615680,26638959:26641800,26716824:26734795,26729065:26729869,26787617:26800745,26831416:26831515,26997178:26998441,26997180:26997286,27040463:27040685,27041275:27041401,27054724:27056231', 'assoc_mat': '26497230:kraft:4207:26497503,26566371:kraft:4207:26569572,26576341:kraft:4207:26576688,26576343:kraft:4207:26576519,26589313:kraft:4207:26595495,26602936:kraft:4207:26603577,26610350:kraft:4207:26610537,26613402:kraft:4207:26613570,26613856:kraft:4207:26614037,26615603:kraft:4207:26615680,26638959:kraft:4207:26641800,26716824:kraft:4207:26734795,26729065:kraft:4207:26729869,26787617:kraft:4207:26800745,26831416:kraft:4207:26831515,26997178:kraft:4207:26998441,26997180:kraft:4207:26997286,27040463:kraft:4207:27040685,27041275:kraft:4207:27041401,27054724:kraft:4207:27056231'}, {'unwanted_material': 'metal', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 0.007564132999268331, 'nb_photo': 2940, 'list_port_cont': '26388525,26389562,26389760,26389887,26390993,26391140,26393673,26395688,26398980,26399254,26399414,26405087,26405574,26407172,26411054,26415161,26415473,26420009,26420105,26420608,26428200,26430030,26438243,26438317,26438669,26438726,26438811,26443009,26444244,26444333,26446122,26454465,26457565,26457764,26457939,26463993,26466426,26481118,26483600,26484323,26484583,26484945,26487353,26487692,26491694,26494655,26497492,26512931,26513976,26514026,26514108,26517209,26517310,26517514,26518871,26532861,26534814,26547041,26548688,26553017,26554596,26554693,26554778,26554816,26554836,26554854,26554909,26554975,26555108,26557656,26557796,26558038,26569575,26570486,26570690,26573517,26573700,26573869,26576529,26576697,26577671,26577728,26588351,26594612,26594793,26594875,26594993,26595286,26595491,26595507,26596455,26596763,26601813,26602674,26603064,26603581,26604920,26605093,26606158,26606186,26606418,26606687,26607090,26607197,26608774,26608972,26609152,26609205,26610453,26610488,26610538,26613439,26613549,2661356', 'assoc_port': '26388352:26389562,26388353:26389760,26388354:26389887,26388368:26388525,26390635:26391140,26390639:26390993,26393344:26393673,26395438:26395688,26397832:26398980,26397834:26399254,26397852:26399414,26404026:26405087,26404326:26405574,26406975:26407172,26409706:26411054,26415088:26415473,26415090:26415161,26419971:26420105,26419972:26420009,26420599:26420608,26427266:26428200,26429657:26430030,26435868:26438669,26435869:26438726,26435872:26438811,26438218:26438317,26438220:26438243,26442935:26443009,26444023:26446122,26444027:26444333,26444030:26444244,26450292:26454465,26453924:26457565,26453929:26457764,26453932:26457939,26458908:26463993,26466363:26466426,26481003:26483600,26481008:26484323,26481010:26484583,26481012:26481118,26481013:26484945,26487185:26487353,26487614:26487692,26491584:26518871,26491588:26491694,26493013:26512931,26494594:26494655,26494595:26513976,26494598:26514026,26497230:26497492,26497233:26517209,26497247:26517310,26504678:26517514,26504679:26514108,26532812:26532861,26534757:2654704', 'assoc_mat': '26388352:metal:4207:26389562,26388353:metal:4207:26389760,26388354:metal:4207:26389887,26388368:metal:4207:26388525,26390635:metal:4207:26391140,26390639:metal:4207:26390993,26393344:metal:4207:26393673,26395438:metal:4207:26395688,26397832:metal:4207:26398980,26397834:metal:4207:26399254,26397852:metal:4207:26399414,26404026:metal:4207:26405087,26404326:metal:4207:26405574,26406975:metal:4207:26407172,26409706:metal:4207:26411054,26415088:metal:4207:26415473,26415090:metal:4207:26415161,26419971:metal:4207:26420105,26419972:metal:4207:26420009,26420599:metal:4207:26420608,26427266:metal:4207:26428200,26429657:metal:4207:26430030,26435868:metal:4207:26438669,26435869:metal:4207:26438726,26435872:metal:4207:26438811,26438218:metal:4207:26438317,26438220:metal:4207:26438243,26442935:metal:4207:26443009,26444023:metal:4207:26446122,26444027:metal:4207:26444333,26444030:metal:4207:26444244,26450292:metal:4207:26454465,26453924:metal:4207:26457565,26453929:metal:4207:26457764,26453932:metal:4207:26457939,26458908:'}, {'unwanted_material': 'metal', 'main_material': 'refus', 'pht_type': 3594, 'ratio': 0.0005562321468011147, 'nb_photo': 251, 'list_port_cont': '26388454,26388984,26390788,26395879,26398304,26398722,26404170,26404700,26406724,26430214,26436170,26438394,26444506,26444652,26445444,26450475,26454603,26455124,26459017,26481274,26481699,26491832,26533588,26535089,26550036,26566468,26575314,26575768,26588130,26589165,26593891,26601916,26605164,26605455,26605766,26609197,26610592,26611514,26613461,26629600,26631351,26649551,26650384,26658572,26666562,26679886,26680766,26684341,26686132,26724321,26724788,26725302,26725491,26726944,26727790,26728375,26728782,26753207,26761734,26788574,26788895,26790258,26792644,26793580,26795043,26798292,26799884,26802099,26827469,26828481,26829083,26843345,26850575,26851196,26863120,26884042,26890340,26892156,26895430,26902338,26903698,26932131,26945243,26949340,26957604,26960033,26968713,26969102,26970344,26994995,26998237,27000802,27002324,27007596,27039975,27040562,27041384,27041606,27047037,27047165', 'assoc_port': '26388367:26388984,26388369:26388454,26390641:26390788,26395440:26395879,26397835:26398722,26397837:26398304,26404029:26404700,26404030:26404170,26406524:26406724,26429659:26430214,26435870:26436170,26438219:26438394,26444024:26445444,26444026:26444652,26444034:26444506,26450291:26450475,26453906:26455124,26453927:26454603,26458929:26459017,26481011:26481699,26481032:26481274,26491587:26491832,26532805:26533588,26534764:26535089,26548449:26550036,26566359:26566468,26574888:26575768,26574891:26575314,26587707:26589165,26587709:26593891,26587711:26588130,26601766:26601916,26604829:26605766,26604830:26605455,26604831:26605164,26607883:26609197,26609510:26610592,26610351:26611514,26613406:26613461,26629342:26629600,26631054:26631351,26649069:26649551,26649947:26650384,26658004:26658572,26666423:26666562,26677710:26679886,26680700:26680766,26684306:26684341,26685910:26686132,26690816:26728782,26691894:26728375,26697949:26727790,26713963:26726944,26716830:26725491,26717897:26725302,26722888:26724788,26724007:2672432', 'assoc_mat': '26388367:metal:3594:26388984,26388369:metal:3594:26388454,26390641:metal:3594:26390788,26395440:metal:3594:26395879,26397835:metal:3594:26398722,26397837:metal:3594:26398304,26404029:metal:3594:26404700,26404030:metal:3594:26404170,26406524:metal:3594:26406724,26429659:metal:3594:26430214,26435870:metal:3594:26436170,26438219:metal:3594:26438394,26444024:metal:3594:26445444,26444026:metal:3594:26444652,26444034:metal:3594:26444506,26450291:metal:3594:26450475,26453906:metal:3594:26455124,26453927:metal:3594:26454603,26458929:metal:3594:26459017,26481011:metal:3594:26481699,26481032:metal:3594:26481274,26491587:metal:3594:26491832,26532805:metal:3594:26533588,26534764:metal:3594:26535089,26548449:metal:3594:26550036,26566359:metal:3594:26566468,26574888:metal:3594:26575768,26574891:metal:3594:26575314,26587707:metal:3594:26589165,26587709:metal:3594:26593891,26587711:metal:3594:26588130,26601766:metal:3594:26601916,26604829:metal:3594:26605766,26604830:metal:3594:26605455,26604831:metal:3594:26605164,26607883:'}, {'unwanted_material': 'papier', 'main_material': 'film_pedb', 'pht_type': 4461, 'ratio': 0.0911536273404687, 'nb_photo': 3921, 'list_port_cont': '26390738,26390818,26390882,26395525,26409895,26427490,26435994,26438407,26438532,26444147,26462861,26478483,26481153,26487716,26490754,26494643,26497339,26531247,26548520,26548870,26574930,26576428,26587822,26587976,26591907,26604948,26604967,26605910,26608020,26610406,26613919,26629384,26639035,26639116,26657622,26658267,26677783,26680805,26684413,26690904,26691023,26722945,26727879,26761308,26787920,26799715,26807742,26824162,26828540,26828876,26832977,26850517,26853458,26866778,26866866,26890594,26902290,26905860,26906117,26910246,26945650,26955547,26964802,26997256,27003940,27039143,27047067', 'assoc_port': '26390634:26390882,26390638:26390818,26390643:26390738,26395437:26395525,26409705:26409895,26427268:26427490,26435875:26435994,26438215:26438532,26438217:26438407,26444031:26444147,26453931:26462861,26478211:26478483,26481007:26481153,26487615:26487716,26490662:26490754,26494596:26494643,26497248:26497339,26531220:26531247,26548445:26548520,26548468:26548870,26574911:26574930,26576342:26576428,26587712:26587976,26587714:26587822,26591763:26591907,26604826:26604948,26604827:26604967,26605868:26605910,26607891:26608020,26610353:26610406,26613876:26613919,26629341:26629384,26638965:26639116,26638967:26639035,26649075:26657622,26658032:26658267,26677709:26677783,26680701:26680805,26684303:26684413,26690807:26691023,26690810:26690904,26722881:26722945,26727637:26727879,26761142:26761308,26787636:26787920,26799535:26799715,26807540:26807742,26824129:26824162,26828460:26828540,26828801:26828876,26832917:26832977,26850412:26850517,26853355:26853458,26866562:26866866,26866563:26866778,26890526:26890594,26902186:2690229', 'assoc_mat': '26390634:papier:4461:26390882,26390638:papier:4461:26390818,26390643:papier:4461:26390738,26395437:papier:4461:26395525,26409705:papier:4461:26409895,26427268:papier:4461:26427490,26435875:papier:4461:26435994,26438215:papier:4461:26438532,26438217:papier:4461:26438407,26444031:papier:4461:26444147,26453931:papier:4461:26462861,26478211:papier:4461:26478483,26481007:papier:4461:26481153,26487615:papier:4461:26487716,26490662:papier:4461:26490754,26494596:papier:4461:26494643,26497248:papier:4461:26497339,26531220:papier:4461:26531247,26548445:papier:4461:26548520,26548468:papier:4461:26548870,26574911:papier:4461:26574930,26576342:papier:4461:26576428,26587712:papier:4461:26587976,26587714:papier:4461:26587822,26591763:papier:4461:26591907,26604826:papier:4461:26604948,26604827:papier:4461:26604967,26605868:papier:4461:26605910,26607891:papier:4461:26608020,26610353:papier:4461:26610406,26613876:papier:4461:26613919,26629341:papier:4461:26629384,26638965:papier:4461:26639116,26638967:papier:4461:26639035,2664'}, {'unwanted_material': 'papier', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 0.007630341529969927, 'nb_photo': 27216, 'list_port_cont': '26388533,26389571,26389756,26389896,26390966,26391002,26391142,26391217,26393665,26395682,26395709,26398975,26399244,26399415,26405088,26405569,26407174,26411053,26415160,26415484,26420000,26420114,26420601,26428194,26429747,26430037,26436085,26436113,26438239,26438311,26438567,26438675,26438731,26438818,26443016,26444242,26444336,26446136,26454456,26457561,26457762,26457933,26464000,26464208,26466416,26481105,26481743,26481902,26482087,26483603,26483801,26484065,26484309,26484580,26484949,26487319,26487363,26487688,26491695,26494667,26497494,26512932,26513977,26514013,26514118,26517202,26517316,26517517,26518862,26519044,26532852,26534823,26547027,26548035,26548695,26553031,26554604,26554698,26554758,26554777,26554820,26554824,26554842,26554917,26554981,26555115,26557669,26557798,26558040,26569576,26570493,26570684,26573520,26573696,26573872,26576413,26576540,26576689,26576897,26577635,26577677,26577726,26588083,26588358,26594615,26594788,26594811,26594868,26594996,26595107,26595288,26595479,26595496,2659563', 'assoc_port': '26388352:26389571,26388353:26389756,26388354:26389896,26388368:26388533,26390635:26391142,26390637:26391217,26390639:26391002,26390642:26390966,26393344:26393665,26395436:26395709,26395438:26395682,26397832:26398975,26397834:26399244,26397852:26399415,26404026:26405088,26404326:26405569,26406975:26407174,26409706:26411053,26415088:26415484,26415090:26415160,26419971:26420114,26419972:26420000,26420599:26420601,26427266:26428194,26429657:26430037,26429660:26429747,26435868:26438675,26435869:26438731,26435872:26438818,26435877:26436113,26435878:26436085,26438216:26438567,26438218:26438311,26438220:26438239,26442935:26443016,26444023:26446136,26444027:26444336,26444030:26444242,26450292:26454456,26453924:26457561,26453929:26457762,26453932:26457933,26458908:26464000,26458928:26464208,26466363:26466416,26478210:26481743,26478212:26481902,26478213:26482087,26481003:26483603,26481004:26483801,26481006:26484065,26481008:26484309,26481010:26484580,26481012:26481105,26481013:26484949,26487185:26487363,26487188:2648731', 'assoc_mat': '26388352:papier:4207:26389571,26388353:papier:4207:26389756,26388354:papier:4207:26389896,26388368:papier:4207:26388533,26390635:papier:4207:26391142,26390637:papier:4207:26391217,26390639:papier:4207:26391002,26390642:papier:4207:26390966,26393344:papier:4207:26393665,26395436:papier:4207:26395709,26395438:papier:4207:26395682,26397832:papier:4207:26398975,26397834:papier:4207:26399244,26397852:papier:4207:26399415,26404026:papier:4207:26405088,26404326:papier:4207:26405569,26406975:papier:4207:26407174,26409706:papier:4207:26411053,26415088:papier:4207:26415484,26415090:papier:4207:26415160,26419971:papier:4207:26420114,26419972:papier:4207:26420000,26420599:papier:4207:26420601,26427266:papier:4207:26428194,26429657:papier:4207:26430037,26429660:papier:4207:26429747,26435868:papier:4207:26438675,26435869:papier:4207:26438731,26435872:papier:4207:26438818,26435877:papier:4207:26436113,26435878:papier:4207:26436085,26438216:papier:4207:26438567,26438218:papier:4207:26438311,26438220:papier:4207:26438239,2644'}, {'unwanted_material': 'papier', 'main_material': 'pet_clair', 'pht_type': 3327, 'ratio': 0.03659740777764293, 'nb_photo': 4, 'list_port_cont': '26723051', 'assoc_port': '26722892:26723051', 'assoc_mat': '26722892:papier:3327:26723051'}, {'unwanted_material': 'papier', 'main_material': 'refus', 'pht_type': 3594, 'ratio': 0.01789364747742476, 'nb_photo': 5437, 'list_port_cont': '26388449,26388978,26390790,26395878,26396941,26398306,26398729,26404169,26404703,26406722,26409928,26430220,26436161,26436371,26438043,26438387,26440729,26444151,26444509,26444653,26445445,26450482,26454086,26454600,26455122,26459011,26478299,26478820,26481280,26481703,26482048,26482627,26487383,26487501,26490710,26491828,26493286,26494889,26497403,26497577,26531317,26533584,26535094,26547995,26548625,26549197,26550043,26550454,26552692,26566464,26575311,26575767,26576796,26587948,26588131,26588558,26589161,26593892,26596199,26601926,26605163,26605457,26605610,26605764,26609189,26610586,26611513,26613457,26629601,26630007,26630166,26631359,26639070,26639673,26639866,26649552,26650392,26652892,26658577,26661144,26666565,26666869,26677540,26679881,26680085,26680764,26681138,26684345,26684523,26686136,26723545,26723726,26724044,26724235,26724315,26724435,26724787,26725092,26725294,26725501,26725925,26726183,26726439,26726943,26727077,26727798,26728051,26728366,26728778,26729254,26753210,26753663,26754273,2675671', 'assoc_port': '26388367:26388978,26388369:26388449,26390641:26390790,26395439:26396941,26395440:26395878,26397835:26398729,26397837:26398306,26404029:26404703,26404030:26404169,26406524:26406722,26409707:26409928,26429659:26430220,26435866:26436371,26435870:26436161,26435873:26438043,26438219:26438387,26440559:26440729,26444024:26445445,26444026:26444653,26444032:26444151,26444034:26444509,26450291:26450482,26453906:26455122,26453927:26454600,26453934:26454086,26458929:26459011,26478209:26478820,26478214:26478299,26481005:26482627,26481009:26482048,26481011:26481703,26481032:26481280,26487184:26487501,26487187:26490710,26487189:26487383,26491587:26491828,26493017:26493286,26494597:26494889,26497232:26497577,26497234:26497403,26531218:26531317,26532805:26533584,26534764:26535094,26541041:26547995,26548447:26550454,26548449:26550043,26548452:26552692,26548456:26549197,26548459:26548625,26566359:26566464,26574866:26576796,26574888:26575767,26574891:26575311,26587707:26589161,26587709:26593892,26587711:26588131,26587716:2658794', 'assoc_mat': '26388367:papier:3594:26388978,26388369:papier:3594:26388449,26390641:papier:3594:26390790,26395439:papier:3594:26396941,26395440:papier:3594:26395878,26397835:papier:3594:26398729,26397837:papier:3594:26398306,26404029:papier:3594:26404703,26404030:papier:3594:26404169,26406524:papier:3594:26406722,26409707:papier:3594:26409928,26429659:papier:3594:26430220,26435866:papier:3594:26436371,26435870:papier:3594:26436161,26435873:papier:3594:26438043,26438219:papier:3594:26438387,26440559:papier:3594:26440729,26444024:papier:3594:26445445,26444026:papier:3594:26444653,26444032:papier:3594:26444151,26444034:papier:3594:26444509,26450291:papier:3594:26450482,26453906:papier:3594:26455122,26453927:papier:3594:26454600,26453934:papier:3594:26454086,26458929:papier:3594:26459011,26478209:papier:3594:26478820,26478214:papier:3594:26478299,26481005:papier:3594:26482627,26481009:papier:3594:26482048,26481011:papier:3594:26481703,26481032:papier:3594:26481280,26487184:papier:3594:26487501,26487187:papier:3594:26490710,2648'}, {'unwanted_material': 'pehd', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 0.0005796457880120662, 'nb_photo': 41, 'list_port_cont': '26398982,26420607,26430031,26438727,26438810,26484073,26512940,26513982,26514115,26554827,26576521,26577727,26594994,26603569,26604924,26651305,26729855,26795783,26799266,26799605,26800737,26828527,26831518,26883104,26890749,26915087,27000279,27040115,27040674,27041411,27055884,27056241', 'assoc_port': '26397832:26398982,26420599:26420607,26429657:26430031,26435869:26438727,26435872:26438810,26481006:26484073,26493013:26512940,26494595:26513982,26504679:26514115,26554755:26554827,26574867:26577727,26576343:26576521,26587710:26594994,26602936:26603569,26604832:26604924,26649945:26651305,26729067:26729855,26787582:26799266,26787583:26799605,26787617:26800737,26794166:26795783,26828461:26828527,26831416:26831518,26882770:26883104,26890525:26890749,26910025:26915087,27000109:27000279,27038969:27040115,27040463:27040674,27041275:27041411,27054702:27055884,27054724:27056241', 'assoc_mat': '26397832:pehd:4207:26398982,26420599:pehd:4207:26420607,26429657:pehd:4207:26430031,26435869:pehd:4207:26438727,26435872:pehd:4207:26438810,26481006:pehd:4207:26484073,26493013:pehd:4207:26512940,26494595:pehd:4207:26513982,26504679:pehd:4207:26514115,26554755:pehd:4207:26554827,26574867:pehd:4207:26577727,26576343:pehd:4207:26576521,26587710:pehd:4207:26594994,26602936:pehd:4207:26603569,26604832:pehd:4207:26604924,26649945:pehd:4207:26651305,26729067:pehd:4207:26729855,26787582:pehd:4207:26799266,26787583:pehd:4207:26799605,26787617:pehd:4207:26800737,26794166:pehd:4207:26795783,26828461:pehd:4207:26828527,26831416:pehd:4207:26831518,26882770:pehd:4207:26883104,26890525:pehd:4207:26890749,26910025:pehd:4207:26915087,27000109:pehd:4207:27000279,27038969:pehd:4207:27040115,27040463:pehd:4207:27040674,27041275:pehd:4207:27041411,27054702:pehd:4207:27055884,27054724:pehd:4207:27056241'}, {'unwanted_material': 'pehd', 'main_material': 'refus', 'pht_type': 3594, 'ratio': 0.0005915037016475334, 'nb_photo': 71, 'list_port_cont': '26398299,26404706,26438396,26481696,26482049,26487388,26535095,26575312,26596200,26605162,26639676,26649549,26666559,26725099,26725500,26725927,26728776,26761733,26790259,26802415,26827473,26851199,26891682,26892155,26949337,27000808', 'assoc_port': '26397837:26398299,26404029:26404706,26438219:26438396,26481009:26482049,26481011:26481696,26487189:26487388,26534764:26535095,26574891:26575312,26594768:26596200,26604831:26605162,26639469:26639676,26649069:26649549,26666423:26666559,26690816:26728776,26690817:26725099,26716828:26725927,26716830:26725500,26761139:26761733,26787618:26802415,26787619:26790259,26827350:26827473,26850411:26851199,26891611:26892155,26891614:26891682,26946471:26949337,27000677:27000808', 'assoc_mat': '26397837:pehd:3594:26398299,26404029:pehd:3594:26404706,26438219:pehd:3594:26438396,26481009:pehd:3594:26482049,26481011:pehd:3594:26481696,26487189:pehd:3594:26487388,26534764:pehd:3594:26535095,26574891:pehd:3594:26575312,26594768:pehd:3594:26596200,26604831:pehd:3594:26605162,26639469:pehd:3594:26639676,26649069:pehd:3594:26649549,26666423:pehd:3594:26666559,26690816:pehd:3594:26728776,26690817:pehd:3594:26725099,26716828:pehd:3594:26725927,26716830:pehd:3594:26725500,26761139:pehd:3594:26761733,26787618:pehd:3594:26802415,26787619:pehd:3594:26790259,26827350:pehd:3594:26827473,26850411:pehd:3594:26851199,26891611:pehd:3594:26892155,26891614:pehd:3594:26891682,26946471:pehd:3594:26949337,27000677:pehd:3594:27000808'}, {'unwanted_material': 'pet_clair', 'main_material': 'film_pedb', 'pht_type': 4461, 'ratio': 0.002747718888392497, 'nb_photo': 1, 'list_port_cont': '26828543', 'assoc_port': '26828460:26828543', 'assoc_mat': '26828460:pet_clair:4461:26828543'}, {'unwanted_material': 'pet_clair', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 0.0028962173011650824, 'nb_photo': 1597, 'list_port_cont': '26389892,26390973,26390994,26393678,26398978,26399246,26399406,26405084,26405572,26407169,26411062,26415156,26420606,26428201,26430032,26438663,26438717,26438871,26443005,26444339,26446131,26454469,26457557,26457938,26463987,26466423,26481110,26483605,26483797,26484068,26484317,26484958,26487354,26491686,26494656,26497493,26512933,26513986,26514021,26514116,26517206,26518863,26519039,26532864,26548699,26553022,26554699,26554771,26554789,26554838,26554847,26557666,26557809,26558030,26569566,26570686,26573863,26576525,26576888,26577663,26577723,26588070,26588344,26594603,26594800,26594817,26594825,26594872,26595000,26595120,26595282,26595503,26596449,26601807,26602662,26603069,26603566,26604921,26605097,26606021,26606155,26606188,26606424,26606678,26607091,26608970,26609138,26610459,26610503,26610539,26613552,26613569,26614042,26614678,26615676,26618306,26630389,26631597,26638983,26639549,26641791,26649094,26649813,26651314,26658555,26659763,26660052,26660413,26668264,26681764,26684367,26684464,26684758,2669192', 'assoc_port': '26388354:26389892,26390639:26390994,26390642:26390973,26393344:26393678,26397832:26398978,26397834:26399246,26397852:26399406,26404026:26405084,26404326:26405572,26406975:26407169,26409706:26411062,26415090:26415156,26420599:26420606,26427266:26428201,26429657:26430032,26435868:26438663,26435869:26438717,26435874:26438871,26442935:26443005,26444023:26446131,26444027:26444339,26450292:26454469,26453924:26457557,26453932:26457938,26458908:26463987,26466363:26466423,26481003:26483605,26481004:26483797,26481006:26484068,26481008:26484317,26481012:26481110,26481013:26484958,26487185:26487354,26491584:26518863,26491586:26519039,26491588:26491686,26493013:26512933,26494594:26494656,26494595:26513986,26494598:26514021,26497230:26497493,26497233:26517206,26504679:26514116,26532812:26532864,26534766:26548699,26548454:26554699,26548458:26554771,26548462:26554847,26552896:26553022,26554752:26557666,26554753:26557809,26554754:26558030,26554755:26554838,26554756:26554789,26566357:26570686,26566371:26569566,26573203:2657386', 'assoc_mat': '26388354:pet_clair:4207:26389892,26390639:pet_clair:4207:26390994,26390642:pet_clair:4207:26390973,26393344:pet_clair:4207:26393678,26397832:pet_clair:4207:26398978,26397834:pet_clair:4207:26399246,26397852:pet_clair:4207:26399406,26404026:pet_clair:4207:26405084,26404326:pet_clair:4207:26405572,26406975:pet_clair:4207:26407169,26409706:pet_clair:4207:26411062,26415090:pet_clair:4207:26415156,26420599:pet_clair:4207:26420606,26427266:pet_clair:4207:26428201,26429657:pet_clair:4207:26430032,26435868:pet_clair:4207:26438663,26435869:pet_clair:4207:26438717,26435874:pet_clair:4207:26438871,26442935:pet_clair:4207:26443005,26444023:pet_clair:4207:26446131,26444027:pet_clair:4207:26444339,26450292:pet_clair:4207:26454469,26453924:pet_clair:4207:26457557,26453932:pet_clair:4207:26457938,26458908:pet_clair:4207:26463987,26466363:pet_clair:4207:26466423,26481003:pet_clair:4207:26483605,26481004:pet_clair:4207:26483797,26481006:pet_clair:4207:26484068,26481008:pet_clair:4207:26484317,26481012:pet_clair:4207:26481110,2'}, {'unwanted_material': 'pet_clair', 'main_material': 'pet_clair', 'pht_type': 3327, 'ratio': 0.9515060103183892, 'nb_photo': 73, 'list_port_cont': '26723046', 'assoc_port': '26722892:26723046', 'assoc_mat': '26722892:pet_clair:3327:26723046'}, {'unwanted_material': 'pet_clair', 'main_material': 'refus', 'pht_type': 3594, 'ratio': 0.06290940323697376, 'nb_photo': 4875, 'list_port_cont': '26388456,26388982,26390781,26395873,26396944,26398308,26398720,26404174,26404699,26406717,26409930,26430219,26436167,26436372,26438041,26438395,26440730,26444153,26444511,26444654,26445440,26450484,26454084,26454607,26455114,26459009,26478303,26478821,26481279,26481695,26482047,26482632,26487382,26487495,26490707,26491826,26493290,26494885,26497396,26497573,26531318,26533591,26535087,26547996,26548626,26549193,26550037,26550455,26552690,26566471,26575315,26575771,26576794,26587954,26588128,26588561,26589163,26593896,26596204,26601919,26605158,26605464,26605608,26605761,26609193,26610595,26611516,26613453,26629602,26630003,26630164,26631348,26639069,26639670,26639869,26649203,26649556,26650390,26652894,26658573,26661137,26666564,26666868,26677533,26679888,26680081,26680762,26681144,26684344,26684528,26686141,26723548,26723719,26724051,26724242,26724317,26724440,26724789,26725100,26725300,26725495,26725928,26726178,26726434,26726936,26727080,26727794,26728041,26728369,26728786,26729248,26753205,26753659,2675428', 'assoc_port': '26388367:26388982,26388369:26388456,26390641:26390781,26395439:26396944,26395440:26395873,26397835:26398720,26397837:26398308,26404029:26404699,26404030:26404174,26406524:26406717,26409707:26409930,26429659:26430219,26435866:26436372,26435870:26436167,26435873:26438041,26438219:26438395,26440559:26440730,26444024:26445440,26444026:26444654,26444032:26444153,26444034:26444511,26450291:26450484,26453906:26455114,26453927:26454607,26453934:26454084,26458929:26459009,26478209:26478821,26478214:26478303,26481005:26482632,26481009:26482047,26481011:26481695,26481032:26481279,26487184:26487495,26487187:26490707,26487189:26487382,26491587:26491826,26493017:26493290,26494597:26494885,26497232:26497573,26497234:26497396,26531218:26531318,26532805:26533591,26534764:26535087,26541041:26547996,26548447:26550455,26548449:26550037,26548452:26552690,26548456:26549193,26548459:26548626,26566359:26566471,26574866:26576794,26574888:26575771,26574891:26575315,26587707:26589163,26587709:26593896,26587711:26588128,26587716:2658795', 'assoc_mat': '26388367:pet_clair:3594:26388982,26388369:pet_clair:3594:26388456,26390641:pet_clair:3594:26390781,26395439:pet_clair:3594:26396944,26395440:pet_clair:3594:26395873,26397835:pet_clair:3594:26398720,26397837:pet_clair:3594:26398308,26404029:pet_clair:3594:26404699,26404030:pet_clair:3594:26404174,26406524:pet_clair:3594:26406717,26409707:pet_clair:3594:26409930,26429659:pet_clair:3594:26430219,26435866:pet_clair:3594:26436372,26435870:pet_clair:3594:26436167,26435873:pet_clair:3594:26438041,26438219:pet_clair:3594:26438395,26440559:pet_clair:3594:26440730,26444024:pet_clair:3594:26445440,26444026:pet_clair:3594:26444654,26444032:pet_clair:3594:26444153,26444034:pet_clair:3594:26444511,26450291:pet_clair:3594:26450484,26453906:pet_clair:3594:26455114,26453927:pet_clair:3594:26454607,26453934:pet_clair:3594:26454084,26458929:pet_clair:3594:26459009,26478209:pet_clair:3594:26478821,26478214:pet_clair:3594:26478303,26481005:pet_clair:3594:26482632,26481009:pet_clair:3594:26482047,26481011:pet_clair:3594:26481695,2'}, {'unwanted_material': 'pet_fonce', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 0.00035406561329176327, 'nb_photo': 129, 'list_port_cont': '26389764,26390995,26398983,26405094,26405581,26420616,26446123,26457566,26463990,26466415,26484321,26494668,26497495,26514120,26517207,26519040,26547028,26554829,26577718,26594792,26594805,26596771,26604923,26606417,26614680,26639548,26649091,26649808,26651303,26659764,26684472,26706695,26713003,26724389,26724473,26724854,26733922,26734083,26734800,26738752,26763017,26799260,26799604,26801047,26804337,26804541,26815289,26817649,26824247,26825106,26828666,26829069,26829439,26831476,26850501,26859180,26862359,26862386,26862432,26868255,26868839,26898193,26915088,26915379,26915573,26964755,26980499,26994789,26995470,26996267,26997439,26997938,26998447,27000266,27008616,27018629,27033239,27040111,27056085,27056238', 'assoc_port': '26388353:26389764,26390639:26390995,26397832:26398983,26404026:26405094,26404326:26405581,26420599:26420616,26444023:26446123,26453924:26457566,26458908:26463990,26466363:26466415,26481008:26484321,26491586:26519040,26494594:26494668,26497230:26497495,26497233:26517207,26504679:26514120,26534757:26547028,26554755:26554829,26574867:26577718,26587706:26594792,26591762:26596771,26594770:26594805,26604832:26604923,26605863:26606417,26614594:26614680,26639468:26639548,26649066:26649808,26649076:26649091,26649945:26651303,26657985:26659764,26684300:26684472,26690781:26724473,26697944:26738752,26704713:26724854,26704714:26706695,26712867:26713003,26716824:26734800,26722884:26733922,26722889:26734083,26724004:26724389,26758309:26763017,26787582:26799260,26787583:26799604,26787623:26801047,26794162:26804541,26804237:26804337,26807537:26815289,26817470:26817649,26824134:26824247,26824840:26825106,26828459:26828666,26828799:26829439,26828803:26829069,26831420:26831476,26850410:26850501,26859101:26862359,26859103:2686243', 'assoc_mat': '26388353:pet_fonce:4207:26389764,26390639:pet_fonce:4207:26390995,26397832:pet_fonce:4207:26398983,26404026:pet_fonce:4207:26405094,26404326:pet_fonce:4207:26405581,26420599:pet_fonce:4207:26420616,26444023:pet_fonce:4207:26446123,26453924:pet_fonce:4207:26457566,26458908:pet_fonce:4207:26463990,26466363:pet_fonce:4207:26466415,26481008:pet_fonce:4207:26484321,26491586:pet_fonce:4207:26519040,26494594:pet_fonce:4207:26494668,26497230:pet_fonce:4207:26497495,26497233:pet_fonce:4207:26517207,26504679:pet_fonce:4207:26514120,26534757:pet_fonce:4207:26547028,26554755:pet_fonce:4207:26554829,26574867:pet_fonce:4207:26577718,26587706:pet_fonce:4207:26594792,26591762:pet_fonce:4207:26596771,26594770:pet_fonce:4207:26594805,26604832:pet_fonce:4207:26604923,26605863:pet_fonce:4207:26606417,26614594:pet_fonce:4207:26614680,26639468:pet_fonce:4207:26639548,26649066:pet_fonce:4207:26649808,26649076:pet_fonce:4207:26649091,26649945:pet_fonce:4207:26651303,26657985:pet_fonce:4207:26659764,26684300:pet_fonce:4207:26684472,2'}, {'unwanted_material': 'pet_fonce', 'main_material': 'refus', 'pht_type': 3594, 'ratio': 0.0006382317212277186, 'nb_photo': 99, 'list_port_cont': '26396945,26404702,26444648,26445443,26455116,26481700,26482040,26497401,26497572,26533592,26535085,26575313,26589168,26605166,26611522,26613456,26649205,26649553,26650386,26661146,26666556,26724785,26725097,26725503,26761727,26790252,26798290,26802423,26826800,26827475,26833321,26851198,26886927,26892162,26947587,26960043,26968716,26994508,26998767,27000800,27039972,27040870', 'assoc_port': '26395439:26396945,26404029:26404702,26444024:26445443,26444026:26444648,26453906:26455116,26481009:26482040,26481011:26481700,26497232:26497572,26497234:26497401,26532805:26533592,26534764:26535085,26574891:26575313,26587707:26589168,26604831:26605166,26610351:26611522,26613406:26613456,26649069:26649553,26649074:26649205,26649947:26650386,26658027:26661146,26666423:26666556,26690817:26725097,26716830:26725503,26722888:26724785,26761139:26761727,26787615:26798290,26787618:26802423,26787619:26790252,26826748:26826800,26827350:26827475,26832212:26833321,26850411:26851198,26882772:26886927,26891611:26892162,26946470:26947587,26957198:26960043,26964639:26968716,26994377:26994508,26996058:26998767,27000677:27000800,27038968:27039972,27038977:27040870', 'assoc_mat': '26395439:pet_fonce:3594:26396945,26404029:pet_fonce:3594:26404702,26444024:pet_fonce:3594:26445443,26444026:pet_fonce:3594:26444648,26453906:pet_fonce:3594:26455116,26481009:pet_fonce:3594:26482040,26481011:pet_fonce:3594:26481700,26497232:pet_fonce:3594:26497572,26497234:pet_fonce:3594:26497401,26532805:pet_fonce:3594:26533592,26534764:pet_fonce:3594:26535085,26574891:pet_fonce:3594:26575313,26587707:pet_fonce:3594:26589168,26604831:pet_fonce:3594:26605166,26610351:pet_fonce:3594:26611522,26613406:pet_fonce:3594:26613456,26649069:pet_fonce:3594:26649553,26649074:pet_fonce:3594:26649205,26649947:pet_fonce:3594:26650386,26658027:pet_fonce:3594:26661146,26666423:pet_fonce:3594:26666556,26690817:pet_fonce:3594:26725097,26716830:pet_fonce:3594:26725503,26722888:pet_fonce:3594:26724785,26761139:pet_fonce:3594:26761727,26787615:pet_fonce:3594:26798290,26787618:pet_fonce:3594:26802423,26787619:pet_fonce:3594:26790252,26826748:pet_fonce:3594:26826800,26827350:pet_fonce:3594:26827475,26832212:pet_fonce:3594:26833321,2'}, {'unwanted_material': 'pet_opaque', 'main_material': 'film_pedb', 'pht_type': 4461, 'ratio': 0.0048721482851135775, 'nb_photo': 4, 'list_port_cont': '26409892,26548885,26639031,26799717', 'assoc_port': '26409705:26409892,26548468:26548885,26638967:26639031,26799535:26799717', 'assoc_mat': '26409705:pet_opaque:4461:26409892,26548468:pet_opaque:4461:26548885,26638967:pet_opaque:4461:26639031,26799535:pet_opaque:4461:26799717'}, {'unwanted_material': 'pet_opaque', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 0.003552800640912029, 'nb_photo': 791, 'list_port_cont': '26390967,26390991,26398981,26399403,26405081,26405579,26411052,26415166,26420104,26420609,26429742,26430039,26436086,26436108,26438673,26438820,26438863,26443017,26444334,26446134,26454458,26457563,26457768,26463985,26481899,26483796,26484310,26494658,26512930,26514022,26514119,26517211,26517320,26517510,26518867,26519043,26532858,26534816,26548697,26553023,26554701,26554766,26554788,26554837,26554852,26554919,26554989,26555118,26557663,26557801,26558029,26570697,26573514,26573697,26573868,26576511,26576693,26576898,26577639,26577719,26588078,26588359,26594610,26594809,26594828,26594870,26595289,26595506,26596454,26596757,26602672,26603066,26603574,26604922,26606144,26606180,26606428,26607085,26607191,26608768,26608983,26609143,26609208,26610456,26610497,26610533,26613540,26613561,26614041,26614672,26615686,26630383,26631594,26639153,26639482,26639544,26640140,26641797,26642084,26642549,26649103,26651308,26658171,26659770,26660065,26660411,26668248,26668255,26677835,26681934,26684364,26684476,26684753,2669192', 'assoc_port': '26390639:26390991,26390642:26390967,26397832:26398981,26397852:26399403,26404026:26405081,26404326:26405579,26409706:26411052,26415090:26415166,26419971:26420104,26420599:26420609,26429657:26430039,26429660:26429742,26435868:26438673,26435872:26438820,26435874:26438863,26435877:26436108,26435878:26436086,26442935:26443017,26444023:26446134,26444027:26444334,26450292:26454458,26453924:26457563,26453929:26457768,26458908:26463985,26478212:26481899,26481004:26483796,26481008:26484310,26491584:26518867,26491586:26519043,26493013:26512930,26494594:26494658,26494598:26514022,26497233:26517211,26497247:26517320,26504678:26517510,26504679:26514119,26532812:26532858,26534766:26548697,26534767:26534816,26548454:26554701,26548458:26554766,26548462:26554852,26548465:26554919,26548466:26554989,26548469:26555118,26552896:26553023,26554752:26557663,26554753:26557801,26554754:26558029,26554755:26554837,26554756:26554788,26566357:26570697,26573203:26573868,26573228:26573514,26573229:26573697,26574867:26577719,26574897:2657763', 'assoc_mat': '26390639:pet_opaque:4207:26390991,26390642:pet_opaque:4207:26390967,26397832:pet_opaque:4207:26398981,26397852:pet_opaque:4207:26399403,26404026:pet_opaque:4207:26405081,26404326:pet_opaque:4207:26405579,26409706:pet_opaque:4207:26411052,26415090:pet_opaque:4207:26415166,26419971:pet_opaque:4207:26420104,26420599:pet_opaque:4207:26420609,26429657:pet_opaque:4207:26430039,26429660:pet_opaque:4207:26429742,26435868:pet_opaque:4207:26438673,26435872:pet_opaque:4207:26438820,26435874:pet_opaque:4207:26438863,26435877:pet_opaque:4207:26436108,26435878:pet_opaque:4207:26436086,26442935:pet_opaque:4207:26443017,26444023:pet_opaque:4207:26446134,26444027:pet_opaque:4207:26444334,26450292:pet_opaque:4207:26454458,26453924:pet_opaque:4207:26457563,26453929:pet_opaque:4207:26457768,26458908:pet_opaque:4207:26463985,26478212:pet_opaque:4207:26481899,26481004:pet_opaque:4207:26483796,26481008:pet_opaque:4207:26484310,26491584:pet_opaque:4207:26518867,26491586:pet_opaque:4207:26519043,26493013:pet_opaque:4207:26512930,2649'}, {'unwanted_material': 'Teint_Dans_La_Masse', 'main_material': 'jrm', 'pht_type': 3726, 'ratio': 0.004877121661567973, 'nb_photo': 2, 'list_port_cont': '26714012', 'assoc_port': '26713945:26714012', 'assoc_mat': '26713945:Teint_Dans_La_Masse:3726:26714012'}, {'unwanted_material': 'textiles_sanitaires', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 7.080002124002662e-05, 'nb_photo': 42, 'list_port_cont': '26399412,26405090,26420611,26443014,26466424,26481113,26483607,26497498,26518864,26548032,26548686,26570695,26573857,26577725,26595510,26596442,26613543,26615689,26641793,26668256,26684370,26734798,26738751,26772710,26868838,26869104,26899162,26915567,26980488,27055877,27056081', 'assoc_port': '26397852:26399412,26404026:26405090,26420599:26420611,26442935:26443014,26466363:26466424,26481003:26483607,26481012:26481113,26491584:26518864,26497230:26497498,26534758:26548032,26534766:26548686,26566357:26570695,26573203:26573857,26574867:26577725,26589313:26595510,26596416:26596442,26613401:26613543,26615603:26615689,26638959:26641793,26666424:26668256,26684307:26684370,26697944:26738751,26716824:26734798,26772140:26772710,26866557:26868838,26866561:26869104,26891608:26899162,26910035:26915567,26980192:26980488,27054702:27055877,27054723:27056081', 'assoc_mat': '26397852:textiles_sanitaires:4207:26399412,26404026:textiles_sanitaires:4207:26405090,26420599:textiles_sanitaires:4207:26420611,26442935:textiles_sanitaires:4207:26443014,26466363:textiles_sanitaires:4207:26466424,26481003:textiles_sanitaires:4207:26483607,26481012:textiles_sanitaires:4207:26481113,26491584:textiles_sanitaires:4207:26518864,26497230:textiles_sanitaires:4207:26497498,26534758:textiles_sanitaires:4207:26548032,26534766:textiles_sanitaires:4207:26548686,26566357:textiles_sanitaires:4207:26570695,26573203:textiles_sanitaires:4207:26573857,26574867:textiles_sanitaires:4207:26577725,26589313:textiles_sanitaires:4207:26595510,26596416:textiles_sanitaires:4207:26596442,26613401:textiles_sanitaires:4207:26613543,26615603:textiles_sanitaires:4207:26615689,26638959:textiles_sanitaires:4207:26641793,26666424:textiles_sanitaires:4207:26668256,26684307:textiles_sanitaires:4207:26684370,26697944:textiles_sanitaires:4207:26738751,26716824:textiles_sanitaires:4207:26734798,26772140:textiles_sanitaires:4207:2'}), 'main_stat': {'nb_photos': 37215}}, 'hostname': (('jetson-5',),), 'impurety_average_per_hashtag': [(('pcnc', '2025-09', 0.027838421381508174),), (('film_pedb', '2025-09', 0.07749203694615692),), (('refus', '2025-09', 0.09262966846819429),), (('jrm', '2025-09', 0.12233618812838642),), (('pet_clair', '2025-09', 0.04849398968161079),)]} VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4887 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4887 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4887 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4887 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! {"input_values":[]} SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3993 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3993 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3993 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3993 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4207, 'hashtag_proportion': 'barquette_opaque,ela,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'carton,background', 'hashtag_weights': {'barquette_opaque': 1, 'ela': 1, 'etiquette': 1.0, 'film_plastique': 0.5, 'kraft': 1, 'metal': 3.0, 'papier': 1, 'pehd': 2, 'pet_clair': 2, 'pet_opaque': 2, 'textiles_sanitaires': 1.0, 'pet_fonce': 2}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3994 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3994 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3994 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3994 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11488 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11496 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11497 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11492 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11492 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11495 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11495 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11489 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11489 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11575 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11575 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11491 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11490 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11490 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11498 send_mail_cod have less outputs used (0) than in the step definition (1) : some outputs may be not used ! Step 11499 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11491 doesn't seem to be define in the database( WARNING : type of input 3 of step 11490 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11488 doesn't seem to be define in the database( WARNING : type of input 2 of step 11492 doesn't seem to be define in the database( WARNING : output 1 of step 11488 have datatype=2 whereas input 1 of step 11495 have datatype=7 WARNING : type of output 2 of step 11495 doesn't seem to be define in the database( WARNING : type of input 1 of step 11489 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11491 have datatype=10 whereas input 3 of step 11498 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11575 doesn't seem to be define in the database( WARNING : output 1 of step 11489 have datatype=7 whereas input 2 of step 11575 have datatype=None WARNING : type of output 3 of step 11575 doesn't seem to be define in the database( WARNING : type of input 1 of step 11491 doesn't seem to be define in the database( WARNING : output 0 of step 11491 have datatype=10 whereas input 0 of step 11581 have datatype=18 WARNING : type of input 5 of step 11498 doesn't seem to be define in the database( WARNING : output 0 of step 11581 have datatype=11 whereas input 5 of step 11498 have datatype=None WARNING : type of output 1 of step 11496 doesn't seem to be define in the database( WARNING : type of input 3 of step 11492 doesn't seem to be define in the database( WARNING : type of output 1 of step 11497 doesn't seem to be define in the database( WARNING : type of input 3 of step 11492 doesn't seem to be define in the database( WARNING : output 0 of step 11495 have datatype=1 whereas input 0 of step 11489 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4209, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,metal,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'papier,background', 'hashtag_background': 'papier', 'hashtag_weights': {'barquette_opaque': 0.7, 'carton': 0.7, 'ela': 0.7, 'etiquette': 0.5, 'film_plastique': 0.5, 'kraft': 0.7, 'metal': 1.5, 'pehd': 0.7, 'pet_clair': 0.7, 'pet_opaque': 0.7, 'textiles_sanitaires': 0.5, 'pet_fonce': 0.7}, 'ETA': 600} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3993 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3993 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3993 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3993 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4207, 'hashtag_proportion': 'barquette_opaque,ela,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'carton,background', 'hashtag_weights': {'barquette_opaque': 1, 'ela': 1, 'etiquette': 1.0, 'film_plastique': 0.5, 'kraft': 1, 'metal': 3.0, 'papier': 1, 'pehd': 2, 'pet_clair': 2, 'pet_opaque': 2, 'textiles_sanitaires': 1.0, 'pet_fonce': 2}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3459 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3459 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3459 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3459 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3726, 'hashtag_proportion': 'Carton_brun,Carton_gris,Teint_Dans_La_Masse,autre_refus,cartonnette,kraft,metal,plastique', 'hashtag_parmi': 'papier,background', 'hashtag_weights': {'Carton_brun': 1.5, 'Carton_gris': 1.5, 'Teint_Dans_La_Masse': 1.0, 'autre_refus': 1.5, 'cartonnette': 1.0, 'kraft': 1.5, 'metal': 3, 'plastique': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3991 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3991 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3991 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3991 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11512 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11521 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11520 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11516 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11516 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11519 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11519 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11513 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11513 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11577 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11577 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11515 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11514 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11514 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11523 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11515 doesn't seem to be define in the database( WARNING : type of input 3 of step 11514 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11512 doesn't seem to be define in the database( WARNING : type of input 2 of step 11516 doesn't seem to be define in the database( WARNING : output 1 of step 11512 have datatype=2 whereas input 1 of step 11519 have datatype=7 WARNING : type of output 2 of step 11519 doesn't seem to be define in the database( WARNING : type of input 1 of step 11513 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11515 have datatype=10 whereas input 3 of step 11522 have datatype=6 WARNING : type of input 2 of step 11577 doesn't seem to be define in the database( WARNING : output 1 of step 11513 have datatype=7 whereas input 2 of step 11577 have datatype=None WARNING : type of output 3 of step 11577 doesn't seem to be define in the database( WARNING : type of input 1 of step 11515 doesn't seem to be define in the database( WARNING : output 0 of step 11515 have datatype=10 whereas input 0 of step 11583 have datatype=18 WARNING : type of input 5 of step 11522 doesn't seem to be define in the database( WARNING : output 0 of step 11583 have datatype=11 whereas input 5 of step 11522 have datatype=None WARNING : type of output 1 of step 11521 doesn't seem to be define in the database( WARNING : type of input 3 of step 11516 doesn't seem to be define in the database( WARNING : type of output 1 of step 11520 doesn't seem to be define in the database( WARNING : type of input 3 of step 11516 doesn't seem to be define in the database( WARNING : output 0 of step 11519 have datatype=1 whereas input 0 of step 11513 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4203, 'hashtag_proportion': 'barquette_opaque,carton,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'ela,background', 'hashtag_background': 'ela', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 1, 'etiquette': 0.5, 'film_plastique': 0.5, 'kraft': 0.8, 'metal': 2, 'papier': 0.8, 'pehd': 0.8, 'pet_clair': 0.8, 'pet_opaque': 0.8, 'textiles_sanitaires': 0.5, 'pet_fonce': 0.8}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3804 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3804 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3804 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3804 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11560 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11567 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11567 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11563 crop_condition is not consistent : 4 used against 2 in the step definition ! Step 11563 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11564 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11564 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11573 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11573 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11566 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11566 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 1 of step 11560 have datatype=2 whereas input 1 of step 11564 have datatype=7 WARNING : type of output 2 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11565 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11567 doesn't seem to be define in the database( WARNING : type of input 3 of step 11563 doesn't seem to be define in the database( WARNING : type of output 3 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11568 doesn't seem to be define in the database( WARNING : type of output 1 of step 11568 doesn't seem to be define in the database( WARNING : type of input 3 of step 11566 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11570 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11569 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11570 doesn't seem to be define in the database( WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11569 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11568 have datatype=10 whereas input 3 of step 11571 have datatype=6 WARNING : type of input 2 of step 11573 doesn't seem to be define in the database( WARNING : output 1 of step 11565 have datatype=7 whereas input 2 of step 11573 have datatype=None WARNING : type of output 3 of step 11573 doesn't seem to be define in the database( WARNING : type of input 3 of step 11568 doesn't seem to be define in the database( WARNING : output 0 of step 11568 have datatype=10 whereas input 0 of step 11587 have datatype=18 WARNING : type of input 5 of step 11571 doesn't seem to be define in the database( WARNING : output 0 of step 11587 have datatype=11 whereas input 5 of step 11571 have datatype=None WARNING : output 0 of step 11564 have datatype=1 whereas input 0 of step 11565 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3327, 'hashtag_proportion': 'autre,carton,metal,papier,pehd,pet_fonce', 'hashtag_parmi': 'pet_clair,bouchon,etiquette,barquette_avec_film,background', 'hashtag_background': 'pet_clair', 'hashtag_weights': {'autre': 8.0, 'barquette_avec_film': 6, 'carton': 8.0, 'metal': 12, 'papier': 5, 'pehd': 8, 'pet_fonce': 8, 'bouchon': 8, 'etiquette': 8}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4322 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4322 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4322 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4322 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11978 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11987 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11986 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11982 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11982 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11985 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11985 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11979 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11979 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11990 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11990 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11981 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11980 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11980 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11989 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11981 doesn't seem to be define in the database( WARNING : type of input 3 of step 11980 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11978 doesn't seem to be define in the database( WARNING : type of input 2 of step 11982 doesn't seem to be define in the database( WARNING : output 1 of step 11978 have datatype=2 whereas input 1 of step 11985 have datatype=7 WARNING : type of output 2 of step 11985 doesn't seem to be define in the database( WARNING : type of input 1 of step 11979 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11981 have datatype=10 whereas input 3 of step 11988 have datatype=6 WARNING : type of input 2 of step 11990 doesn't seem to be define in the database( WARNING : output 1 of step 11979 have datatype=7 whereas input 2 of step 11990 have datatype=None WARNING : type of output 3 of step 11990 doesn't seem to be define in the database( WARNING : type of input 1 of step 11981 doesn't seem to be define in the database( WARNING : output 0 of step 11981 have datatype=10 whereas input 0 of step 11991 have datatype=18 WARNING : type of input 5 of step 11988 doesn't seem to be define in the database( WARNING : output 0 of step 11991 have datatype=11 whereas input 5 of step 11988 have datatype=None WARNING : type of output 1 of step 11987 doesn't seem to be define in the database( WARNING : type of input 3 of step 11982 doesn't seem to be define in the database( WARNING : type of output 1 of step 11986 doesn't seem to be define in the database( WARNING : type of input 3 of step 11982 doesn't seem to be define in the database( WARNING : output 0 of step 11985 have datatype=1 whereas input 0 of step 11979 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4461, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,pehd,kraft,metal,papier,pet_fonce,pet_clair,pet_opaque,textiles_sanitaires', 'hashtag_parmi': 'film_plastique', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 0.3, 'ela': 0.3, 'etiquette': 0.1, 'film_plastique': 0.1, 'kraft': 0.3, 'metal': 1.5, 'papier': 0.3, 'pet_clair': 0.3, 'pet_opaque': 0.3, 'textiles_sanitaires': 0.3, 'pet_fonce': 0.3}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3995 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3995 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3995 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3995 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11524 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11533 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11532 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11528 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11528 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11531 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11531 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11525 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11525 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11578 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11578 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11527 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11526 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11526 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11535 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11527 doesn't seem to be define in the database( WARNING : type of input 3 of step 11526 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11524 doesn't seem to be define in the database( WARNING : type of input 2 of step 11528 doesn't seem to be define in the database( WARNING : output 1 of step 11524 have datatype=2 whereas input 1 of step 11531 have datatype=7 WARNING : type of output 2 of step 11531 doesn't seem to be define in the database( WARNING : type of input 1 of step 11525 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11527 have datatype=10 whereas input 3 of step 11534 have datatype=6 WARNING : type of input 2 of step 11578 doesn't seem to be define in the database( WARNING : output 1 of step 11525 have datatype=7 whereas input 2 of step 11578 have datatype=None WARNING : type of output 3 of step 11578 doesn't seem to be define in the database( WARNING : type of input 1 of step 11527 doesn't seem to be define in the database( WARNING : output 0 of step 11527 have datatype=10 whereas input 0 of step 11584 have datatype=18 WARNING : type of input 5 of step 11534 doesn't seem to be define in the database( WARNING : output 0 of step 11584 have datatype=11 whereas input 5 of step 11534 have datatype=None WARNING : type of output 1 of step 11533 doesn't seem to be define in the database( WARNING : type of input 3 of step 11528 doesn't seem to be define in the database( WARNING : type of output 1 of step 11532 doesn't seem to be define in the database( WARNING : type of input 3 of step 11528 doesn't seem to be define in the database( WARNING : output 0 of step 11531 have datatype=1 whereas input 0 of step 11525 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4211, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,metal,papier,pet_fonce,pet_clair,pet_opaque,textiles_sanitaires', 'hashtag_parmi': 'pehd,background', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 0.3, 'ela': 0.3, 'etiquette': 0.1, 'film_plastique': 0.1, 'kraft': 0.3, 'metal': 1.5, 'papier': 0.3, 'pet_clair': 0.3, 'pet_opaque': 0.3, 'textiles_sanitaires': 0.3, 'pet_fonce': 0.3, 'background': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4153 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4153 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4153 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4153 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11548 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11556 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11557 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11552 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11552 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11555 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11555 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11580 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11580 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11551 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11550 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11550 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11559 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11551 doesn't seem to be define in the database( WARNING : type of input 3 of step 11550 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11548 doesn't seem to be define in the database( WARNING : type of input 2 of step 11552 doesn't seem to be define in the database( WARNING : output 1 of step 11548 have datatype=2 whereas input 1 of step 11555 have datatype=7 WARNING : type of output 2 of step 11555 doesn't seem to be define in the database( WARNING : type of input 1 of step 11549 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11551 have datatype=10 whereas input 3 of step 11558 have datatype=6 WARNING : type of input 2 of step 11580 doesn't seem to be define in the database( WARNING : output 1 of step 11549 have datatype=7 whereas input 2 of step 11580 have datatype=None WARNING : type of output 3 of step 11580 doesn't seem to be define in the database( WARNING : type of input 1 of step 11551 doesn't seem to be define in the database( WARNING : output 0 of step 11551 have datatype=10 whereas input 0 of step 11586 have datatype=18 WARNING : type of input 5 of step 11558 doesn't seem to be define in the database( WARNING : output 0 of step 11586 have datatype=11 whereas input 5 of step 11558 have datatype=None WARNING : type of output 1 of step 11556 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : type of output 1 of step 11557 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : output 0 of step 11555 have datatype=1 whereas input 0 of step 11549 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4200, 'hashtag_proportion': 'carton,ela,etiquette,film_plastique,kraft,metal,papier,pehd,pet_opaque,textiles_sanitaires,barquette_opaque,pet_clair', 'hashtag_parmi': 'pet_fonce,background', 'hashtag_weights': {'barquette_opaque': 1.5, 'carton': 2.5, 'ela': 1.5, 'etiquette': 1.5, 'film_plastique': 1, 'kraft': 1.5, 'metal': 3.0, 'papier': 1.2, 'pehd': 1.5, 'pet_clair': 1.5, 'pet_opaque': 1.5, 'textiles_sanitaires': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3992 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3992 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3992 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3992 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11536 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11545 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11544 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11540 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11540 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11543 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11543 merge_mask_thcl_custom have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 11537 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11579 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11579 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11539 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11538 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11538 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11547 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11539 doesn't seem to be define in the database( WARNING : type of input 3 of step 11538 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11536 doesn't seem to be define in the database( WARNING : type of input 2 of step 11540 doesn't seem to be define in the database( WARNING : output 1 of step 11536 have datatype=2 whereas input 1 of step 11543 have datatype=7 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11539 have datatype=10 whereas input 3 of step 11546 have datatype=6 WARNING : type of input 2 of step 11579 doesn't seem to be define in the database( WARNING : output 1 of step 11537 have datatype=7 whereas input 2 of step 11579 have datatype=None WARNING : type of output 3 of step 11579 doesn't seem to be define in the database( WARNING : type of input 1 of step 11539 doesn't seem to be define in the database( WARNING : output 0 of step 11539 have datatype=10 whereas input 0 of step 11585 have datatype=18 WARNING : type of input 5 of step 11546 doesn't seem to be define in the database( WARNING : output 0 of step 11585 have datatype=11 whereas input 5 of step 11546 have datatype=None WARNING : type of output 1 of step 11545 doesn't seem to be define in the database( WARNING : type of input 3 of step 11540 doesn't seem to be define in the database( WARNING : type of output 1 of step 11544 doesn't seem to be define in the database( WARNING : type of input 3 of step 11540 doesn't seem to be define in the database( WARNING : output 0 of step 11543 have datatype=1 whereas input 0 of step 11537 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4205, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'metal,background', 'hashtag_background': 'metal', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 1.5, 'ela': 1.5, 'etiquette': 1, 'film_plastique': 1, 'kraft': 1, 'papier': 1, 'pehd': 1.5, 'pet_clair': 1.5, 'pet_opaque': 1.5, 'textiles_sanitaires': 1.5, 'pet_fonce': 1.5}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3318 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3318 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3318 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3594, 'hashtag_proportion': 'papier,carton,metal,pet_clair,autre,pehd,pet_fonce', 'hashtag_parmi': 'refus,background', 'hashtag_weights': {'papier': 1, 'carton': 1, 'metal': 1, 'pet_clair': 1, 'autre': 1, 'pehd': 1, 'pet_fonce': 1, 'refus': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier TODO : Insert select and so on SELECT id, name, misc_info, datou_id_for_right FROM MTRPhoto.dashboard_places WHERE name="Sevran"; SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4101 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4101 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4101 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4101 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! {"input_values":[]} SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3993 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3993 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3993 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3993 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4207, 'hashtag_proportion': 'barquette_opaque,ela,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'carton,background', 'hashtag_weights': {'barquette_opaque': 1, 'ela': 1, 'etiquette': 1.0, 'film_plastique': 0.5, 'kraft': 1, 'metal': 3.0, 'papier': 1, 'pehd': 2, 'pet_clair': 2, 'pet_opaque': 2, 'textiles_sanitaires': 1.0, 'pet_fonce': 2}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3994 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3994 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3994 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3994 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11488 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11496 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11497 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11492 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11492 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11495 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11495 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11489 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11489 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11575 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11575 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11491 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11490 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11490 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11498 send_mail_cod have less outputs used (0) than in the step definition (1) : some outputs may be not used ! Step 11499 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11491 doesn't seem to be define in the database( WARNING : type of input 3 of step 11490 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11488 doesn't seem to be define in the database( WARNING : type of input 2 of step 11492 doesn't seem to be define in the database( WARNING : output 1 of step 11488 have datatype=2 whereas input 1 of step 11495 have datatype=7 WARNING : type of output 2 of step 11495 doesn't seem to be define in the database( WARNING : type of input 1 of step 11489 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11491 have datatype=10 whereas input 3 of step 11498 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11575 doesn't seem to be define in the database( WARNING : output 1 of step 11489 have datatype=7 whereas input 2 of step 11575 have datatype=None WARNING : type of output 3 of step 11575 doesn't seem to be define in the database( WARNING : type of input 1 of step 11491 doesn't seem to be define in the database( WARNING : output 0 of step 11491 have datatype=10 whereas input 0 of step 11581 have datatype=18 WARNING : type of input 5 of step 11498 doesn't seem to be define in the database( WARNING : output 0 of step 11581 have datatype=11 whereas input 5 of step 11498 have datatype=None WARNING : type of output 1 of step 11496 doesn't seem to be define in the database( WARNING : type of input 3 of step 11492 doesn't seem to be define in the database( WARNING : type of output 1 of step 11497 doesn't seem to be define in the database( WARNING : type of input 3 of step 11492 doesn't seem to be define in the database( WARNING : output 0 of step 11495 have datatype=1 whereas input 0 of step 11489 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4209, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,metal,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'papier,background', 'hashtag_background': 'papier', 'hashtag_weights': {'barquette_opaque': 0.7, 'carton': 0.7, 'ela': 0.7, 'etiquette': 0.5, 'film_plastique': 0.5, 'kraft': 0.7, 'metal': 1.5, 'pehd': 0.7, 'pet_clair': 0.7, 'pet_opaque': 0.7, 'textiles_sanitaires': 0.5, 'pet_fonce': 0.7}, 'ETA': 600} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3993 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3993 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3993 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3993 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4207, 'hashtag_proportion': 'barquette_opaque,ela,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'carton,background', 'hashtag_weights': {'barquette_opaque': 1, 'ela': 1, 'etiquette': 1.0, 'film_plastique': 0.5, 'kraft': 1, 'metal': 3.0, 'papier': 1, 'pehd': 2, 'pet_clair': 2, 'pet_opaque': 2, 'textiles_sanitaires': 1.0, 'pet_fonce': 2}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3459 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3459 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3459 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3459 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3726, 'hashtag_proportion': 'Carton_brun,Carton_gris,Teint_Dans_La_Masse,autre_refus,cartonnette,kraft,metal,plastique', 'hashtag_parmi': 'papier,background', 'hashtag_weights': {'Carton_brun': 1.5, 'Carton_gris': 1.5, 'Teint_Dans_La_Masse': 1.0, 'autre_refus': 1.5, 'cartonnette': 1.0, 'kraft': 1.5, 'metal': 3, 'plastique': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3991 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3991 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3991 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3991 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11512 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11521 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11520 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11516 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11516 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11519 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11519 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11513 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11513 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11577 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11577 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11515 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11514 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11514 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11523 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11515 doesn't seem to be define in the database( WARNING : type of input 3 of step 11514 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11512 doesn't seem to be define in the database( WARNING : type of input 2 of step 11516 doesn't seem to be define in the database( WARNING : output 1 of step 11512 have datatype=2 whereas input 1 of step 11519 have datatype=7 WARNING : type of output 2 of step 11519 doesn't seem to be define in the database( WARNING : type of input 1 of step 11513 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11515 have datatype=10 whereas input 3 of step 11522 have datatype=6 WARNING : type of input 2 of step 11577 doesn't seem to be define in the database( WARNING : output 1 of step 11513 have datatype=7 whereas input 2 of step 11577 have datatype=None WARNING : type of output 3 of step 11577 doesn't seem to be define in the database( WARNING : type of input 1 of step 11515 doesn't seem to be define in the database( WARNING : output 0 of step 11515 have datatype=10 whereas input 0 of step 11583 have datatype=18 WARNING : type of input 5 of step 11522 doesn't seem to be define in the database( WARNING : output 0 of step 11583 have datatype=11 whereas input 5 of step 11522 have datatype=None WARNING : type of output 1 of step 11521 doesn't seem to be define in the database( WARNING : type of input 3 of step 11516 doesn't seem to be define in the database( WARNING : type of output 1 of step 11520 doesn't seem to be define in the database( WARNING : type of input 3 of step 11516 doesn't seem to be define in the database( WARNING : output 0 of step 11519 have datatype=1 whereas input 0 of step 11513 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4203, 'hashtag_proportion': 'barquette_opaque,carton,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'ela,background', 'hashtag_background': 'ela', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 1, 'etiquette': 0.5, 'film_plastique': 0.5, 'kraft': 0.8, 'metal': 2, 'papier': 0.8, 'pehd': 0.8, 'pet_clair': 0.8, 'pet_opaque': 0.8, 'textiles_sanitaires': 0.5, 'pet_fonce': 0.8}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3804 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3804 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3804 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3804 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11560 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11567 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11567 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11563 crop_condition is not consistent : 4 used against 2 in the step definition ! Step 11563 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11564 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11564 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11573 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11573 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11566 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11566 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 1 of step 11560 have datatype=2 whereas input 1 of step 11564 have datatype=7 WARNING : type of output 2 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11565 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11567 doesn't seem to be define in the database( WARNING : type of input 3 of step 11563 doesn't seem to be define in the database( WARNING : type of output 3 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11568 doesn't seem to be define in the database( WARNING : type of output 1 of step 11568 doesn't seem to be define in the database( WARNING : type of input 3 of step 11566 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11570 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11569 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11570 doesn't seem to be define in the database( WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11569 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11568 have datatype=10 whereas input 3 of step 11571 have datatype=6 WARNING : type of input 2 of step 11573 doesn't seem to be define in the database( WARNING : output 1 of step 11565 have datatype=7 whereas input 2 of step 11573 have datatype=None WARNING : type of output 3 of step 11573 doesn't seem to be define in the database( WARNING : type of input 3 of step 11568 doesn't seem to be define in the database( WARNING : output 0 of step 11568 have datatype=10 whereas input 0 of step 11587 have datatype=18 WARNING : type of input 5 of step 11571 doesn't seem to be define in the database( WARNING : output 0 of step 11587 have datatype=11 whereas input 5 of step 11571 have datatype=None WARNING : output 0 of step 11564 have datatype=1 whereas input 0 of step 11565 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3327, 'hashtag_proportion': 'autre,carton,metal,papier,pehd,pet_fonce', 'hashtag_parmi': 'pet_clair,bouchon,etiquette,barquette_avec_film,background', 'hashtag_background': 'pet_clair', 'hashtag_weights': {'autre': 8.0, 'barquette_avec_film': 6, 'carton': 8.0, 'metal': 12, 'papier': 5, 'pehd': 8, 'pet_fonce': 8, 'bouchon': 8, 'etiquette': 8}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4322 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4322 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4322 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4322 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11978 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11987 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11986 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11982 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11982 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11985 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11985 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11979 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11979 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11990 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11990 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11981 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11980 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11980 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11989 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11981 doesn't seem to be define in the database( WARNING : type of input 3 of step 11980 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11978 doesn't seem to be define in the database( WARNING : type of input 2 of step 11982 doesn't seem to be define in the database( WARNING : output 1 of step 11978 have datatype=2 whereas input 1 of step 11985 have datatype=7 WARNING : type of output 2 of step 11985 doesn't seem to be define in the database( WARNING : type of input 1 of step 11979 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11981 have datatype=10 whereas input 3 of step 11988 have datatype=6 WARNING : type of input 2 of step 11990 doesn't seem to be define in the database( WARNING : output 1 of step 11979 have datatype=7 whereas input 2 of step 11990 have datatype=None WARNING : type of output 3 of step 11990 doesn't seem to be define in the database( WARNING : type of input 1 of step 11981 doesn't seem to be define in the database( WARNING : output 0 of step 11981 have datatype=10 whereas input 0 of step 11991 have datatype=18 WARNING : type of input 5 of step 11988 doesn't seem to be define in the database( WARNING : output 0 of step 11991 have datatype=11 whereas input 5 of step 11988 have datatype=None WARNING : type of output 1 of step 11987 doesn't seem to be define in the database( WARNING : type of input 3 of step 11982 doesn't seem to be define in the database( WARNING : type of output 1 of step 11986 doesn't seem to be define in the database( WARNING : type of input 3 of step 11982 doesn't seem to be define in the database( WARNING : output 0 of step 11985 have datatype=1 whereas input 0 of step 11979 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4461, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,pehd,kraft,metal,papier,pet_fonce,pet_clair,pet_opaque,textiles_sanitaires', 'hashtag_parmi': 'film_plastique', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 0.3, 'ela': 0.3, 'etiquette': 0.1, 'film_plastique': 0.1, 'kraft': 0.3, 'metal': 1.5, 'papier': 0.3, 'pet_clair': 0.3, 'pet_opaque': 0.3, 'textiles_sanitaires': 0.3, 'pet_fonce': 0.3}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3995 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3995 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3995 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3995 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11524 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11533 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11532 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11528 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11528 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11531 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11531 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11525 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11525 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11578 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11578 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11527 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11526 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11526 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11535 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11527 doesn't seem to be define in the database( WARNING : type of input 3 of step 11526 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11524 doesn't seem to be define in the database( WARNING : type of input 2 of step 11528 doesn't seem to be define in the database( WARNING : output 1 of step 11524 have datatype=2 whereas input 1 of step 11531 have datatype=7 WARNING : type of output 2 of step 11531 doesn't seem to be define in the database( WARNING : type of input 1 of step 11525 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11527 have datatype=10 whereas input 3 of step 11534 have datatype=6 WARNING : type of input 2 of step 11578 doesn't seem to be define in the database( WARNING : output 1 of step 11525 have datatype=7 whereas input 2 of step 11578 have datatype=None WARNING : type of output 3 of step 11578 doesn't seem to be define in the database( WARNING : type of input 1 of step 11527 doesn't seem to be define in the database( WARNING : output 0 of step 11527 have datatype=10 whereas input 0 of step 11584 have datatype=18 WARNING : type of input 5 of step 11534 doesn't seem to be define in the database( WARNING : output 0 of step 11584 have datatype=11 whereas input 5 of step 11534 have datatype=None WARNING : type of output 1 of step 11533 doesn't seem to be define in the database( WARNING : type of input 3 of step 11528 doesn't seem to be define in the database( WARNING : type of output 1 of step 11532 doesn't seem to be define in the database( WARNING : type of input 3 of step 11528 doesn't seem to be define in the database( WARNING : output 0 of step 11531 have datatype=1 whereas input 0 of step 11525 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4211, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,metal,papier,pet_fonce,pet_clair,pet_opaque,textiles_sanitaires', 'hashtag_parmi': 'pehd,background', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 0.3, 'ela': 0.3, 'etiquette': 0.1, 'film_plastique': 0.1, 'kraft': 0.3, 'metal': 1.5, 'papier': 0.3, 'pet_clair': 0.3, 'pet_opaque': 0.3, 'textiles_sanitaires': 0.3, 'pet_fonce': 0.3, 'background': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4153 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4153 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4153 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4153 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11548 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11556 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11557 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11552 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11552 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11555 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11555 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11580 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11580 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11551 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11550 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11550 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11559 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11551 doesn't seem to be define in the database( WARNING : type of input 3 of step 11550 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11548 doesn't seem to be define in the database( WARNING : type of input 2 of step 11552 doesn't seem to be define in the database( WARNING : output 1 of step 11548 have datatype=2 whereas input 1 of step 11555 have datatype=7 WARNING : type of output 2 of step 11555 doesn't seem to be define in the database( WARNING : type of input 1 of step 11549 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11551 have datatype=10 whereas input 3 of step 11558 have datatype=6 WARNING : type of input 2 of step 11580 doesn't seem to be define in the database( WARNING : output 1 of step 11549 have datatype=7 whereas input 2 of step 11580 have datatype=None WARNING : type of output 3 of step 11580 doesn't seem to be define in the database( WARNING : type of input 1 of step 11551 doesn't seem to be define in the database( WARNING : output 0 of step 11551 have datatype=10 whereas input 0 of step 11586 have datatype=18 WARNING : type of input 5 of step 11558 doesn't seem to be define in the database( WARNING : output 0 of step 11586 have datatype=11 whereas input 5 of step 11558 have datatype=None WARNING : type of output 1 of step 11556 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : type of output 1 of step 11557 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : output 0 of step 11555 have datatype=1 whereas input 0 of step 11549 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4200, 'hashtag_proportion': 'carton,ela,etiquette,film_plastique,kraft,metal,papier,pehd,pet_opaque,textiles_sanitaires,barquette_opaque,pet_clair', 'hashtag_parmi': 'pet_fonce,background', 'hashtag_weights': {'barquette_opaque': 1.5, 'carton': 2.5, 'ela': 1.5, 'etiquette': 1.5, 'film_plastique': 1, 'kraft': 1.5, 'metal': 3.0, 'papier': 1.2, 'pehd': 1.5, 'pet_clair': 1.5, 'pet_opaque': 1.5, 'textiles_sanitaires': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3992 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3992 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3992 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3992 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11536 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11545 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11544 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11540 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11540 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11543 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11543 merge_mask_thcl_custom have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 11537 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11579 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11579 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11539 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11538 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11538 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11547 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11539 doesn't seem to be define in the database( WARNING : type of input 3 of step 11538 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11536 doesn't seem to be define in the database( WARNING : type of input 2 of step 11540 doesn't seem to be define in the database( WARNING : output 1 of step 11536 have datatype=2 whereas input 1 of step 11543 have datatype=7 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11539 have datatype=10 whereas input 3 of step 11546 have datatype=6 WARNING : type of input 2 of step 11579 doesn't seem to be define in the database( WARNING : output 1 of step 11537 have datatype=7 whereas input 2 of step 11579 have datatype=None WARNING : type of output 3 of step 11579 doesn't seem to be define in the database( WARNING : type of input 1 of step 11539 doesn't seem to be define in the database( WARNING : output 0 of step 11539 have datatype=10 whereas input 0 of step 11585 have datatype=18 WARNING : type of input 5 of step 11546 doesn't seem to be define in the database( WARNING : output 0 of step 11585 have datatype=11 whereas input 5 of step 11546 have datatype=None WARNING : type of output 1 of step 11545 doesn't seem to be define in the database( WARNING : type of input 3 of step 11540 doesn't seem to be define in the database( WARNING : type of output 1 of step 11544 doesn't seem to be define in the database( WARNING : type of input 3 of step 11540 doesn't seem to be define in the database( WARNING : output 0 of step 11543 have datatype=1 whereas input 0 of step 11537 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4205, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'metal,background', 'hashtag_background': 'metal', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 1.5, 'ela': 1.5, 'etiquette': 1, 'film_plastique': 1, 'kraft': 1, 'papier': 1, 'pehd': 1.5, 'pet_clair': 1.5, 'pet_opaque': 1.5, 'textiles_sanitaires': 1.5, 'pet_fonce': 1.5}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3318 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3318 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3318 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3594, 'hashtag_proportion': 'papier,carton,metal,pet_clair,autre,pehd,pet_fonce', 'hashtag_parmi': 'refus,background', 'hashtag_weights': {'papier': 1, 'carton': 1, 'metal': 1, 'pet_clair': 1, 'autre': 1, 'pehd': 1, 'pet_fonce': 1, 'refus': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier {'number_of_analysed_photos': ((37215,),), 'unwanted_material_monthly_percentage': ((0.036292015522133174,),), 'material_repartition': (('pcnc', 32099), ('refus', 3995), ('film_pedb', 1104), ('pet_clair', 9), ('jrm', 8)), 'material_dict': {'pcnc': 32099, 'refus': 3995, 'autres': 1121}, 'coverage_data': (('2025/09/20/', 0.0), ('2025/09/19/', 0.0), ('2025/09/18/', 0.0), ('2025/09/17/', 0.0), ('2025/09/16/', 0.0), ('2025/09/15/', 0.0), ('2025/09/13/', 0.0), ('2025/09/12/', 0.0), ('2025/09/11/', 0.0), ('2025/09/10/', 0.0), ('2025/09/09/', 0.0), ('2025/09/08/', 0.0), ('2025/09/06/', 0.0), ('2025/09/05/', 0.0), ('2025/09/04/', 0.0), ('2025/09/03/', 0.0), ('2025/09/02/', 0.0), ('2025/09/01/', 0.0)), 'impurety_average_data': ((datetime.date(2025, 9, 1), 0.042373614667356, 20), (datetime.date(2025, 9, 2), 0.033328603340253074, 16), (datetime.date(2025, 9, 3), 0.03838334346467932, 130), (datetime.date(2025, 9, 4), 0.028390163134892867, 84), (datetime.date(2025, 9, 5), 0.03284800120418105, 31), (datetime.date(2025, 9, 6), 0.040440254915649426, 30), (datetime.date(2025, 9, 7), 0.004321662791239028, 14), (datetime.date(2025, 9, 8), 0.03975604841424327, 197), (datetime.date(2025, 9, 9), 0.037487706885625936, 28), (datetime.date(2025, 9, 10), 0.04346982142992465, 143), (datetime.date(2025, 9, 11), 0.032644025628419934, 32), (datetime.date(2025, 9, 12), 0.03339808547942257, 226), (datetime.date(2025, 9, 13), 0.027403135827115982, 71), (datetime.date(2025, 9, 14), 0.004624411403925293, 12), (datetime.date(2025, 9, 15), 0.029898571900308858, 135), (datetime.date(2025, 9, 16), 0.03958460425501454, 138), (datetime.date(2025, 9, 17), 0.040388862838240745, 122), (datetime.date(2025, 9, 18), 0.03820287508394967, 64), (datetime.date(2025, 9, 19), 0.03619439669811114, 11)), 'impurety_average_data_per_hashtag': {'pcnc': ((datetime.date(2025, 9, 1), 0.03249371686250528, 20), (datetime.date(2025, 9, 2), 0.02332150974776004, 16), (datetime.date(2025, 9, 3), 0.03051213120072261, 130), (datetime.date(2025, 9, 4), 0.022949801899620686, 84), (datetime.date(2025, 9, 5), 0.027080380361735087, 31), (datetime.date(2025, 9, 6), 0.0349156961031441, 30), (datetime.date(2025, 9, 7), 0.004321662791239028, 14), (datetime.date(2025, 9, 8), 0.031415459254594214, 197), (datetime.date(2025, 9, 9), 0.029064521973250077, 28), (datetime.date(2025, 9, 10), 0.03682100938986683, 143), (datetime.date(2025, 9, 11), 0.026274812964725894, 32), (datetime.date(2025, 9, 12), 0.02537819266456874, 226), (datetime.date(2025, 9, 13), 0.020449513658222975, 71), (datetime.date(2025, 9, 14), 0.004624411403925293, 12), (datetime.date(2025, 9, 15), 0.020916676167879192, 135), (datetime.date(2025, 9, 16), 0.028810122224800328, 138), (datetime.date(2025, 9, 17), 0.025443515822153668, 108), (datetime.date(2025, 9, 18), 0.029619413062166818, 64), (datetime.date(2025, 9, 19), 0.02481319636144952, 11)), 'film_pedb': ((datetime.date(2025, 9, 1), 0.0892693395087305, 13), (datetime.date(2025, 9, 2), 0.07340605571443365, 12), (datetime.date(2025, 9, 3), 0.07116679217824619, 9), (datetime.date(2025, 9, 4), 0.06574014922882049, 8), (datetime.date(2025, 9, 5), 0.06627348786755716, 13), (datetime.date(2025, 9, 6), 0.058856515875085016, 8), (datetime.date(2025, 9, 8), 0.07170955883332084, 8), (datetime.date(2025, 9, 9), 0.07453127010316209, 9), (datetime.date(2025, 9, 10), 0.10899179764984966, 20), (datetime.date(2025, 9, 11), 0.11132801669835199, 25), (datetime.date(2025, 9, 12), 0.07960383854181884, 24), (datetime.date(2025, 9, 13), 0.06551343712753274, 9), (datetime.date(2025, 9, 15), 0.06433345876354286, 39), (datetime.date(2025, 9, 16), 0.0985849655479817, 32), (datetime.date(2025, 9, 17), 0.08730092647842554, 10), (datetime.date(2025, 9, 18), 0.08151115755023078, 21), (datetime.date(2025, 9, 19), 0.07396449393517394, 26)), 'refus': ((datetime.date(2025, 9, 1), 0.11807340029761905, 9), (datetime.date(2025, 9, 2), 0.09630416943782245, 66), (datetime.date(2025, 9, 3), 0.11545823339654918, 9), (datetime.date(2025, 9, 4), 0.08894689527936056, 11), (datetime.date(2025, 9, 5), 0.10595636267185747, 22), (datetime.date(2025, 9, 6), 0.10955163317722387, 10), (datetime.date(2025, 9, 8), 0.08459122384970293, 12), (datetime.date(2025, 9, 9), 0.10157206131718047, 9), (datetime.date(2025, 9, 10), 0.09457640879320262, 11), (datetime.date(2025, 9, 11), 0.07806329125228623, 9), (datetime.date(2025, 9, 12), 0.07412083605751107, 16), (datetime.date(2025, 9, 13), 0.07233777839696692, 13), (datetime.date(2025, 9, 15), 0.06981710443081969, 19), (datetime.date(2025, 9, 16), 0.09557568725792785, 17), (datetime.date(2025, 9, 17), 0.1003637493194216, 122), (datetime.date(2025, 9, 18), 0.08243006539050443, 11), (datetime.date(2025, 9, 19), 0.1053389766719845, 10)), 'jrm': ((datetime.date(2025, 9, 10), 0.12233618812838642, 8),), 'pet_clair': ((datetime.date(2025, 9, 10), 0.04849398968161079, 9),)}, 'quality_array': [['0.6583970907452947', '01092025'], ['0.7314433881715517', '02092025'], ['0.45122153500532036', '03092025'], ['0.47498165405430615', '04092025'], ['0.77518921230246', '05092025'], ['0.792182020028259', '06092025'], ['2.165162455202924', '07092025'], ['0.5277763474210418', '08092025'], ['0.5954286791315171', '09092025'], ['0.7540664835239836', '10092025'], ['0.5886605238829048', '11092025'], ['0.5463592328288531', '12092025'], ['0.551973477408286', '13092025'], ['3.3869562326296503', '14092025'], ['0.3947553447259551', '15092025'], ['0.3586337759005362', '16092025'], ['0.9006281665226135', '17092025'], ['0.1863699269306064', '18092025'], ['0.39046027711096276', '19092025']], 'number_of_batch': ((752,),), 'datou_id_sts': 4101, 'map_hashtag_number_mat': {'hash_to_mat_nb': ({'unwanted_material': 'autre', 'main_material': 'pet_clair', 'pht_type': 3327, 'ratio': 0.0010705069599419859, 'nb_photo': 1, 'list_port_cont': '26723047', 'assoc_port': '26722892:26723047', 'assoc_mat': '26722892:autre:3327:26723047'}, {'unwanted_material': 'autre', 'main_material': 'refus', 'pht_type': 3594, 'ratio': 0.001604984101442466, 'nb_photo': 569, 'list_port_cont': '26388448,26390786,26396949,26398301,26398725,26404171,26404705,26406727,26409925,26430216,26436373,26444502,26444649,26445437,26450485,26454080,26454606,26455118,26459010,26481276,26481694,26482046,26487493,26490709,26491830,26493293,26497404,26497571,26533585,26535088,26547997,26548618,26550042,26552691,26566469,26575317,26576787,26587955,26588559,26589160,26593897,26596205,26601922,26605159,26605462,26605765,26609187,26610594,26611515,26613451,26630009,26630168,26631358,26639072,26639674,26639875,26649548,26650391,26652891,26661142,26666561,26666872,26680086,26680769,26681143,26686135,26723725,26724791,26725094,26725496,26725921,26726946,26727074,26727789,26728046,26728785,26729250,26753204,26756717,26761730,26788573,26788896,26789221,26790253,26791389,26793224,26794521,26798288,26799885,26800998,26802419,26807675,26823741,26826795,26827472,26828482,26829080,26830529,26832960,26833315,26833716,26843353,26843712,26845983,26850569,26850752,26851200,26851939,26853897,26862257,26862565,26862859,26863127,2686673', 'assoc_port': '26388369:26388448,26390641:26390786,26395439:26396949,26397835:26398725,26397837:26398301,26404029:26404705,26404030:26404171,26406524:26406727,26409707:26409925,26429659:26430216,26435866:26436373,26444024:26445437,26444026:26444649,26444034:26444502,26450291:26450485,26453906:26455118,26453927:26454606,26453934:26454080,26458929:26459010,26481009:26482046,26481011:26481694,26481032:26481276,26487184:26487493,26487187:26490709,26491587:26491830,26493017:26493293,26497232:26497571,26497234:26497404,26532805:26533585,26534764:26535088,26541041:26547997,26548449:26550042,26548452:26552691,26548459:26548618,26566359:26566469,26574866:26576787,26574891:26575317,26587707:26589160,26587709:26593897,26587716:26587955,26588293:26588559,26594768:26596205,26601766:26601922,26604829:26605765,26604830:26605462,26604831:26605159,26607883:26609187,26609510:26610594,26610351:26611515,26613406:26613451,26629339:26630168,26629340:26630009,26631054:26631358,26638960:26639072,26639467:26639875,26639469:26639674,26649069:2664954', 'assoc_mat': '26388369:autre:3594:26388448,26390641:autre:3594:26390786,26395439:autre:3594:26396949,26397835:autre:3594:26398725,26397837:autre:3594:26398301,26404029:autre:3594:26404705,26404030:autre:3594:26404171,26406524:autre:3594:26406727,26409707:autre:3594:26409925,26429659:autre:3594:26430216,26435866:autre:3594:26436373,26444024:autre:3594:26445437,26444026:autre:3594:26444649,26444034:autre:3594:26444502,26450291:autre:3594:26450485,26453906:autre:3594:26455118,26453927:autre:3594:26454606,26453934:autre:3594:26454080,26458929:autre:3594:26459010,26481009:autre:3594:26482046,26481011:autre:3594:26481694,26481032:autre:3594:26481276,26487184:autre:3594:26487493,26487187:autre:3594:26490709,26491587:autre:3594:26491830,26493017:autre:3594:26493293,26497232:autre:3594:26497571,26497234:autre:3594:26497404,26532805:autre:3594:26533585,26534764:autre:3594:26535088,26541041:autre:3594:26547997,26548449:autre:3594:26550042,26548452:autre:3594:26552691,26548459:autre:3594:26548618,26566359:autre:3594:26566469,26574866:'}, {'unwanted_material': 'autre_refus', 'main_material': 'jrm', 'pht_type': 3726, 'ratio': 0.03659626103142702, 'nb_photo': 1, 'list_port_cont': '26714010', 'assoc_port': '26713945:26714010', 'assoc_mat': '26713945:autre_refus:3726:26714010'}, {'unwanted_material': 'barquette_opaque', 'main_material': 'film_pedb', 'pht_type': 4461, 'ratio': 0.007205310780105326, 'nb_photo': 5, 'list_port_cont': '26576424,26680804,26828541,26866781,26906115', 'assoc_port': '26576342:26576424,26680701:26680804,26828460:26828541,26866563:26866781,26905513:26906115', 'assoc_mat': '26576342:barquette_opaque:4461:26576424,26680701:barquette_opaque:4461:26680804,26828460:barquette_opaque:4461:26828541,26866563:barquette_opaque:4461:26866781,26905513:barquette_opaque:4461:26906115'}, {'unwanted_material': 'barquette_opaque', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 0.0027677355068840637, 'nb_photo': 6006, 'list_port_cont': '26388532,26389563,26389762,26389893,26390975,26390999,26391133,26391213,26395690,26395713,26398976,26399243,26399413,26405095,26405570,26407167,26411057,26415151,26415470,26420010,26420110,26420615,26428195,26429743,26430038,26436078,26436120,26438229,26438316,26438574,26438674,26438721,26438812,26438868,26443004,26444245,26444342,26446135,26454459,26457559,26457763,26457936,26463988,26464214,26466418,26481103,26481745,26481896,26482094,26483596,26483795,26484064,26484313,26484572,26484950,26487318,26487359,26491691,26494654,26497496,26512942,26513974,26514023,26514113,26517215,26517315,26517508,26518870,26519041,26532865,26534818,26547039,26548037,26548684,26553021,26554610,26554692,26554768,26554776,26554828,26554844,26554922,26554976,26555109,26557664,26557810,26558027,26569570,26570481,26570696,26573513,26573702,26573858,26576535,26576687,26576886,26577640,26577673,26577720,26588347,26594609,26594796,26594812,26594865,26595109,26595277,26595486,26595501,26595635,26596446,26596758,26602670,26603065,2660357', 'assoc_port': '26388352:26389563,26388353:26389762,26388354:26389893,26388368:26388532,26390635:26391133,26390637:26391213,26390639:26390999,26390642:26390975,26395436:26395713,26395438:26395690,26397832:26398976,26397834:26399243,26397852:26399413,26404026:26405095,26404326:26405570,26406975:26407167,26409706:26411057,26415088:26415470,26415090:26415151,26419971:26420110,26419972:26420010,26420599:26420615,26427266:26428195,26429657:26430038,26429660:26429743,26435868:26438674,26435869:26438721,26435872:26438812,26435874:26438868,26435877:26436120,26435878:26436078,26438216:26438574,26438218:26438316,26438220:26438229,26442935:26443004,26444023:26446135,26444027:26444342,26444030:26444245,26450292:26454459,26453924:26457559,26453929:26457763,26453932:26457936,26458908:26463988,26458928:26464214,26466363:26466418,26478210:26481745,26478212:26481896,26478213:26482094,26481003:26483596,26481004:26483795,26481006:26484064,26481008:26484313,26481010:26484572,26481012:26481103,26481013:26484950,26487185:26487359,26487188:2648731', 'assoc_mat': '26388352:barquette_opaque:4207:26389563,26388353:barquette_opaque:4207:26389762,26388354:barquette_opaque:4207:26389893,26388368:barquette_opaque:4207:26388532,26390635:barquette_opaque:4207:26391133,26390637:barquette_opaque:4207:26391213,26390639:barquette_opaque:4207:26390999,26390642:barquette_opaque:4207:26390975,26395436:barquette_opaque:4207:26395713,26395438:barquette_opaque:4207:26395690,26397832:barquette_opaque:4207:26398976,26397834:barquette_opaque:4207:26399243,26397852:barquette_opaque:4207:26399413,26404026:barquette_opaque:4207:26405095,26404326:barquette_opaque:4207:26405570,26406975:barquette_opaque:4207:26407167,26409706:barquette_opaque:4207:26411057,26415088:barquette_opaque:4207:26415470,26415090:barquette_opaque:4207:26415151,26419971:barquette_opaque:4207:26420110,26419972:barquette_opaque:4207:26420010,26420599:barquette_opaque:4207:26420615,26427266:barquette_opaque:4207:26428195,26429657:barquette_opaque:4207:26430038,26429660:barquette_opaque:4207:26429743,26435868:barquette_opaqu'}, {'unwanted_material': 'carton', 'main_material': 'film_pedb', 'pht_type': 4461, 'ratio': 0.004167282241694771, 'nb_photo': 102, 'list_port_cont': '26390813,26390880,26395535,26409894,26427489,26435998,26438399,26438536,26462851,26481155,26490759,26497345,26548531,26548874,26574926,26576435,26587828,26591922,26613921,26639112,26658262,26690903,26722946,26727884,26761302,26787927,26807739,26828880,26832983,26850529,26866775,26890593,26902293,26905865,26906112,26910224,26945645,26955542,26964803,27003926,27039141,27047069', 'assoc_port': '26390634:26390880,26390638:26390813,26395437:26395535,26409705:26409894,26427268:26427489,26435875:26435998,26438215:26438536,26438217:26438399,26453931:26462851,26481007:26481155,26490662:26490759,26497248:26497345,26548445:26548531,26548468:26548874,26574911:26574926,26576342:26576435,26587714:26587828,26591763:26591922,26613876:26613921,26638965:26639112,26658032:26658262,26690810:26690903,26722881:26722946,26727637:26727884,26761142:26761302,26787636:26787927,26807540:26807739,26828801:26828880,26832917:26832983,26850412:26850529,26866563:26866775,26890526:26890593,26902186:26902293,26905513:26906112,26905517:26905865,26910032:26910224,26945365:26955542,26945366:26945645,26964643:26964803,27003816:27003926,27038970:27039141,27046878:27047069', 'assoc_mat': '26390634:carton:4461:26390880,26390638:carton:4461:26390813,26395437:carton:4461:26395535,26409705:carton:4461:26409894,26427268:carton:4461:26427489,26435875:carton:4461:26435998,26438215:carton:4461:26438536,26438217:carton:4461:26438399,26453931:carton:4461:26462851,26481007:carton:4461:26481155,26490662:carton:4461:26490759,26497248:carton:4461:26497345,26548445:carton:4461:26548531,26548468:carton:4461:26548874,26574911:carton:4461:26574926,26576342:carton:4461:26576435,26587714:carton:4461:26587828,26591763:carton:4461:26591922,26613876:carton:4461:26613921,26638965:carton:4461:26639112,26658032:carton:4461:26658262,26690810:carton:4461:26690903,26722881:carton:4461:26722946,26727637:carton:4461:26727884,26761142:carton:4461:26761302,26787636:carton:4461:26787927,26807540:carton:4461:26807739,26828801:carton:4461:26828880,26832917:carton:4461:26832983,26850412:carton:4461:26850529,26866563:carton:4461:26866775,26890526:carton:4461:26890593,26902186:carton:4461:26902293,26905513:carton:4461:26906112,2690'}, {'unwanted_material': 'carton', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 0.9757636265286489, 'nb_photo': 6589, 'list_port_cont': '26388521,26389572,26389767,26389899,26391001,26391218,26393664,26395687,26398977,26399248,26399416,26405082,26405580,26407168,26415159,26415478,26420002,26420113,26420605,26429739,26430041,26436076,26436110,26438230,26438310,26438571,26438670,26438725,26438821,26443019,26444253,26444337,26446121,26454462,26457551,26457765,26457934,26463999,26464207,26466431,26481116,26481742,26481904,26482088,26483598,26484316,26484578,26484955,26487325,26487352,26487699,26494662,26497491,26512935,26513973,26514020,26514111,26517212,26517515,26518872,26519035,26532860,26534822,26547040,26548692,26553018,26554601,26554688,26554772,26554780,26554823,26554835,26554840,26554914,26554990,26557654,26557794,26558034,26569564,26570483,26570688,26573523,26573695,26573859,26576410,26576533,26577730,26588345,26594605,26594813,26594832,26594866,26594999,26595113,26595291,26595489,26595508,26595631,26596443,26596766,26601816,26602676,26603056,26603579,26604931,26605092,26606008,26606154,26606190,26606429,26606681,26607084,26607184,2660809', 'assoc_port': '26388352:26389572,26388353:26389767,26388354:26389899,26388368:26388521,26390637:26391218,26390639:26391001,26393344:26393664,26395438:26395687,26397832:26398977,26397834:26399248,26397852:26399416,26404026:26405082,26404326:26405580,26406975:26407168,26415088:26415478,26415090:26415159,26419971:26420113,26419972:26420002,26420599:26420605,26429657:26430041,26429660:26429739,26435868:26438670,26435869:26438725,26435872:26438821,26435877:26436110,26435878:26436076,26438216:26438571,26438218:26438310,26438220:26438230,26442935:26443019,26444023:26446121,26444027:26444337,26444030:26444253,26450292:26454462,26453924:26457551,26453929:26457765,26453932:26457934,26458908:26463999,26458928:26464207,26466363:26466431,26478210:26481742,26478212:26481904,26478213:26482088,26481003:26483598,26481008:26484316,26481010:26484578,26481012:26481116,26481013:26484955,26487185:26487352,26487188:26487325,26487614:26487699,26491584:26518872,26491586:26519035,26493013:26512935,26494594:26494662,26494595:26513973,26494598:2651402', 'assoc_mat': '26388352:carton:4207:26389572,26388353:carton:4207:26389767,26388354:carton:4207:26389899,26388368:carton:4207:26388521,26390637:carton:4207:26391218,26390639:carton:4207:26391001,26393344:carton:4207:26393664,26395438:carton:4207:26395687,26397832:carton:4207:26398977,26397834:carton:4207:26399248,26397852:carton:4207:26399416,26404026:carton:4207:26405082,26404326:carton:4207:26405580,26406975:carton:4207:26407168,26415088:carton:4207:26415478,26415090:carton:4207:26415159,26419971:carton:4207:26420113,26419972:carton:4207:26420002,26420599:carton:4207:26420605,26429657:carton:4207:26430041,26429660:carton:4207:26429739,26435868:carton:4207:26438670,26435869:carton:4207:26438725,26435872:carton:4207:26438821,26435877:carton:4207:26436110,26435878:carton:4207:26436076,26438216:carton:4207:26438571,26438218:carton:4207:26438310,26438220:carton:4207:26438230,26442935:carton:4207:26443019,26444023:carton:4207:26446121,26444027:carton:4207:26444337,26444030:carton:4207:26444253,26450292:carton:4207:26454462,2645'}, {'unwanted_material': 'carton', 'main_material': 'pet_clair', 'pht_type': 3327, 'ratio': 0.010826074944025878, 'nb_photo': 1, 'list_port_cont': '26723054', 'assoc_port': '26722892:26723054', 'assoc_mat': '26722892:carton:3327:26723054'}, {'unwanted_material': 'carton', 'main_material': 'refus', 'pht_type': 3594, 'ratio': 0.011012671675260769, 'nb_photo': 1288, 'list_port_cont': '26388457,26388977,26390780,26395877,26398303,26398719,26404166,26404696,26406726,26409932,26430213,26436160,26436365,26438393,26440731,26444150,26444501,26444656,26445446,26450478,26454085,26454596,26455115,26459008,26478297,26478818,26481275,26481704,26482045,26482628,26487385,26487497,26490708,26491836,26493287,26494883,26497405,26497567,26531309,26533586,26535091,26547994,26548631,26549196,26550040,26566465,26575310,26575765,26576791,26587947,26588560,26589169,26593899,26596197,26601917,26605161,26605456,26605605,26605758,26609194,26610593,26611521,26613460,26629606,26630005,26630171,26631356,26639073,26639677,26639867,26649208,26649555,26650387,26652889,26658567,26661139,26666555,26666876,26677531,26679884,26680082,26680763,26684338,26684533,26686138,26723547,26723720,26724048,26724241,26724314,26724784,26725093,26725293,26725502,26725923,26726176,26726429,26726939,26727079,26727797,26728045,26728781,26729246,26753206,26753665,26754279,26756708,26761729,26772904,26788094,26788569,26788894,26789224,2679025', 'assoc_port': '26388367:26388977,26388369:26388457,26390641:26390780,26395440:26395877,26397835:26398719,26397837:26398303,26404029:26404696,26404030:26404166,26406524:26406726,26409707:26409932,26429659:26430213,26435866:26436365,26435870:26436160,26438219:26438393,26440559:26440731,26444024:26445446,26444026:26444656,26444032:26444150,26444034:26444501,26450291:26450478,26453906:26455115,26453927:26454596,26453934:26454085,26458929:26459008,26478209:26478818,26478214:26478297,26481005:26482628,26481009:26482045,26481011:26481704,26481032:26481275,26487184:26487497,26487187:26490708,26487189:26487385,26491587:26491836,26493017:26493287,26494597:26494883,26497232:26497567,26497234:26497405,26531218:26531309,26532805:26533586,26534764:26535091,26541041:26547994,26548449:26550040,26548456:26549196,26548459:26548631,26566359:26566465,26574866:26576791,26574888:26575765,26574891:26575310,26587707:26589169,26587709:26593899,26587716:26587947,26588293:26588560,26594768:26596197,26601766:26601917,26604828:26605605,26604829:2660575', 'assoc_mat': '26388367:carton:3594:26388977,26388369:carton:3594:26388457,26390641:carton:3594:26390780,26395440:carton:3594:26395877,26397835:carton:3594:26398719,26397837:carton:3594:26398303,26404029:carton:3594:26404696,26404030:carton:3594:26404166,26406524:carton:3594:26406726,26409707:carton:3594:26409932,26429659:carton:3594:26430213,26435866:carton:3594:26436365,26435870:carton:3594:26436160,26438219:carton:3594:26438393,26440559:carton:3594:26440731,26444024:carton:3594:26445446,26444026:carton:3594:26444656,26444032:carton:3594:26444150,26444034:carton:3594:26444501,26450291:carton:3594:26450478,26453906:carton:3594:26455115,26453927:carton:3594:26454596,26453934:carton:3594:26454085,26458929:carton:3594:26459008,26478209:carton:3594:26478818,26478214:carton:3594:26478297,26481005:carton:3594:26482628,26481009:carton:3594:26482045,26481011:carton:3594:26481704,26481032:carton:3594:26481275,26487184:carton:3594:26487497,26487187:carton:3594:26490708,26487189:carton:3594:26487385,26491587:carton:3594:26491836,2649'}, {'unwanted_material': 'Carton_brun', 'main_material': 'jrm', 'pht_type': 3726, 'ratio': 0.02007531817515666, 'nb_photo': 1, 'list_port_cont': '26714006', 'assoc_port': '26713945:26714006', 'assoc_mat': '26713945:Carton_brun:3726:26714006'}, {'unwanted_material': 'ela', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 5.732080497007787e-05, 'nb_photo': 5, 'list_port_cont': '26573867,26576694,26730022,26999834', 'assoc_port': '26573203:26573867,26576341:26576694,26691892:26730022,26999690:26999834', 'assoc_mat': '26573203:ela:4207:26573867,26576341:ela:4207:26576694,26691892:ela:4207:26730022,26999690:ela:4207:26999834'}, {'unwanted_material': 'etiquette', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 0.00031300842563893673, 'nb_photo': 1269, 'list_port_cont': '26388527,26389886,26398971,26399245,26399417,26405096,26405573,26407171,26415152,26420006,26420115,26420610,26430040,26436082,26438677,26438724,26443010,26444241,26444332,26446126,26454468,26457560,26457758,26463998,26466420,26481104,26483595,26484322,26484581,26494660,26497505,26512934,26513980,26514029,26514107,26517217,26518876,26519042,26532851,26534819,26548700,26553019,26554689,26554781,26554832,26557665,26557807,26558026,26570488,26570694,26573521,26573694,26573864,26576531,26576690,26577675,26577732,26588346,26594602,26594873,26594997,26595509,26596445,26602666,26603057,26603567,26604926,26606013,26606149,26607082,26607194,26608769,26608984,26610484,26610534,26613438,26613542,26613559,26614043,26614668,26615679,26630586,26631595,26638979,26639144,26641796,26649807,26649997,26651311,26658696,26659757,26660192,26660401,26666946,26668253,26681771,26681932,26684373,26684475,26691916,26704755,26706701,26712943,26712998,26714166,26717087,26717125,26723599,26724385,26724419,26724474,26724624,26724867,2672487', 'assoc_port': '26388354:26389886,26388368:26388527,26397832:26398971,26397834:26399245,26397852:26399417,26404026:26405096,26404326:26405573,26406975:26407171,26415090:26415152,26419971:26420115,26419972:26420006,26420599:26420610,26429657:26430040,26435868:26438677,26435869:26438724,26435878:26436082,26442935:26443010,26444023:26446126,26444027:26444332,26444030:26444241,26450292:26454468,26453924:26457560,26453929:26457758,26458908:26463998,26466363:26466420,26481003:26483595,26481008:26484322,26481010:26484581,26481012:26481104,26491584:26518876,26491586:26519042,26493013:26512934,26494594:26494660,26494595:26513980,26494598:26514029,26497230:26497505,26497233:26517217,26504679:26514107,26532812:26532851,26534766:26548700,26534767:26534819,26548454:26554689,26552896:26553019,26554752:26557665,26554753:26557807,26554754:26558026,26554755:26554832,26554756:26554781,26566356:26570488,26566357:26570694,26573203:26573864,26573228:26573521,26573229:26573694,26574867:26577732,26574890:26577675,26576341:26576690,26576343:2657653', 'assoc_mat': '26388354:etiquette:4207:26389886,26388368:etiquette:4207:26388527,26397832:etiquette:4207:26398971,26397834:etiquette:4207:26399245,26397852:etiquette:4207:26399417,26404026:etiquette:4207:26405096,26404326:etiquette:4207:26405573,26406975:etiquette:4207:26407171,26415090:etiquette:4207:26415152,26419971:etiquette:4207:26420115,26419972:etiquette:4207:26420006,26420599:etiquette:4207:26420610,26429657:etiquette:4207:26430040,26435868:etiquette:4207:26438677,26435869:etiquette:4207:26438724,26435878:etiquette:4207:26436082,26442935:etiquette:4207:26443010,26444023:etiquette:4207:26446126,26444027:etiquette:4207:26444332,26444030:etiquette:4207:26444241,26450292:etiquette:4207:26454468,26453924:etiquette:4207:26457560,26453929:etiquette:4207:26457758,26458908:etiquette:4207:26463998,26466363:etiquette:4207:26466420,26481003:etiquette:4207:26483595,26481008:etiquette:4207:26484322,26481010:etiquette:4207:26484581,26481012:etiquette:4207:26481104,26491584:etiquette:4207:26518876,26491586:etiquette:4207:26519042,2'}, {'unwanted_material': 'film_plastique', 'main_material': 'film_pedb', 'pht_type': 4461, 'ratio': 0.9158985426908046, 'nb_photo': 1034, 'list_port_cont': '26390743,26390825,26390883,26395524,26409881,26427485,26435989,26438401,26438530,26444140,26462849,26478485,26481152,26487702,26490751,26494653,26497341,26531236,26548522,26548883,26574932,26576430,26587814,26587984,26591918,26604938,26604960,26605922,26608013,26610417,26613915,26629385,26639023,26639119,26657613,26658273,26677790,26680813,26684403,26690902,26691022,26722953,26727873,26761315,26787922,26799719,26807740,26824175,26828547,26828875,26832975,26850530,26853447,26866789,26866837,26890601,26902288,26905851,26906125,26910232,26945646,26955532,26964797,26997264,27003937,27039146,27047071', 'assoc_port': '26390634:26390883,26390638:26390825,26390643:26390743,26395437:26395524,26409705:26409881,26427268:26427485,26435875:26435989,26438215:26438530,26438217:26438401,26444031:26444140,26453931:26462849,26478211:26478485,26481007:26481152,26487615:26487702,26490662:26490751,26494596:26494653,26497248:26497341,26531220:26531236,26548445:26548522,26548468:26548883,26574911:26574932,26576342:26576430,26587712:26587984,26587714:26587814,26591763:26591918,26604826:26604938,26604827:26604960,26605868:26605922,26607891:26608013,26610353:26610417,26613876:26613915,26629341:26629385,26638965:26639119,26638967:26639023,26649075:26657613,26658032:26658273,26677709:26677790,26680701:26680813,26684303:26684403,26690807:26691022,26690810:26690902,26722881:26722953,26727637:26727873,26761142:26761315,26787636:26787922,26799535:26799719,26807540:26807740,26824129:26824175,26828460:26828547,26828801:26828875,26832917:26832975,26850412:26850530,26853355:26853447,26866562:26866837,26866563:26866789,26890526:26890601,26902186:2690228', 'assoc_mat': '26390634:film_plastique:4461:26390883,26390638:film_plastique:4461:26390825,26390643:film_plastique:4461:26390743,26395437:film_plastique:4461:26395524,26409705:film_plastique:4461:26409881,26427268:film_plastique:4461:26427485,26435875:film_plastique:4461:26435989,26438215:film_plastique:4461:26438530,26438217:film_plastique:4461:26438401,26444031:film_plastique:4461:26444140,26453931:film_plastique:4461:26462849,26478211:film_plastique:4461:26478485,26481007:film_plastique:4461:26481152,26487615:film_plastique:4461:26487702,26490662:film_plastique:4461:26490751,26494596:film_plastique:4461:26494653,26497248:film_plastique:4461:26497341,26531220:film_plastique:4461:26531236,26548445:film_plastique:4461:26548522,26548468:film_plastique:4461:26548883,26574911:film_plastique:4461:26574932,26576342:film_plastique:4461:26576430,26587712:film_plastique:4461:26587984,26587714:film_plastique:4461:26587814,26591763:film_plastique:4461:26591918,26604826:film_plastique:4461:26604938,26604827:film_plastique:4461:2660496'}, {'unwanted_material': 'film_plastique', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 0.006449629101592603, 'nb_photo': 17967, 'list_port_cont': '26388535,26389561,26389759,26389894,26390976,26390992,26393668,26395681,26395720,26398970,26399249,26399410,26405086,26405567,26407175,26411059,26415163,26415481,26420004,26420126,26420602,26428196,26429740,26430035,26436083,26436115,26438309,26438577,26438667,26438716,26438807,26438861,26443008,26444252,26444340,26446130,26454466,26457562,26457767,26457942,26463996,26464217,26466422,26481112,26481755,26481893,26482085,26483599,26483802,26484066,26484311,26484579,26484953,26487317,26487362,26487683,26491687,26494666,26497506,26512939,26513978,26514014,26514112,26517205,26517317,26517504,26518865,26519038,26532853,26534809,26547030,26548038,26548694,26553027,26554597,26554691,26554762,26554786,26554811,26554825,26554850,26554908,26554977,26555120,26557660,26557797,26558031,26569563,26570494,26570687,26573512,26573699,26573870,26576411,26576517,26576691,26576885,26577630,26577667,26577724,26588079,26588349,26594614,26594795,26594808,26594822,26594863,26595001,26595114,26595281,26595490,26595500,26595633,2659645', 'assoc_port': '26388352:26389561,26388353:26389759,26388354:26389894,26388368:26388535,26390639:26390992,26390642:26390976,26393344:26393668,26395436:26395720,26395438:26395681,26397832:26398970,26397834:26399249,26397852:26399410,26404026:26405086,26404326:26405567,26406975:26407175,26409706:26411059,26415088:26415481,26415090:26415163,26419971:26420126,26419972:26420004,26420599:26420602,26427266:26428196,26429657:26430035,26429660:26429740,26435868:26438667,26435869:26438716,26435872:26438807,26435874:26438861,26435877:26436115,26435878:26436083,26438216:26438577,26438218:26438309,26442935:26443008,26444023:26446130,26444027:26444340,26444030:26444252,26450292:26454466,26453924:26457562,26453929:26457767,26453932:26457942,26458908:26463996,26458928:26464217,26466363:26466422,26478210:26481755,26478212:26481893,26478213:26482085,26481003:26483599,26481004:26483802,26481006:26484066,26481008:26484311,26481010:26484579,26481012:26481112,26481013:26484953,26487185:26487362,26487188:26487317,26487614:26487683,26491584:2651886', 'assoc_mat': '26388352:film_plastique:4207:26389561,26388353:film_plastique:4207:26389759,26388354:film_plastique:4207:26389894,26388368:film_plastique:4207:26388535,26390639:film_plastique:4207:26390992,26390642:film_plastique:4207:26390976,26393344:film_plastique:4207:26393668,26395436:film_plastique:4207:26395720,26395438:film_plastique:4207:26395681,26397832:film_plastique:4207:26398970,26397834:film_plastique:4207:26399249,26397852:film_plastique:4207:26399410,26404026:film_plastique:4207:26405086,26404326:film_plastique:4207:26405567,26406975:film_plastique:4207:26407175,26409706:film_plastique:4207:26411059,26415088:film_plastique:4207:26415481,26415090:film_plastique:4207:26415163,26419971:film_plastique:4207:26420126,26419972:film_plastique:4207:26420004,26420599:film_plastique:4207:26420602,26427266:film_plastique:4207:26428196,26429657:film_plastique:4207:26430035,26429660:film_plastique:4207:26429740,26435868:film_plastique:4207:26438667,26435869:film_plastique:4207:26438716,26435872:film_plastique:4207:2643880'}, {'unwanted_material': 'kraft', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 0.00013092845221580632, 'nb_photo': 26, 'list_port_cont': '26497503,26569572,26576519,26576688,26595495,26603577,26610537,26613570,26614037,26615680,26641800,26729869,26734795,26800745,26831515,26997286,26998441,27040685,27041401,27056231', 'assoc_port': '26497230:26497503,26566371:26569572,26576341:26576688,26576343:26576519,26589313:26595495,26602936:26603577,26610350:26610537,26613402:26613570,26613856:26614037,26615603:26615680,26638959:26641800,26716824:26734795,26729065:26729869,26787617:26800745,26831416:26831515,26997178:26998441,26997180:26997286,27040463:27040685,27041275:27041401,27054724:27056231', 'assoc_mat': '26497230:kraft:4207:26497503,26566371:kraft:4207:26569572,26576341:kraft:4207:26576688,26576343:kraft:4207:26576519,26589313:kraft:4207:26595495,26602936:kraft:4207:26603577,26610350:kraft:4207:26610537,26613402:kraft:4207:26613570,26613856:kraft:4207:26614037,26615603:kraft:4207:26615680,26638959:kraft:4207:26641800,26716824:kraft:4207:26734795,26729065:kraft:4207:26729869,26787617:kraft:4207:26800745,26831416:kraft:4207:26831515,26997178:kraft:4207:26998441,26997180:kraft:4207:26997286,27040463:kraft:4207:27040685,27041275:kraft:4207:27041401,27054724:kraft:4207:27056231'}, {'unwanted_material': 'metal', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 0.007564132999268331, 'nb_photo': 2940, 'list_port_cont': '26388525,26389562,26389760,26389887,26390993,26391140,26393673,26395688,26398980,26399254,26399414,26405087,26405574,26407172,26411054,26415161,26415473,26420009,26420105,26420608,26428200,26430030,26438243,26438317,26438669,26438726,26438811,26443009,26444244,26444333,26446122,26454465,26457565,26457764,26457939,26463993,26466426,26481118,26483600,26484323,26484583,26484945,26487353,26487692,26491694,26494655,26497492,26512931,26513976,26514026,26514108,26517209,26517310,26517514,26518871,26532861,26534814,26547041,26548688,26553017,26554596,26554693,26554778,26554816,26554836,26554854,26554909,26554975,26555108,26557656,26557796,26558038,26569575,26570486,26570690,26573517,26573700,26573869,26576529,26576697,26577671,26577728,26588351,26594612,26594793,26594875,26594993,26595286,26595491,26595507,26596455,26596763,26601813,26602674,26603064,26603581,26604920,26605093,26606158,26606186,26606418,26606687,26607090,26607197,26608774,26608972,26609152,26609205,26610453,26610488,26610538,26613439,26613549,2661356', 'assoc_port': '26388352:26389562,26388353:26389760,26388354:26389887,26388368:26388525,26390635:26391140,26390639:26390993,26393344:26393673,26395438:26395688,26397832:26398980,26397834:26399254,26397852:26399414,26404026:26405087,26404326:26405574,26406975:26407172,26409706:26411054,26415088:26415473,26415090:26415161,26419971:26420105,26419972:26420009,26420599:26420608,26427266:26428200,26429657:26430030,26435868:26438669,26435869:26438726,26435872:26438811,26438218:26438317,26438220:26438243,26442935:26443009,26444023:26446122,26444027:26444333,26444030:26444244,26450292:26454465,26453924:26457565,26453929:26457764,26453932:26457939,26458908:26463993,26466363:26466426,26481003:26483600,26481008:26484323,26481010:26484583,26481012:26481118,26481013:26484945,26487185:26487353,26487614:26487692,26491584:26518871,26491588:26491694,26493013:26512931,26494594:26494655,26494595:26513976,26494598:26514026,26497230:26497492,26497233:26517209,26497247:26517310,26504678:26517514,26504679:26514108,26532812:26532861,26534757:2654704', 'assoc_mat': '26388352:metal:4207:26389562,26388353:metal:4207:26389760,26388354:metal:4207:26389887,26388368:metal:4207:26388525,26390635:metal:4207:26391140,26390639:metal:4207:26390993,26393344:metal:4207:26393673,26395438:metal:4207:26395688,26397832:metal:4207:26398980,26397834:metal:4207:26399254,26397852:metal:4207:26399414,26404026:metal:4207:26405087,26404326:metal:4207:26405574,26406975:metal:4207:26407172,26409706:metal:4207:26411054,26415088:metal:4207:26415473,26415090:metal:4207:26415161,26419971:metal:4207:26420105,26419972:metal:4207:26420009,26420599:metal:4207:26420608,26427266:metal:4207:26428200,26429657:metal:4207:26430030,26435868:metal:4207:26438669,26435869:metal:4207:26438726,26435872:metal:4207:26438811,26438218:metal:4207:26438317,26438220:metal:4207:26438243,26442935:metal:4207:26443009,26444023:metal:4207:26446122,26444027:metal:4207:26444333,26444030:metal:4207:26444244,26450292:metal:4207:26454465,26453924:metal:4207:26457565,26453929:metal:4207:26457764,26453932:metal:4207:26457939,26458908:'}, {'unwanted_material': 'metal', 'main_material': 'refus', 'pht_type': 3594, 'ratio': 0.0005562321468011147, 'nb_photo': 251, 'list_port_cont': '26388454,26388984,26390788,26395879,26398304,26398722,26404170,26404700,26406724,26430214,26436170,26438394,26444506,26444652,26445444,26450475,26454603,26455124,26459017,26481274,26481699,26491832,26533588,26535089,26550036,26566468,26575314,26575768,26588130,26589165,26593891,26601916,26605164,26605455,26605766,26609197,26610592,26611514,26613461,26629600,26631351,26649551,26650384,26658572,26666562,26679886,26680766,26684341,26686132,26724321,26724788,26725302,26725491,26726944,26727790,26728375,26728782,26753207,26761734,26788574,26788895,26790258,26792644,26793580,26795043,26798292,26799884,26802099,26827469,26828481,26829083,26843345,26850575,26851196,26863120,26884042,26890340,26892156,26895430,26902338,26903698,26932131,26945243,26949340,26957604,26960033,26968713,26969102,26970344,26994995,26998237,27000802,27002324,27007596,27039975,27040562,27041384,27041606,27047037,27047165', 'assoc_port': '26388367:26388984,26388369:26388454,26390641:26390788,26395440:26395879,26397835:26398722,26397837:26398304,26404029:26404700,26404030:26404170,26406524:26406724,26429659:26430214,26435870:26436170,26438219:26438394,26444024:26445444,26444026:26444652,26444034:26444506,26450291:26450475,26453906:26455124,26453927:26454603,26458929:26459017,26481011:26481699,26481032:26481274,26491587:26491832,26532805:26533588,26534764:26535089,26548449:26550036,26566359:26566468,26574888:26575768,26574891:26575314,26587707:26589165,26587709:26593891,26587711:26588130,26601766:26601916,26604829:26605766,26604830:26605455,26604831:26605164,26607883:26609197,26609510:26610592,26610351:26611514,26613406:26613461,26629342:26629600,26631054:26631351,26649069:26649551,26649947:26650384,26658004:26658572,26666423:26666562,26677710:26679886,26680700:26680766,26684306:26684341,26685910:26686132,26690816:26728782,26691894:26728375,26697949:26727790,26713963:26726944,26716830:26725491,26717897:26725302,26722888:26724788,26724007:2672432', 'assoc_mat': '26388367:metal:3594:26388984,26388369:metal:3594:26388454,26390641:metal:3594:26390788,26395440:metal:3594:26395879,26397835:metal:3594:26398722,26397837:metal:3594:26398304,26404029:metal:3594:26404700,26404030:metal:3594:26404170,26406524:metal:3594:26406724,26429659:metal:3594:26430214,26435870:metal:3594:26436170,26438219:metal:3594:26438394,26444024:metal:3594:26445444,26444026:metal:3594:26444652,26444034:metal:3594:26444506,26450291:metal:3594:26450475,26453906:metal:3594:26455124,26453927:metal:3594:26454603,26458929:metal:3594:26459017,26481011:metal:3594:26481699,26481032:metal:3594:26481274,26491587:metal:3594:26491832,26532805:metal:3594:26533588,26534764:metal:3594:26535089,26548449:metal:3594:26550036,26566359:metal:3594:26566468,26574888:metal:3594:26575768,26574891:metal:3594:26575314,26587707:metal:3594:26589165,26587709:metal:3594:26593891,26587711:metal:3594:26588130,26601766:metal:3594:26601916,26604829:metal:3594:26605766,26604830:metal:3594:26605455,26604831:metal:3594:26605164,26607883:'}, {'unwanted_material': 'papier', 'main_material': 'film_pedb', 'pht_type': 4461, 'ratio': 0.0911536273404687, 'nb_photo': 3921, 'list_port_cont': '26390738,26390818,26390882,26395525,26409895,26427490,26435994,26438407,26438532,26444147,26462861,26478483,26481153,26487716,26490754,26494643,26497339,26531247,26548520,26548870,26574930,26576428,26587822,26587976,26591907,26604948,26604967,26605910,26608020,26610406,26613919,26629384,26639035,26639116,26657622,26658267,26677783,26680805,26684413,26690904,26691023,26722945,26727879,26761308,26787920,26799715,26807742,26824162,26828540,26828876,26832977,26850517,26853458,26866778,26866866,26890594,26902290,26905860,26906117,26910246,26945650,26955547,26964802,26997256,27003940,27039143,27047067', 'assoc_port': '26390634:26390882,26390638:26390818,26390643:26390738,26395437:26395525,26409705:26409895,26427268:26427490,26435875:26435994,26438215:26438532,26438217:26438407,26444031:26444147,26453931:26462861,26478211:26478483,26481007:26481153,26487615:26487716,26490662:26490754,26494596:26494643,26497248:26497339,26531220:26531247,26548445:26548520,26548468:26548870,26574911:26574930,26576342:26576428,26587712:26587976,26587714:26587822,26591763:26591907,26604826:26604948,26604827:26604967,26605868:26605910,26607891:26608020,26610353:26610406,26613876:26613919,26629341:26629384,26638965:26639116,26638967:26639035,26649075:26657622,26658032:26658267,26677709:26677783,26680701:26680805,26684303:26684413,26690807:26691023,26690810:26690904,26722881:26722945,26727637:26727879,26761142:26761308,26787636:26787920,26799535:26799715,26807540:26807742,26824129:26824162,26828460:26828540,26828801:26828876,26832917:26832977,26850412:26850517,26853355:26853458,26866562:26866866,26866563:26866778,26890526:26890594,26902186:2690229', 'assoc_mat': '26390634:papier:4461:26390882,26390638:papier:4461:26390818,26390643:papier:4461:26390738,26395437:papier:4461:26395525,26409705:papier:4461:26409895,26427268:papier:4461:26427490,26435875:papier:4461:26435994,26438215:papier:4461:26438532,26438217:papier:4461:26438407,26444031:papier:4461:26444147,26453931:papier:4461:26462861,26478211:papier:4461:26478483,26481007:papier:4461:26481153,26487615:papier:4461:26487716,26490662:papier:4461:26490754,26494596:papier:4461:26494643,26497248:papier:4461:26497339,26531220:papier:4461:26531247,26548445:papier:4461:26548520,26548468:papier:4461:26548870,26574911:papier:4461:26574930,26576342:papier:4461:26576428,26587712:papier:4461:26587976,26587714:papier:4461:26587822,26591763:papier:4461:26591907,26604826:papier:4461:26604948,26604827:papier:4461:26604967,26605868:papier:4461:26605910,26607891:papier:4461:26608020,26610353:papier:4461:26610406,26613876:papier:4461:26613919,26629341:papier:4461:26629384,26638965:papier:4461:26639116,26638967:papier:4461:26639035,2664'}, {'unwanted_material': 'papier', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 0.007630341529969927, 'nb_photo': 27216, 'list_port_cont': '26388533,26389571,26389756,26389896,26390966,26391002,26391142,26391217,26393665,26395682,26395709,26398975,26399244,26399415,26405088,26405569,26407174,26411053,26415160,26415484,26420000,26420114,26420601,26428194,26429747,26430037,26436085,26436113,26438239,26438311,26438567,26438675,26438731,26438818,26443016,26444242,26444336,26446136,26454456,26457561,26457762,26457933,26464000,26464208,26466416,26481105,26481743,26481902,26482087,26483603,26483801,26484065,26484309,26484580,26484949,26487319,26487363,26487688,26491695,26494667,26497494,26512932,26513977,26514013,26514118,26517202,26517316,26517517,26518862,26519044,26532852,26534823,26547027,26548035,26548695,26553031,26554604,26554698,26554758,26554777,26554820,26554824,26554842,26554917,26554981,26555115,26557669,26557798,26558040,26569576,26570493,26570684,26573520,26573696,26573872,26576413,26576540,26576689,26576897,26577635,26577677,26577726,26588083,26588358,26594615,26594788,26594811,26594868,26594996,26595107,26595288,26595479,26595496,2659563', 'assoc_port': '26388352:26389571,26388353:26389756,26388354:26389896,26388368:26388533,26390635:26391142,26390637:26391217,26390639:26391002,26390642:26390966,26393344:26393665,26395436:26395709,26395438:26395682,26397832:26398975,26397834:26399244,26397852:26399415,26404026:26405088,26404326:26405569,26406975:26407174,26409706:26411053,26415088:26415484,26415090:26415160,26419971:26420114,26419972:26420000,26420599:26420601,26427266:26428194,26429657:26430037,26429660:26429747,26435868:26438675,26435869:26438731,26435872:26438818,26435877:26436113,26435878:26436085,26438216:26438567,26438218:26438311,26438220:26438239,26442935:26443016,26444023:26446136,26444027:26444336,26444030:26444242,26450292:26454456,26453924:26457561,26453929:26457762,26453932:26457933,26458908:26464000,26458928:26464208,26466363:26466416,26478210:26481743,26478212:26481902,26478213:26482087,26481003:26483603,26481004:26483801,26481006:26484065,26481008:26484309,26481010:26484580,26481012:26481105,26481013:26484949,26487185:26487363,26487188:2648731', 'assoc_mat': '26388352:papier:4207:26389571,26388353:papier:4207:26389756,26388354:papier:4207:26389896,26388368:papier:4207:26388533,26390635:papier:4207:26391142,26390637:papier:4207:26391217,26390639:papier:4207:26391002,26390642:papier:4207:26390966,26393344:papier:4207:26393665,26395436:papier:4207:26395709,26395438:papier:4207:26395682,26397832:papier:4207:26398975,26397834:papier:4207:26399244,26397852:papier:4207:26399415,26404026:papier:4207:26405088,26404326:papier:4207:26405569,26406975:papier:4207:26407174,26409706:papier:4207:26411053,26415088:papier:4207:26415484,26415090:papier:4207:26415160,26419971:papier:4207:26420114,26419972:papier:4207:26420000,26420599:papier:4207:26420601,26427266:papier:4207:26428194,26429657:papier:4207:26430037,26429660:papier:4207:26429747,26435868:papier:4207:26438675,26435869:papier:4207:26438731,26435872:papier:4207:26438818,26435877:papier:4207:26436113,26435878:papier:4207:26436085,26438216:papier:4207:26438567,26438218:papier:4207:26438311,26438220:papier:4207:26438239,2644'}, {'unwanted_material': 'papier', 'main_material': 'pet_clair', 'pht_type': 3327, 'ratio': 0.03659740777764293, 'nb_photo': 4, 'list_port_cont': '26723051', 'assoc_port': '26722892:26723051', 'assoc_mat': '26722892:papier:3327:26723051'}, {'unwanted_material': 'papier', 'main_material': 'refus', 'pht_type': 3594, 'ratio': 0.01789364747742476, 'nb_photo': 5437, 'list_port_cont': '26388449,26388978,26390790,26395878,26396941,26398306,26398729,26404169,26404703,26406722,26409928,26430220,26436161,26436371,26438043,26438387,26440729,26444151,26444509,26444653,26445445,26450482,26454086,26454600,26455122,26459011,26478299,26478820,26481280,26481703,26482048,26482627,26487383,26487501,26490710,26491828,26493286,26494889,26497403,26497577,26531317,26533584,26535094,26547995,26548625,26549197,26550043,26550454,26552692,26566464,26575311,26575767,26576796,26587948,26588131,26588558,26589161,26593892,26596199,26601926,26605163,26605457,26605610,26605764,26609189,26610586,26611513,26613457,26629601,26630007,26630166,26631359,26639070,26639673,26639866,26649552,26650392,26652892,26658577,26661144,26666565,26666869,26677540,26679881,26680085,26680764,26681138,26684345,26684523,26686136,26723545,26723726,26724044,26724235,26724315,26724435,26724787,26725092,26725294,26725501,26725925,26726183,26726439,26726943,26727077,26727798,26728051,26728366,26728778,26729254,26753210,26753663,26754273,2675671', 'assoc_port': '26388367:26388978,26388369:26388449,26390641:26390790,26395439:26396941,26395440:26395878,26397835:26398729,26397837:26398306,26404029:26404703,26404030:26404169,26406524:26406722,26409707:26409928,26429659:26430220,26435866:26436371,26435870:26436161,26435873:26438043,26438219:26438387,26440559:26440729,26444024:26445445,26444026:26444653,26444032:26444151,26444034:26444509,26450291:26450482,26453906:26455122,26453927:26454600,26453934:26454086,26458929:26459011,26478209:26478820,26478214:26478299,26481005:26482627,26481009:26482048,26481011:26481703,26481032:26481280,26487184:26487501,26487187:26490710,26487189:26487383,26491587:26491828,26493017:26493286,26494597:26494889,26497232:26497577,26497234:26497403,26531218:26531317,26532805:26533584,26534764:26535094,26541041:26547995,26548447:26550454,26548449:26550043,26548452:26552692,26548456:26549197,26548459:26548625,26566359:26566464,26574866:26576796,26574888:26575767,26574891:26575311,26587707:26589161,26587709:26593892,26587711:26588131,26587716:2658794', 'assoc_mat': '26388367:papier:3594:26388978,26388369:papier:3594:26388449,26390641:papier:3594:26390790,26395439:papier:3594:26396941,26395440:papier:3594:26395878,26397835:papier:3594:26398729,26397837:papier:3594:26398306,26404029:papier:3594:26404703,26404030:papier:3594:26404169,26406524:papier:3594:26406722,26409707:papier:3594:26409928,26429659:papier:3594:26430220,26435866:papier:3594:26436371,26435870:papier:3594:26436161,26435873:papier:3594:26438043,26438219:papier:3594:26438387,26440559:papier:3594:26440729,26444024:papier:3594:26445445,26444026:papier:3594:26444653,26444032:papier:3594:26444151,26444034:papier:3594:26444509,26450291:papier:3594:26450482,26453906:papier:3594:26455122,26453927:papier:3594:26454600,26453934:papier:3594:26454086,26458929:papier:3594:26459011,26478209:papier:3594:26478820,26478214:papier:3594:26478299,26481005:papier:3594:26482627,26481009:papier:3594:26482048,26481011:papier:3594:26481703,26481032:papier:3594:26481280,26487184:papier:3594:26487501,26487187:papier:3594:26490710,2648'}, {'unwanted_material': 'pehd', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 0.0005796457880120662, 'nb_photo': 41, 'list_port_cont': '26398982,26420607,26430031,26438727,26438810,26484073,26512940,26513982,26514115,26554827,26576521,26577727,26594994,26603569,26604924,26651305,26729855,26795783,26799266,26799605,26800737,26828527,26831518,26883104,26890749,26915087,27000279,27040115,27040674,27041411,27055884,27056241', 'assoc_port': '26397832:26398982,26420599:26420607,26429657:26430031,26435869:26438727,26435872:26438810,26481006:26484073,26493013:26512940,26494595:26513982,26504679:26514115,26554755:26554827,26574867:26577727,26576343:26576521,26587710:26594994,26602936:26603569,26604832:26604924,26649945:26651305,26729067:26729855,26787582:26799266,26787583:26799605,26787617:26800737,26794166:26795783,26828461:26828527,26831416:26831518,26882770:26883104,26890525:26890749,26910025:26915087,27000109:27000279,27038969:27040115,27040463:27040674,27041275:27041411,27054702:27055884,27054724:27056241', 'assoc_mat': '26397832:pehd:4207:26398982,26420599:pehd:4207:26420607,26429657:pehd:4207:26430031,26435869:pehd:4207:26438727,26435872:pehd:4207:26438810,26481006:pehd:4207:26484073,26493013:pehd:4207:26512940,26494595:pehd:4207:26513982,26504679:pehd:4207:26514115,26554755:pehd:4207:26554827,26574867:pehd:4207:26577727,26576343:pehd:4207:26576521,26587710:pehd:4207:26594994,26602936:pehd:4207:26603569,26604832:pehd:4207:26604924,26649945:pehd:4207:26651305,26729067:pehd:4207:26729855,26787582:pehd:4207:26799266,26787583:pehd:4207:26799605,26787617:pehd:4207:26800737,26794166:pehd:4207:26795783,26828461:pehd:4207:26828527,26831416:pehd:4207:26831518,26882770:pehd:4207:26883104,26890525:pehd:4207:26890749,26910025:pehd:4207:26915087,27000109:pehd:4207:27000279,27038969:pehd:4207:27040115,27040463:pehd:4207:27040674,27041275:pehd:4207:27041411,27054702:pehd:4207:27055884,27054724:pehd:4207:27056241'}, {'unwanted_material': 'pehd', 'main_material': 'refus', 'pht_type': 3594, 'ratio': 0.0005915037016475334, 'nb_photo': 71, 'list_port_cont': '26398299,26404706,26438396,26481696,26482049,26487388,26535095,26575312,26596200,26605162,26639676,26649549,26666559,26725099,26725500,26725927,26728776,26761733,26790259,26802415,26827473,26851199,26891682,26892155,26949337,27000808', 'assoc_port': '26397837:26398299,26404029:26404706,26438219:26438396,26481009:26482049,26481011:26481696,26487189:26487388,26534764:26535095,26574891:26575312,26594768:26596200,26604831:26605162,26639469:26639676,26649069:26649549,26666423:26666559,26690816:26728776,26690817:26725099,26716828:26725927,26716830:26725500,26761139:26761733,26787618:26802415,26787619:26790259,26827350:26827473,26850411:26851199,26891611:26892155,26891614:26891682,26946471:26949337,27000677:27000808', 'assoc_mat': '26397837:pehd:3594:26398299,26404029:pehd:3594:26404706,26438219:pehd:3594:26438396,26481009:pehd:3594:26482049,26481011:pehd:3594:26481696,26487189:pehd:3594:26487388,26534764:pehd:3594:26535095,26574891:pehd:3594:26575312,26594768:pehd:3594:26596200,26604831:pehd:3594:26605162,26639469:pehd:3594:26639676,26649069:pehd:3594:26649549,26666423:pehd:3594:26666559,26690816:pehd:3594:26728776,26690817:pehd:3594:26725099,26716828:pehd:3594:26725927,26716830:pehd:3594:26725500,26761139:pehd:3594:26761733,26787618:pehd:3594:26802415,26787619:pehd:3594:26790259,26827350:pehd:3594:26827473,26850411:pehd:3594:26851199,26891611:pehd:3594:26892155,26891614:pehd:3594:26891682,26946471:pehd:3594:26949337,27000677:pehd:3594:27000808'}, {'unwanted_material': 'pet_clair', 'main_material': 'film_pedb', 'pht_type': 4461, 'ratio': 0.002747718888392497, 'nb_photo': 1, 'list_port_cont': '26828543', 'assoc_port': '26828460:26828543', 'assoc_mat': '26828460:pet_clair:4461:26828543'}, {'unwanted_material': 'pet_clair', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 0.0028962173011650824, 'nb_photo': 1597, 'list_port_cont': '26389892,26390973,26390994,26393678,26398978,26399246,26399406,26405084,26405572,26407169,26411062,26415156,26420606,26428201,26430032,26438663,26438717,26438871,26443005,26444339,26446131,26454469,26457557,26457938,26463987,26466423,26481110,26483605,26483797,26484068,26484317,26484958,26487354,26491686,26494656,26497493,26512933,26513986,26514021,26514116,26517206,26518863,26519039,26532864,26548699,26553022,26554699,26554771,26554789,26554838,26554847,26557666,26557809,26558030,26569566,26570686,26573863,26576525,26576888,26577663,26577723,26588070,26588344,26594603,26594800,26594817,26594825,26594872,26595000,26595120,26595282,26595503,26596449,26601807,26602662,26603069,26603566,26604921,26605097,26606021,26606155,26606188,26606424,26606678,26607091,26608970,26609138,26610459,26610503,26610539,26613552,26613569,26614042,26614678,26615676,26618306,26630389,26631597,26638983,26639549,26641791,26649094,26649813,26651314,26658555,26659763,26660052,26660413,26668264,26681764,26684367,26684464,26684758,2669192', 'assoc_port': '26388354:26389892,26390639:26390994,26390642:26390973,26393344:26393678,26397832:26398978,26397834:26399246,26397852:26399406,26404026:26405084,26404326:26405572,26406975:26407169,26409706:26411062,26415090:26415156,26420599:26420606,26427266:26428201,26429657:26430032,26435868:26438663,26435869:26438717,26435874:26438871,26442935:26443005,26444023:26446131,26444027:26444339,26450292:26454469,26453924:26457557,26453932:26457938,26458908:26463987,26466363:26466423,26481003:26483605,26481004:26483797,26481006:26484068,26481008:26484317,26481012:26481110,26481013:26484958,26487185:26487354,26491584:26518863,26491586:26519039,26491588:26491686,26493013:26512933,26494594:26494656,26494595:26513986,26494598:26514021,26497230:26497493,26497233:26517206,26504679:26514116,26532812:26532864,26534766:26548699,26548454:26554699,26548458:26554771,26548462:26554847,26552896:26553022,26554752:26557666,26554753:26557809,26554754:26558030,26554755:26554838,26554756:26554789,26566357:26570686,26566371:26569566,26573203:2657386', 'assoc_mat': '26388354:pet_clair:4207:26389892,26390639:pet_clair:4207:26390994,26390642:pet_clair:4207:26390973,26393344:pet_clair:4207:26393678,26397832:pet_clair:4207:26398978,26397834:pet_clair:4207:26399246,26397852:pet_clair:4207:26399406,26404026:pet_clair:4207:26405084,26404326:pet_clair:4207:26405572,26406975:pet_clair:4207:26407169,26409706:pet_clair:4207:26411062,26415090:pet_clair:4207:26415156,26420599:pet_clair:4207:26420606,26427266:pet_clair:4207:26428201,26429657:pet_clair:4207:26430032,26435868:pet_clair:4207:26438663,26435869:pet_clair:4207:26438717,26435874:pet_clair:4207:26438871,26442935:pet_clair:4207:26443005,26444023:pet_clair:4207:26446131,26444027:pet_clair:4207:26444339,26450292:pet_clair:4207:26454469,26453924:pet_clair:4207:26457557,26453932:pet_clair:4207:26457938,26458908:pet_clair:4207:26463987,26466363:pet_clair:4207:26466423,26481003:pet_clair:4207:26483605,26481004:pet_clair:4207:26483797,26481006:pet_clair:4207:26484068,26481008:pet_clair:4207:26484317,26481012:pet_clair:4207:26481110,2'}, {'unwanted_material': 'pet_clair', 'main_material': 'pet_clair', 'pht_type': 3327, 'ratio': 0.9515060103183892, 'nb_photo': 73, 'list_port_cont': '26723046', 'assoc_port': '26722892:26723046', 'assoc_mat': '26722892:pet_clair:3327:26723046'}, {'unwanted_material': 'pet_clair', 'main_material': 'refus', 'pht_type': 3594, 'ratio': 0.06290940323697376, 'nb_photo': 4875, 'list_port_cont': '26388456,26388982,26390781,26395873,26396944,26398308,26398720,26404174,26404699,26406717,26409930,26430219,26436167,26436372,26438041,26438395,26440730,26444153,26444511,26444654,26445440,26450484,26454084,26454607,26455114,26459009,26478303,26478821,26481279,26481695,26482047,26482632,26487382,26487495,26490707,26491826,26493290,26494885,26497396,26497573,26531318,26533591,26535087,26547996,26548626,26549193,26550037,26550455,26552690,26566471,26575315,26575771,26576794,26587954,26588128,26588561,26589163,26593896,26596204,26601919,26605158,26605464,26605608,26605761,26609193,26610595,26611516,26613453,26629602,26630003,26630164,26631348,26639069,26639670,26639869,26649203,26649556,26650390,26652894,26658573,26661137,26666564,26666868,26677533,26679888,26680081,26680762,26681144,26684344,26684528,26686141,26723548,26723719,26724051,26724242,26724317,26724440,26724789,26725100,26725300,26725495,26725928,26726178,26726434,26726936,26727080,26727794,26728041,26728369,26728786,26729248,26753205,26753659,2675428', 'assoc_port': '26388367:26388982,26388369:26388456,26390641:26390781,26395439:26396944,26395440:26395873,26397835:26398720,26397837:26398308,26404029:26404699,26404030:26404174,26406524:26406717,26409707:26409930,26429659:26430219,26435866:26436372,26435870:26436167,26435873:26438041,26438219:26438395,26440559:26440730,26444024:26445440,26444026:26444654,26444032:26444153,26444034:26444511,26450291:26450484,26453906:26455114,26453927:26454607,26453934:26454084,26458929:26459009,26478209:26478821,26478214:26478303,26481005:26482632,26481009:26482047,26481011:26481695,26481032:26481279,26487184:26487495,26487187:26490707,26487189:26487382,26491587:26491826,26493017:26493290,26494597:26494885,26497232:26497573,26497234:26497396,26531218:26531318,26532805:26533591,26534764:26535087,26541041:26547996,26548447:26550455,26548449:26550037,26548452:26552690,26548456:26549193,26548459:26548626,26566359:26566471,26574866:26576794,26574888:26575771,26574891:26575315,26587707:26589163,26587709:26593896,26587711:26588128,26587716:2658795', 'assoc_mat': '26388367:pet_clair:3594:26388982,26388369:pet_clair:3594:26388456,26390641:pet_clair:3594:26390781,26395439:pet_clair:3594:26396944,26395440:pet_clair:3594:26395873,26397835:pet_clair:3594:26398720,26397837:pet_clair:3594:26398308,26404029:pet_clair:3594:26404699,26404030:pet_clair:3594:26404174,26406524:pet_clair:3594:26406717,26409707:pet_clair:3594:26409930,26429659:pet_clair:3594:26430219,26435866:pet_clair:3594:26436372,26435870:pet_clair:3594:26436167,26435873:pet_clair:3594:26438041,26438219:pet_clair:3594:26438395,26440559:pet_clair:3594:26440730,26444024:pet_clair:3594:26445440,26444026:pet_clair:3594:26444654,26444032:pet_clair:3594:26444153,26444034:pet_clair:3594:26444511,26450291:pet_clair:3594:26450484,26453906:pet_clair:3594:26455114,26453927:pet_clair:3594:26454607,26453934:pet_clair:3594:26454084,26458929:pet_clair:3594:26459009,26478209:pet_clair:3594:26478821,26478214:pet_clair:3594:26478303,26481005:pet_clair:3594:26482632,26481009:pet_clair:3594:26482047,26481011:pet_clair:3594:26481695,2'}, {'unwanted_material': 'pet_fonce', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 0.00035406561329176327, 'nb_photo': 129, 'list_port_cont': '26389764,26390995,26398983,26405094,26405581,26420616,26446123,26457566,26463990,26466415,26484321,26494668,26497495,26514120,26517207,26519040,26547028,26554829,26577718,26594792,26594805,26596771,26604923,26606417,26614680,26639548,26649091,26649808,26651303,26659764,26684472,26706695,26713003,26724389,26724473,26724854,26733922,26734083,26734800,26738752,26763017,26799260,26799604,26801047,26804337,26804541,26815289,26817649,26824247,26825106,26828666,26829069,26829439,26831476,26850501,26859180,26862359,26862386,26862432,26868255,26868839,26898193,26915088,26915379,26915573,26964755,26980499,26994789,26995470,26996267,26997439,26997938,26998447,27000266,27008616,27018629,27033239,27040111,27056085,27056238', 'assoc_port': '26388353:26389764,26390639:26390995,26397832:26398983,26404026:26405094,26404326:26405581,26420599:26420616,26444023:26446123,26453924:26457566,26458908:26463990,26466363:26466415,26481008:26484321,26491586:26519040,26494594:26494668,26497230:26497495,26497233:26517207,26504679:26514120,26534757:26547028,26554755:26554829,26574867:26577718,26587706:26594792,26591762:26596771,26594770:26594805,26604832:26604923,26605863:26606417,26614594:26614680,26639468:26639548,26649066:26649808,26649076:26649091,26649945:26651303,26657985:26659764,26684300:26684472,26690781:26724473,26697944:26738752,26704713:26724854,26704714:26706695,26712867:26713003,26716824:26734800,26722884:26733922,26722889:26734083,26724004:26724389,26758309:26763017,26787582:26799260,26787583:26799604,26787623:26801047,26794162:26804541,26804237:26804337,26807537:26815289,26817470:26817649,26824134:26824247,26824840:26825106,26828459:26828666,26828799:26829439,26828803:26829069,26831420:26831476,26850410:26850501,26859101:26862359,26859103:2686243', 'assoc_mat': '26388353:pet_fonce:4207:26389764,26390639:pet_fonce:4207:26390995,26397832:pet_fonce:4207:26398983,26404026:pet_fonce:4207:26405094,26404326:pet_fonce:4207:26405581,26420599:pet_fonce:4207:26420616,26444023:pet_fonce:4207:26446123,26453924:pet_fonce:4207:26457566,26458908:pet_fonce:4207:26463990,26466363:pet_fonce:4207:26466415,26481008:pet_fonce:4207:26484321,26491586:pet_fonce:4207:26519040,26494594:pet_fonce:4207:26494668,26497230:pet_fonce:4207:26497495,26497233:pet_fonce:4207:26517207,26504679:pet_fonce:4207:26514120,26534757:pet_fonce:4207:26547028,26554755:pet_fonce:4207:26554829,26574867:pet_fonce:4207:26577718,26587706:pet_fonce:4207:26594792,26591762:pet_fonce:4207:26596771,26594770:pet_fonce:4207:26594805,26604832:pet_fonce:4207:26604923,26605863:pet_fonce:4207:26606417,26614594:pet_fonce:4207:26614680,26639468:pet_fonce:4207:26639548,26649066:pet_fonce:4207:26649808,26649076:pet_fonce:4207:26649091,26649945:pet_fonce:4207:26651303,26657985:pet_fonce:4207:26659764,26684300:pet_fonce:4207:26684472,2'}, {'unwanted_material': 'pet_fonce', 'main_material': 'refus', 'pht_type': 3594, 'ratio': 0.0006382317212277186, 'nb_photo': 99, 'list_port_cont': '26396945,26404702,26444648,26445443,26455116,26481700,26482040,26497401,26497572,26533592,26535085,26575313,26589168,26605166,26611522,26613456,26649205,26649553,26650386,26661146,26666556,26724785,26725097,26725503,26761727,26790252,26798290,26802423,26826800,26827475,26833321,26851198,26886927,26892162,26947587,26960043,26968716,26994508,26998767,27000800,27039972,27040870', 'assoc_port': '26395439:26396945,26404029:26404702,26444024:26445443,26444026:26444648,26453906:26455116,26481009:26482040,26481011:26481700,26497232:26497572,26497234:26497401,26532805:26533592,26534764:26535085,26574891:26575313,26587707:26589168,26604831:26605166,26610351:26611522,26613406:26613456,26649069:26649553,26649074:26649205,26649947:26650386,26658027:26661146,26666423:26666556,26690817:26725097,26716830:26725503,26722888:26724785,26761139:26761727,26787615:26798290,26787618:26802423,26787619:26790252,26826748:26826800,26827350:26827475,26832212:26833321,26850411:26851198,26882772:26886927,26891611:26892162,26946470:26947587,26957198:26960043,26964639:26968716,26994377:26994508,26996058:26998767,27000677:27000800,27038968:27039972,27038977:27040870', 'assoc_mat': '26395439:pet_fonce:3594:26396945,26404029:pet_fonce:3594:26404702,26444024:pet_fonce:3594:26445443,26444026:pet_fonce:3594:26444648,26453906:pet_fonce:3594:26455116,26481009:pet_fonce:3594:26482040,26481011:pet_fonce:3594:26481700,26497232:pet_fonce:3594:26497572,26497234:pet_fonce:3594:26497401,26532805:pet_fonce:3594:26533592,26534764:pet_fonce:3594:26535085,26574891:pet_fonce:3594:26575313,26587707:pet_fonce:3594:26589168,26604831:pet_fonce:3594:26605166,26610351:pet_fonce:3594:26611522,26613406:pet_fonce:3594:26613456,26649069:pet_fonce:3594:26649553,26649074:pet_fonce:3594:26649205,26649947:pet_fonce:3594:26650386,26658027:pet_fonce:3594:26661146,26666423:pet_fonce:3594:26666556,26690817:pet_fonce:3594:26725097,26716830:pet_fonce:3594:26725503,26722888:pet_fonce:3594:26724785,26761139:pet_fonce:3594:26761727,26787615:pet_fonce:3594:26798290,26787618:pet_fonce:3594:26802423,26787619:pet_fonce:3594:26790252,26826748:pet_fonce:3594:26826800,26827350:pet_fonce:3594:26827475,26832212:pet_fonce:3594:26833321,2'}, {'unwanted_material': 'pet_opaque', 'main_material': 'film_pedb', 'pht_type': 4461, 'ratio': 0.0048721482851135775, 'nb_photo': 4, 'list_port_cont': '26409892,26548885,26639031,26799717', 'assoc_port': '26409705:26409892,26548468:26548885,26638967:26639031,26799535:26799717', 'assoc_mat': '26409705:pet_opaque:4461:26409892,26548468:pet_opaque:4461:26548885,26638967:pet_opaque:4461:26639031,26799535:pet_opaque:4461:26799717'}, {'unwanted_material': 'pet_opaque', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 0.003552800640912029, 'nb_photo': 791, 'list_port_cont': '26390967,26390991,26398981,26399403,26405081,26405579,26411052,26415166,26420104,26420609,26429742,26430039,26436086,26436108,26438673,26438820,26438863,26443017,26444334,26446134,26454458,26457563,26457768,26463985,26481899,26483796,26484310,26494658,26512930,26514022,26514119,26517211,26517320,26517510,26518867,26519043,26532858,26534816,26548697,26553023,26554701,26554766,26554788,26554837,26554852,26554919,26554989,26555118,26557663,26557801,26558029,26570697,26573514,26573697,26573868,26576511,26576693,26576898,26577639,26577719,26588078,26588359,26594610,26594809,26594828,26594870,26595289,26595506,26596454,26596757,26602672,26603066,26603574,26604922,26606144,26606180,26606428,26607085,26607191,26608768,26608983,26609143,26609208,26610456,26610497,26610533,26613540,26613561,26614041,26614672,26615686,26630383,26631594,26639153,26639482,26639544,26640140,26641797,26642084,26642549,26649103,26651308,26658171,26659770,26660065,26660411,26668248,26668255,26677835,26681934,26684364,26684476,26684753,2669192', 'assoc_port': '26390639:26390991,26390642:26390967,26397832:26398981,26397852:26399403,26404026:26405081,26404326:26405579,26409706:26411052,26415090:26415166,26419971:26420104,26420599:26420609,26429657:26430039,26429660:26429742,26435868:26438673,26435872:26438820,26435874:26438863,26435877:26436108,26435878:26436086,26442935:26443017,26444023:26446134,26444027:26444334,26450292:26454458,26453924:26457563,26453929:26457768,26458908:26463985,26478212:26481899,26481004:26483796,26481008:26484310,26491584:26518867,26491586:26519043,26493013:26512930,26494594:26494658,26494598:26514022,26497233:26517211,26497247:26517320,26504678:26517510,26504679:26514119,26532812:26532858,26534766:26548697,26534767:26534816,26548454:26554701,26548458:26554766,26548462:26554852,26548465:26554919,26548466:26554989,26548469:26555118,26552896:26553023,26554752:26557663,26554753:26557801,26554754:26558029,26554755:26554837,26554756:26554788,26566357:26570697,26573203:26573868,26573228:26573514,26573229:26573697,26574867:26577719,26574897:2657763', 'assoc_mat': '26390639:pet_opaque:4207:26390991,26390642:pet_opaque:4207:26390967,26397832:pet_opaque:4207:26398981,26397852:pet_opaque:4207:26399403,26404026:pet_opaque:4207:26405081,26404326:pet_opaque:4207:26405579,26409706:pet_opaque:4207:26411052,26415090:pet_opaque:4207:26415166,26419971:pet_opaque:4207:26420104,26420599:pet_opaque:4207:26420609,26429657:pet_opaque:4207:26430039,26429660:pet_opaque:4207:26429742,26435868:pet_opaque:4207:26438673,26435872:pet_opaque:4207:26438820,26435874:pet_opaque:4207:26438863,26435877:pet_opaque:4207:26436108,26435878:pet_opaque:4207:26436086,26442935:pet_opaque:4207:26443017,26444023:pet_opaque:4207:26446134,26444027:pet_opaque:4207:26444334,26450292:pet_opaque:4207:26454458,26453924:pet_opaque:4207:26457563,26453929:pet_opaque:4207:26457768,26458908:pet_opaque:4207:26463985,26478212:pet_opaque:4207:26481899,26481004:pet_opaque:4207:26483796,26481008:pet_opaque:4207:26484310,26491584:pet_opaque:4207:26518867,26491586:pet_opaque:4207:26519043,26493013:pet_opaque:4207:26512930,2649'}, {'unwanted_material': 'Teint_Dans_La_Masse', 'main_material': 'jrm', 'pht_type': 3726, 'ratio': 0.004877121661567973, 'nb_photo': 2, 'list_port_cont': '26714012', 'assoc_port': '26713945:26714012', 'assoc_mat': '26713945:Teint_Dans_La_Masse:3726:26714012'}, {'unwanted_material': 'textiles_sanitaires', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 7.080002124002662e-05, 'nb_photo': 42, 'list_port_cont': '26399412,26405090,26420611,26443014,26466424,26481113,26483607,26497498,26518864,26548032,26548686,26570695,26573857,26577725,26595510,26596442,26613543,26615689,26641793,26668256,26684370,26734798,26738751,26772710,26868838,26869104,26899162,26915567,26980488,27055877,27056081', 'assoc_port': '26397852:26399412,26404026:26405090,26420599:26420611,26442935:26443014,26466363:26466424,26481003:26483607,26481012:26481113,26491584:26518864,26497230:26497498,26534758:26548032,26534766:26548686,26566357:26570695,26573203:26573857,26574867:26577725,26589313:26595510,26596416:26596442,26613401:26613543,26615603:26615689,26638959:26641793,26666424:26668256,26684307:26684370,26697944:26738751,26716824:26734798,26772140:26772710,26866557:26868838,26866561:26869104,26891608:26899162,26910035:26915567,26980192:26980488,27054702:27055877,27054723:27056081', 'assoc_mat': '26397852:textiles_sanitaires:4207:26399412,26404026:textiles_sanitaires:4207:26405090,26420599:textiles_sanitaires:4207:26420611,26442935:textiles_sanitaires:4207:26443014,26466363:textiles_sanitaires:4207:26466424,26481003:textiles_sanitaires:4207:26483607,26481012:textiles_sanitaires:4207:26481113,26491584:textiles_sanitaires:4207:26518864,26497230:textiles_sanitaires:4207:26497498,26534758:textiles_sanitaires:4207:26548032,26534766:textiles_sanitaires:4207:26548686,26566357:textiles_sanitaires:4207:26570695,26573203:textiles_sanitaires:4207:26573857,26574867:textiles_sanitaires:4207:26577725,26589313:textiles_sanitaires:4207:26595510,26596416:textiles_sanitaires:4207:26596442,26613401:textiles_sanitaires:4207:26613543,26615603:textiles_sanitaires:4207:26615689,26638959:textiles_sanitaires:4207:26641793,26666424:textiles_sanitaires:4207:26668256,26684307:textiles_sanitaires:4207:26684370,26697944:textiles_sanitaires:4207:26738751,26716824:textiles_sanitaires:4207:26734798,26772140:textiles_sanitaires:4207:2'}), 'main_stat': {'nb_photos': 37215}}, 'hostname': (('jetson-5',),), 'impurety_average_per_hashtag': [(('pcnc', '2025-09', 0.027838421381508174),), (('film_pedb', '2025-09', 0.07749203694615692),), (('refus', '2025-09', 0.09262966846819429),), (('jrm', '2025-09', 0.12233618812838642),), (('pet_clair', '2025-09', 0.04849398968161079),)]} filepath : /data_4/data_log/job/memo/sevran/sla_mensuel_Sevran_mois_09_annee_2025.pdf Before plot_photos_and_unwanted_material_summary # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? Before organize_and_plot_unwanted_material_stats {'pet_clair': {'autre': ['autre', '0.11%', 1], 'carton': ['carton', '1.08%', 1], 'papier': ['papier', '3.66%', 4], 'pet_clair': ['pet_clair', '95.15%', 73]}, 'refus': {'autre': ['autre', '0.16%', 569], 'carton': ['carton', '1.1%', 1288], 'metal': ['metal', '0.06%', 251], 'papier': ['papier', '1.79%', 5437], 'pehd': ['pehd', '0.06%', 71], 'pet_clair': ['pet_clair', '6.29%', 4875], 'pet_fonce': ['pet_fonce', '0.06%', 99]}, 'jrm': {'autre_refus': ['autre_refus', '3.66%', 1], 'Carton_brun': ['Carton_brun', '2.01%', 1], 'Teint_Dans_La_Masse': ['Teint_Dans_La_Masse', '0.49%', 2]}, 'film_pedb': {'barquette_opaque': ['barquette_opaque', '0.72%', 5], 'carton': ['carton', '0.42%', 102], 'film_plastique': ['film_plastique', '91.59%', 1034], 'papier': ['papier', '9.12%', 3921], 'pet_clair': ['pet_clair', '0.27%', 1], 'pet_opaque': ['pet_opaque', '0.49%', 4]}, 'pcnc': {'barquette_opaque': ['barquette_opaque', '0.28%', 6006], 'carton': ['carton', '97.58%', 6589], 'ela': ['ela', '0.01%', 5], 'etiquette': ['etiquette', '0.03%', 1269], 'film_plastique': ['film_plastique', '0.64%', 17967], 'kraft': ['kraft', '0.01%', 26], 'metal': ['metal', '0.76%', 2940], 'papier': ['papier', '0.76%', 27216], 'pehd': ['pehd', '0.06%', 41], 'pet_clair': ['pet_clair', '0.29%', 1597], 'pet_fonce': ['pet_fonce', '0.04%', 129], 'pet_opaque': ['pet_opaque', '0.36%', 791], 'textiles_sanitaires': ['textiles_sanitaires', '0.01%', 42]}} before plot_matierial_repartition before organize_and_plot_coverage_data Warning a wrong coverage has been found : 0.0 Warning a wrong coverage has been found : 0.0 Warning a wrong coverage has been found : 0.0 Warning a wrong coverage has been found : 0.0 Warning a wrong coverage has been found : 0.0 Warning a wrong coverage has been found : 0.0 Warning a wrong coverage has been found : 0.0 Warning a wrong coverage has been found : 0.0 Warning a wrong coverage has been found : 0.0 TODO VR to ADNNANE : a mon avis il faut refactorer la préparation des données, je ne comprends pas non plus ce -0.0 et puis il y a un bug avec la taille differente (reproduit en commentant cette ligne ou : --raspi=20077 --use_sqlite --date=2022-09 -v --job=sla_mensuel) Erreur dans le script sla mensuel mise en forme 943: mean requires at least one data point shold exit but treated as warning to keep behavior le fichier se trouve ici : /data_4/data_log/job/memo/sevran 3.10user 3.34system 0:08.73elapsed 73%CPU (0avgtext+0avgdata 179568maxresident)k 1024inputs+1488outputs (2major+44854minor)pagefaults 0swaps